OSGeo - User contributions [en]

Spatialreference.org

2011-04-29T00:37:33Z

Wiki-Crschmidt:

SR.org lives on its own apache server to prevent it going down and taking out the rest of the projects VM. To fix it:

* cat /var/run/srorgapache.pid for a PID File, and check that that pid is an apache2 file running with the srorg config (using grep).
* Kill this process.
* Run /etc/init.d/srorgapache start

This weird process is a side effect of how the srorgapache init.d script is written; because it is the same process name (apache2), the apache init script will kill the main projects VM if you just run restart.

The server runs on port 8090; it takes about one minute to become available after the server is started. You can access it directly at http://spatialreference.org:8090, and http://spatialreference.org is proxied through the main apache.

Spatialreference.org

2011-04-29T00:36:57Z

Wiki-Crschmidt: Created page with 'SR.org lives on its own apache server to prevent it going down and taking out the rest of the projects VM. To fix it: 1. cat /var/run/srorgapache.pid for a PID File, and check t…'

SR.org lives on its own apache server to prevent it going down and taking out the rest of the projects VM. To fix it:

1. cat /var/run/srorgapache.pid for a PID File, and check that that pid is an apache2 file running with the srorg config (using grep).
2. Kill this process.
3. Run /etc/init.d/srorgapache start

This weird process is a side effect of how the srorgapache init.d script is written; because it is the same process name (apache2), the apache init script will kill the main projects VM if you just run restart.

The server runs on port 8090; it takes about one minute to become available after the server is started. You can access it directly at http://spatialreference.org:8090, and http://spatialreference.org is proxied through the main apache.

FOSS4G 2010 Code Sprint

2010-08-26T17:36:14Z

Wiki-Crschmidt: /* OpenLayers */

[[Category:FOSS4G2010]] [[Category:FOSS4G]] [[Category:Code Sprints]]
== Organizing Contacts ==

*Wladimir Szczerban, Enric Rodellas

== Code Sprint - what's that? ==

A code sprint is usually organized by a group that is using an open source project and wants to see something done. They fly the developers to a single location and feed them for a couple of days with the necessities of the hacking life (internet, caffeine, electricity). The communication that happens from face to face hacking usually lasts the project for a year or more. You see this a lot in projects like Drupal etc...

== Venue ==

For map and more details see

*Date: '''Friday, 10 Sep 2010''' (the day after the conference).
*Time: '''9am-5pm'''  ([http://www.timeanddate.com/worldclock/meetingdetails.html?year=2010&month=9&day=10&hour=7&min=0&sec=0&p1=31 timeandate]) 
*'''Where:''' Citilab-Cornellà
Citilab-Cornellà
Phone: +34 93 551 06 60
Fax: +34 93 551 06 78
[http://en.citilab.eu/home/ web Citilab]
Pl. Can Suris s/n
08940 Cornellà de Llobregat (Barcelona)
*'''Rooms:''' A+B+C
*'''[http://www.openstreetmap.org/?mlat=41.359847&mlon=2.061653&zoom=18&layers=B000FTF online maps]'''

More than 100 attendees are expected!

== Motivation and Direction ==

A day, a code base, and your imagination?

Projects can use the time and venue for organizational discussions, development roadmaps, and group resolution of thorny issues in their code bases.

Is this your First Sprint? Here is some background information to get you started:

*http://www.infrae.com/about/activities/sprintathon/tips
*http://www.onlamp.com/pub/a/python/2006/10/19/running-a-sprint.html
*Example Sprint (from same people who do GeoServer): http://www.openplans.org/projects/bbq-sprint

Visit FOSS4G past experiences: [http://wiki.osgeo.org/wiki/FOSS4G_2009_Code_Sprint 2009], [http://wiki.osgeo.org/wiki/FOSS4G2008_CodeSprint 2008], [http://wiki.osgeo.org/wiki/FOSS4G2007_CodeSprint 2007 ]

== Summary of Workgroups ==

List of Workgroups here, more info follows...

*workgroup 1
*workgroup 2

== Additional Interested People ==

The following people are potentially interested in participating in sprinting activities though have not yet established a Workgroup.

* Frank Warmerdam: GDAL, MapServer, PROJ.4, OSGeo4W
* Ari Jolma: GDAL
* Chaitanya kumar CH: GDAL

= Workgroups =

To participate, copy a project skeleton and start a section below for your project.

== OpenLayers ==

'''Coordinator:'''

* [[User:Tschaub | Tim Schaub]]

'''Attending:'''

* [[User:Tschaub | Tim Schaub]]
* Christopher Schmidt

'''Goals:'''

* Make OpenLayers 2.x awesomer.
* Make OpenLayers 3.0 a reality (or closer to it).

== 52°North WPS ==

'''Coordinator:'''

*Bastian Schäffer

'''Attending:'''

*Person 1

'''Goals:'''

* Technical disucssions about 52°North WPS

== Geomajas Code Sprint ==

'''Coordinator:'''

*Pieter De Graef

'''Attending:'''

*Pieter De Graef
*Jan De Moerloose
*Joachim van der Auwera
*Dirk Frigne
*Frank Maes
*Oliver May

'''Goals:'''

* Improving getting started documentation
* Create a GeoJson service, so that an OpenLayers client can make use of a Geomajas server.
* Create a Geomajas DataStore for GeoTools.
* Work toward plug-in graduation (documentation + tests)

== PostGIS ==

'''Attending:'''

* Paul Ramsey
* Olivier Courtin
* Mark Cave-Ayland
* Pierre Racine

'''Goals:'''

* Synchronize fall development goals
* Discuss ISO type extensions
* Discuss official raster integration issues

== GeoJQuery ==

'''Coordinator:'''

* [[User:Vmische | Volker Mische]]

'''Attending:'''

* [[User:Astrid Emde | Astrid Emde]]
* [[User:Testbaudson | Christoph Baudson]]
* [[User:Jacarma | Javi Carrasco]]
* [[Arnulf Christl]]

'''Goals:'''

* getting started
* ...

== gvSIG ==

Someone asked at gvSIG mailing lists ([http://listserv.gva.es/pipermail/gvsig_desarrolladores/2010-August/004697.html 1], [http://listserv.gva.es/pipermail/gvsig_internacional/2010-August/005857.html 2]) about a possible gvSIG code sprint at Barcelona FOSS4G.

'''(Tentative) coordinator:'''

* [[Jorge Sanz]]

'''Attending:'''

* [[User:Amaneiro | Andrés Maneiro]]
* [[User:nachouve | Nacho Varela]]
* [[User:jpiera | Jorge Piera]]

'''Goals:'''

Not defined yet.

Subversion

2010-06-14T15:55:44Z

Wiki-Crschmidt: /* Creating a repository */

= Intro =

OSGeo maintains a set of subversion services, currently hosted on the primary Peer1 server at the virtual host http://svn.osgeo.org/. Subversion access is authenticated based on [http://www.osgeo.org/osgeo_userid OSGeo Userids] and each project has a committer list also maintained in LDAP. Excellent general information on subversion is available from the [http://svnbook.red-bean.com/nightly/en/index.html Subversion Book].

= Current Repositories =

* http://svn.osgeo.org/fdo - FDO (also a bunch of old repositories exist for FDO)
* http://svn.osgeo.org/gdal - GDAL
* http://svn.osgeo.org/grass - GRASS GIS
* http://svn.osgeo.org/mapbender - Mapbender
* http://svn.osgeo.org/mapguide - MapGuide
* http://svn.osgeo.org/moss4g - MOSS4g
* http://svn.osgeo.org/osgeo - OSGeo
* http://svn.osgeo.org/ossim - OSSIM
* http://svn.osgeo.org/geos - GEOS
* http://svn.osgeo.org/mapserver - MapServer
* http://svn.osgeo.org/qgis - QGIS
* http://svn.osgeo.org/fusion - Fusion
* http://svn.osgeo.org/osgeo4w - OSGeo4W
* http://svn.osgeo.org/metacrs - MetaCRS
* https://svn.osgeo.org/geoinformatica/ - Geoinformatica

= Administration =

Howard Butler (hobu), and Shawn Barnes (sbarnes) are the primary contacts for Subversion administration issues. Requests can be submitted via the [http://trac.osgeo.org/osgeo/newticket SAC Trac].

== Add/Remove Committer ==

Any member of a subversion committer group and add and remove members to the commiter group at an url of the following form, with the project name substituted for gdal. [http://www.osgeo.org/osgeo_userid OSGeo Userids] has details on finding or creating OSGeo userids.

https://www.osgeo.org/cgi-bin/auth/ldap_group.py?group=gdal

== Creating a repository ==

Create the repository on the main server using the create_svn_repo.sh script on tracsvn.osgeo.org
$ cd /osgeo/tools
$ sudo ./create_svn_repo.sh project_name

Create the authorization group for the svn repository by using the tool

/osgeo/tools/create_ldap_group.py group_name admin_username

This will prompt you for the manager password.

Then restart apache gracefully:

$ sudo /etc/init.d/apache2 reload

Notify hobu/mloskot about adding a mirror of the newly created repository to http://svnmirror.osgeo.org

== Loading a repository from a dumpfile ==

By root on main server:
$ sudo svnadmin load /var/www/svn/repos/<repo_name> < /path/to/dumpfile
$ sudo chown -R apache:apache /var/www/svn/repos/<repo_name>

== Dumping a repository ==

By root on main server:
$ sudo svnadmin dump /var/www/svn/repos/<repo_name> > dumpfile

== Recovering / unlocking repository ==
* subversion may lock if user ctl-c during checkout or checkout is interupted with an apache restart
* Need policy on who to contact and who can run 'svnadmin recover' as
priviledged access is needed (may need to stop/start apache to drop
requests to repository before recover)

Subversion was upgraded to version 1.4.3 (30 Jan. 2007) to reduce the repository locking problem if ctl-c used to end a checkout.

If the repository locks the following command should be used to recover the repository:

$ sudo svnadmin --wait recover /var/www/svn/repos/<repo_name>
$ sudo chown -R apache:apache /var/www/svn/repos/<repo_name>

In most cases this will work in the odd case that you are waiting a very long time for the command to run then apache may have to be restarted to drop anything accessing the repository and preventing the repository from being recovered

$ sudo /sbin/service httpd restart
$ sudo svnadmin --wait recover /var/www/svn/repos/<repo_name>
$ sudo chown -R apache:apache /var/www/svn/repos/<repo_name>

= Authz Rules =

By default we use one LDAP "group" for an entire subversion repository. Everyone in that group has commit priveledges on the whole repository. However, some project desire to have subgroups. For instance a core commiter group with update on the trunk source tree, and a broader contributor group that has commit access in a subarea, such as /sandbox. We accomplish this using an "authz" file to hold the rules for the respository, and multiple LDAP groups.

A project wishing this will need to prepare an authz template file looking something like:

<pre>
[groups]
committers = @@gdal@@
sandbox = @@gdal_sandbox@@

[/]
* = r
@committers = rw

[/sandbox]
* = r
@committers = rw
@sandbox = rw
</pre>

This file should be submitted to SAC via a Trac ticket for placement on the server, and for creation of any corresponding LDAP groups. Thereafter any successful update via https://www.osgeo.org/cgi-bin/auth/ldap_group.py?group=project will result in the authz being generated from the corresponding authz.tmpl.

== Administration Notes ==

The authz.tmpl files need to be named exactly authz.tmpl and place in the corresponding project repository directory, /var/www/svn/repos/gdal for instance. Make sure the file is owned by www-date.www-data.

The corresponding /etc/httpd/conf.d/subversion/project.conf file should look something like the following. Note the removal of <LimitExcept> stuff, and reference to any specific ldap group as well as the AuthzSVNAccessFile.

<pre>
<Location /gdal>
DAV svn
SVNPath /var/www/svn/repos/gdal
AuthzSVNAccessFile /var/www/svn/repos/gdal/authz
Include conf.d/ldap_auth_url.inc
Satisfy Any
Require valid-user
</Location>
</pre>

The LDAP groups should be created as ''groupOfNames'' nodes below the ou=svn element using PHPLDAPAdmin. Make sure the membership is pre-initialized with an administrator for the project so they can do future updates themselves. Try to keep the names of the groups clearly related to the base project. eg. gdal, gdal_sandbox, gdal_documentors.

== Notes ==

The script /var/www/svn/site-local/ldap_update_authz.py script is run by an os.system() call out of ldap_group.py on any successful group update. It will scan for /var/www/svn/repos/*/authz.tmpl.

There are lots of things that can go wrong in the script which has poor error checking, and it might only manifest as some or all of the authz file no longer getting regenerated. So when an authz.tmpl file is put in place, or updated do a test update and verify that all authz files are being updated (check timestamps).

Anyone (on osgeo1) can run ldap_update_authz.py, but if authz files are created by someone that apache.apache can't delete, problems may ensue. If this occurs, the following as root may help.

cd /var/www/svn
chown apache.apache */*/authz*

= SVN Mirror =

The OSGeo SVN mirror is maintained at http://svnmirror.osgeo.org This machine is located at TelaScience, but it is not a blade and not part of the normal cadre of machines that OSGeo typically uses of TelaScience's. The mirror is Subversion 1.5.6 svnsync-based. When new repositories are created, a new mirror repository must also be created if it is wished that it is backed up, this is normally done by Howard Butler. Nothing prevents individual users or projects from maintaining their own backups with svnsync.

The mirror itself is located in /state/partition1/osgeo_svn_mirror There is a in /etc/cron.hourly/svnmirror that runs the syncs.sh script in /state/partition1/osgeo_svn_mirror to do the repository synchronization.

To create a new mirror:

1) Make a new .conf file in /etc/httpd/conf.d/subversion/ for the repository (use an existing one as a template)

2) Initialize the repo

svnadmin init /state/partition1/osgeo_svn_mirror/repos/newrepo

3) restart apache

sudo /etc/init.d/httpd restart

4) Copy the pre-revprop-change hook script from an existing repo into the new repo

sudo cp /state/partition1/osgeo_svn_mirror/repos/gdal/hooks/pre-revprop-change /state/partition1/osgeo_svn_mirror/repos/newrepo/hooks/pre-revprop-change

5) init the svnsync (password is empty \'\' without the backslashes)

svnsync init --username svnsync --password '' http://svnmirror.osgeo.org/newrepo http://svn.osgeo.org/newrepo

6) Add it to the repositories list in /state/partition1/osgeo_svn_mirror/syncs.sh

7) Run the syncs.sh script

sudo ./syncs.sh

[[Category:Infrastructure]]

Infrastructure Transition Plan 2010

2010-06-10T16:05:11Z

Wiki-Crschmidt:

'''This is a draft document for the purposes of collaborative planning of the new server transition. This notice will be removed once SAC has determined it's final course of action.'''

= Background =

[[SAC]] and the board have allocated a budget to purchase new server machines. These new servers have been specified, quoted and ordered. Delivery by Feb 22, 2010. They will be physically hosted by the Open Source Lab (OSL) and the main host OS on which virtual machines will be managed in part by OSL. We will continue use of current Telescience blades but plan to discontinue use of PEER1 services for osgeo1 and osgeo2 once all services have been migrated.

== OSL Hosting ==
During the setup process [[User:Wildintellect| Wildintellect]] is the OSGeo liason to [[OSL]]. Questions should be sent to the [[SAC]] mailing list or asked on [[IRC]]

= New Hardware =

== osgeo3(previously osl1) ==

*2x 4 core 2.5 Ghz cpu
*6x 146 GB 15K rpm, 3GB/s hard drives in RAID 5 configuration ~ 730 GB
*48 GB of RAM
*Dual NIC ethernet

== osgeo4(previously osl1) ==

*2x 4 core 2.5 Ghz cpu
*6x 300 GB 15K rpm, 6GB/s hard drives in RAID 6 configuration. ~ 1.17 TB
*48 GB of RAM
*Dual NIC ethernet

= Resource Allocation =

The plan includes running virtual machines on the new machines. OSL has suggested KVM as that's their preferred vm solution and they could provide support. OSL plans to install [http://code.google.com/p/ganeti/ ganeti] to manage the virtual machines - it allows things like live moving of VMs between machines, scaling of RAM, running VM creation/installation scripts, vnc connection to guests(in case ssh is down), etc...

== Ideas(Virtual Machines)<br> ==

Each line should be a suggested virtual machine(VM) (or in the case of Telescience 1 blade). There are lots of possible scenarios but this list will try to capture the most common options (expect the final selection to be a subset).

One alternative is to simply give each service/project it's own virtual machine(VM), this may make administration easier(for security) or harder (for backup, general management) and may not use resources efficiently. For example if there were more than 12 VMs on any one machine they would each have at most 4GB of RAM. By pooling some services that use the same infrastructure we could essentially balance 16GB of RAM across 4 sites, assuming that heavy loads occur only occasionally any one of the 4 sites could potentially use the 16GB as needed and would be unlikely to conflict with the other 3.

=== osgeo3 ===
Suggested Name, Service, Details
*tracsvn,Trac/SVN with <strike>orwithout </strike>Postgres - Trac from source
*osgeoweb or web,Apache/PHP (Drupal +<strike>Mediawiki</strike>)(with <strike>or without</strike> MySQL + <strike>Postgres</strike>)
**LAMP (Drupal + MySQL)
***www.osgeo.org
***mapguide.osgeo.org
***fdo.osgeo.org
*wiki,
**LAPP (MediaWiki+Postgres)
***wiki.osgeo.org
*<strike>Mysql</strike>
*<strike>Postgres</strike>
*secure or ldap,Secure VM
**LDAP
**LDAP Python admin scripts.
**Secure admin notes for OSGeo admins
***not* using LDAP for logins.

=== osgeo4 ===
*lists or mail,Postfix/Mailman
*download1,download.osgeo.org mirror (rsynced from telascience)
*backup,Local Backup
*qgis,QGIS VM (Apache/Joomla + MySQL)<br>
**qgis.org - main website (Joomla)
**blog.qgis.org - developer blog (Drupal)
**forum.qgis.org - forum (phpBB3)
**pyqgis.org ?? - Ruby on Rails
*grass,GRASS VM
**grass web site (static from svn)
**grass wiki (mediawiki on mysql)
**automated linux builds (for binary distribution)
*mapbender, Mapbender VM
** Mapbender VM with main portal and development instances, uses OSGeo LDAP for authentication
**mapbender wiki (MediaWiki on MySQL; currently hosted externally)
*projects,Lower load project websites (hosted on xblade14 now - relatively low priority to migrate)
**mapserver.org
**gdal.org
**geotools.org
*webextra,?
**planet.osgeo
**geodictionary(Wiktionary)
**FOSSGis
**FOSS4G

=== Telescience Blades ===

*Lower load project websites
*Buildbot slaves
*Offsite Backup
*download.osgeo.org

== Final Plan ==
=== osgeo3 & osgeo4 ===

{| border="1" class="wikitable sortable"
|+ OSGeo3 - Allocation of resources, names, configuration notes.
|-
! Virtual Machine
! Cores
! RAM
! HD(DRBD)[SWAP]
! DRBD*
! Backup Time(GMT)
! Domains
! Notes
|-
| Wiki
| 2
| 4
| 16[4]=20
| No
|  ?
|
*wiki.osgeo.org

| Martin
|-
| Secure
| 2
| 4
| 10(10)[4]=28
| Yes
|  ?
|
*ldap.osgeo.org

| Howard,Martin
|-
| Web
| 2
| 4
| 32(32)[4]=72
| Yes
|  ?
|
*www.osgeo.org
*fdo.osgeo.org
*mapguide.osgeo.org
*board.osgeo.org

| Wolf, Tyler, aghilsa - (Drupal),?(Mysql)
|-
| Tracsvn
| 4
| 8
| 100
| no
| A: 9 GMT
|
*trac.osgeo.org
*svn.osgeo.org

| crschmidt, hobu, frankw
|-
| Webextra
| 2
| 4
| 20[4]=24
| No
|  ?
|
*planet.osgeo.org
*foss4g.org
*foss4g.osgeo.org
*conference.org.org (OCS)
*live.osgeo.org

| Tyler, Mateusz
|-
| '''Totals'''
| 10 (~125%)
| 20 (~42%)
| 220 (~30%)
| 2
| NA
| NA
|
|}

{| border="1" class="wikitable sortable"
|+ OSGeo4 - Allocation of resources, names, configuration notes.
|-
! Virtual Machine
! Cores
! RAM
! HD(DRBD)[SWAP]
! DRBD*
! Backup Time(GMT)
! Domains
! Notes
|-
| Backup
| 2
| 8
| 500[4]=504
| No
| Fri 5am GMT (Weekend for everyone?
|
*backup.osgeo.org

| Martin, :Backup time is for off-site Sync
|-
| Qgis
| 2
| 4
| 50[4]=54
| No
|  ?
|
| Gary,Macho,QGIS team
|-
| Mail
| 2
| 4
| 20[4]=24
| No
|  ?
|
*lists.osgeo.org

| FrankW, ?
|-
| Projects
| 4
| 8
| 250GB
|
|
| * mapbender.org
*grass.org
*geonetwork.org

|
|-
| '''Totals'''
| 6 (75%)
| 16 (~33%)
| 636 (~50%)
| 0
| NA
| NA
|
|}

*Note: OSL has stated that it's fine to double book cores in the VMs, and that they recommend a minimum of 2. We may want to reduce the number of VMs if we're concerned about maxing all the virtual cores at the same time.
*DRBD: Can be run in Synchronous or Asynchronous mode, Async would not slow down the I/O on the original machine since DRBD won't wait for machine 2 to finish writing. Our preference is Async mode to reduce possibility of I/O delay on main image.

'''Connecting''' the VMs can be reached at $name.osgeo.osuosl.org , Primary admins have key based access and all SAC has LDAP based access to every VM

=== osgeo1 ===
?

=== osgeo2 ===
All services on osgeo2 will be migrated asap so this machine can be turned off, and that part of our Peer1 contract eliminated.

=== Telescience Blades ===
Some upgrades to OS, rebalancing of loads and a clear backup sync from osgeo4 to telescience.

= Base Image =

*Debian Stable 64bit + Backports
*10 GB HD (This is the default set by OSL, we can request a different size and the images can always be grown)
** OSGeo recommended default is 20GB, unless you can justify more.
** default swap is 4GB
*4 GB RAM (default, leaves enough ram to run 2x the normal load of vms, from 5-6 to 10-12)
*64 bit
*Standard partitioning /boot, swap, / (This is OSL default for backup and management purposes, we can request something different.)
*ext3 (ext4 not feasible with current kernel, consider newer kernel for Backup and Download as ext4 serves large files faster)

*Except for the securevm, all virtual machines should be configured for LDAP based authentication. This should probably be done as part of the template image used to make new virtual machines. That way the local admin users are already setup, ssh is on and the machine will be ready for login when booted the 1st time.

== Package List ==

Policy: Install from packages unless exception agreed on by SAC

=== Standard Packages ===

*SSL Cert
*Open-ssh server - done
*libpam-LDAP for client login authentication
*Add [http://www.backports.org/dokuwiki/doku.php?id=instructions Debian Backports] repository for Debian Stable (5.0.4) - done
*[http://munin-monitoring.org/ Munin] monitoring tools, apt-get install munin-node from Debian [main]- done
*Added postfix - removed exim - done
*editors - emacs,joe - done
*[http://www.bacula.org/en/?page=documentation Bacula] client (Backports version 5.0.x)
* Misc
libwww-perl liblwp-useragent-determined-perl
*Emergency user account - Admins have a key based access method.

==== Undecided ====
*Firewall? Shorewall? blocking all but 22, 80, 443 by default?

=== Selective Packages ===

*Apache
*Php (Apache by default should be the non-php builds, except for the servers that require php)
*MySQL
*Postgresql
*SVN
*Postfix
*Mailman

'''Source Exceptions''' Packages that will be installed from source in order to obtain specific version and customizations.

*Trac (mod_wsgi? or mod_python?)

= Migration Plan & Schedule =

== Priority ==

# Setup LDAP (Are we moving it or just configuring the new servers to use it? Does this need to happen at the start?)
# Setup backupVM so it's ready to store backups
# Migrate osgeo2 (Many of these could be done at the same time if the virtual machines are created)
## wiki.osgeo.org
## backups (how much data is this, might need to be scheduled in off hours, and split into smaller jobs, or throttled)
## moodle? ocs? wiktionary? fossgis wiki? community.osgeo.org? - these could just be archived on the backup server if not in use
## planet
## qgis.org joomla site
# Download mirror (one that can take files bigger than 2 GB)
# Trac/SVN
# Migrate OSGeo1

It's anticipated that services would be switched as soon as they are tested on the new setup and the DNS for each service is redirected to it's new working home.

== Schedule ==

(All dates are approximate, alternative schedule suggestions welcome)

*Order - Feb 10,2010 {{Done}}
*General Plan - Feb 26, 2010 {{Done}}
*Physical Installation - Feb 22-Mar 15 2010 {{Done}}
*Specific Plan - Mar 22, 2010
*Software Setup(Start) - Mar 23, 2010
** Configure Base image - Mar 24-28 {{Done}}
** Create Wiki, Secure, Backup - Mar 29 {{Done}}
** Create Qgis, Webextra,Web - May 12 {{Done}}
** Create Tracsvn - June {{Done}}
** Create Projects, Mail - June
** Create ... TBD
*Migration - March-May 2010

= TODO: List =

*<strike>Create a base virtual machine image for all new VMs</strike> - OSL will do this for us.
** OSGeo template image should be based on the OSL template but include LDAP based pam authentication against the OSGeo LDAP service for ssh login.
*** May also include standard backup scripts or mount of the backup virtual machine.
*<strike>Naming scheme for virtual machines.</strike>
*Upgrade Telescience blade OS (May require service shuffle rotation or downtime)
*Contingency plan for unexpected hardware failure

= Questions to ask OSL/Ourselves =

*Can ram be increased/decreased live? No
**Can ram be increased/decreased via a web interface live or with power cycle?With power cycle via [[Ganeti]] cli<br>
*Is it easy to move VMs between the machines? Yes, using [[Ganeit]] cli
*Should the LDAP be hosted on one of the Host OS' for reliability?
*Would LVM snapshot backups of virtual machines be a viable backup method? Should be doable, still needs some testing.
*Define our base VM: (OSL does not recommend gentoo, though that is what they use as the base KVM host)
**Choose a standard: '''Debian Stable + backports''', Ubuntu LTS, Centos ... (Does it need to implement SELinux or is that overkill?)
***ext4 formatting? OSL still testing that backup and management tools work with ext4, otherwise ext3
***32bit vs'''64bit''' - in some cases smaller VMs with only 2 GB etc could perform better with 32 bit :'''64 bit'''
***default HD size? - remember to leave lots of room for /var, logs and database dumps even if there's not much in the VM : '''10 GB'''
*How much ram should we reserve for the host OS?
*Naming of the Virtual Machines?
**Latitude, Longitude, Northing, Easting, Parallels, etc.
**Mercator, Albers, Robinson, Sinusodial, etc.
**'''wiki, mail, web, ldap, etc.''' (based on primary DNS of that vm)
**vm1, vm2, vm3, etc.
*Should we stagger the backups to reduce chance of backups grinding things to a halt
** Times to choose from (GMT) for backup starts (Assuming blocks of 2-3 hours to complete backups)
*** A: 9 GMT (1-4 US,8-11 Europe,19 Australia,13-15 India)
*** B: 15 GMT (8-11 US,14-16 Europe,2 Australia,17-19 India)
*** C: 23 GMT (16-19 US, 22-24 Europe,10 Australia,3-5 India)

[[Category:Infrastructure]]

SAC:Migration Commands

2010-06-07T19:34:47Z

Wiki-Crschmidt:

stash of commands I'm using in the migration.

osgeo1:
{{{
$ time for trac in `cat tracs`; do pg_dump -f $trac.dump $trac; done
$ cd ..
$ zip -9r db.zip trac-db
$ scp db.zip tracsvn.osgeo.osuosl.org
}}}
tracsvn:
{{{
$ unzip db.zip
$ cd trac-db
$ time for i in `cat tracs`; do dropdb $i; createdb $i; psql -f $i.dump $i; done
}}}

$ rsync -rav trac root@tracsvn.osgeo.osuosl.org:/var/www/

SAC:Migration Commands

2010-06-07T19:34:26Z

Wiki-Crschmidt: Created page with 'stash of commands I'm using in the migration. osgeo1: $ time for trac in `cat tracs`; do pg_dump -f $trac.dump $trac; done $ cd .. $ zip -9r db.zip trac-db $ scp db.zip tracsvn…'

stash of commands I'm using in the migration.

osgeo1:

$ time for trac in `cat tracs`; do pg_dump -f $trac.dump $trac; done
$ cd ..
$ zip -9r db.zip trac-db
$ scp db.zip tracsvn.osgeo.osuosl.org

tracsvn:

$ unzip db.zip
$ cd trac-db
$ time for i in `cat tracs`; do dropdb $i; createdb $i; psql -f $i.dump $i; done

$ rsync -rav trac root@tracsvn.osgeo.osuosl.org:/var/www/

Infrastructure Transition Plan 2010

2010-05-26T14:51:53Z

Wiki-Crschmidt: /* osgeo3 & osgeo4 */

'''This is a draft document for the purposes of collaborative planning of the new server transition. This notice will be removed once SAC has determined it's final course of action.'''

= Background =

[[SAC]] and the board have allocated a budget to purchase new server machines. These new servers have been specified, quoted and ordered. Delivery by Feb 22, 2010. They will be physically hosted by the Open Source Lab (OSL) and the main host OS on which virtual machines will be managed in part by OSL. We will continue use of current Telescience blades but plan to discontinue use of PEER1 services for osgeo1 and osgeo2 once all services have been migrated.

== OSL Hosting ==
During the setup process [[User:Wildintellect| Wildintellect]] is the OSGeo liason to [[OSL]]. Questions should be sent to the [[SAC]] mailing list or asked on [[IRC]]

= New Hardware =

== osgeo3(previously osl1) ==

*2x 4 core 2.5 Ghz cpu
*6x 146 GB 15K rpm, 3GB/s hard drives in RAID 5 configuration ~ 730 GB
*48 GB of RAM
*Dual NIC ethernet

== osgeo4(previously osl1) ==

*2x 4 core 2.5 Ghz cpu
*6x 300 GB 15K rpm, 6GB/s hard drives in RAID 6 configuration. ~ 1.17 TB
*48 GB of RAM
*Dual NIC ethernet

= Resource Allocation =

The plan includes running virtual machines on the new machines. OSL has suggested KVM as that's their preferred vm solution and they could provide support. OSL plans to install [http://code.google.com/p/ganeti/ ganeti] to manage the virtual machines - it allows things like live moving of VMs between machines, scaling of RAM, running VM creation/installation scripts, vnc connection to guests(in case ssh is down), etc...

== Ideas(Virtual Machines)<br> ==

Each line should be a suggested virtual machine(VM) (or in the case of Telescience 1 blade). There are lots of possible scenarios but this list will try to capture the most common options (expect the final selection to be a subset).

One alternative is to simply give each service/project it's own virtual machine(VM), this may make administration easier(for security) or harder (for backup, general management) and may not use resources efficiently. For example if there were more than 12 VMs on any one machine they would each have at most 4GB of RAM. By pooling some services that use the same infrastructure we could essentially balance 16GB of RAM across 4 sites, assuming that heavy loads occur only occasionally any one of the 4 sites could potentially use the 16GB as needed and would be unlikely to conflict with the other 3.

=== osgeo3 ===
Suggested Name, Service, Details
*tracsvn,Trac/SVN with <strike>orwithout </strike>Postgres - Trac from source
*osgeoweb or web,Apache/PHP (Drupal +<strike>Mediawiki</strike>)(with <strike>or without</strike> MySQL + <strike>Postgres</strike>)
**LAMP (Drupal + MySQL)
***www.osgeo.org
***mapguide.osgeo.org
***fdo.osgeo.org
*wiki,
**LAPP (MediaWiki+Postgres)
***wiki.osgeo.org
*<strike>Mysql</strike>
*<strike>Postgres</strike>
*secure or ldap,Secure VM
**LDAP
**LDAP Python admin scripts.
**Secure admin notes for OSGeo admins
***not* using LDAP for logins.

=== osgeo4 ===
*lists or mail,Postfix/Mailman
*download1,download.osgeo.org mirror (rsynced from telascience)
*backup,Local Backup
*qgis,QGIS VM (Apache/Joomla + MySQL)<br>
**qgis.org - main website (Joomla)
**blog.qgis.org - developer blog (Drupal)
**forum.qgis.org - forum (phpBB3)
**pyqgis.org ?? - Ruby on Rails
*grass,GRASS VM
**grass web site (static from svn)
**grass wiki (mediawiki on mysql)
**automated linux builds (for binary distribution)
*mapbender, Mapbender VM
** Mapbender VM with main portal and development instances, uses OSGeo LDAP for authentication
**mapbender wiki (MediaWiki on MySQL; currently hosted externally)
*projects,Lower load project websites (hosted on xblade14 now - relatively low priority to migrate)
**mapserver.org
**gdal.org
**geotools.org
*webextra,?
**planet.osgeo
**geodictionary(Wiktionary)
**FOSSGis
**FOSS4G

=== Telescience Blades ===

*Lower load project websites
*Buildbot slaves
*Offsite Backup
*download.osgeo.org

== Final Plan ==
=== osgeo3 & osgeo4 ===

{| border="1" class="wikitable sortable"
|+ OSGeo3 - Allocation of resources, names, configuration notes.
|-
! Virtual Machine
! Cores
! RAM
! HD(DRBD)[SWAP]
! DRBD*
! Backup Time(GMT)
! Domains
! Notes
|-
| Wiki
| 2
| 4
| 16[4]=20
| No
| ?
|
*wiki.osgeo.org

| Martin
|-
| Secure
| 2
| 4
| 10(10)[4]=28
| Yes
| ?
|
*ldap.osgeo.org

| Howard,Martin
|-
| Web
| 2
| 4
| 32(32)[4]=72
| Yes
| ?
|
*www.osgeo.org, foss4g.osgeo.org?

| Wolf, Tyler - (Drupal),?(Mysql)
|-
| Tracsvn
| 4
| 8
| 100
|
|
|
| crschmidt, hobu, frankw
|-
| '''Totals'''
| 6
| 12 (25%)
| 120
| 1
| NA
| NA
|
|}

{| border="1" class="wikitable sortable"
|+ OSGeo4 - Allocation of resources, names, configuration notes.
|-
! Virtual Machine
! Cores
! RAM
! HD(DRBD)[SWAP]
! DRBD*
! Backup Time(GMT)
! Domains
! Notes
|-
| Backup
| 2
| 8
| 500[4]=504
| No
| Fri 5am GMT (Weekend for everyone?
|
*backup.osgeo.org

| Martin, :Backup time is for off-site Sync
|-
| Qgis
| 2
| 4
| 50[4]=54
| No
| ?
|
| Gary,Macho,QGIS team
|-
| Webextra
| 2
| 4
| 20[4]=24
| No
| ?
|
*planet.osgeo.org
| Tyler, Mateusz
|-
| Projects
|
|
|
|
|
|
|
|-
| GRASS?
| 2
| 4
| 50[4]=54
| No
| ?
|
*grass.osgeo.org

| MarkusN, MartinL
|-
| Mapbender?
| 2
| 4
| 20[4?]=24?
| No
| Monday 3:00 UTC (?)
|
*mapbender.osgeo.org

| administration by the [http://www.mapbender.org/Category:Administrators Mapbender admin team].
|-
| '''Totals'''
| 6
| 16 (33%)
| 636
| 0
| NA
| NA
|
|}

*Note: OSL has stated that it's fine to double book cores in the VMs, and that they recommend a minimum of 2. We may want to reduce the number of VMs if we're concerned about maxing all the virtual cores at the same time.
*DRBD: Can be run in Synchronous or Asynchronous mode, Async would not slow down the I/O on the original machine since DRBD won't wait for machine 2 to finish writing. Our preference is Async mode to reduce possibility of I/O delay on main image.

'''Connecting''' the VMs can be reached at $name.osgeo.osuosl.org , Primary admins have key based access and all SAC has LDAP based access to every VM

=== osgeo1 ===
?

=== osgeo2 ===
All services on osgeo2 will be migrated asap so this machine can be turned off, and that part of our Peer1 contract eliminated.

=== Telescience Blades ===
Some upgrades to OS, rebalancing of loads and a clear backup sync from osgeo4 to telescience.

= Base Image =

*Debian Stable 64bit + Backports
*10 GB HD (This is the default set by OSL, we can request a different size and the images can always be grown)
** OSGeo recommended default is 20GB, unless you can justify more.
** default swap is 4GB
*4 GB RAM (default, leaves enough ram to run 2x the normal load of vms, from 5-6 to 10-12)
*64 bit
*Standard partitioning /boot, swap, / (This is OSL default for backup and management purposes, we can request something different.)
*ext3 (ext4 not feasible with current kernel, consider newer kernel for Backup and Download as ext4 serves large files faster)

*Except for the securevm, all virtual machines should be configured for LDAP based authentication. This should probably be done as part of the template image used to make new virtual machines. That way the local admin users are already setup, ssh is on and the machine will be ready for login when booted the 1st time.

== Package List ==

Policy: Install from packages unless exception agreed on by SAC

=== Standard Packages ===

*SSL Cert
*Open-ssh server - done
*libpam-LDAP for client login authentication
*Add [http://www.backports.org/dokuwiki/doku.php?id=instructions Debian Backports] repository for Debian Stable (5.0.4) - done
*[http://munin-monitoring.org/ Munin] monitoring tools, apt-get install munin-node from Debian [main]- done
*Added postfix - removed exim - done
*editors - emacs,joe - done
*[http://www.bacula.org/en/?page=documentation Bacula] client (Backports version 5.0.x)
* Misc
libwww-perl liblwp-useragent-determined-perl
*Emergency user account - Admins have a key based access method.

==== Undecided ====
*Firewall? Shorewall? blocking all but 22, 80, 443 by default?

=== Selective Packages ===

*Apache
*Php (Apache by default should be the non-php builds, except for the servers that require php)
*MySQL
*Postgresql
*SVN
*Postfix
*Mailman

'''Source Exceptions''' Packages that will be installed from source in order to obtain specific version and customizations.

*Trac (mod_wsgi? or mod_python?)

= Migration Plan & Schedule =

== Priority ==

# Setup LDAP (Are we moving it or just configuring the new servers to use it? Does this need to happen at the start?)
# Setup backupVM so it's ready to store backups
# Migrate osgeo2 (Many of these could be done at the same time if the virtual machines are created)
## wiki.osgeo.org
## backups (how much data is this, might need to be scheduled in off hours, and split into smaller jobs, or throttled)
## moodle? ocs? wiktionary? fossgis wiki? community.osgeo.org? - these could just be archived on the backup server if not in use
## planet
## qgis.org joomla site
# Download mirror (one that can take files bigger than 2 GB)
# Trac/SVN
# Migrate OSGeo1

It's anticipated that services would be switched as soon as they are tested on the new setup and the DNS for each service is redirected to it's new working home.

== Schedule ==

(All dates are approximate, alternative schedule suggestions welcome)

*Order - Feb 10,2010 {{Done}}
*General Plan - Feb 26, 2010 {{Done}}
*Physical Installation - Feb 22-Mar 15 2010 {{Done}}
*Specific Plan - Mar 22, 2010
*Software Setup(Start) - Mar 23, 2010
** Configure Base image - Mar 24-28 {{Done}}
** Create Wiki, Secure, Backup - Mar 29 {{Done}}
** Create Qgis, Webextra,Web - May 12 {{Done}}
** Create Downloadmirror, Lists, Tracsvn - May
** Create ... TBD
*Migration - March-May 2010

= TODO: List =

*<strike>Create a base virtual machine image for all new VMs</strike> - OSL will do this for us.
** OSGeo template image should be based on the OSL template but include LDAP based pam authentication against the OSGeo LDAP service for ssh login.
*** May also include standard backup scripts or mount of the backup virtual machine.
*<strike>Naming scheme for virtual machines.</strike>
*Upgrade Telescience blade OS (May require service shuffle rotation or downtime)
*Contingency plan for unexpected hardware failure

= Questions to ask OSL/Ourselves =

*Can ram be increased/decreased live? No
**Can ram be increased/decreased via a web interface live or with power cycle?With power cycle via [[Ganeti]] cli<br>
*Is it easy to move VMs between the machines? Yes, using [[Ganeit]] cli
*Should the LDAP be hosted on one of the Host OS' for reliability?
*Would LVM snapshot backups of virtual machines be a viable backup method? Should be doable, still needs some testing.
*Define our base VM: (OSL does not recommend gentoo, though that is what they use as the base KVM host)
**Choose a standard: '''Debian Stable + backports''', Ubuntu LTS, Centos ... (Does it need to implement SELinux or is that overkill?)
***ext4 formatting? OSL still testing that backup and management tools work with ext4, otherwise ext3
***32bit vs'''64bit''' - in some cases smaller VMs with only 2 GB etc could perform better with 32 bit :'''64 bit'''
***default HD size? - remember to leave lots of room for /var, logs and database dumps even if there's not much in the VM : '''10 GB'''
*How much ram should we reserve for the host OS?
*Naming of the Virtual Machines?
**Latitude, Longitude, Northing, Easting, Parallels, etc.
**Mercator, Albers, Robinson, Sinusodial, etc.
**'''wiki, mail, web, ldap, etc.''' (based on primary DNS of that vm)
**vm1, vm2, vm3, etc.
*Should we stagger the backups to reduce chance of backups grinding things to a halt
** Times to choose from (GMT) for backup starts (Assuming blocks of 2-3 hours to complete backups)
*** A: 9 GMT (1-4 US,8-11 Europe,19 Australia,13-15 India)
*** B: 15 GMT (8-11 US,14-16 Europe,2 Australia,17-19 India)
*** C: 23 GMT (16-19 US, 22-24 Europe,10 Australia,3-5 India)

[[Category:Infrastructure]]

Infrastructure Transition Plan 2010

2010-05-26T14:39:06Z

Wiki-Crschmidt: /* osgeo3 & osgeo4 */

'''This is a draft document for the purposes of collaborative planning of the new server transition. This notice will be removed once SAC has determined it's final course of action.'''

= Background =

[[SAC]] and the board have allocated a budget to purchase new server machines. These new servers have been specified, quoted and ordered. Delivery by Feb 22, 2010. They will be physically hosted by the Open Source Lab (OSL) and the main host OS on which virtual machines will be managed in part by OSL. We will continue use of current Telescience blades but plan to discontinue use of PEER1 services for osgeo1 and osgeo2 once all services have been migrated.

== OSL Hosting ==
During the setup process [[User:Wildintellect| Wildintellect]] is the OSGeo liason to [[OSL]]. Questions should be sent to the [[SAC]] mailing list or asked on [[IRC]]

= New Hardware =

== osgeo3(previously osl1) ==

*2x 4 core 2.5 Ghz cpu
*6x 146 GB 15K rpm, 3GB/s hard drives in RAID 5 configuration ~ 730 GB
*48 GB of RAM
*Dual NIC ethernet

== osgeo4(previously osl1) ==

*2x 4 core 2.5 Ghz cpu
*6x 300 GB 15K rpm, 6GB/s hard drives in RAID 6 configuration. ~ 1.17 TB
*48 GB of RAM
*Dual NIC ethernet

= Resource Allocation =

The plan includes running virtual machines on the new machines. OSL has suggested KVM as that's their preferred vm solution and they could provide support. OSL plans to install [http://code.google.com/p/ganeti/ ganeti] to manage the virtual machines - it allows things like live moving of VMs between machines, scaling of RAM, running VM creation/installation scripts, vnc connection to guests(in case ssh is down), etc...

== Ideas(Virtual Machines)<br> ==

Each line should be a suggested virtual machine(VM) (or in the case of Telescience 1 blade). There are lots of possible scenarios but this list will try to capture the most common options (expect the final selection to be a subset).

One alternative is to simply give each service/project it's own virtual machine(VM), this may make administration easier(for security) or harder (for backup, general management) and may not use resources efficiently. For example if there were more than 12 VMs on any one machine they would each have at most 4GB of RAM. By pooling some services that use the same infrastructure we could essentially balance 16GB of RAM across 4 sites, assuming that heavy loads occur only occasionally any one of the 4 sites could potentially use the 16GB as needed and would be unlikely to conflict with the other 3.

=== osgeo3 ===
Suggested Name, Service, Details
*tracsvn,Trac/SVN with <strike>orwithout </strike>Postgres - Trac from source
*osgeoweb or web,Apache/PHP (Drupal +<strike>Mediawiki</strike>)(with <strike>or without</strike> MySQL + <strike>Postgres</strike>)
**LAMP (Drupal + MySQL)
***www.osgeo.org
***mapguide.osgeo.org
***fdo.osgeo.org
*wiki,
**LAPP (MediaWiki+Postgres)
***wiki.osgeo.org
*<strike>Mysql</strike>
*<strike>Postgres</strike>
*secure or ldap,Secure VM
**LDAP
**LDAP Python admin scripts.
**Secure admin notes for OSGeo admins
***not* using LDAP for logins.

=== osgeo4 ===
*lists or mail,Postfix/Mailman
*download1,download.osgeo.org mirror (rsynced from telascience)
*backup,Local Backup
*qgis,QGIS VM (Apache/Joomla + MySQL)<br>
**qgis.org - main website (Joomla)
**blog.qgis.org - developer blog (Drupal)
**forum.qgis.org - forum (phpBB3)
**pyqgis.org ?? - Ruby on Rails
*grass,GRASS VM
**grass web site (static from svn)
**grass wiki (mediawiki on mysql)
**automated linux builds (for binary distribution)
*mapbender, Mapbender VM
** Mapbender VM with main portal and development instances, uses OSGeo LDAP for authentication
**mapbender wiki (MediaWiki on MySQL; currently hosted externally)
*projects,Lower load project websites (hosted on xblade14 now - relatively low priority to migrate)
**mapserver.org
**gdal.org
**geotools.org
*webextra,?
**planet.osgeo
**geodictionary(Wiktionary)
**FOSSGis
**FOSS4G

=== Telescience Blades ===

*Lower load project websites
*Buildbot slaves
*Offsite Backup
*download.osgeo.org

== Final Plan ==
=== osgeo3 & osgeo4 ===

{| border="1" class="wikitable sortable"
|+ OSGeo3 - Allocation of resources, names, configuration notes.
|-
! Virtual Machine
! Cores
! RAM
! HD(DRBD)[SWAP]
! DRBD*
! Backup Time(GMT)
! Domains
! Notes
|-
| Wiki
| 2
| 4
| 16[4]=20
| No
| ?
|
*wiki.osgeo.org

| Martin
|-
| Secure
| 2
| 4
| 10(10)[4]=28
| Yes
| ?
|
*ldap.osgeo.org

| Howard,Martin
|-
| Web
| 2
| 4
| 32(32)[4]=72
| Yes
| ?
|
*www.osgeo.org, foss4g.osgeo.org?

| Wolf, Tyler - (Drupal),?(Mysql)
|-
| Tracsvn
| 2
| 8
| 100
|
|
|
| crschmidt, hobu, frankw
|-
| '''Totals'''
| 6
| 12 (25%)
| 120
| 1
| NA
| NA
|
|}

{| border="1" class="wikitable sortable"
|+ OSGeo4 - Allocation of resources, names, configuration notes.
|-
! Virtual Machine
! Cores
! RAM
! HD(DRBD)[SWAP]
! DRBD*
! Backup Time(GMT)
! Domains
! Notes
|-
| Backup
| 2
| 8
| 500[4]=504
| No
| Fri 5am GMT (Weekend for everyone?
|
*backup.osgeo.org

| Martin, :Backup time is for off-site Sync
|-
| Qgis
| 2
| 4
| 50[4]=54
| No
| ?
|
| Gary,Macho,QGIS team
|-
| Webextra
| 2
| 4
| 20[4]=24
| No
| ?
|
*planet.osgeo.org
| Tyler, Mateusz
|-
| Projects
|
|
|
|
|
|
|
|-
| GRASS?
| 2
| 4
| 50[4]=54
| No
| ?
|
*grass.osgeo.org

| MarkusN, MartinL
|-
| Mapbender?
| 2
| 4
| 20[4?]=24?
| No
| Monday 3:00 UTC (?)
|
*mapbender.osgeo.org

| administration by the [http://www.mapbender.org/Category:Administrators Mapbender admin team].
|-
| '''Totals'''
| 6
| 16 (33%)
| 636
| 0
| NA
| NA
|
|}

*Note: OSL has stated that it's fine to double book cores in the VMs, and that they recommend a minimum of 2. We may want to reduce the number of VMs if we're concerned about maxing all the virtual cores at the same time.
*DRBD: Can be run in Synchronous or Asynchronous mode, Async would not slow down the I/O on the original machine since DRBD won't wait for machine 2 to finish writing. Our preference is Async mode to reduce possibility of I/O delay on main image.

'''Connecting''' the VMs can be reached at $name.osgeo.osuosl.org , Primary admins have key based access and all SAC has LDAP based access to every VM

=== osgeo1 ===
?

=== osgeo2 ===
All services on osgeo2 will be migrated asap so this machine can be turned off, and that part of our Peer1 contract eliminated.

=== Telescience Blades ===
Some upgrades to OS, rebalancing of loads and a clear backup sync from osgeo4 to telescience.

= Base Image =

*Debian Stable 64bit + Backports
*10 GB HD (This is the default set by OSL, we can request a different size and the images can always be grown)
** OSGeo recommended default is 20GB, unless you can justify more.
** default swap is 4GB
*4 GB RAM (default, leaves enough ram to run 2x the normal load of vms, from 5-6 to 10-12)
*64 bit
*Standard partitioning /boot, swap, / (This is OSL default for backup and management purposes, we can request something different.)
*ext3 (ext4 not feasible with current kernel, consider newer kernel for Backup and Download as ext4 serves large files faster)

*Except for the securevm, all virtual machines should be configured for LDAP based authentication. This should probably be done as part of the template image used to make new virtual machines. That way the local admin users are already setup, ssh is on and the machine will be ready for login when booted the 1st time.

== Package List ==

Policy: Install from packages unless exception agreed on by SAC

=== Standard Packages ===

*SSL Cert
*Open-ssh server - done
*libpam-LDAP for client login authentication
*Add [http://www.backports.org/dokuwiki/doku.php?id=instructions Debian Backports] repository for Debian Stable (5.0.4) - done
*[http://munin-monitoring.org/ Munin] monitoring tools, apt-get install munin-node from Debian [main]- done
*Added postfix - removed exim - done
*editors - emacs,joe - done
*[http://www.bacula.org/en/?page=documentation Bacula] client (Backports version 5.0.x)
* Misc
libwww-perl liblwp-useragent-determined-perl
*Emergency user account - Admins have a key based access method.

==== Undecided ====
*Firewall? Shorewall? blocking all but 22, 80, 443 by default?

=== Selective Packages ===

*Apache
*Php (Apache by default should be the non-php builds, except for the servers that require php)
*MySQL
*Postgresql
*SVN
*Postfix
*Mailman

'''Source Exceptions''' Packages that will be installed from source in order to obtain specific version and customizations.

*Trac (mod_wsgi? or mod_python?)

= Migration Plan & Schedule =

== Priority ==

# Setup LDAP (Are we moving it or just configuring the new servers to use it? Does this need to happen at the start?)
# Setup backupVM so it's ready to store backups
# Migrate osgeo2 (Many of these could be done at the same time if the virtual machines are created)
## wiki.osgeo.org
## backups (how much data is this, might need to be scheduled in off hours, and split into smaller jobs, or throttled)
## moodle? ocs? wiktionary? fossgis wiki? community.osgeo.org? - these could just be archived on the backup server if not in use
## planet
## qgis.org joomla site
# Download mirror (one that can take files bigger than 2 GB)
# Trac/SVN
# Migrate OSGeo1

It's anticipated that services would be switched as soon as they are tested on the new setup and the DNS for each service is redirected to it's new working home.

== Schedule ==

(All dates are approximate, alternative schedule suggestions welcome)

*Order - Feb 10,2010 {{Done}}
*General Plan - Feb 26, 2010 {{Done}}
*Physical Installation - Feb 22-Mar 15 2010 {{Done}}
*Specific Plan - Mar 22, 2010
*Software Setup(Start) - Mar 23, 2010
** Configure Base image - Mar 24-28 {{Done}}
** Create Wiki, Secure, Backup - Mar 29 {{Done}}
** Create Qgis, Webextra,Web - May 12 {{Done}}
** Create Downloadmirror, Lists, Tracsvn - May
** Create ... TBD
*Migration - March-May 2010

= TODO: List =

*<strike>Create a base virtual machine image for all new VMs</strike> - OSL will do this for us.
** OSGeo template image should be based on the OSL template but include LDAP based pam authentication against the OSGeo LDAP service for ssh login.
*** May also include standard backup scripts or mount of the backup virtual machine.
*<strike>Naming scheme for virtual machines.</strike>
*Upgrade Telescience blade OS (May require service shuffle rotation or downtime)
*Contingency plan for unexpected hardware failure

= Questions to ask OSL/Ourselves =

*Can ram be increased/decreased live? No
**Can ram be increased/decreased via a web interface live or with power cycle?With power cycle via [[Ganeti]] cli<br>
*Is it easy to move VMs between the machines? Yes, using [[Ganeit]] cli
*Should the LDAP be hosted on one of the Host OS' for reliability?
*Would LVM snapshot backups of virtual machines be a viable backup method? Should be doable, still needs some testing.
*Define our base VM: (OSL does not recommend gentoo, though that is what they use as the base KVM host)
**Choose a standard: '''Debian Stable + backports''', Ubuntu LTS, Centos ... (Does it need to implement SELinux or is that overkill?)
***ext4 formatting? OSL still testing that backup and management tools work with ext4, otherwise ext3
***32bit vs'''64bit''' - in some cases smaller VMs with only 2 GB etc could perform better with 32 bit :'''64 bit'''
***default HD size? - remember to leave lots of room for /var, logs and database dumps even if there's not much in the VM : '''10 GB'''
*How much ram should we reserve for the host OS?
*Naming of the Virtual Machines?
**Latitude, Longitude, Northing, Easting, Parallels, etc.
**Mercator, Albers, Robinson, Sinusodial, etc.
**'''wiki, mail, web, ldap, etc.''' (based on primary DNS of that vm)
**vm1, vm2, vm3, etc.
*Should we stagger the backups to reduce chance of backups grinding things to a halt
** Times to choose from (GMT) for backup starts (Assuming blocks of 2-3 hours to complete backups)
*** A: 9 GMT (1-4 US,8-11 Europe,19 Australia,13-15 India)
*** B: 15 GMT (8-11 US,14-16 Europe,2 Australia,17-19 India)
*** C: 23 GMT (16-19 US, 22-24 Europe,10 Australia,3-5 India)

[[Category:Infrastructure]]

Board Meeting 2010-05-06

2010-04-16T20:02:46Z

Wiki-Crschmidt: /* Agenda */

== Agenda ==
* Discuss timing of board meeting at FOSS4G 2010
** Establish how board members will be compensated/helped to attend, if attendance is mandatory.

Board Meeting 2010-05-06

2010-04-16T20:02:31Z

Wiki-Crschmidt: /* Agenda */

== Agenda ==
* Discuss timing of board meeting at FOSS4G 2010
* Establish how board members will be compensated/helped to attend, if attendance is mandatory.

Board Meeting 2010-05-06

2010-04-16T20:02:16Z

Wiki-Crschmidt: Created page with '== Agenda == * Discuss timing of board meeting at FOSS4G 2010 * Establish how board members will be compensated/helped to attend, if attendance is mandatory.'

== Agenda ==
* Discuss timing of board meeting at FOSS4G 2010
* Establish how board members will be compensated/helped to attend, if attendance is mandatory.

SAC:Primary Administrators

2010-03-25T20:27:51Z

Wiki-Crschmidt:

This page documents what a Primary Administrator is, and who they are.

Primary Administrators are those people who have been given the highest level of access to OSGeo system resources. This is a position of substantial trust and responsibility. Primary Administrators are provided with:

* accounts and sudo access on the primary Peer1 server (www.osgeo.org)
* account information for the OSGeo DNS account at Pairnic.
* account info for logging into the UPS web page to reboot the main and secondary Peer1 servers.
* LDAP Password for primary LDAP repository
* account info for filing tickets with Peer1

The following individuals are Primary Administrators and have access to this information. If they don't know the info, they should contact another primary administrator for details, and keep it somewhere off the main server so they can get to it in an emergency!

* [[User:Sbarnes|Shawn Barnes]]: +1 613.565.5056 - Ottawa/CAN business hours - timezone GMT-4
* [[User:Tmitchell|Tyler Mitchell]]: +1-250-303-1831 - tmitchell at osgeo.org - timezone GMT-7
* [[User:Warmerda|Frank Warmerdam]]: +1 613.754.2041 - anytime (all incl. UPS reboot)
* [[User:Hobu|Howard Butler]]: +1 515 708 0858 IRC (UPS reboot)
* [[User:Mspott|Martin Spott]]: +49 172 2019167 - timezone (GMT +1)
* [[User:Wolf|Wolf Bergenheim]]: (Drupal) +358-41-5176362 - timezone GMT+2
* [[User:Neteler|Markus Neteler]]: +39 0461 615 570 Trento/IT business hours - timezone GMT+1
* [[User:Crschmidt|Christopher Schmidt]]: +1 603 264 2294

=== Other Admins of Note ===

* [[User:Arnulf Christl | Arnulf Christl]]: (Mediawiki)
* [[User:johng|HyperJohnGraham]]: (Telascience)

=== IRC channels ===

Go here to catch people:

* irc://irc.freenode.org#osgeo
* irc://irc.freenode.org#telascience
* If you don't have an IRC client, you can use the [http://irc.telascience.org/cgi-bin/telascience-irc.cgi IRC Web browser interface] or [http://webchat.freenode.net/ Freenode's Webchat] (if you are behind a restrictive firewall)

[[Category: Infrastructure]]

Board Meeting 2009-10-08

2009-10-08T16:09:46Z

Wiki-Crschmidt: /* Minutes */

[[Category: Board]]
[[Category:Board Meetings 2009]]

This board meeting has been scheduled for the 8th of October 2009 at 15:00 UTC [http://www.timeanddate.com/worldclock/fixedtime.html?year=2009&month=09&day=03&hour=15&min=0&sec=0 at 15:00 UTC], on IRC ([irc://irc.freenode.net/#osgeo #osgeo]). We will need to make a Skype call if there is anything to vote on, so please make sure that you give Tyler your ID and have your box up and running. Ideally make a test call a day before.

; If this date does not work for you at all please let the board list know so that we can find an alternative
; Please add to the agenda ''before'' the actual meeting.

== Agenda ==
* Appoint meeting secretary
* Short intro from the new board members (if you feel like it)
* Selection of executive: President, Treasurer and Secretary.
* [http://lists.osgeo.org/pipermail/board/2009-October/003066.html FOSS4G budget decision] whether to fund lunch
* Follow up on Broadband Mapping Discussion (see [http://logs.qgis.org/osgeo/%23osgeo.2009-08-31.log discussion on IRC logs] and [http://wiki.osgeo.org/wiki/ARRA_Broadband_Mapping Letter])
* F2F Meeting preparation for Sydney
* Update from Tyler
* Pramsey, Change to [[Board Election Procedure]] "Charter members may apply all their votes to a single person or distribute them in integral amounts over multiple candidates" to "Charter member may vote for zero candidates or cast as many votes as the number of board slots open, but may not vote for the same candidate twice"
* cont. The Future of OSGeo discussion
* ''Add your items''

== Minutes ==

* Attended:
** Christopher Schmidt
** Jeff McKenna
** Frank Warmardam
** Arnulf
** Ravi
** Markus
** Geoff Zeiss

** Tyler Mitchell

Toronto Code Sprint 2009

2009-03-05T16:48:43Z

Wiki-Crschmidt: /* Participation */

== Purpose ==

Get together project members to make decisions and tackle larger problems, see the [[Toronto Code Sprint 2009 Agenda]]. We have chosen a mid-North American location because this code sprint is targeting members of the "C Tribe" (eg, Mapserver, GRASS, GDAL, Proj, PostGIS, MapGuide) and many members of the "C Tribe" are clustered in the area. Toronto is also a major travel hub, for sprinters traveling from afar. Other tribes are welcome to join the sprint, of course, but we hope that "C Tribe" members will give this event special consideration.

== Sponsors ==

We have received support from six sponsors, each providing a $500 sponsorship that will be put towards venue, internet and lunch costs.

Thanks to our sponsors!

* [http://www.greenwoodmap.com/ Rich Greenwood]
* [http://www.osgis.nl/index_en.htm OSGIS.nl]
* [http://www.coordinatesolutions.com Coordinate Solutions]
* [http://www.lizardtech.com/ LizardTech]
* [http://www.sjgeophysics.com/ SJ Geophysics]
* [http://qpublic.net/ qPublic.net]

The event budget is available [http://spreadsheets.google.com/pub?key=plI7bw56S6qHPAj9OEsIMaQ here]. Any surplus at the end of the event will be turned over to OSGeo.

== Timing ==

Where: '''Rainbow Room''', Radisson Admiral Waterfront Hotel, Toronto, Ontario

When: Saturday March 7 - Tuesday March 10, 2009.

Duration: Four days from approximately 9am-4pm

== Venue ==

[http://www.radisson.com/torontoca_admiral Radisson Hotel Admiral Toronto-Harbourfront]<br/>
249 Queen's Quay West<br/>
Toronto, Ontario<br/>
M5J 2N5 , Canada<br/>
Reservations: 1-888-201-1718<br/>
Telephone: +01-416-203-3333<br/>
Fax: +01-416-203-3100<br/>

[http://maps.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=Radisson+Hotel+Admiral+Toronto-Harbourfront&sll=37.0625,-95.677068&sspn=58.337319,62.314453&ie=UTF8&ll=43.643156,-79.385662&spn=0.026428,0.030427&z=15 Map]

When reserving, please specify "OSGeo" as the block name. '''The block rate is $79/night.'''

== Costs ==

Participants should plan for the following costs:

* Travel to Toronto, variable depending on where you are.
* Accommodation for four nights, $160 to $400 depending on what room you choose and whether you room share.
* Breakfast, lunch, and other snacks.
* The sponsorship moneys will be put towards: meeting room rental, internet access, Saturday night social event (hockey), group dinners Saturday, Sunday and Monday.

== Communication ==

Please join the mailing list at:

http://lists.osgeo.org/mailman/listinfo/tosprint

== Participation ==

We are planning for attendance of 20-40. Please add your name and the projects you are hoping to sprint on, if you have a strong intention to attend.

* [[User:pwramsey3|Paul Ramsey]] (PostGIS, Mapserver, Proj) '''attendance confirmed''' YYZ @ 14:00 Friday AC190 2508850632
* [[User:Tomkralidis|Tom Kralidis]] (MapServer, Mapbuilder) '''attendance confirmed'''
* Frank Warmerdam (GDAL/OGR, PROJ.4, MapServer, QGIS, OSGeo4W) '''attendance confirmed''', cell:613-635-3771
* [[User:tbonfort|Thomas Bonfort]] (MapServer) '''attendance confirmed''' YYZ @ 12:45 Friday
* Howard Butler (MapServer, GeoDjango, GDAL, CS-Map, spatialreference.org) '''attendance confirmed''' YYZ @ 16:00 Friday 5157080858
* [[User:jmckenna|Jeff McKenna]] (MapServer docs, MS4W) '''attendance confirmed'''
* Steve Lime (MapServer) '''attendance confirmed''' YYZ @ 18:15 Friday NW 2882
* [[User:dmorissette|Daniel Morissette]] (MapServer, GDAL/OGR) '''attendance confirmed''' YYZ @ 8:15am Friday, then in a meeting until about 16:30
* [[User:assefa|Yewondwossen Assefa]] (MapServer) '''attendance confirmed'''
* [[User:mpg|Michael P. Gerlek]] (GDAL & liblas) '''attendance confirmed'''
* [[User:mrosen|Mike Rosen]] (GDAL & liblas) '''attendance confirmed'''
* [[User:paragon|Leo Hsu and Regina Obe]] (PostGIS, GEOS, Mapserver) '''Can attend Saturday only'''
* [[User:olivier.courtin|Olivier Courtin]] (PostGIS, TinyOWS) '''attendance confirmed''' YYZ @ 12:45 Friday
* Mark Cave-Ayland (PostGIS) '''attendance confirmed''' YYZ @ 19.35 Friday BA0099
* [[User:JulienSam|Julien-Samuel Lacroix]] (MapServer) '''attendance confirmed''' YYZ @ 8:15am Friday, then in a meeting until about 16:30
* [[User:pnaciona|Perry Nacionales]] (MapServer docs) '''attendance confirmed''' YYZ @ 18:15 Friday NW 2882
* [[User:pierre|Pierre Racine]] ([http://postgis.refractions.net/support/wiki/index.php?WKTRasterHomePage PostGIS WKT Raster]) '''attendance confirmed''' YYZ @ 21:55 Friday AC8925
* [[User:jimk|Jim Klassen]] (Mapserver, GeoMOOSE) '''attendance confirmed'''
* Dan Little (Mapserver, OpenLayers, GeoMOOSE) '''attendance confirmed'''
* Alan Boudreault (MapServer, GDAL/OGR) '''attendance confirmed''' YYZ @ 8:15am Friday, then in a meeting until about 16:30
* Christopher Schmidt (OpenLayers) '''attendance confirmed''' YYZ @ 10:35PM Friday. 603.264.2294
* [[User:SchuylerErle|Schuyler Erle]] (OpenLayers)

=== Present in spirit ===

If you can not make it to get to Toronto in person and you still want to actively participate in the sprint, there will be a chance to do it by joining the event on IRC ([irc://irc.freenode.net/tosprint #tosprint]). If you are interested in remote participation, feel free to add yourself below.

* [[User:mloskot|Mateusz Loskot]] (GEOS, GDAL/OGR, PostGIS, Proj) '''attendance confirmed'''
* [[User:szekerest|Tamas Szekeres]] (MapServer, GDAL/OGR) '''attendance confirmed'''

== Gear ==

* Extra items that would be useful (please sign up if you can bring)
** Wireless hub (Perry 1, Mike R 1)
** Extension Cords (Pierre 1, Paul 1, Steve 1, Daniel 3)
** Power Bars (Pierre 1, Paul 1, Steve 1, Daniel 3)
** Ethernet Cables (Pierre 2 short, Paul 1 long, Schuyler some short, Daniel 2-3 long)
** Projector (Schuyler 1, assuming the airline lets him carry it on)
** Screen
** [http://www.pace.edu/emplibrary/EMC%20Flip%20Chart.jpg Flip Charts]
** Wired hubs
** Daniel will bring a 16 port switch, just in case

== Room Share ==

If you would like to room share,

# Reserve a room at the hotel, choosing a type with more than one bed.
# Put your name in this section, indicating the amount of space in your room.

Put your names below:

* example entry: B has a triple room, needs two roommates.

== Individual Preparation ==

* Bring your own computer
* Install subversion and the compiler tools, and come with a working development environment if possible.

== FAQ ==

* Is the Toronto Code Sprint just a coding event?
** Yes, a coding and documentation event. It is a working session for people who are already participants in open source projects.
* Will it be possible to present new projects during this event?
** No, this is not a presentation-oriented event. People will get together in small groups and work on areas of mutual interest within their projects.

== Social Events ==

* Saturday March 7th
** 4PM, '''Ice hockey game''', Hershey Bears vs Toronto Marlies @ Ricoh Coliseum, 100 Princes' Blvd. [http://maps.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=100+Princes+Boulevard,+Toronto,+ON+M6K,+Canada%E2%80%8E&sll=43.640237,-79.392271&sspn=0.03056,0.073214&ie=UTF8&ll=43.636821,-79.411583&spn=0.032053,0.073214&z=14&iwloc=addr map] If you are interested please send a message to the 'tosprint' mailing list, as the tickets must be pre-ordered
** Dinner at [http://maps.google.com/maps?q=151+Front+Street+West+Toronto+on+(East+Side+Marios) East Side Mario's] (8PM)
* Sunday March 8th
** Dinner at [http://www.batonrougerestaurants.com/page.asp?intNodeID=33079 Baton Rouge] (7PM)
* Monday March 9th
** Dinner at [http://maps.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=jack+astor%27s&sll=43.643032,-79.40918&sspn=0.256397,0.585709&ie=UTF8&ll=43.667623,-79.39064&spn=0.128146,0.292854&z=12&iwloc=D Jack Astor's] (7PM)

[[Category:Code Sprints]]
[[Category:Events]]

OpenLayers Report 2008

2009-03-05T15:39:03Z

Wiki-Crschmidt: /* Opportunities to Help */

== OpenLayers ==

* Contact name: '''Erik Uzureau, Chris Schmidt, Tim Schaub'''

=== Key Accomplishments ===

In 2008, OpenLayers had two major releases that demonstrate the majority of our work on the library in this time frame.

The OpenLayers 2.6 release added significant visual improvements, including animated panning of the map and improved popup support for better in-map visualization. In support of our growing international usage, we added internationalization support. We also added a powerful new API for styling client side data, and added support for connecting to MapGuide data sources.

OpenLayers 2.7 added improved rendering capabilities, and added the ability to read OGC standard SLD style documents. There was also a significant development in pushing for vector behaviors, allowing users to easily extend OpenLayers to support communication with custom data providers through open or proprietary protocols.

In addition to code improvements, in 2008 OpenLayers added a revamped demonstration gallery, showing off more than 75 uses of OpenLayers with descriptions, screenshots, and more. In addition to the gallery, the OpenLayers website now has case studies -- organizations which have shared their usage of OpenLayers by explaining how that decision came about and is supported.

=== Areas for Improvement ===

* Documentation, as with any open source project, is always in need of expansion and improvement. With the new OpenLayers documentation site up and running, it is now easier to create documentation.
* Thorough API review. As we bend towards the 8th release of the 2nd OpenLayers API, there are many who long for a massive spring cleaning session to build a 3.0 version of the library.
* Improved access to third party services. With the new protocols and formats, it is now possible to easily create tools which allow OpenLayers to communicate with more servers. One target which has thus far been neglected, for example, is ESRI's server products, both in access to map tiles and vector data. It would be great to see the community step up to help support these important targets.

=== Opportunities to Help ===

* OpenLayers is now a member of the OSGeo Project Sponsorship program, which allows organizations to support the project financially through donations to OSGeo. If your organization is using OpenLayers successfully, consider donating funds to the project to help support its continued success.
* The now-formalized Case Studies section needs more contributions. If your organization is using OpenLayers and successful with it, share your success with others, and help them to understand why and how you chose to use the OpenLayers library.
* Internationalization - We currently have only 15 of the 7,000 living languages translated in the library. The translation process is simple (only 28 strings total).
* Ticket Review - As always, there are many more tickets with patches waiting review than available developer hours. If you have even a little experience with JavaScript, you can help to try out the new code that developers are writing and offer feedback.
* Documentation - Efforts continue to improve the library's documentation, and users of the library are the most effective contributors to this. Participate on the mailing lists and share your problems and solutions, then use the tools in the OpenLayers project to convert them into documentation for all users.

=== Outlook for 2009 ===

2009 brings new leadership to the project's Steering Committee as Tim Schaub takes over the reigns as the new PSC chair.

Efforts are already underway for a 2.8 release which will include long-awaited WFS Protocol functionality, as well as a massive improvement to OpenLayers's vector capabilities which increase performance and interactivity for maps integrating multiple vector layers.

__notoc__
[[Category: Reports 2008]]

OpenLayers Report 2008

2009-03-05T15:35:15Z

Wiki-Crschmidt: /* Areas for Improvement */

== OpenLayers ==

* Contact name: '''Erik Uzureau, Chris Schmidt, Tim Schaub'''

=== Key Accomplishments ===

In 2008, OpenLayers had two major releases that demonstrate the majority of our work on the library in this time frame.

The OpenLayers 2.6 release added significant visual improvements, including animated panning of the map and improved popup support for better in-map visualization. In support of our growing international usage, we added internationalization support. We also added a powerful new API for styling client side data, and added support for connecting to MapGuide data sources.

OpenLayers 2.7 added improved rendering capabilities, and added the ability to read OGC standard SLD style documents. There was also a significant development in pushing for vector behaviors, allowing users to easily extend OpenLayers to support communication with custom data providers through open or proprietary protocols.

In addition to code improvements, in 2008 OpenLayers added a revamped demonstration gallery, showing off more than 75 uses of OpenLayers with descriptions, screenshots, and more. In addition to the gallery, the OpenLayers website now has case studies -- organizations which have shared their usage of OpenLayers by explaining how that decision came about and is supported.

=== Areas for Improvement ===

* Documentation, as with any open source project, is always in need of expansion and improvement. With the new OpenLayers documentation site up and running, it is now easier to create documentation.
* Thorough API review. As we bend towards the 8th release of the 2nd OpenLayers API, there are many who long for a massive spring cleaning session to build a 3.0 version of the library.
* Improved access to third party services. With the new protocols and formats, it is now possible to easily create tools which allow OpenLayers to communicate with more servers. One target which has thus far been neglected, for example, is ESRI's server products, both in access to map tiles and vector data. It would be great to see the community step up to help support these important targets.

=== Opportunities to Help ===

* The now-formalized Case Studies section needs more contributions. Help others to understand why/how you chose to use the OpenLayers library.
* Internationalization - We currently have only 15 of the 7,000 living languages translated in the library. The translation process is simple (only 28 strings total).
* Ticket Review - As always, there are many more tickets with patches waiting review than available developer hours.
* Documentation - Efforts continue to improve the library's documentation, but the *users* are really those who can best help with this mission.

=== Outlook for 2009 ===

2009 brings new leadership to the project's Steering Committee as Tim Schaub takes over the reigns as the new PSC chair.

Efforts are already underway for a 2.8 release which will include long-awaited WFS Protocol functionality, as well as a massive improvement to OpenLayers's vector capabilities which increase performance and interactivity for maps integrating multiple vector layers.

__notoc__
[[Category: Reports 2008]]

OpenLayers Report 2008

2009-03-05T15:28:11Z

Wiki-Crschmidt:

Toronto Code Sprint 2009

2009-02-24T19:06:28Z

Wiki-Crschmidt: /* Participation */

== Purpose ==

Get together project members to make decisions and tackle larger problems, see the [[Toronto Code Sprint 2009 Agenda]]. We have chosen a mid-North American location because this code sprint is targeting members of the "C Tribe" (eg, Mapserver, GRASS, GDAL, Proj, PostGIS, MapGuide) and many members of the "C Tribe" are clustered in the area. Toronto is also a major travel hub, for sprinters traveling from afar. Other tribes are welcome to join the sprint, of course, but we hope that "C Tribe" members will give this event special consideration.

== Sponsors ==

We have received support from five sponsors, each providing a $500 sponsorship that will be put towards venue, internet and lunch costs.

Thanks to our sponsors!

* [http://www.greenwoodmap.com/ Rich Greenwood]
* [http://www.osgis.nl/index_en.htm OSGIS.nl]
* [http://www.coordinatesolutions.com Coordinate Solutions]
* [http://www.lizardtech.com/ LizardTech]
* [http://www.sjgeophysics.com/ SJ Geophysics]

The event budget is available [http://spreadsheets.google.com/pub?key=plI7bw56S6qHPAj9OEsIMaQ here]. Any surplus at the end of the event will be turned over to OSGeo.

== Timing ==

Where: '''Rainbow Room''', Radisson Admiral Waterfront Hotel, Toronto, Ontario

When: Saturday March 7 - Tuesday March 10, 2009.

Duration: Four days from approximately 9am-4pm

== Venue ==

[http://www.radisson.com/torontoca_admiral Radisson Hotel Admiral Toronto-Harbourfront]<br/>
249 Queen's Quay West<br/>
Toronto, Ontario<br/>
M5J 2N5 , Canada<br/>
Reservations: 1-888-201-1718<br/>
Telephone: +01-416-203-3333<br/>
Fax: +01-416-203-3100<br/>

[http://maps.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=Radisson+Hotel+Admiral+Toronto-Harbourfront&sll=37.0625,-95.677068&sspn=58.337319,62.314453&ie=UTF8&ll=43.643156,-79.385662&spn=0.026428,0.030427&z=15 Map]

When reserving, please specify "OSGeo" as the block name. '''The block rate is $79/night.'''

== Costs ==

Participants should plan for the following costs:

* Travel to Toronto, variable depending on where you are.
* Accommodation for four nights, $160 to $400 depending on what room you choose and whether you room share.
* Meals. Dinners at least, lunches and coffee are covered by sponsors.

== Communication ==

Please join the mailing list at:

http://lists.osgeo.org/mailman/listinfo/tosprint

== Participation ==

We are planning for attendance of 20-40. Please add your name and the projects you are hoping to sprint on, if you have a strong intention to attend.

* [[User:pwramsey3|Paul Ramsey]] (PostGIS, Mapserver, Proj) '''attendance confirmed'''
* [[User:Tomkralidis|Tom Kralidis]] (MapServer, Mapbuilder) '''attendance confirmed'''
* Frank Warmerdam (GDAL/OGR, PROJ.4, MapServer, QGIS, OSGeo4W) '''attendance confirmed'''
* [[User:tbonfort|Thomas Bonfort]] (MapServer) '''attendance confirmed'''
* Howard Butler (MapServer, GeoDjango, GDAL, CS-Map, spatialreference.org) '''attendance confirmed'''
* [[User:jmckenna|Jeff McKenna]] (MapServer docs, MS4W) '''attendance confirmed'''
* Steve Lime (MapServer) '''attendance confirmed'''
* [[User:dmorissette|Daniel Morissette]] (MapServer, GDAL/OGR) '''attendance confirmed'''
* [[User:assefa|Yewondwossen Assefa]] (MapServer) '''attendance confirmed'''
* [[User:Aross|Andrew Ross]] (Had to change plans unfortunate can't attend)
* [[User:mpg|Michael P. Gerlek]] (GDAL & liblas) '''attendance confirmed'''
* [[User:mrosen|Mike Rosen]] (GDAL & liblas) '''attendance confirmed'''
* [[User:paragon|Leo Hsu and Regina Obe]] (PostGIS, GEOS, Mapserver) '''Can attend Saturday only'''
* [[User:olivier.courtin|Olivier Courtin]] (PostGIS, TinyOWS) '''attendance confirmed'''
* Mark Cave-Ayland (PostGIS)
* [[User:JulienSam|Julien-Samuel Lacroix]] (MapServer) '''attendance confirmed'''
* [[User:pnaciona|Perry Nacionales]] (MapServer docs) '''attendance confirmed'''
* [[User:pierre|Pierre Racine]] ([http://postgis.refractions.net/support/wiki/index.php?WKTRasterHomePage PostGIS WKT Raster]) '''attendance confirmed'''
* [[User:jimk|Jim Klassen]] (Mapserver, GeoMOOSE) '''attendance confirmed'''
* Dan Little (Mapserver, OpenLayers, GeoMOOSE) '''attendance confirmed'''
* Alan Boudreault (MapServer, GDAL/OGR) '''attendance confirmed'''
* Christopher Schmidt (OpenLayers) '''attendance confirmed'''

=== Present in spirit ===

If you can not make it to get to Toronto in person and you still want to actively participate in the sprint, there will be a chance to do it by joining the event on IRC ([irc://irc.freenode.net/tosprint #tosprint]). If you are interested in remote participation, feel free to add yourself below.

* [[User:mloskot|Mateusz Loskot]] (GEOS, GDAL/OGR, PostGIS, Proj) '''attendance confirmed'''
* [[User:szekerest|Tamas Szekeres]] (MapServer, GDAL/OGR) '''attendance confirmed'''

== Gear ==

* Extra items that would be useful (please sign up if you can bring)
** Wireless hub
** Wireless hub (Perry 1)
** Extension Cords (Pierre 1, Paul 1)
** Power Bars (Pierre 1, Paul 1)
** Ethernet Cables (Pierre 2 short, Paul 1 long)
** Projector
** Screen
** [http://www.pace.edu/emplibrary/EMC%20Flip%20Chart.jpg Flip Charts]
** Wired hubs -- mpg will bring 3, plus some cabling

== Room Share ==

If you would like to room share,

# Reserve a room at the hotel, choosing a type with more than one bed.
# Put your name in this section, indicating the amount of space in your room.

Put your names below:

* example entry: B has a triple room, needs two roommates.

== Individual Preparation ==

* Bring your own computer
* Install subversion and the compiler tools, and come with a working development environment if possible.

== FAQ ==

* Is the Toronto Code Sprint just a coding event?
** Yes, a coding and documentation event. It is a working session for people who are already participants in open source projects.
* Will it be possible to present new projects during this event?
** No, this is not a presentation-oriented event. People will get together in small groups and work on areas of mutual interest within their projects.

== Social Events ==

* Saturday March 7th

4pm
Ice hockey game
Hershey Bears vs Toronto Marlies
@ Ricoh Coliseum
100 Princes' Blvd.
[http://maps.google.com/maps?f=q&source=s_q&hl=en&geocode=&q=100+Princes+Boulevard,+Toronto,+ON+M6K,+Canada%E2%80%8E&sll=43.640237,-79.392271&sspn=0.03056,0.073214&ie=UTF8&ll=43.636821,-79.411583&spn=0.032053,0.073214&z=14&iwloc=addr map]

If you are interested please send a message to the 'tosprint' mailing list, as the tickets must be pre-ordered

[[Category:Code Sprints]]
[[Category:Events]]

Main Page

2008-10-26T15:47:18Z

Wiki-Crschmidt:

{| width="100%"
|-
| width="68%" style="vertical-align:top" |
<div style="margin:0; margin-right:10px; border:1px solid #dfdfdf; background-color:#f8f8ff;">

<div style="padding:0.3em 1em 0.7em 1em;">

== Introduction to the Open Source Geospatial Foundation Wiki ==

This is the community Wiki of the Open Source Geospatial Foundation. Please refer to [http://www.osgeo.org/ the official web site] for official documents and policies. This Wiki is the place where documents such as committee notes, discussion on software projects, and proposals can be created collaboratively.

See [[Getting Started]] for how to dive in and get involved. We have [[Local Chapters]], which work regionally and in other languages. We also have many active [[Mailing Lists]] for discussions. Take a moment to visit our [[Library]]. We have a list of email [[Contacts]] for various projects and functions.

The OSGeo has an [http://www.osgeo.org/about official structure] but the movement is much larger. You are free to join us and add yourself to this [[:Category:OSGeo_Member | OSGeo Member List]].

In November of 2006, OSGeo accomplished a major milestone with the addition of a full time Executive Director. Tyler Mitchell was selected by the board of directors and helps to coordinate and lead the efforts of our organization. Find out more at [http://www.osgeo.org/tyler Tyler Mitchell's Blog].
</div>
</div>

<div style="margin:0; margin-top:10px; margin-right:10px; border:1px solid #dfdfdf; padding:0em 1em 1em 1em; background-color:#f8f8ff;">
=== Committees ===
The committees are part of the official structure of OSGeo. Committees meet on the [[IRC]] on [irc://irc.freenode.net/osgeo #osgeo] or use conference calls. For a list of scheduled or regularly scheduled meetings of many of the committees check the [[Foundation Calendar]]. From the committees' pages you will find the missions, names of the people involved, and links to the working documents.

Informal participation in committees via mailing list, wiki contributions and meeting attendance is encouraged by all interested parties!

* [[Board of Directors]]
* [[Conference Committee]]
* [[Education and Curriculum Committee]]
* [[Finance Committee]]
* [[Incubation Committee]]
* [[Marketing Committee]]
* [[Project Steering Committees]]
* [[Public Geospatial Data Committee]]
* [[SAC|System Administration Committee (SAC)]]
* [[Website Committee]] - [[WebComTODO|Current WebCom tasks]]
</div>

<div style="margin:0; margin-top:10px; margin-right:10px; border:1px solid #dfdfdf; padding: 0em 1em 1em 1em; background-color:#f8f8ff;">

=== Networking ===

OSGeo means community based development. We work at both global and local level. Check here for joining active communities:
* [[Local Chapters]]
* [[Like Minded Regional Organizations]]
* [[International Outreach]]
* [[:Category:OSGeo_Member | OSGeo Members]]
</div>


| width="38%" style="vertical-align:top" |
<div style="margin:0; border:1px solid #dfdfdf; padding:0em 1em 1em 1em; background-color:#f8f8ff;">

=== Current Issues ===
* [[:Category:Events|Events]] - our calendar
* [[Volunteers Needed]]
* [[What's Working]]
* [[What's Not Working]]
</div>

<div style="margin:0; margin-top:10px; border:1px solid #dfdfdf; padding: 0em 1em 1em 1em; background-color:#f8f8ff;">

=== General OSGeo ===
* [[OSGeo Description]]
* OSGeo [http://en.wikipedia.org/wiki/Open_Source_Geospatial_Foundation Wikipedia entry]
* [http://www.osgeo.org/membership Membership Rules]
* [[Committee Guidelines]]
* [[Contacts]] - for projects, committees, etc
* [http://trac.osgeo.org/osgeo OSGeo issue tracker]
* [http://trac.osgeo.org All OSGeo issue trackers]
* [http://trac.osgeo.org/osgeo/browser/ OSGeo repositories]
* [[Protocol for requesting letter of support|Protocol for requesting a letter of support]]
* [[Jobs Board]]
</div>

<div style="margin:0; margin-top:10px; border:1px solid #dfdfdf; padding: 0em 1em 1em 1em; background-color:#f8f8ff;">

=== Software and Data ===

Services:
* [[Choosing a Web Mapping Platform]]
* [[Commercial Services]]
* [[Geodata Repository]]

Development:
* [[AJAX WebMapping Project Request]]

* [[Distribution Special Interest Groups]]
* [[Google Summer of Code]] initiative
* [[Java GIS Collaboration]]
* [[MetaCRS]] project
* [[Mobile Solutions]]
* [[Programming Languages Project]]
* [[Script Repository]]
* [[Software Translation Portal]]
* [[OSGeo Labs]]
</div>

<div style="margin:0; margin-top:10px; border:1px solid #dfdfdf; padding: 0em 1em 1em 1em; background-color:#f8f8ff;">

== Useful Notes ==

* [[Getting Started]] will help you to find about.
* [[How to Edit]] this Wiki.
* [[How to keep Track]] of what is going on in the Wiki.
* [[OSGEO:Protected page guidelines|Protected page guidelines]]
</div>
|}

__NOTOC__
-----
[[OSGEO:About|Wiki Site Disclaimer]]

Live GIS Disc Packages

2008-10-01T15:00:37Z

Wiki-Crschmidt: New page: == Direct from Debian == * OGR (with Python, Perl bindings) * mapserver * postgis * pgadmin * grass * proj == Not in Debian == * qgis * geoserver * uDig * gvSig * r-spatial *...

== Direct from Debian ==
* OGR (with Python, Perl bindings)
* mapserver
* postgis
* pgadmin
* grass
* proj

== Not in Debian ==
* qgis
* geoserver
* uDig
* gvSig
* r-spatial
* GeoNetwork

== possiblies ==
* ossim
* jump

FOSS4G2008 Presentation Materials

2008-10-01T14:02:19Z

Wiki-Crschmidt:

Please link presentation materials from this wiki page when they are complete.

* Open Geodata Lightning Talk, Schuyler Erle, http://www.vimeo.com/1841244
* OpenStreetMap in India, Free Data in the Developing World , Schuyler Erle and Mikel Maron: http://www.slideshare.net/mikel_maron/freemapindia-2008-part-1, http://www.slideshare.net/mikel_maron/freemapindia-2008-part-2
* Rebuilding a City through Community Participation, Neogeography and GIS , Andrew Turner, http://www.slideshare.net/ajturner/rebuilding-a-city-through-community-participation-neogeography-and-gis-presentation

FOSS4G2008 Presentation Materials

2008-10-01T13:55:33Z

Wiki-Crschmidt:

Please link presentation materials from this wiki page when they are complete.

* OpenStreetMap in India, Free Data in the Developing World , Schuyler Erle and Mikel Maron: http://www.slideshare.net/mikel_maron/freemapindia-2008-part-1, http://www.slideshare.net/mikel_maron/freemapindia-2008-part-2
* Rebuilding a City through Community Participation, Neogeography and GIS , Andrew Turner, http://www.slideshare.net/ajturner/rebuilding-a-city-through-community-participation-neogeography-and-gis-presentation

FOSS4G2008 Presentation Materials

2008-10-01T13:54:21Z

Wiki-Crschmidt:

FOSS4G2008 Presentation Materials

2008-10-01T13:47:45Z

Wiki-Crschmidt:

Please link presentation materials from this wiki page when they are complete.

* OSM In India, Schuyler Erle and Mikel Maron: http://www.slideshare.net/mikel_maron/freemapindia-2008-part-1, http://www.slideshare.net/mikel_maron/freemapindia-2008-part-2

FOSS4G2008 Presentation Materials

2008-10-01T13:47:21Z

Wiki-Crschmidt:

Please link presentation materials from this wiki page when they are complete.

* OSM In India, Schuyler Erle and Mikel Maron: http://www.slideshare.net/mikel_maron/freemapindia-2008-part-1

FOSS4G2008 Presentation Materials

2008-10-01T13:43:50Z

Wiki-Crschmidt: New page: Please link presentation materials from this wiki page when they are complete.

Please link presentation materials from this wiki page when they are complete.

FOSS4G2008 Directory

2008-09-26T11:28:57Z

Wiki-Crschmidt:

Directory of where people are staying/contact information during the conference.

* Christopher Schmidt: Fountains Hotel, arrive Cape Town Sat, 4pm. [[User:Crschmidt|Crschmidt]] 07:28, 26 September 2008 (EDT)

FOSS4G2008 Directory

2008-09-26T11:28:49Z

Wiki-Crschmidt: New page: Directory of where people are staying/contact information during the conference. * Christopher Schmidt: Fountains Hotel, arrive Cape Town Sat, 4pm.

Directory of where people are staying/contact information during the conference.

* Christopher Schmidt: Fountains Hotel, arrive Cape Town Sat, 4pm.

Open Source GIS History

2008-08-23T22:51:41Z

Wiki-Crschmidt: /* Timeline */

== Software projects ==

In '''XX''' and '''XXI''' century, a series of other desktop and server Open Source GIS projects were started:
* geospatial libraries: [http://trac.osgeo.org/proj/ PROJ.4], [http://www.osgeo.org/geotools Geotools], Geoserver, TerraLib
* Desktop GIS: [http://grass.osgeo.org GRASS GIS], SAGA GIS, uDIG, [http://www.osgeo.org/gvsig gvSIG], ILWIS
* Web mapping/WebGIS: [http://www.osgeo.org/deegree deegree], [http://www.osgeo.org/mapserver UMN MapServer], [http://www.osgeo.org/mapguide MapGuide Open Source]
* geostatistics software: gstat, R Project for Statistical Computing
* metadata catalogs: [http://www.osgeo.org/geonetwork GeoNetwork Open Source]

=== Timeline ===

'''1978''' - Map Overlay and Statistical System (MOSS). A pioneer vector-based geographic information system (GIS) developed by the U.S. Department of Interior. MOSS is still available to download (ftp://ftp.blm.gov/pub/gis/). Mr. Carl Reed has written an article about [http://www.scribd.com/doc/4606038/2004-Article-by-Carl-Reed-MOSS-A-Historical-perspective MOSS history].

'''since 1982-today''' - [http://www.osgeo.org/grass GRASS] (Geographical Resources Analysis Support System) is the earliest Open Source GIS which reached production status and supported both raster and vector data. It was originally developed from 1982 to 1995 by the U.S. Army Corps of Engineers, since then by the international GRASS Development Team. Initially published as public domain software, its license was changed to GNU GPL (General Public License, see www.gnu.org) in 1999.

'''199?''' - [http://trac.osgeo.org/proj/ PROJ4 library] development started

'''1995''' - [http://www.osgeo.org/mapserver UMN MapServer] project started. In '''2002''' MapServer gets Python support.

'''1998''' - [http://www.osgeo.org/gdal_ogr GDAL/OGR] development started. Python support was added in '''2000'''.

'''1999''' - [http://grass.osgeo.org GRASS GIS] source code moved from manual management into CVS

'''2000''' - Atlantis Scientific launched [http://openev.sourceforge.net/ OpenEV] project

'''2000''' - [http://sourceforge.net/projects/jts-topo-suite/ JTS Topology Suite] project was initiated in Fall 2000. JTS 1.0 was released in February '''2002''' and version 1.1 in March '''2002'''.

'''2001''' - [http://www.osgeo.org/ossim OSSIM] initial revision in CVS

'''2001''' - [http://www.osgeo.org/mapbuilder MapBuilder] started. The end of life of MapBuilder project was officially [http://communitymapbuilder.org/display/MAP/EndOfLife announced] in '''28 July 2008'''

'''2001''' - [http://www.postgis.org PostGIS] started

'''2002''' - Intevation,Gmbh starts [http://thuban.intevation.org Thuban] projects

'''2002''' - [http://www.osgeo.org/qgis Quantum GIS] initial revision in CVS

'''2002''' - [http://geos.refractions.net/ GEOS] initial revision in CVS

'''2002''' - [http://avpython.sourceforge.net/ AVPython] for ArcView 3.x published as FOSS

'''2005''' - [http://www.osgeo.org/mapguide MapGuide Open Source]

'''2006''' - [http://www.osgeo.org/mapbender MapBender] gets first bits in CVS

'''2006''' - [http://www.osgeo.org/openlayers OpenLayers] started

'''2008''' - [http://grass.osgeo.org GRASS GIS] runs natively also on MS-Windows

== Organizations ==

'''1992:''' "Open GRASS Foundation" (OGF)

'''1994:''' OGF was re-structured as the Open Geospatial Consortium ([http://www.opengeospatial.org/ogc/historylong OGC])

'''2006:''' Open Source Geospatial Foundation (http://www.osgeo.org) established whose mission is to support and promote the collaborative development of open geospatial technologies, data and educational material.

== See also ==

* Kenn Gardel's OGC history: http://www.opengeospatial.org/ogc/historylong
* [[History|OSGeo Foundation History]]
* Software projects:
** GRASS GIS History: http://grass.osgeo.org/devel/grasshist.html
** PostGIS History: http://www.refractions.net/products/postgis/history/
** JTS / GEOS History: http://lin-ear-th-inking.blogspot.com/2007/06/history-of-jts-and-geos.html

[[Category: History]]

Licenses for Education Material

2008-06-09T18:59:56Z

Wiki-Crschmidt:

''Any material that furthers and promotes the development, dissemination and use of Free and Open Source Geospatial Software is welcome. ''

An interesting thread on Copyright and publishing traditions in OSGeo's [http://lists.osgeo.org/pipermail/discuss/2008-January/002923.html Mailing List] and [http://logs.qgis.org/osgeo/%23osgeo.2008-01-18.log IRC] has brought up several positions one of which is further discussed here. Please feel free to edit this page as it is not a final version but hopefully a good start only.

== Introduction ==
There are basically three different ways to go about this topic:
* Ignore it. This is what most people currently do. Depending on the author's surrounding legislation this can mean different things. In the US all material that is not explicitly copyrighted is considered to be copyrighted by the owner, with the typical copyright/IP protections. In German legislation all work of art is autmagically protected by an individual copyright (in the sense of the originator's rights "Urheberrecht") - only the commercial exploitation can be divested.
* Publish it under a Free and Open License. There are several licenses to choose from, the most common ones are probably the [[Creative Commons|CreativeCommons family]] and the [[GNU FDL]] license (find more details below).
* Publish it under a proprietary license. You are not a bad person if you do this but you will restrict the potential that lies within you work. If you can, please reconsider your licensing needs, the below arguments might help you find your individual position.

If you can choose to select a license yourself because you are the creator of the work or have the copyright please consider the following arguments when selecting an appropriate license. If you are not the copyright holder please do not publish any material here or anywhere else on OSGeo servers without written consent by the respective copyright owner!

== Types of Audiences ==
There are three distinct categories of people who *use* educational material:
* Experts
* Students
* Professionals

=== Experts ===
The real Experts are the hackers, nerds and freaks who in many cases are also developers. They will not pay for courses because they are too damn smart. They will not offer courses themselves (which would be detrimental to the business of the creator) because it would bore them to death. But they still profit from having access to material because it will speed up understanding the corresponding FOSSGIS project. This will make them choose this project one over another one because good developers are also lazy. This is good for the FOSSGIS project and community because those people listen to what those real experts have to say, recommend, etc. Hard to measure - but unquestionably there.

=== Students ===
They will not be able to pay high rates for individual courses, so that the Creator does not loose anything if they give the material away for free. Quite the contrary, when those students leave school and come into a position where they have to decide where to go they will probably remember. This is a long term strategy that has been pursued by all major market leaders.

Students can potentially also enhance educational material, keep it up to date, etc. But this can only happen if the material is available under a FOSS license

Locking away training material and treating it as "Intellectual Property" restricts potential for collaboration.

=== Professionals ===
The characteristics of Professionals are that they have budgets to solve problems in a limited time. They will not try to learn how to solve their problem on their own with freely available material because they have the resources to do it professionally and get somebody to explain it to them. They don't have the time to learn it by themselves. If they don't have the budget, then they are not really professional.

== Types of Beneficiaries ==
There are three distinct groups of people who *profit* from having course material released under an open and free license. These are:
* Audiences (~users, as categorized above)
* Creators (those who create the material)
* Trainers (those who make money by using and disseminating the material)
* FOSSGIS projects and communities that are in the focus of the training material

Audiences, beneficiaries, creators and the software projects are interconnected and depend on each other.

=== Creators ===
Creators have produced the educational material for some purpose. Frequently their source of income is to use it in training courses. In this case the Creator is also the Trainer. Creators produce material for target groups but Audiences can be broader than that (see above). Educational material that has been produced for focused, solution oriented, professional, commercial training courses can also be used in university seminars. Vice versa material produced in universities can be the foundation to build commercially oriented courses. The only precondition to either is that the license allows this.

=== Trainers ===
The main source of income for professional Trainers is to give courses. The more and the better material they have the more they will profit. Having access to freely available training material will make their job a lot easier. "Stealing" course material is much more difficult if not impossible if that same material is well known to the community and publicly available. If the license contains references to invariant sections (like the contributors' names, contact, log, etc.) then the Trainer will be obliged to give credit to whom credit is due.

=== FOSSGIS Collaboration ===
The Software Project will obviously also profit from good educational material and happily promote and disseminate it. In many cases it is the only way to give back to the project and follow up on the 2Ct. rule.

== Marketing and Promotion ==
The added value of releasing educational content under a free and open license are Marketing and Promotion. All three audiences know who created the course material and will memorize them as the experts on the topic. The [[GNU FDL]] license has a clause where invariant sections can be defined, typically this could be the front page and back cover, there you can find the authors, company logo and web site links or the creators' individual address, contacts. Link to the repository where the document is maintained, mailing list or whatever you want to advertise as important for this publication.

[[Category:Education]]
[[Category:Advocacy]]

TelaScience/NFS/Agami

2008-03-30T04:34:34Z

Wiki-Crschmidt: New page: This drive is 2.1GB, and is *fast*. Currently, it hosts tiles for a number of TileCache instances from HyperCube, as well as tiles for the OSM t@h project.

This drive is 2.1GB, and is *fast*.

Currently, it hosts tiles for a number of TileCache instances from HyperCube, as well as tiles for the OSM t@h project.

TelaScience

2008-03-30T04:33:58Z

Wiki-Crschmidt: /* Drives */

TelaScience is a lovely organization which helps us to gain large scale hosting for our non-mission critical tasks, as well as anything that requires a lot of hardware.

== Machines ==
* Blades : [[SAC_Service_Status#Telascience_Blades]]
* [[TelaScience/Machines/HyperCube]]

== Drives ==
* [[TelaScience/NFS/GeoThumper]]
* [[TelaScience/NFS/Agami]]

TelaScience

2008-03-30T04:33:28Z

Wiki-Crschmidt: lovely organization

TelaScience

2008-03-30T04:28:18Z

Wiki-Crschmidt:

TelaScience is an organization which helps us to gain large scale hosting for our non-mission critical tasks, as well as anything that requires a lot of hardware.

== Machines ==
* Blades : [[SAC_Service_Status#Telascience_Blades]]
* [[TelaScience/Machines/HyperCube]]

== Drives ==
* [[TelaScience/NFS/GeoThumper]]

TelaScience/NFS/GeoThumper

2008-03-30T04:27:02Z

Wiki-Crschmidt:

The GeoThumper is a Sun Fire X4500 with 17TB of disk attached.

Admin Contacts:
* John Graham (johng at telascience)
* Chris Schmidt (crschmidt@crschmidt.net)

== Remote Administration in case of Failure ==

Administrative functionality is available through the Integrated Lights Out Manager. http://docs.sun.com/source/819-4358-12/chap2-sw.html has instructions. Chris and John have access. It is available over ssh from the rockscluster machine. ~crschmidt/LOM has details on how to get there from rockscluster

Useful commands include:

* 'start /SP/console' -> starts a console
* 'reset /SYS' -> last resort, should reboot the machine

== Mounted From ==
* [[TelaScience/Machines/HyperCube]]
* [[TelaScience/Machines/HyperSphere]]

TelaScience/NFS/GeoThumper

2008-03-30T04:24:19Z

Wiki-Crschmidt: /* Remote Administration in case of Failure */

TelaScience/Machines/HyperCube

2008-03-30T04:19:32Z

Wiki-Crschmidt: /* Activity Log */

HyperCube (aka http://hypercube.telascience.org) is a debian etch machine, hosted at TelaScience, which is to be used for the Geodata repository and related tasks.

Currently, there is a second machine serving geodata related tasks: geodata.telascience.org, aka xblade11-2. Hopefully, we will be able to migrate from geodata to hypercube.

Any changes made to the machine -- software installed, changes to config files, etc. -- should be recorded here so that the machine is in a state which can be reproduced if it fails.

Data on HyperCube's local disk is not, at the moment, backed up or running under RAID. If your data is important, please keep a backup or keep it in SVN somewhere.

== Current Uses ==
* OpenAerialMap main server
** Tiles hosted on agami
** data hosted on optistor
* Landsat7 dataset serving
** data hosted on optistor
* OpenStreetMap "t@h" distributed tile rendering project

== Storage ==
/mnt/geodata is a 1.8T partition for geodata storage.
/mnt/agami is a 2.6T partition for geodata storage

HyperCube is connected to several different NFS mounts.

* Agami: [[TelaScience/NFS/Agami]]
* Geothumper: [[TelaScience/NFS/GeoThumper]]
* Optistor [[TelaScience/NFS/Optistor]]

== Activity Log ==

The activity log below is all very old.

* sudo apt-get install libwww-perl [[User:Crschmidt|Crschmidt]] 21:48, 7 April 2007 (CEST)
* sudo apt-get install libgdal-doc libgdal1-1.3.2 libgdal1-1.3.2-grass python-gdal gdal-bin , markusN MODIS processing [[User:Crschmidt|Crschmidt]] 21:07, 7 April 2007 (CEST)
* Created 'osgeo' group, added crschmidt, sderle, johng [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Created sderle user for Schuyler Erle [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Edited /etc/motd to reference this wiki page [[User:Crschmidt|Crschmidt]] 21:00, 7 April 2007 (CEST)
* Disabled apparently unnecessary services openbsd-inetd, cupsys, netatalk, winbind for security purposes [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Replaced exim4 with postfix [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Installed Debian build tools (build-essential, devscripts, etc.) [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GDAL 1.4.0 using D-GIS packaging files. Had to change libcurl4 dependency to libcurl3. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GRASS 6.2.1 (and gdal-grass 1.4.0) using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed Mapnik 0.4.0 from Debian Sid sources. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed MapServer 4.10.1 using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:58 CEST
* Rebuilt and installed libgeotiff 1.2.3 using D-GIS sources. See /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* apt-get install openmpi-* per request of HJG & NHV [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* Built and installed Debian package of TileCache from project SVN trunk revision 52. [[User:SchuylerErle|SchuylerErle]] 04:19, 8 Apr 2007 CEST
* Built and installed OSSIM from project SVN trunk [[User:Nhv|NormanVine]] Sat Apr 7 18:42:24 PDT 2007
** Installed to /usr/local
* Installed ossim_preferences in /usr/local/etc [[User:johng|HyperJohnGraham]] Sat Apr 7 18:58:24 PDT 2007
* Installed egm96.grd in /mnt/agami/elevation/geoids/geoid1996 [[User:johng|HyperJohnGraham]] Sat Apr 7 19:02:00 PDT 2007
* Add /tiles URL setup: points to TileCache. This will be true for all subdomains. To add tilecache layers, edit /etc/tilecache.cfg and restart Apache.
** TileCache caches to /mnt/agami/tilecache/
* Installed CGIAR SRTM V3 in /mnt/agami/elevation/cgiar_srtm_v3 [[User:johng|HyperJohnGraham]]
* After installing phppgadmin via apt: [[User:Crschmidt|Crschmidt]] 01:40, 9 April 2007 (CEST)
** Copy /etc/apache/conf.d/phppgadmin to /etc/apache2/sites-available/phppgadmin
** ln -s /etc/apache2/sites-available/phppgadmin /etc/apache2/sites-enabled/phppgadmin
** apt-get install php5-pg
** restart apache
* Installed bind9 in default local caching configuration. Changed /etc/resolv.conf to point to localhost. [[User:SchuylerErle|SchuylerErle]] 00:18 GMT 1 May 2007
* Added user account 'brandon' for Brandon Martin-Anderson, who I hope will be helping get TIGER into OSM. [[User:SchuylerErle|SchuylerErle]] Wed Jun 13 07:22:43 EDT 2007

[[Category:Public Geospatial Data Committee]]
[[Category: Infrastructure]]

TelaScience/Machines/HyperCube

2008-03-30T04:18:32Z

Wiki-Crschmidt:

HyperCube (aka http://hypercube.telascience.org) is a debian etch machine, hosted at TelaScience, which is to be used for the Geodata repository and related tasks.

Currently, there is a second machine serving geodata related tasks: geodata.telascience.org, aka xblade11-2. Hopefully, we will be able to migrate from geodata to hypercube.

Any changes made to the machine -- software installed, changes to config files, etc. -- should be recorded here so that the machine is in a state which can be reproduced if it fails.

Data on HyperCube's local disk is not, at the moment, backed up or running under RAID. If your data is important, please keep a backup or keep it in SVN somewhere.

== Current Uses ==
* OpenAerialMap main server
** Tiles hosted on agami
** data hosted on optistor
* Landsat7 dataset serving
** data hosted on optistor
* OpenStreetMap "t@h" distributed tile rendering project

== Storage ==
/mnt/geodata is a 1.8T partition for geodata storage.
/mnt/agami is a 2.6T partition for geodata storage

HyperCube is connected to several different NFS mounts.

* Agami: [[TelaScience/NFS/Agami]]
* Geothumper: [[TelaScience/NFS/GeoThumper]]
* Optistor [[TelaScience/NFS/Optistor]]

== Activity Log ==
* sudo apt-get install libwww-perl [[User:Crschmidt|Crschmidt]] 21:48, 7 April 2007 (CEST)
* sudo apt-get install libgdal-doc libgdal1-1.3.2 libgdal1-1.3.2-grass python-gdal gdal-bin , markusN MODIS processing [[User:Crschmidt|Crschmidt]] 21:07, 7 April 2007 (CEST)
* Created 'osgeo' group, added crschmidt, sderle, johng [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Created sderle user for Schuyler Erle [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Edited /etc/motd to reference this wiki page [[User:Crschmidt|Crschmidt]] 21:00, 7 April 2007 (CEST)
* Disabled apparently unnecessary services openbsd-inetd, cupsys, netatalk, winbind for security purposes [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Replaced exim4 with postfix [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Installed Debian build tools (build-essential, devscripts, etc.) [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GDAL 1.4.0 using D-GIS packaging files. Had to change libcurl4 dependency to libcurl3. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GRASS 6.2.1 (and gdal-grass 1.4.0) using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed Mapnik 0.4.0 from Debian Sid sources. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed MapServer 4.10.1 using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:58 CEST
* Rebuilt and installed libgeotiff 1.2.3 using D-GIS sources. See /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* apt-get install openmpi-* per request of HJG & NHV [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* Built and installed Debian package of TileCache from project SVN trunk revision 52. [[User:SchuylerErle|SchuylerErle]] 04:19, 8 Apr 2007 CEST
* Built and installed OSSIM from project SVN trunk [[User:Nhv|NormanVine]] Sat Apr 7 18:42:24 PDT 2007
** Installed to /usr/local
* Installed ossim_preferences in /usr/local/etc [[User:johng|HyperJohnGraham]] Sat Apr 7 18:58:24 PDT 2007
* Installed egm96.grd in /mnt/agami/elevation/geoids/geoid1996 [[User:johng|HyperJohnGraham]] Sat Apr 7 19:02:00 PDT 2007
* Add /tiles URL setup: points to TileCache. This will be true for all subdomains. To add tilecache layers, edit /etc/tilecache.cfg and restart Apache.
** TileCache caches to /mnt/agami/tilecache/
* Installed CGIAR SRTM V3 in /mnt/agami/elevation/cgiar_srtm_v3 [[User:johng|HyperJohnGraham]]
* After installing phppgadmin via apt: [[User:Crschmidt|Crschmidt]] 01:40, 9 April 2007 (CEST)
** Copy /etc/apache/conf.d/phppgadmin to /etc/apache2/sites-available/phppgadmin
** ln -s /etc/apache2/sites-available/phppgadmin /etc/apache2/sites-enabled/phppgadmin
** apt-get install php5-pg
** restart apache
* Installed bind9 in default local caching configuration. Changed /etc/resolv.conf to point to localhost. [[User:SchuylerErle|SchuylerErle]] 00:18 GMT 1 May 2007
* Added user account 'brandon' for Brandon Martin-Anderson, who I hope will be helping get TIGER into OSM. [[User:SchuylerErle|SchuylerErle]] Wed Jun 13 07:22:43 EDT 2007

[[Category:Public Geospatial Data Committee]]
[[Category: Infrastructure]]

TelaScience

2008-03-30T04:15:39Z

Wiki-Crschmidt: creating telascience page

TelaScience is an organization which helps us to gain large scale hosting for our non-mission critical tasks, as well as anything that requires a lot of hardware.

== Machines ==
* Blades
* [[TelaScience/Machines/HyperCube]]

== Drives ==
* [[TelaScience/NFS/GeoThumper]]

TelaScience/Machines/HyperCube

2008-03-30T04:14:31Z

Wiki-Crschmidt: /* Storage */

HyperCube (aka http://hypercube.telascience.org) is a debian etch machine, hosted at TelaScience, which is to be used for the Geodata repository and related tasks.

Currently, there is a second machine serving geodata related tasks: geodata.telascience.org, aka xblade11-2. Hopefully, we will be able to migrate from geodata to hypercube.

Any changes made to the machine -- software installed, changes to config files, etc. -- should be recorded here so that the machine is in a state which can be reproduced if it fails.

Data on HyperCube's local disk is not, at the moment, backed up or running under RAID. If your data is important, please keep a backup or keep it in SVN somewhere.

== Storage ==
/mnt/geodata is a 1.8T partition for geodata storage.
/mnt/agami is a 2.6T partition for geodata storage

HyperCube is connected to several different NFS mounts.

* Agami: [[TelaScience/NFS/Agami]]
* Geothumper: [[TelaScience/NFS/GeoThumper]]
* Optistor [[TelaScience/NFS/Optistor]]

== Activity Log ==
* sudo apt-get install libwww-perl [[User:Crschmidt|Crschmidt]] 21:48, 7 April 2007 (CEST)
* sudo apt-get install libgdal-doc libgdal1-1.3.2 libgdal1-1.3.2-grass python-gdal gdal-bin , markusN MODIS processing [[User:Crschmidt|Crschmidt]] 21:07, 7 April 2007 (CEST)
* Created 'osgeo' group, added crschmidt, sderle, johng [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Created sderle user for Schuyler Erle [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Edited /etc/motd to reference this wiki page [[User:Crschmidt|Crschmidt]] 21:00, 7 April 2007 (CEST)
* Disabled apparently unnecessary services openbsd-inetd, cupsys, netatalk, winbind for security purposes [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Replaced exim4 with postfix [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Installed Debian build tools (build-essential, devscripts, etc.) [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GDAL 1.4.0 using D-GIS packaging files. Had to change libcurl4 dependency to libcurl3. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GRASS 6.2.1 (and gdal-grass 1.4.0) using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed Mapnik 0.4.0 from Debian Sid sources. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed MapServer 4.10.1 using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:58 CEST
* Rebuilt and installed libgeotiff 1.2.3 using D-GIS sources. See /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* apt-get install openmpi-* per request of HJG & NHV [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* Built and installed Debian package of TileCache from project SVN trunk revision 52. [[User:SchuylerErle|SchuylerErle]] 04:19, 8 Apr 2007 CEST
* Built and installed OSSIM from project SVN trunk [[User:Nhv|NormanVine]] Sat Apr 7 18:42:24 PDT 2007
** Installed to /usr/local
* Installed ossim_preferences in /usr/local/etc [[User:johng|HyperJohnGraham]] Sat Apr 7 18:58:24 PDT 2007
* Installed egm96.grd in /mnt/agami/elevation/geoids/geoid1996 [[User:johng|HyperJohnGraham]] Sat Apr 7 19:02:00 PDT 2007
* Add /tiles URL setup: points to TileCache. This will be true for all subdomains. To add tilecache layers, edit /etc/tilecache.cfg and restart Apache.
** TileCache caches to /mnt/agami/tilecache/
* Installed CGIAR SRTM V3 in /mnt/agami/elevation/cgiar_srtm_v3 [[User:johng|HyperJohnGraham]]
* After installing phppgadmin via apt: [[User:Crschmidt|Crschmidt]] 01:40, 9 April 2007 (CEST)
** Copy /etc/apache/conf.d/phppgadmin to /etc/apache2/sites-available/phppgadmin
** ln -s /etc/apache2/sites-available/phppgadmin /etc/apache2/sites-enabled/phppgadmin
** apt-get install php5-pg
** restart apache
* Installed bind9 in default local caching configuration. Changed /etc/resolv.conf to point to localhost. [[User:SchuylerErle|SchuylerErle]] 00:18 GMT 1 May 2007
* Added user account 'brandon' for Brandon Martin-Anderson, who I hope will be helping get TIGER into OSM. [[User:SchuylerErle|SchuylerErle]] Wed Jun 13 07:22:43 EDT 2007

[[Category:Public Geospatial Data Committee]]
[[Category: Infrastructure]]

TelaScience/Machines/HyperCube

2008-03-30T04:13:56Z

Wiki-Crschmidt:

HyperCube (aka http://hypercube.telascience.org) is a debian etch machine, hosted at TelaScience, which is to be used for the Geodata repository and related tasks.

Currently, there is a second machine serving geodata related tasks: geodata.telascience.org, aka xblade11-2. Hopefully, we will be able to migrate from geodata to hypercube.

Any changes made to the machine -- software installed, changes to config files, etc. -- should be recorded here so that the machine is in a state which can be reproduced if it fails.

Data on HyperCube's local disk is not, at the moment, backed up or running under RAID. If your data is important, please keep a backup or keep it in SVN somewhere.

== Storage ==
/mnt/geodata is a 1.8T partition for geodata storage.
/mnt/agami is a 2.6T partition for geodata storage

HyperCube is connected to several different NFS mounts.

* Agami: [[Telascience/NFS/Agami]]
* Geothumper: [[Telascience/NFS/GeoThumper]]
* Optistor [[Telascience/NFS/Optistor]]

== Activity Log ==
* sudo apt-get install libwww-perl [[User:Crschmidt|Crschmidt]] 21:48, 7 April 2007 (CEST)
* sudo apt-get install libgdal-doc libgdal1-1.3.2 libgdal1-1.3.2-grass python-gdal gdal-bin , markusN MODIS processing [[User:Crschmidt|Crschmidt]] 21:07, 7 April 2007 (CEST)
* Created 'osgeo' group, added crschmidt, sderle, johng [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Created sderle user for Schuyler Erle [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Edited /etc/motd to reference this wiki page [[User:Crschmidt|Crschmidt]] 21:00, 7 April 2007 (CEST)
* Disabled apparently unnecessary services openbsd-inetd, cupsys, netatalk, winbind for security purposes [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Replaced exim4 with postfix [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Installed Debian build tools (build-essential, devscripts, etc.) [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GDAL 1.4.0 using D-GIS packaging files. Had to change libcurl4 dependency to libcurl3. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GRASS 6.2.1 (and gdal-grass 1.4.0) using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed Mapnik 0.4.0 from Debian Sid sources. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed MapServer 4.10.1 using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:58 CEST
* Rebuilt and installed libgeotiff 1.2.3 using D-GIS sources. See /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* apt-get install openmpi-* per request of HJG & NHV [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* Built and installed Debian package of TileCache from project SVN trunk revision 52. [[User:SchuylerErle|SchuylerErle]] 04:19, 8 Apr 2007 CEST
* Built and installed OSSIM from project SVN trunk [[User:Nhv|NormanVine]] Sat Apr 7 18:42:24 PDT 2007
** Installed to /usr/local
* Installed ossim_preferences in /usr/local/etc [[User:johng|HyperJohnGraham]] Sat Apr 7 18:58:24 PDT 2007
* Installed egm96.grd in /mnt/agami/elevation/geoids/geoid1996 [[User:johng|HyperJohnGraham]] Sat Apr 7 19:02:00 PDT 2007
* Add /tiles URL setup: points to TileCache. This will be true for all subdomains. To add tilecache layers, edit /etc/tilecache.cfg and restart Apache.
** TileCache caches to /mnt/agami/tilecache/
* Installed CGIAR SRTM V3 in /mnt/agami/elevation/cgiar_srtm_v3 [[User:johng|HyperJohnGraham]]
* After installing phppgadmin via apt: [[User:Crschmidt|Crschmidt]] 01:40, 9 April 2007 (CEST)
** Copy /etc/apache/conf.d/phppgadmin to /etc/apache2/sites-available/phppgadmin
** ln -s /etc/apache2/sites-available/phppgadmin /etc/apache2/sites-enabled/phppgadmin
** apt-get install php5-pg
** restart apache
* Installed bind9 in default local caching configuration. Changed /etc/resolv.conf to point to localhost. [[User:SchuylerErle|SchuylerErle]] 00:18 GMT 1 May 2007
* Added user account 'brandon' for Brandon Martin-Anderson, who I hope will be helping get TIGER into OSM. [[User:SchuylerErle|SchuylerErle]] Wed Jun 13 07:22:43 EDT 2007

[[Category:Public Geospatial Data Committee]]
[[Category: Infrastructure]]

Telascience/NFS/GeoThumper

2008-03-30T04:13:14Z

Wiki-Crschmidt: Telascience/NFS/GeoThumper moved to TelaScience/NFS/GeoThumper: mispelled telascience

#REDIRECT [[TelaScience/NFS/GeoThumper]]

TelaScience/NFS/GeoThumper

2008-03-30T04:13:14Z

Wiki-Crschmidt: Telascience/NFS/GeoThumper moved to TelaScience/NFS/GeoThumper: mispelled telascience

The GeoThumper is a Sun Fire X4500 with 17TB of disk attached.

Admin Contacts:
* John Graham (johng at telascience)
* Chris Schmidt (crschmidt@crschmidt.net)

== Remote Administration in case of Failure ==

Administrative functionality is available through the Integrated Lights Out Manager. http://docs.sun.com/source/819-4358-12/chap2-sw.html has instructions. Chris and John have access. It is available over ssh from the rockscluster machine.

Useful commands include:

* 'start /SP/console' -> starts a console
* 'reset /SYS' -> last resort, should reboot the machine

Telascience/Machines/HyperCube

2008-03-30T04:12:48Z

Wiki-Crschmidt: Telascience/Machines/HyperCube moved to TelaScience/Machines/HyperCube: mispelled TelaScience

#REDIRECT [[TelaScience/Machines/HyperCube]]

TelaScience/Machines/HyperCube

2008-03-30T04:12:48Z

Wiki-Crschmidt: Telascience/Machines/HyperCube moved to TelaScience/Machines/HyperCube: mispelled TelaScience

HyperCube (aka http://hypercube.telascience.org) is a debian etch machine, hosted at TelaScience, which is to be used for the Geodata repository and related tasks.

Currently, there is a second machine serving geodata related tasks: geodata.telascience.org, aka xblade11-2. Hopefully, we will be able to migrate from geodata to hypercube.

Any changes made to the machine -- software installed, changes to config files, etc. -- should be recorded here so that the machine is in a state which can be reproduced if it fails.

Data on HyperCube's local disk is not, at the moment, backed up or running under RAID. If your data is important, please keep a backup or keep it in SVN somewhere.

== Storage ==
/mnt/geodata is a 1.8T partition for geodata storage.
/mnt/agami is a 2.6T partition for geodata storage

== Activity Log ==
* sudo apt-get install libwww-perl [[User:Crschmidt|Crschmidt]] 21:48, 7 April 2007 (CEST)
* sudo apt-get install libgdal-doc libgdal1-1.3.2 libgdal1-1.3.2-grass python-gdal gdal-bin , markusN MODIS processing [[User:Crschmidt|Crschmidt]] 21:07, 7 April 2007 (CEST)
* Created 'osgeo' group, added crschmidt, sderle, johng [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Created sderle user for Schuyler Erle [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Edited /etc/motd to reference this wiki page [[User:Crschmidt|Crschmidt]] 21:00, 7 April 2007 (CEST)
* Disabled apparently unnecessary services openbsd-inetd, cupsys, netatalk, winbind for security purposes [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Replaced exim4 with postfix [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Installed Debian build tools (build-essential, devscripts, etc.) [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GDAL 1.4.0 using D-GIS packaging files. Had to change libcurl4 dependency to libcurl3. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GRASS 6.2.1 (and gdal-grass 1.4.0) using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed Mapnik 0.4.0 from Debian Sid sources. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed MapServer 4.10.1 using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:58 CEST
* Rebuilt and installed libgeotiff 1.2.3 using D-GIS sources. See /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* apt-get install openmpi-* per request of HJG & NHV [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* Built and installed Debian package of TileCache from project SVN trunk revision 52. [[User:SchuylerErle|SchuylerErle]] 04:19, 8 Apr 2007 CEST
* Built and installed OSSIM from project SVN trunk [[User:Nhv|NormanVine]] Sat Apr 7 18:42:24 PDT 2007
** Installed to /usr/local
* Installed ossim_preferences in /usr/local/etc [[User:johng|HyperJohnGraham]] Sat Apr 7 18:58:24 PDT 2007
* Installed egm96.grd in /mnt/agami/elevation/geoids/geoid1996 [[User:johng|HyperJohnGraham]] Sat Apr 7 19:02:00 PDT 2007
* Add /tiles URL setup: points to TileCache. This will be true for all subdomains. To add tilecache layers, edit /etc/tilecache.cfg and restart Apache.
** TileCache caches to /mnt/agami/tilecache/
* Installed CGIAR SRTM V3 in /mnt/agami/elevation/cgiar_srtm_v3 [[User:johng|HyperJohnGraham]]
* After installing phppgadmin via apt: [[User:Crschmidt|Crschmidt]] 01:40, 9 April 2007 (CEST)
** Copy /etc/apache/conf.d/phppgadmin to /etc/apache2/sites-available/phppgadmin
** ln -s /etc/apache2/sites-available/phppgadmin /etc/apache2/sites-enabled/phppgadmin
** apt-get install php5-pg
** restart apache
* Installed bind9 in default local caching configuration. Changed /etc/resolv.conf to point to localhost. [[User:SchuylerErle|SchuylerErle]] 00:18 GMT 1 May 2007
* Added user account 'brandon' for Brandon Martin-Anderson, who I hope will be helping get TIGER into OSM. [[User:SchuylerErle|SchuylerErle]] Wed Jun 13 07:22:43 EDT 2007

[[Category:Public Geospatial Data Committee]]
[[Category: Infrastructure]]

HyperCube

2008-03-30T04:12:02Z

Wiki-Crschmidt: HyperCube moved to Telascience/Machines/HyperCube: Namespacing telascience stuff

#REDIRECT [[Telascience/Machines/HyperCube]]

TelaScience/Machines/HyperCube

2008-03-30T04:12:02Z

Wiki-Crschmidt: HyperCube moved to Telascience/Machines/HyperCube: Namespacing telascience stuff

HyperCube (aka http://hypercube.telascience.org) is a debian etch machine, hosted at TelaScience, which is to be used for the Geodata repository and related tasks.

Currently, there is a second machine serving geodata related tasks: geodata.telascience.org, aka xblade11-2. Hopefully, we will be able to migrate from geodata to hypercube.

Any changes made to the machine -- software installed, changes to config files, etc. -- should be recorded here so that the machine is in a state which can be reproduced if it fails.

Data on HyperCube's local disk is not, at the moment, backed up or running under RAID. If your data is important, please keep a backup or keep it in SVN somewhere.

== Storage ==
/mnt/geodata is a 1.8T partition for geodata storage.
/mnt/agami is a 2.6T partition for geodata storage

== Activity Log ==
* sudo apt-get install libwww-perl [[User:Crschmidt|Crschmidt]] 21:48, 7 April 2007 (CEST)
* sudo apt-get install libgdal-doc libgdal1-1.3.2 libgdal1-1.3.2-grass python-gdal gdal-bin , markusN MODIS processing [[User:Crschmidt|Crschmidt]] 21:07, 7 April 2007 (CEST)
* Created 'osgeo' group, added crschmidt, sderle, johng [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Created sderle user for Schuyler Erle [[User:Crschmidt|Crschmidt]] 21:03, 7 April 2007 (CEST)
* Edited /etc/motd to reference this wiki page [[User:Crschmidt|Crschmidt]] 21:00, 7 April 2007 (CEST)
* Disabled apparently unnecessary services openbsd-inetd, cupsys, netatalk, winbind for security purposes [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Replaced exim4 with postfix [[User:SchuylerErle|SchuylerErle]] 21:14 CEST
* Installed Debian build tools (build-essential, devscripts, etc.) [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GDAL 1.4.0 using D-GIS packaging files. Had to change libcurl4 dependency to libcurl3. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 21:57 CEST
* Rebuilt and installed GRASS 6.2.1 (and gdal-grass 1.4.0) using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed Mapnik 0.4.0 from Debian Sid sources. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:27 CEST
* Rebuilt and installed MapServer 4.10.1 using D-GIS packaging files. Source packages can be found in /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 22:58 CEST
* Rebuilt and installed libgeotiff 1.2.3 using D-GIS sources. See /usr/local/src. [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* apt-get install openmpi-* per request of HJG & NHV [[User:SchuylerErle|SchuylerErle]] 03:56, 8 Apr 2007 CEST
* Built and installed Debian package of TileCache from project SVN trunk revision 52. [[User:SchuylerErle|SchuylerErle]] 04:19, 8 Apr 2007 CEST
* Built and installed OSSIM from project SVN trunk [[User:Nhv|NormanVine]] Sat Apr 7 18:42:24 PDT 2007
** Installed to /usr/local
* Installed ossim_preferences in /usr/local/etc [[User:johng|HyperJohnGraham]] Sat Apr 7 18:58:24 PDT 2007
* Installed egm96.grd in /mnt/agami/elevation/geoids/geoid1996 [[User:johng|HyperJohnGraham]] Sat Apr 7 19:02:00 PDT 2007
* Add /tiles URL setup: points to TileCache. This will be true for all subdomains. To add tilecache layers, edit /etc/tilecache.cfg and restart Apache.
** TileCache caches to /mnt/agami/tilecache/
* Installed CGIAR SRTM V3 in /mnt/agami/elevation/cgiar_srtm_v3 [[User:johng|HyperJohnGraham]]
* After installing phppgadmin via apt: [[User:Crschmidt|Crschmidt]] 01:40, 9 April 2007 (CEST)
** Copy /etc/apache/conf.d/phppgadmin to /etc/apache2/sites-available/phppgadmin
** ln -s /etc/apache2/sites-available/phppgadmin /etc/apache2/sites-enabled/phppgadmin
** apt-get install php5-pg
** restart apache
* Installed bind9 in default local caching configuration. Changed /etc/resolv.conf to point to localhost. [[User:SchuylerErle|SchuylerErle]] 00:18 GMT 1 May 2007
* Added user account 'brandon' for Brandon Martin-Anderson, who I hope will be helping get TIGER into OSM. [[User:SchuylerErle|SchuylerErle]] Wed Jun 13 07:22:43 EDT 2007

[[Category:Public Geospatial Data Committee]]
[[Category: Infrastructure]]

TelaScience/NFS/GeoThumper

2008-03-30T04:11:23Z

Wiki-Crschmidt:

The GeoThumper is a Sun Fire X4500 with 17TB of disk attached.

Admin Contacts:
* John Graham (johng at telascience)
* Chris Schmidt (crschmidt@crschmidt.net)

== Remote Administration in case of Failure ==

Administrative functionality is available through the Integrated Lights Out Manager. http://docs.sun.com/source/819-4358-12/chap2-sw.html has instructions. Chris and John have access. It is available over ssh from the rockscluster machine.

Useful commands include:

* 'start /SP/console' -> starts a console
* 'reset /SYS' -> last resort, should reboot the machine

TelaScience/NFS/GeoThumper

2008-03-30T04:07:38Z

Wiki-Crschmidt: New page: The GeoThumper is a Sun Fire X4500 with 17TB of disk attached. Admin Contacts: * John Graham (johng at telascience) * Chris Schmidt (crschmidt@crschmidt.net) == Remote Administration in ...

The GeoThumper is a Sun Fire X4500 with 17TB of disk attached.

Admin Contacts:
* John Graham (johng at telascience)
* Chris Schmidt (crschmidt@crschmidt.net)

== Remote Administration in case of Failure ==

Administrative functionality is available through the Integrated Lights Out Manager. http://docs.sun.com/source/819-4358-12/chap2-sw.html has instructions. Chris and John have access. It is available over ssh from rockscluster.telascience.org.

Useful commands include:

* 'start /SP/console' -> starts a console
* 'reset /SYS' -> last resort, should reboot the machine