OSGeo - User contributions [en]

SAC:Gitea

2025-11-20T13:39:22Z

Strk: /* Administration */

Gitea is an instance of the [https://gitea.io/ Go Git Service] that runs on [[TracSVN]] as part of the [[SAC:Git Service|OSGeo Git Services]].

It can be accessed via https://gitea.osgeo.org/ (login with your [[SAC:LDAP|OSGeo Userid]])

Until September 2025 it was accessible also as https://git.osgeo.org/gitea/ - it should still be for backward compatibility

= Files location and configuration =

It is installed in <code>/home/git/gitea</code>.
Its configuration is in the ''custom/'' subdir and controlled via ansible.

Repositories are in <code>/home/git/gitea-repositories</code> and all files are created as readable for any user in the ''git'' group.
Apache running user (''www-data'') is made part of the group to allow for browsing ''gitea-managed'' repositories via existing [[Trac_Instances|trac instances]].

Attachment and session data are in <code>/home/git/gitea/data</code>.

It is configured to use [[SAC:LDAP|LDAP]] for authentication and ''PostgreSQL'' as the backend, see the configuration for access parameters.

Backups are currently automated for the database and data directory via scripts in <code>/osgeo/backup/</code> (start from <code>/osgeo/backup/bacula_before.sh</code>). No repositories are backed up (what's a distributed code version control system worth otherwise?:). Refer to [[SAC:Backups]] for other backup info.

It listens on IP <code>127.0.0.1</code> and TCP port <code>3001</code> via HTTP. Apache is configured to deal with HTTPS and act as a proxy.
See [[TracSVN]] for info about the apache configuration.

Gitea is built to be composed by a single binary.
See https://gitea.io/ for more info.

= Administration =

At the moment [[User:Strk|Sandro Santilli]] (promoter of the initiative) and Martin Spott have admin privileges from the web UI.
[[User:Robe|Regina Obe]] and [[Jeff McKenna]] are willing to help.

Server configuration is done via https://gitea.osgeo.org/sac/ansible-deployment
(requires login and authorization to see)

As of 2025 we're debating whether to switch to [[Forgejo]] instead

== Starting and stopping the service ==

The service is managed via systemctl:

- systemctl start gitea
- systemctl stop gitea
- systemctl restart gitea

= Continuous integration =

A CI server is associated to the hosting service,
see [[Dronie]] and [[Woodie]]

[[Category:Infrastructure]]
[[Category:Services]]

SAC:Gitea

2025-11-20T13:37:40Z

Strk:

Gitea is an instance of the [https://gitea.io/ Go Git Service] that runs on [[TracSVN]] as part of the [[SAC:Git Service|OSGeo Git Services]].

It can be accessed via https://gitea.osgeo.org/ (login with your [[SAC:LDAP|OSGeo Userid]])

Until September 2025 it was accessible also as https://git.osgeo.org/gitea/ - it should still be for backward compatibility

= Files location and configuration =

It is installed in <code>/home/git/gitea</code>.
Its configuration is in the ''custom/'' subdir and controlled via ansible.

Repositories are in <code>/home/git/gitea-repositories</code> and all files are created as readable for any user in the ''git'' group.
Apache running user (''www-data'') is made part of the group to allow for browsing ''gitea-managed'' repositories via existing [[Trac_Instances|trac instances]].

Attachment and session data are in <code>/home/git/gitea/data</code>.

It is configured to use [[SAC:LDAP|LDAP]] for authentication and ''PostgreSQL'' as the backend, see the configuration for access parameters.

Backups are currently automated for the database and data directory via scripts in <code>/osgeo/backup/</code> (start from <code>/osgeo/backup/bacula_before.sh</code>). No repositories are backed up (what's a distributed code version control system worth otherwise?:). Refer to [[SAC:Backups]] for other backup info.

It listens on IP <code>127.0.0.1</code> and TCP port <code>3001</code> via HTTP. Apache is configured to deal with HTTPS and act as a proxy.
See [[TracSVN]] for info about the apache configuration.

Gitea is built to be composed by a single binary.
See https://gitea.io/ for more info.

= Administration =

At the moment [[User:Strk|Sandro Santilli]] (promoter of the initiative) and Martin Spott have admin privileges from the web UI.
[[User:Robe|Regina Obe]] and [[Jeff McKenna]] are willing to help.

Server configuration is done via https://gitea.osgeo.org/sac/ansible-deployment
(requires login and authorization to see)

== Starting and stopping the service ==

The service is managed via systemctl:

- systemctl start gitea
- systemctl stop gitea
- systemctl restart gitea

= Continuous integration =

A CI server is associated to the hosting service,
see [[Dronie]] and [[Woodie]]

[[Category:Infrastructure]]
[[Category:Services]]

Forgejo

2025-11-20T13:37:13Z

Strk:

Forgejo was [https://forgejo.org/2022-12-15-hello-forgejo/ created] in October 2022 after a for profit company took over the [[SAC:Gitea|Gitea]] project. It exists under the umbrella of a non-profit organization, Codeberg e.V. and is developed in the interest of the general public.

Comparison with Gitea, as seen by Forgejo: https://forgejo.org/compare-to-gitea/

As of 2025 SAC is [https://trac.osgeo.org/osgeo/ticket/3414 debating] whether we should switch the [[SAC:Git Service|OSGeo Git Services]] over.

Forgejo

2025-11-20T13:35:30Z

Strk: Created page with "Forgejo was [https://forgejo.org/2022-12-15-hello-forgejo/ created] in October 2022 after a for profit company took over the Gitea project. It exists under the umbrella of..."

Forgejo was [https://forgejo.org/2022-12-15-hello-forgejo/ created] in October 2022 after a for profit company took over the [[Gitea]] project. It exists under the umbrella of a non-profit organization, Codeberg e.V. and is developed in the interest of the general public.

Comparison with Gitea, as seen by Forgejo: https://forgejo.org/compare-to-gitea/

As of 2025 SAC is [https://trac.osgeo.org/osgeo/ticket/3414 debating] whether we should switch the [[OSGeo Git Service]] over.

Peertube

2025-10-21T20:16:38Z

Strk:

Peertube is a P2P video streaming web based service.
See https://en.wikipedia.org/wiki/PeerTube

We host an experimental peertube instance on https://video.osgeo.org

Internal details on how the peertube instance is configured are in:
https://gitea.osgeo.org/sac/osgeo3/wiki/peertube-container---moved-to-osgeo9 (private)

= Administration =

Peertube is installed from the git repository to /var/www/peertube, following instructions written in https://docs.joinpeertube.org/install-any-os?id=installation

Version and more info can be seen on https://video.osgeo.org/about/instance

= Using Peertube =

See https://docs.joinpeertube.org/use-third-party-application

[[Category:Infrastructure]]
[[Category:Services]]

Peertube

2025-10-21T19:58:36Z

Strk:

Peertube is a P2P video streaming web based service.
See https://en.wikipedia.org/wiki/PeerTube

We host an experimental peertube instance on https://video.osgeo.org

Internal details on how the peertube instance is configured are in:
https://gitea.osgeo.org/sac/osgeo3/wiki/peertube-container---moved-to-osgeo9 (private)

= Administration =

Peertube is installed from the git repository to /var/www/peertube, following instructions written in https://docs.joinpeertube.org/install-any-os?id=installation

= Using Peertube =

See https://docs.joinpeertube.org/use-third-party-application

[[Category:Infrastructure]]
[[Category:Services]]

Peertube

2025-10-21T19:56:19Z

Strk:

Mail server

2025-10-02T17:39:55Z

Strk: /* SSL certificates */

Mail server

2025-10-02T17:38:06Z

Strk: /* MySQL server */

Mail server

2025-10-02T17:37:22Z

Strk: /* Websites */

Mail server

2025-10-02T17:36:33Z

Strk: /* Websites */

Mail server

2025-10-02T17:34:58Z

Strk: Undo revision 134553 by Strk (talk)

Mail server

2025-10-02T17:34:18Z

Strk: Reverted edits by Strk (talk) to last revision by Jmckenna

'''Osgeo6''' is a Debian 10 machine administered by [[SAC]], hosted on [[SAC_Service_Status#Servers_at_OSL|OSU OSL servers]] since August 2015 (see also [[Infrastructure Transition Plan 2014#Hardware|Hardware plan 2014]]).

It hosts several '''critical resources''', projects web sites mail-transport and -lists, it is the successor of the [[ProjectsVM]] and the [[MailVM]] (this machine runs NO VMs instead).

The host is reachable by ssh at '''osgeo6.osgeo.osuosl.org'''.

= Shell access =

Anyone in the https://www.osgeo.org/cgi-bin/auth/ldap_shell.py has ssh access, and anyone in this group can add new people via the link. Sudo access can be provided by existing sudoer's by adding folks to the sudoers group in /etc/group, though it is normal practice to try and only extend sudo access to one user per project.

It is a shared environment and it is important that folks making changes on the system be aware of the impact they might have on other hosted services. Apache changes should be made carefully and needfully. Think about '''security'''!

See [[SAC#Communication]] in case of troubles or quick questions

= Services hosted on osgeo6 =

== Websites ==

All websites are served by Apache

{| border="1" class="wikitable"
|-
! site
! path
! contact
! [[SAC:Backups|backup]]
! comments
|-
| <del>old.grass.osgeo.org</del> (grass.osgeo.org moved to osgeo7 grass container)
| /var/www/grass/grass-cms
| admined by [[User:Neteler]], martinL
| BackupOg6 bacula job
| based on CMSMS; GRASS GIS infrastructure explained [https://trac.osgeo.org/grass/browser/grass/trunk/doc/infrastructure.txt here], also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=grass.osgeo.org&latest LetsEncrypt]
|-
| <del>old.grasswiki.osgeo.org</del> (grasswiki.osgeo.org moved to osgeo3 grass-wiki container)
| /var/www/grass/grass-wiki
| admined by [[User:Neteler]], martinL
| BackupOg6 bacula job
| own MediaWiki, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=grasswiki.osgeo.org&latest LetsEncrypt]
|-
| <del>www.featureserver.org</del>
| /var/www/featureserver/website
| admined by [[User:Warmerda]]
| BackupOg6 bacula job
| DEAD project. Not yet active, pending Python/GEOS issues
|-
| www.tilecache.org
| /var/www/tilecache/docs
| SAC !?
| BackupOg6 bacula job
|
|-
| <del>www.gdal.org</del> Now hosted on github (gdal.org) and redirect for www.gdal.org (redirected to https://gdal.org on osgeo7 nginx)
| /var/www/gdal/gdal-web/
| admined by [[User:Warmerda]]
| BackupOg6 bacula job
| CRON-job migrated as well, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=gdal.org&latest LetsEncrypt]
|-
|-
| <del>www.mapserver.org</del>
| /var/www/mapserver.org/
| admined by [[Jeff McKenna]]
| BackupOg6 bacula job
| moved to OSGeo7 on 2025-08-01 ([https://trac.osgeo.org/osgeo/ticket/3405 ticket])
|-
| <del>drone.osgeo.org</del> (this has been replaced by [[Dronie | dronie.osgeo.org]] which is on osgeo7)
| /var/www/drone.osgeo.org
| admined by [[User:Strk]]
| Continuous Integration for [[SAC:Gitea|Gitea]]
| reverse-proxy to [[#Drone service|Drone server]] server, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=drone.osgeo..org&latest LetsEncrypt]
|-
| https://lists.osgeo.org
| admin
| Web interface for managing Mailman
|
| also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=lists.osgeo.org&latest LetsEncypt]

|-
|}

== MySQL server ==
* <del>used for GRASS GIS Wiki (maintained by Martin Landa and Markus Neteler)</del>
<del>* used for GRASS CMS and GRASS Wiki ? </devl> now on grass on osgeo7 and grass-wiki on osgeo3
* backed up via [[SAC:Backups|bacula]] in BackupOg6 job (see /osgeo/backup)
* admin user credentials found in ~root/.my.cnf

== Postfix SMTP server ==

* Central OSGeo MX running Postfix (includes @osgeo.org aliases in /etc/aliases)
=== Setting up mail alias ===
# '''''edit''''' /etc/aliases
# git diff # and git commit (please set GIT_AUTHOR_NAME/GIT_AUTHOR_EMAIL envs)
# newaliases
# postfix reload

== Mailman ==

* [[SAC:Mailing Lists]] - mailman configuration for lists.osgeo.org.

== Mailman subscriber statistics ==
* monthly cronjob "OSGeo mailman server unique subscribers", run as root user with scripts in /home/neteler/osgeo_mailman_stats/*.sh (operated by [[User:Neteler|M. Neteler]])

== PostgreSQL server ==
OBSOLETE removed.
As of April 2017 PostgreSQL 9.6 is installed from pgdg packages and a new cluster was added
to host the database for the Drone service (in progress)

== Drone service ==

See [[SAC::Drone]] No longer hosted on this

= SSL certificates =

* LetsEncrypt was configured by [[Jeff McKenna]] on 2018-07-27 for mapserver.org, gdal.org, grass.osgeo.org, grasswiki.osgeo.org, drone.osgeo.org, and lists.osgeo.org using certbot-auto
** careful: check the conf files in /etc/apache2/sites-enabled/ to make sure that the VirtualHost settings do not include something like ''<VirtualHost _default_:443>'' and instead should point to the IP such as ''<VirtualHost 140.211.15.3:443>'' or else the certificate loaded will always default to mapserver.org
** certbot-auto lives in /usr/local/sbin.
** to add more sites, run the command:<blockquote>certbot-auto --apache -d mapserver.org -d www.mapserver.org</blockquote>
** a cronjob (certbot-auto renew) was created to check for renewal twice a day
** also enabled for geos.osgeo.org on by [[Jeff McKenna]] on 2018-10-01

= Backup strategy =

As of Feb 2017 backup is performed by bacula, with the BackupOg6 job,
which includes the whole /var/www, /etc, /osgeo, /var/lib/mysql and more
files (see [[SAC:Backups]] for info about figuring out more).

A dump of each mysql database is also stored as a separate file under /osgeo
(created during the backup phase).

= Hardware =

Details:
CPU: 2 x Intel Xeon E5-2620v3, 2.4 GHz (6-Core, HT, 15MB Cache, 85W) 22nm
RAM: 128GB (8 x 16GB DDR4-2133 ECC Registered 2R 1.2V DIMMs) Operating at 2133 MT/s Max
NIC: Dual Intel i210 Gigabit Ethernet Controllers - Integrated
Management: Integrated IPMI 2.0 & KVM over LAN
Controller: 10 Ports 6Gb/s SATA (Intel C612 Chipset)
PCIe 3.0 x8: No Item Selected
NOTE: Hot-swap and fixed drives will be connected to SATA3 controller (C612) unless otherwise specified
Hot-Swap Drive - 1: 80GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 2: 80GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 3: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 4: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 5: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 6: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Optical Drive: No Item Selected

3 year warranty starting on May 4,2015 ending on May 4,2018

[[Category:Infrastructure]]

Mail server

2025-10-02T17:33:58Z

Strk: /* Websites */

Mail server

2025-10-02T17:33:02Z

Strk:

The production mail server is a Debian 10 LXD container administered by [[SAC]], hosted on [[osgeo9]].

See [[SAC#Communication]] in case of troubles or quick questions

= Services hosted on the mail container =

== Postfix SMTP server ==

Handles [[SAC:Message Submission Agent|outgoing]] and [[SAC:Message Transport Agent|incoming]] email

== Mailman ==

* [[SAC:Mailing Lists]] - mailman configuration for lists.osgeo.org.

== Websites ==

All websites are served by Apache

'''TODO''': review

{| border="1" class="wikitable"
|-
! site
! path
! contact
! [[SAC:Backups|backup]]
! comments
|-
| <del>old.grass.osgeo.org</del> (grass.osgeo.org moved to osgeo7 grass container)
| /var/www/grass/grass-cms
| admined by [[User:Neteler]], martinL
| BackupOg6 bacula job
| based on CMSMS; GRASS GIS infrastructure explained [https://trac.osgeo.org/grass/browser/grass/trunk/doc/infrastructure.txt here], also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=grass.osgeo.org&latest LetsEncrypt]
|-
| <del>old.grasswiki.osgeo.org</del> (grasswiki.osgeo.org moved to osgeo3 grass-wiki container)
| /var/www/grass/grass-wiki
| admined by [[User:Neteler]], martinL
| BackupOg6 bacula job
| own MediaWiki, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=grasswiki.osgeo.org&latest LetsEncrypt]
|-
| <del>www.featureserver.org</del>
| /var/www/featureserver/website
| admined by [[User:Warmerda]]
| BackupOg6 bacula job
| DEAD project. Not yet active, pending Python/GEOS issues
|-
| www.tilecache.org
| /var/www/tilecache/docs
| SAC !?
| BackupOg6 bacula job
|
|-
| <del>www.gdal.org</del> Now hosted on github (gdal.org) and redirect for www.gdal.org (redirected to https://gdal.org on osgeo7 nginx)
| /var/www/gdal/gdal-web/
| admined by [[User:Warmerda]]
| BackupOg6 bacula job
| CRON-job migrated as well, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=gdal.org&latest LetsEncrypt]
|-
|-
| <del>www.mapserver.org</del>
| /var/www/mapserver.org/
| admined by [[Jeff McKenna]]
| BackupOg6 bacula job
| moved to OSGeo7 on 2025-08-01 ([https://trac.osgeo.org/osgeo/ticket/3405 ticket])
|-
| <del>drone.osgeo.org</del> (this has been replaced by [[Dronie | dronie.osgeo.org]] which is on osgeo7)
| /var/www/drone.osgeo.org
| admined by [[User:Strk]]
| Continuous Integration for [[SAC:Gitea|Gitea]]
| reverse-proxy to [[#Drone service|Drone server]] server, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=drone.osgeo..org&latest LetsEncrypt]
|-
| https://lists.osgeo.org
| admin
| Web interface for managing Mailman
|
| also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=lists.osgeo.org&latest LetsEncypt]

|-
|}

== MySQL server ==

'''TODO''': review

* <del>used for GRASS GIS Wiki (maintained by Martin Landa and Markus Neteler)</del>
<del>* used for GRASS CMS and GRASS Wiki ? </devl> now on grass on osgeo7 and grass-wiki on osgeo3
* backed up via [[SAC:Backups|bacula]] in BackupOg6 job (see /osgeo/backup)
* admin user credentials found in ~root/.my.cnf

= SSL certificates =

* LetsEncrypt was configured by [[Jeff McKenna]] on 2018-07-27 for mapserver.org, gdal.org, grass.osgeo.org, grasswiki.osgeo.org, drone.osgeo.org, and lists.osgeo.org using certbot-auto
** careful: check the conf files in /etc/apache2/sites-enabled/ to make sure that the VirtualHost settings do not include something like ''<VirtualHost _default_:443>'' and instead should point to the IP such as ''<VirtualHost 140.211.15.3:443>'' or else the certificate loaded will always default to mapserver.org
** certbot-auto lives in /usr/local/sbin.
** to add more sites, run the command:<blockquote>certbot-auto --apache -d mapserver.org -d www.mapserver.org</blockquote>
** a cronjob (certbot-auto renew) was created to check for renewal twice a day
** also enabled for geos.osgeo.org on by [[Jeff McKenna]] on 2018-10-01

= Backup strategy =

See [[SAC:Backups]] for general info about backup strategies for containers.

A dump of each mysql database is also stored as a separate file under /osgeo
(created during the backup phase).

SAC Service Status

2025-10-02T17:31:53Z

Strk: /* mail */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

==== mail ====

Hosts: lists.osgeo.org, mail.osgeo.org and a few other services.
See [[Mail server]] for more details.

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

See [[osgeo6]]

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-10-02T17:31:31Z

Strk: /* osgeo6 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

==== mail ====

Hosts: lists.osgeo.org, mail.osgeo.org and a few other services
See [[Mail server]] for more details

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

See [[osgeo6]]

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-10-02T17:31:19Z

Strk: /* osgeo6 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

==== mail ====

Hosts: lists.osgeo.org, mail.osgeo.org and a few other services
See [[Mail server]] for more details

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

See [[OSGeo6]]

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

Osgeo6

2025-10-02T17:31:00Z

Strk: Removed redirect to Mail server

The host is reachable by ssh at '''osgeo6.osgeo.osuosl.org'''.

Used to be the [[Mail server]] but as of October 2025 it's to be reallocated to be an LXD host.

= Hardware =

Details:
CPU: 2 x Intel Xeon E5-2620v3, 2.4 GHz (6-Core, HT, 15MB Cache, 85W) 22nm
RAM: 128GB (8 x 16GB DDR4-2133 ECC Registered 2R 1.2V DIMMs) Operating at 2133 MT/s Max
NIC: Dual Intel i210 Gigabit Ethernet Controllers - Integrated
Management: Integrated IPMI 2.0 & KVM over LAN
Controller: 10 Ports 6Gb/s SATA (Intel C612 Chipset)
PCIe 3.0 x8: No Item Selected
NOTE: Hot-swap and fixed drives will be connected to SATA3 controller (C612) unless otherwise specified
Hot-Swap Drive - 1: 80GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 2: 80GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 3: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 4: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 5: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 6: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Optical Drive: No Item Selected

3 year warranty starting on May 4,2015 ending on May 4,2018

[[Category:Infrastructure]]

SAC Service Status

2025-10-02T17:29:30Z

Strk: /* osgeo6 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

==== mail ====

Hosts: lists.osgeo.org, mail.osgeo.org and a few other services
See [[Mail server]] for more details

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

Used to be the [[Mail server]] but as of October 2025 it's to be reallocated to be an LXD host.

The host is reachable by ssh at '''osgeo6.osgeo.osuosl.org'''.

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-10-02T17:26:00Z

Strk: /* osgeo6 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

==== mail ====

Hosts: lists.osgeo.org, mail.osgeo.org and a few other services
See [[Mail server]] for more details

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

Used to be the [[Mail server]] but as of October 2025 it's to be reallocated to be an LXD host

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-10-02T17:25:06Z

Strk: /* Services running on osgeo9 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

==== mail ====

Hosts: lists.osgeo.org, mail.osgeo.org and a few other services
See [[Mail server]] for more details

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

VisibilityStats

2025-10-02T09:47:55Z

Strk: /* Mailing list subscribers */

This page has some summary statistics about us.

= osgeo.org Web =

* OSGeo's main website (www.osgeo.org) has access stats available [http://www.osgeo.org/awstats/ here].
* 2015
** May: 30,582 unique visitors in the month
* 2014
** July: 32,181 unique visitors in the month
* 2013
** February: 28,793 unique visitors in the month
** January: 30,487 unique visitors in the month
* May 2006 (3rd month since launch) - from Daniel's mail
** registered users: 1223
** 192K hits
** 10K unique visitors

= download.osgeo.org =

* http://download.osgeo.org/stats/

= Gitea =

The [[SAC:Gitea]] service was setup in April 2016.

== March 2020 ==

The Gitea database holds:
- 192 users
- 25 organizations
- 186 repositories

= LDAP users (OSGeo Userid) =

Statistics about the [[SAC:LDAP]] service

== Number of registrations per year ==

- Users registered in 2019: 422
- Users registered in 2018: 464
- Users registered in 2017: 453 -- Mantra requirement added
- Users registered in 2016: 2121
- Users registered in 2015: 6670
- Users registered in 2014: 2595

== May 15 2020 ==

- Currently registered users: 22016

== September 2019 ==

- Currently registered users: 21744

20715+291+464+274

== April 2017 ==

- Currently registered users: 20715
- Unique registered emails: 19935 (780 duplicated email)

- Different mail domain used: 5201
- Mail domains used by a single user: 4374

- Different .gov mail domains: 48
- Users with .gov mail address: 114

- Different .edu mail domains: 194
- Users with .edu mail address: 287

- Users with username only composed by numbers: 254
- Top 20 most used mail domains (spammers most likely still hiding here):

users domain
----------------------
7195 gmail.com
949 yahoo.com
740 hotmail.com
234 googlemail.com
225 web.de
200 arcor.de
197 gmx.de
192 yahoo.de
189 t-online.de
183 bigstring.com
177 zoho.com
177 inbox.com
172 gawab.com
171 freenet.de
171 aol.com
133 gmx.net
104 autodesk.com
89 yahoo.fr
84 163.com
69 live.com

= Mailing list subscribers =

''Source: [[User:Neteler|M Neteler]]'s monthly cronjob:'' (see [[SAC:Mailing_Lists#List_Statistics]])
* OSGeo mailman server unique subscribers 2024_08_01: 34696
* OSGeo mailman server unique subscribers 2024_07_01: 34693
* OSGeo mailman server unique subscribers 2024_06_01: 34591
* OSGeo mailman server unique subscribers 2024_05_01: 34696
* OSGeo mailman server unique subscribers 2024_04_01: 34666
* OSGeo mailman server unique subscribers 2024_03_01: 34631
* OSGeo mailman server unique subscribers 2024_02_01: 34633
* OSGeo mailman server unique subscribers 2024_01_01: 34699
* OSGeo mailman server unique subscribers 2023_12_01: 34623
* OSGeo mailman server unique subscribers 2023_11_01: 34583
* OSGeo mailman server unique subscribers 2023_10_01: 36482
* OSGeo mailman server unique subscribers 2023_09_01: 36453
* OSGeo mailman server unique subscribers 2023_08_01: 36426
* OSGeo mailman server unique subscribers 2023_07_01: 36438
* OSGeo mailman server unique subscribers 2023_05_01: 36401
* OSGeo mailman server unique subscribers 2023_04_01: 36622
* OSGeo mailman server unique subscribers 2023_03_01: 36618
* OSGeo mailman server unique subscribers 2023_02_01: 36621
* OSGeo mailman server unique subscribers 2023_01_01: 36827
* OSGeo mailman server unique subscribers 2022_12_01: 36812
* OSGeo mailman server unique subscribers 2022_11_01: 36706
* OSGeo mailman server unique subscribers 2022_10_01: 36717
* OSGeo mailman server unique subscribers 2022_09_01: 36706
* OSGeo mailman server unique subscribers 2022_08_01: 36713
* OSGeo mailman server unique subscribers 2022_07_01: 36699
* OSGeo mailman server unique subscribers 2022_06_01: 36697
* OSGeo mailman server unique subscribers 2022_05_01: 36693
* OSGeo mailman server unique subscribers 2022_04_01: 36603
* OSGeo mailman server unique subscribers 2022_03_01: 36603
* OSGeo mailman server unique subscribers 2022_02_01: 36599
* OSGeo mailman server unique subscribers 2022_01_01: 36292
* OSGeo mailman server unique subscribers 2021_12_01: 36286
* OSGeo mailman server unique subscribers 2021_11_01: 36256
* OSGeo mailman server unique subscribers 2021_10_01: 36252
* OSGeo mailman server unique subscribers 2021_09_01: 36249
* OSGeo mailman server unique subscribers 2021_08_01: 36229
* OSGeo mailman server unique subscribers 2021_07_01: 36178
* OSGeo mailman server unique subscribers 2021_06_01: 36155
* OSGeo mailman server unique subscribers 2021_05_01: 36201
* OSGeo mailman server unique subscribers 2021_04_01: 36268
* OSGeo mailman server unique subscribers 2021_03_01: 36203
* OSGeo mailman server unique subscribers 2021_02_01: 36121
* OSGeo mailman server unique subscribers 2021_01_01: 36108
* OSGeo mailman server unique subscribers 2020_12_01: 36001
* OSGeo mailman server unique subscribers 2020_11_01: 35925
* OSGeo mailman server unique subscribers 2020_10_01: 35901
* OSGeo mailman server unique subscribers 2020_09_01: 35839
* OSGeo mailman server unique subscribers 2020_08_01: 35783
* OSGeo mailman server unique subscribers 2020_07_01: 35725
* OSGeo mailman server unique subscribers 2020_06_01: 35659
* OSGeo mailman server unique subscribers 2020_05_01: 35176
* OSGeo mailman server unique subscribers 2020_04_01: 34971
* OSGeo mailman server unique subscribers 2020_03_01: 34524
* OSGeo mailman server unique subscribers 2020_02_01: 34423
* OSGeo mailman server unique subscribers 2020_01_01: 34370
* OSGeo mailman server unique subscribers 2019_12_01: 34259
* OSGeo mailman server unique subscribers 2019_11_01: 34158
* OSGeo mailman server unique subscribers 2019_10_01: 33983
* OSGeo mailman server unique subscribers 2019_09_01: 33945
* OSGeo mailman server unique subscribers 2019_08_01: 33790
* OSGeo mailman server unique subscribers 2019_07_01: 33790
* OSGeo mailman server unique subscribers 2019_07_01: 33659
* OSGeo mailman server unique subscribers 2019_06_01: 33539
* OSGeo mailman server unique subscribers 2019_05_01: 33446
* OSGeo mailman server unique subscribers 2019_04_01: 33193
* OSGeo mailman server unique subscribers 2019_03_01: 33062
* OSGeo mailman server unique subscribers 2019_02_01: 32874
* OSGeo mailman server unique subscribers 2019_01_01: 32879
* OSGeo mailman server unique subscribers 2018_12_01: 33225
* OSGeo mailman server unique subscribers 2018_11_13: 31418
* OSGeo mailman server unique subscribers 2018_11_01: 31356
* OSGeo mailman server unique subscribers 2018_10_01: 31204
* OSGeo mailman server unique subscribers 2018_09_01: 31057
* OSGeo mailman server unique subscribers 2018_08_01: 30846
* OSGeo mailman server unique subscribers 2018_06_01: 30587
* OSGeo mailman server unique subscribers 2018_05_01: 30460
* OSGeo mailman server unique subscribers 2018_04_01: 30356
* OSGeo mailman server unique subscribers 2018_03_01: 30235
* OSGeo mailman server unique subscribers 2018_02_01: 30181
* OSGeo mailman server unique subscribers 2018_01_01: 30049
* OSGeo mailman server unique subscribers 2017_12_01: 30005
* OSGeo mailman server unique subscribers 2017_11_01: 29610
* OSGeo mailman server unique subscribers 2017_10_01: 29574
* OSGeo mailman server unique subscribers 2017_09_01: 29531
* OSGeo mailman server unique subscribers 2017_08_01: 29476
* OSGeo mailman server unique subscribers 2017_07_01: 29410
* OSGeo mailman server unique subscribers 2017_06_01: 28857
* OSGeo mailman server unique subscribers 2017_05_01: 28735
* OSGeo mailman server unique subscribers 2017_04_01: 28937
* OSGeo mailman server unique subscribers 2017_03_01: 28852
* OSGeo mailman server unique subscribers 2017_02_01: 28672
* OSGeo mailman server unique subscribers 2017_01_01: 28635
* OSGeo mailman server unique subscribers 2016_12_01: 28538
* OSGeo mailman server unique subscribers 2016_11_01: 28410
* OSGeo mailman server unique subscribers 2016_10_01: 28343
* OSGeo mailman server unique subscribers 2016_09_01: 28290
* OSGeo mailman server unique subscribers 2016_08_01: 28404
* OSGeo mailman server unique subscribers 2016_07_01: 28343
* OSGeo mailman server unique subscribers 2016_06_01: 28297
* OSGeo mailman server unique subscribers 2016_05_01: 28202
* OSGeo mailman server unique subscribers 2016_04_01: 27663
* OSGeo mailman server unique subscribers 2016_03_01: 27636
* OSGeo mailman server unique subscribers 2016_02_01: 27417
* OSGeo mailman server unique subscribers 2016_01_01: 27329
* OSGeo mailman server unique subscribers 2015_12_01: 27243
* OSGeo mailman server unique subscribers 2015_11_01: 27159
* OSGeo mailman server unique subscribers 2015_10_09: 27123
* OSGeo mailman server unique subscribers 2015_10_01: 27083
* OSGeo mailman server unique subscribers 2015_09_01: 26933
* OSGeo mailman server unique subscribers 2015_08_01: 26792
* OSGeo mailman server unique subscribers 2015_07_01: 26673
* OSGeo mailman server unique subscribers 2015_06_01: 26570
* OSGeo mailman server unique subscribers 2015_05_01: 26395
* OSGeo mailman server unique subscribers 2015_04_01: 26004
* OSGeo mailman server unique subscribers 2015_03_01: 25842
* OSGeo mailman server unique subscribers 2015_02_01: 25366
* OSGeo mailman server unique subscribers 2015_01_01: 25283
* OSGeo mailman server unique subscribers 2014_12_01: 25195
* OSGeo mailman server unique subscribers 2014_11_01: 25134
* OSGeo mailman server unique subscribers 2014_10_01: 24997
* OSGeo mailman server unique subscribers 2014_09_01: 24811
* OSGeo mailman server unique subscribers 2014_08_01: 24472
* OSGeo mailman server unique subscribers 2014_07_01: 24303
* OSGeo mailman server unique subscribers 2014_06_01: 24171
* OSGeo mailman server unique subscribers 2014_05_01: 24046
* OSGeo mailman server unique subscribers 2014_04_01: 23882
* OSGeo mailman server unique subscribers 2014_03_01: 23846
* OSGeo mailman server unique subscribers 2014_02_01: 23326
* OSGeo mailman server unique subscribers 2014_01_01: 23140
* OSGeo mailman server unique subscribers 2013_12_01: 22482
* OSGeo mailman server unique subscribers 2013_10_01: 22101
* OSGeo mailman server unique subscribers 2013_09_01: 22598
* OSGeo mailman server unique subscribers 2013_08_01: 22471
* OSGeo mailman server unique subscribers 2013_07_01: 22365
* OSGeo mailman server unique subscribers 2013_06_01: 22227
* OSGeo mailman server unique subscribers 2013_05_01: 21995
* OSGeo mailman server unique subscribers 2013_04_06: n/a
* OSGeo mailman server unique subscribers 2013_03_06: 19160
* OSGeo mailman server unique subscribers 2013_02_06: n/a
* OSGeo mailman server unique subscribers 2013_01_01: 19160
* OSGeo mailman server unique subscribers 2012_12_01: 19160
* OSGeo mailman server unique subscribers 2012_11_01: 19160
* OSGeo mailman server unique subscribers 2012_10_01: n/a
* OSGeo mailman server unique subscribers 2012_09_01: 19160
* OSGeo mailman server unique subscribers 2012_08_01: 19160
* OSGeo mailman server unique subscribers 2012_07_01: 19160
* OSGeo mailman server unique subscribers 2012_05_01: 18947
* OSGeo mailman server unique subscribers 2012_04_01: 18769
* OSGeo mailman server unique subscribers 2012_03_01: 18631
* OSGeo mailman server unique subscribers 2012_02_01: 18492
* OSGeo mailman server unique subscribers 2012_01_01: 18314
* OSGeo mailman server unique subscribers 2011_12_01: 18156
* OSGeo mailman server unique subscribers 2011_11_01: 18001
* OSGeo mailman server unique subscribers 2011_10_01: 17837
* OSGeo mailman server unique subscribers 2011_09_01: 17697
* OSGeo mailman server unique subscribers 2011_08_01: 17598
* OSGeo mailman server unique subscribers 2011_07_01: 17183
* OSGeo mailman server unique subscribers 2011_06_01: 16992
* OSGeo mailman server unique subscribers 2011_05_01: 16811
* OSGeo mailman server unique subscribers 2011_04_01: 16571
* OSGeo mailman server unique subscribers 2011_03_01: 16376
* OSGeo mailman server unique subscribers 2011_02_01: 15662
* OSGeo mailman server unique subscribers 2011_01_01: 15450
* OSGeo mailman server unique subscribers 2010_12_01: 15277
* OSGeo mailman server unique subscribers 2010_11_01: 15061
* OSGeo mailman server unique subscribers 2010_10_01: 14833
* OSGeo mailman server unique subscribers 2010_09_01: 14202
* OSGeo mailman server unique subscribers 2010_08_01: 14056
* OSGeo mailman server unique subscribers 2010_07_01: 13891
* OSGeo mailman server unique subscribers 2010_06_01: 13744
* OSGeo mailman server unique subscribers 2010_05_01: 13465
* OSGeo mailman server unique subscribers 2010_04_01: 13268
* OSGeo mailman server unique subscribers 2010_03_01: 12976
* OSGeo mailman server unique subscribers 2010_02_01: 12596
* OSGeo mailman server unique subscribers 2010_01_01: 12426
* OSGeo mailman server unique subscribers 2009_12_01: 12187
* OSGeo mailman server unique subscribers 2009_11_01: 11974
* OSGeo mailman server unique subscribers 2009_10_01: 11773
* OSGeo mailman server unique subscribers 2009_09_01: 11605
* OSGeo mailman server unique subscribers 2009_08_01: 11531
* OSGeo mailman server unique subscribers 2009_07_01: 11362
* OSGeo mailman server unique subscribers 2009_06_01: 11088
* OSGeo mailman server unique subscribers 2009_05_01: 10046

* May 2, 2009:
** Total number of enabled subscribers in [http://lists.osgeo.org/mailman/listinfo all OSGeo hosted lists]: 15941
** Unique number of enabled subscribers in [http://lists.osgeo.org/mailman/listinfo all OSGeo hosted lists]: 9791
** Note that these metrics only include OSGeo lists, there are a number of lists maintained on other servers.
*** Source Metrics collated in a spreadsheet at: http://spreadsheets.google.com/ccc?key=r_y6-xiF3ZvE-rDJ5y30GfA
* May 2, 2009: [http://lists.osgeo.org/mailman/listinfo/announce announce]: 871, [http://lists.osgeo.org/mailman/listinfo/discuss discuss]: 866
* Dec 1, 2008: [http://lists.osgeo.org/mailman/listinfo/announce announce]: 761, [http://lists.osgeo.org/mailman/listinfo/discuss discuss]: 814
* Jan 26, 2007: [http://lists.osgeo.org/mailman/listinfo/announce announce]: 579, [http://lists.osgeo.org/mailman/listinfo/discuss discuss]: 402

= wiki.osgeo.org =

from [[Special:Statistics]]

* 3. Sep 2023: 4,053 content pages, 5,839 registered users (list of members)
* 22 Jul 2022: 3,993 content pages, 5,751 users (now linked to LDAP single sign-on system)
* 14 Feb 2018: 3,672 content pages, 5,208 users
* 25 Sep 2017: 3,529 content pages, 4,923 users (views no longer listed in [[Special:Statistics]])
** some massive spam user cleanup was done in 2016
* 1 May 2015: 3,152 pages, 18,391 users, 31M views
* 1 August 2014: 3,026 pages, 17,384 users, 24.1M views
* 2 June 2014: 3,016 pages, 17,270 users, 23.4M views
* 1 May 2014: 2,995 pages, 16,985 users, 22.2M views
* 6 March 2013: 2,741 pages, 12,609 users, 17.5M views
* 4 February 2013: 2,720 pages, 12,550 users, 17M views
* 4 June 2008: 2360 pages, 5513 users, 2.7M views
* Jan 27, 2007: 349 active pages, 569 registered users, 646K page views
* Oct 24, 2006: 272 active pages, 383 registered users, 323K page views
* June 11, 2006: 141 active pages, 201 registered users, 104K page views

= Debian download statistics =

* https://qa.debian.org/popcon.php?package=gdal
* https://qa.debian.org/popcon.php?package=grass
* https://qa.debian.org/popcon.php?package=mapserver
* https://qa.debian.org/popcon.php?package=proj
* https://qa.debian.org/popcon.php?package=qgis
* ...

= Google Hits for "osgeo" =

as per [[http://www.google.com/search?hl=en&q=osgeo Google Query]]
* 16 Sep 2023: 805.000
* 22 Jul 2022: 885,000
* 25 Sep 17: 543,000
* 01 Jun 15: 430,000
* 02 Jun 14: 1,380,000
* 01 May 14: 1,180,000
* 06 Mar 13: 1,370,000
* 04 Feb 13: 1,350,000
* 03 May 09: 616,000
* 17 Nov 08: 636,000
* 04 Jun 08: 538,000
* 24 Mar 08: 318,000
* 24 Sep 07: 760,000
* 16 Aug 07: 440,000
* 19 Jul 07: 486,000
* 16 Apr 07: 395,000
* 24 Feb 07: 352,000
* 26 Jan 07: 360,000
* 12 Jan 07: 214,000
* 22 Nov 06: 209,000
* 01 Nov 06: 230,000
* 23 Oct 06: 177,000
* 26 Sep 06: 156,000
* 11 Sep 06: 150,000
* 09 Sep 06: 137,000
* 29 Aug 06: 127,000
* 19 Jul 06: 110,000
* 11 Jul 06: 99,700
* 21 Jun 06: 103,000
* 11 Jun 06: 101,000
* 05 Jun 06: 96,700
* 15 May 06: 109,000
* 05 May 06: 115,000
* 25 Apr 06: 113,000
* 18 Apr 06: 107,000
* 16 Mar 06: 56,200
* 13 Mar 06: 37,000
* 10 Mar 06: 17,500
* 04 Feb 06: 0

= Alexa Stats =

[http://www.alexa.com/data/details/traffic_details/osgeo.org?site0=osgeo.org&y=r&z=3&h=400&w=700&u%5B%5D=osgeo.org&x=2008-03-24T22%3A10%3A53.000Z&check=www.alexa.com&signature=1im6JB6UH8t7BRv9p46mY0ZMolM%3D&range=3y&size=Large Link]

Global traffic rank (smaller is better):

* (Alexa.com retired on May 1, 2022)
* 25 Sep 17: 60,867 (China rank: 29,063)
* 24 Mar 08: 208,609
* 04 Jun 08: 159,273
* 17 Nov 08: 121,594
* 03 May 09: 117,381
* 04 Feb 13: 82,198
* 06 Mar 13: 74,176
* 01 May 14: 62,812
* 01 Jun 15: 73,210

= OSGeo Foundation Charter Members =

* See list of https://www.osgeo.org/about/charter-members/
* Election statistics years by year: https://wiki.osgeo.org/wiki/Category:Elections

= Wikipedia EN OSGeo Article stats =

* http://stats.grok.se/en/latest90/Open_Source_Geospatial_Foundation
** 2015_06_01: viewed 2902 times in the last 30 days

= References =
See also:

* [[Project_Stats]] which aims to capture some project specific stats.
* [http://live.osgeo.org/en/metrics.html OSGeo Live metrics] is a page that presents OpenHub (formerly Ohloh) statistics for many FOSS4G projects.

[[Category:Statistics]]
[[Category:Visibility]]
[[Category:Marketing]]

SAC:Mailing Lists

2025-10-02T09:46:50Z

Strk: osgeo6 -> Mail Server

Mailing lists are administered with Mailman on lists.osgeo.org (see http://lists.osgeo.org for a list of available lists), physically this is a container (see [[Mail server]]). Jorge Sanz (jsanz) does most of the mailman work, with Frank Warmerdam (warmerdam) and Martin Spott (martin) being the server side people if there are super technical issues.

= Notes for List Administrators =

== Requesting a new list ==

If your project or activity would like to have a mailing list at lists.osgeo.org please take the following steps:

* First, confirm that there isn't already an appropriate list for this activity, and consider whether OSGeo is the right home for the proposed list.
* File a ticket at http://trac.osgeo.org/osgeo (use your OSGeo Userid to login) and make sure the component is set to "Mails & Mailing Lists". This is the request to the System Administration Committee to create the list.
* Please include the exact name you would like for the list (ie. foo-announce), and the email address of the person who should be the list admin. Also provide the justification for the list, and indicate if it was explicitly requested by an OSGeo Project PSC or project representative.
* Include any special instructions (such pointers to info if the list is actually being migrated from elsewhere).
* Hopefully, someone in SAC will act on the ticket and create the list. When complete the ticket will be updated and closed, and the proposed admin will receive an email with the admin password for the list.
* Review the list settings, in particular ensuring that the short description gets set (ie. review following points)

Generally it is up to the mailman administrator to judge whether a list is justified for creation. The justification doesn't need to be strong, but the list should be OSGeo related, reasonably likely to generate some use, or be requested on behalf of a project.

== Configuring the mailing list ==

* Please set "A terse phrase identifying this list." to something brief and meaningful as this is what is shown on the main lists directory. It is on the ''General'' tab.
* Set "Who can view subscription list?" on the ''Privacy'' tab to "List Admin Only", otherwise anyone can subscribe and then harvest the mailing list.
* Set ''generic_nonmember_action'' on the ''Privacy->Sender filters'' tab to reject as most lists are not actively administered so we prefer to reject rather than holding posts from unsubscribed folks.
* Be sure to choose a name that does not already have an existing alias, such as: sales, support, www, security. If you need to use one of these names someone will have to edit the /etc/aliases file for you manually.
* Configure to not tamper the original incoming message in any way to avoid breaking DKIM signatures, see https://trac.osgeo.org/osgeo/ticket/3011#comment:23 - you may find the /osgeo/mailman-tools/recommended_setup script useful to do this (installed on the list server host)
* Make sure bounce processing is enabled, see https://trac.osgeo.org/osgeo/ticket/3440#comment:2 - this is done going to https://lists.osgeo.org/mailman/admin/LISTNAME/?VARHELP=bounce/bounce_processing (change LISTNAME with the actual mailing list name) - you may find the /osgeo/mailman-tools/recommended_bounce_processing_setup script useful to do this (installed on the list server host)

== Other options ==

* For announce lists (ie. moderated lists) turn on "Emergency moderation of all list traffic" on. It is on the ''General'' tab.

= Outstanding Issues =

# Administrator/moderator permissions. Currently this is a hodgepodge. Some administrators have set the passwords but then others can't help administrate the list. The default admin password is not very secure. It has been suggested that we use some sort of LDAP/http authentication to verify that folks trying to do list admin are in some sort of mail administration group.
# List setting policies. Do we want to mandate more policies than the ones listed above as "Notes for List Administrators"?
# Search. Do we want to do anything special to enable searching the archive? Jason has setup an OSGeo.org grouping on nabble (<strike>http://www.nabble.com/OSGeo.org-f18127.html</strike>, http://osgeo-org.1803224.n2.nabble.com/) that makes searching all osgeo related mailing lists effective. We might want to expand on that.

= System Tasks =

== Mailing List Admin tasks when moving list to discourse ==

Modify the listinfo.html of the mailing list, navigating from the administration panel

'''Edit the public HTML pages and text files''' -> '''General list information page'''

This
* will not show about new subscriptions
* will allow the subscribers to unsubscribe.

<pre>
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">

<HTML>
<HEAD>
<TITLE><MM-List-Name> Info Page</TITLE>

</HEAD>
<BODY BGCOLOR="#ffffff">


<TABLE BORDER="0" CELLSPACING="4" CELLPADDING="5">
<TR>
<TD COLSPAN="2" WIDTH="100%" BGCOLOR="#99CCFF" ALIGN="CENTER">
<MM-List-Name> --
<MM-List-Description>
</TD>
</TR>
<tr>
<td colspan="2">
 
</td>
</tr>
<tr>
<TD COLSPAN="1" WIDTH="100%" BGCOLOR="#FFF0D0">
About <MM-List-Name>
</TD>
<TD COLSPAN="1" WIDTH="100%" BGCOLOR="#FFF0D0">
<MM-lang-form-start><MM-displang-box> <MM-list-langs>
<MM-form-end>
</TD>
</TR>
<tr>
<td colspan="2">
<MM-List-Info>
 To see the collection of prior postings to the list,
visit the <MM-Archive><MM-List-Name>
Archives</MM-Archive>.
<MM-Restricted-List-Message>

</TD>
</TR>
<tr>
<TD COLSPAN="2" WIDTH="100%">

<MM-Options-Form-Start>
<MM-Editing-Options>
<MM-Form-End>
</td>
</tr>
</table>
<MM-Mailman-Footer>
</BODY>
</HTML>
</pre>

== New Lists ==

'''Not accepting new lists'''
* Create a new list through the [http://lists.osgeo.org/mailman/create web admin login].

== Renaming Lists ==

* create new list
$sudo /usr/lib/mailman/bin/newlist listname admins@email lists_passwd
* move original lists archive to newlists archive location
$ sudo cp /var/lib/mailman/archives/private/oldlist.mbox/oldlist.mbox \
/var/lib/mailman/archives/private/newlist.mbox/newlist.mbox
* create archive
$ sudo /usr/lib/mailman/bin/arch --wipe newlist
* export subscribers from old list regular and digest members
$ sudo /usr/lib/mailman/bin/list_members -r oldlistname > listname-regular.txt
$ sudo /usr/lib/mailman/bin/list_members -d oldlistname > listname-digest.txt
* import subscribers into new list
$ sudo /usr/lib/mailman/bin/add_members --regular-members=listname-regular.txt --welcome-msg=y newlistname
$ sudo /usr/lib/mailman/bin/add_members --digest-members=listname-digest.txt --welcome-msg=y newlistname
* remove old list
$ sudo /usr/lib/mailman/bin/rmlist oldlistname
* check that proper permissions are set (takes 10+ minutes!)
$ sudo /usr/lib/mailman/bin/check_perms -f
* edit postfix aliases - /etc/aliases
oldlist: newlist@lists.osgeo.org
oldlist-request: newlist-request@lists.osgeo.org
oldlist-admin: newlist-admin@lists.osgeo.org
oldlist-owner: newlist-owner@lists.osgeo.org
* update postfix with new aliases
$ sudo /usr/bin/newaliases
$ sudo /usr/sbin/service postfix reload

== copy / clone user addresses across lists ==
* add '''-r''' to remove the old address
$ sudo clone_member old@address.com new@address.com

== Migrate ==

When migrating from another system to osgeo, get the .mbox files, and the whole /var/lib/mailman/lists/<listname> directory, and follow roughly the following steps as root (or sudo each step):

# newlist -q grass-announce warmerdam@pobox.com junk
# cd /var/lib/mailman/lists/grass-announce
# cp ~warmerdam/grass-announce/* .
# withlist -l -r fix_url grass-announce
# /usr/lib/mailman/bin/arch grass-announce ~warmerdam/grass-announce.mbox
# chown -R list.list /var/lib/mailman/lists/grass-announce
# chown -R list.list /var/lib/mailman/archives/private/grass-announce*
# /usr/lib/mailman/bin/genaliases
# /usr/sbin/service postfix restart
# /usr/lib/mailman/bin/mailmanctl restart

If the list name on the new system is different than on the old system, it may be prudent to fix this up on the mail page of the web admin interface after the ''withlist'' command has been used, and before the archives are imported. (''FrankW'')

== References ==
* Here is [http://www.chris-lamb.co.uk/2007/10/02/renaming-a-mailman-list/ another approach to renaming], though our web admin interface won't actually allow you to do the final rename step

== Remove Mails from Archive ==
Sometimes users send mails with contentious content to the list and ask for it to be removed. As a courtesy this should be done asap. In general it is better to not remove the mail altogether but just remove the content. Instructions:
* http://wiki.list.org/pages/viewpage.action?pageId=4030681
Archives live in:
/var/lib/mailman/archives/
To recreate archives use:
/usr/lib/mailman/bin/arch [listname]

== List Statistics ==

From time to time it is nice to get a sense of the number of lists, users, etc. The following may be helpful:

all subscribers of all osgeo lists hosted on osgeo.org:

sudo list_lists -b | xargs -n 1 sudo list_members | wc -l

unique list of email addresses across all lists:

sudo list_lists -b | xargs -n 1 sudo list_members | sort | uniq | wc -l

Since 2009 there is [[User:Neteler|Markus Neteler]]'s cronjob running for gathering these statistics and sending them to "info AT osgeo org".
The monthly cronjob "OSGeo mailman server unique subscribers" run as root user in the container with scripts in /home/neteler/osgeo_mailman_stats/*.sh (operated by [[User:Neteler|M. Neteler]])

For a time series, [[VisibilityStats#Mailing_list_subscribers|see statistics]]

= Hints for subscribers =

Being subscribed to one or more mailing lists may result in a lot of incoming mail so it may be useful to configure your Mail User Agent (MUA) so that it makes it easier for you to tell which mail comes from which mailing list. How to do this depends on your system setup.

== Procmail users ==

If you use [https://en.wikipedia.org/wiki/Procmail Procmail] to filter your incoming email a good recipe to automatically
put mailing list traffic each in its own folder could be this:

:0
* ^List-Id: *<\/[^.]*
.list-$MATCH/

== Mutt users ==

If you use [http://mutt.org/ Mutt] MUA you may find these useful:

* '''subjectrx''' directive to tweak the Subject line (e.g. drop or add a prefix) - http://www.mutt.org/doc/manual/#display-munging
* '''list-reply''' command to reply to the mailing list (OSGeo Mailing Lists contain '''List-Post''' header) - http://www.mutt.org/doc/manual/#list-reply

= Nabble (deprecated) =

Since August 2021 Nabble is not anymore an archive for OSGeo. More details in the [https://www.osgeo.org/foundation-news/osgeo-nabble-forum-is-shutting-down/ OSGeo news item].

[[Category:Infrastructure]]
[[Category:Services]]

Osgeo6

2025-10-02T09:43:38Z

Strk: Strk moved page Osgeo6 to Mail server: host moved to a cointainer

#REDIRECT [[Mail server]]

Mail server

2025-10-02T09:43:38Z

Strk: Strk moved page Osgeo6 to Mail server: host moved to a cointainer

'''Osgeo6''' is a Debian 10 machine administered by [[SAC]], hosted on [[SAC_Service_Status#Servers_at_OSL|OSU OSL servers]] since August 2015 (see also [[Infrastructure Transition Plan 2014#Hardware|Hardware plan 2014]]).

It hosts several '''critical resources''', projects web sites mail-transport and -lists, it is the successor of the [[ProjectsVM]] and the [[MailVM]] (this machine runs NO VMs instead).

The host is reachable by ssh at '''osgeo6.osgeo.osuosl.org'''.

= Shell access =

Anyone in the https://www.osgeo.org/cgi-bin/auth/ldap_shell.py has ssh access, and anyone in this group can add new people via the link. Sudo access can be provided by existing sudoer's by adding folks to the sudoers group in /etc/group, though it is normal practice to try and only extend sudo access to one user per project.

It is a shared environment and it is important that folks making changes on the system be aware of the impact they might have on other hosted services. Apache changes should be made carefully and needfully. Think about '''security'''!

See [[SAC#Communication]] in case of troubles or quick questions

= Services hosted on osgeo6 =

== Websites ==

All websites are served by Apache

{| border="1" class="wikitable"
|-
! site
! path
! contact
! [[SAC:Backups|backup]]
! comments
|-
| <del>old.grass.osgeo.org</del> (grass.osgeo.org moved to osgeo7 grass container)
| /var/www/grass/grass-cms
| admined by [[User:Neteler]], martinL
| BackupOg6 bacula job
| based on CMSMS; GRASS GIS infrastructure explained [https://trac.osgeo.org/grass/browser/grass/trunk/doc/infrastructure.txt here], also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=grass.osgeo.org&latest LetsEncrypt]
|-
| <del>old.grasswiki.osgeo.org</del> (grasswiki.osgeo.org moved to osgeo3 grass-wiki container)
| /var/www/grass/grass-wiki
| admined by [[User:Neteler]], martinL
| BackupOg6 bacula job
| own MediaWiki, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=grasswiki.osgeo.org&latest LetsEncrypt]
|-
| <del>www.featureserver.org</del>
| /var/www/featureserver/website
| admined by [[User:Warmerda]]
| BackupOg6 bacula job
| DEAD project. Not yet active, pending Python/GEOS issues
|-
| www.tilecache.org
| /var/www/tilecache/docs
| SAC !?
| BackupOg6 bacula job
|
|-
| <del>www.gdal.org</del> Now hosted on github (gdal.org) and redirect for www.gdal.org (redirected to https://gdal.org on osgeo7 nginx)
| /var/www/gdal/gdal-web/
| admined by [[User:Warmerda]]
| BackupOg6 bacula job
| CRON-job migrated as well, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=gdal.org&latest LetsEncrypt]
|-
|-
| <del>www.mapserver.org</del>
| /var/www/mapserver.org/
| admined by [[Jeff McKenna]]
| BackupOg6 bacula job
| moved to OSGeo7 on 2025-08-01 ([https://trac.osgeo.org/osgeo/ticket/3405 ticket])
|-
| <del>drone.osgeo.org</del> (this has been replaced by [[Dronie | dronie.osgeo.org]] which is on osgeo7)
| /var/www/drone.osgeo.org
| admined by [[User:Strk]]
| Continuous Integration for [[SAC:Gitea|Gitea]]
| reverse-proxy to [[#Drone service|Drone server]] server, also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=drone.osgeo..org&latest LetsEncrypt]
|-
| https://lists.osgeo.org
| admin
| Web interface for managing Mailman
|
| also enabled [https://www.ssllabs.com/ssltest/analyze.html?d=lists.osgeo.org&latest LetsEncypt]

|-
|}

== MySQL server ==
* <del>used for GRASS GIS Wiki (maintained by Martin Landa and Markus Neteler)</del>
<del>* used for GRASS CMS and GRASS Wiki ? </devl> now on grass on osgeo7 and grass-wiki on osgeo3
* backed up via [[SAC:Backups|bacula]] in BackupOg6 job (see /osgeo/backup)
* admin user credentials found in ~root/.my.cnf

== Postfix SMTP server ==

Handles [[SAC:Message Submission Agent|outgoing]] and [[SAC:Message Transport Agent|incoming]] email

== Mailman ==

* [[SAC:Mailing Lists]] - mailman configuration for lists.osgeo.org.

= SSL certificates =

* LetsEncrypt was configured by [[Jeff McKenna]] on 2018-07-27 for mapserver.org, gdal.org, grass.osgeo.org, grasswiki.osgeo.org, drone.osgeo.org, and lists.osgeo.org using certbot-auto
** careful: check the conf files in /etc/apache2/sites-enabled/ to make sure that the VirtualHost settings do not include something like ''<VirtualHost _default_:443>'' and instead should point to the IP such as ''<VirtualHost 140.211.15.3:443>'' or else the certificate loaded will always default to mapserver.org
** certbot-auto lives in /usr/local/sbin.
** to add more sites, run the command:<blockquote>certbot-auto --apache -d mapserver.org -d www.mapserver.org</blockquote>
** a cronjob (certbot-auto renew) was created to check for renewal twice a day
** also enabled for geos.osgeo.org on by [[Jeff McKenna]] on 2018-10-01

= Backup strategy =

As of Feb 2017 backup is performed by bacula, with the BackupOg6 job,
which includes the whole /var/www, /etc, /osgeo, /var/lib/mysql and more
files (see [[SAC:Backups]] for info about figuring out more).

A dump of each mysql database is also stored as a separate file under /osgeo
(created during the backup phase).

= Hardware =

Details:
CPU: 2 x Intel Xeon E5-2620v3, 2.4 GHz (6-Core, HT, 15MB Cache, 85W) 22nm
RAM: 128GB (8 x 16GB DDR4-2133 ECC Registered 2R 1.2V DIMMs) Operating at 2133 MT/s Max
NIC: Dual Intel i210 Gigabit Ethernet Controllers - Integrated
Management: Integrated IPMI 2.0 & KVM over LAN
Controller: 10 Ports 6Gb/s SATA (Intel C612 Chipset)
PCIe 3.0 x8: No Item Selected
NOTE: Hot-swap and fixed drives will be connected to SATA3 controller (C612) unless otherwise specified
Hot-Swap Drive - 1: 80GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 2: 80GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 3: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 4: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 5: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Hot-Swap Drive - 6: 480GB Intel DC S3500 Series MLC (6Gb/s, 0.3 DWPD) 2.5" SATA SSD
Optical Drive: No Item Selected

3 year warranty starting on May 4,2015 ending on May 4,2018

[[Category:Infrastructure]]

VisibilityStats

2025-10-02T09:41:08Z

Strk: /* Mailing list subscribers */

This page has some summary statistics about us.

= osgeo.org Web =

* OSGeo's main website (www.osgeo.org) has access stats available [http://www.osgeo.org/awstats/ here].
* 2015
** May: 30,582 unique visitors in the month
* 2014
** July: 32,181 unique visitors in the month
* 2013
** February: 28,793 unique visitors in the month
** January: 30,487 unique visitors in the month
* May 2006 (3rd month since launch) - from Daniel's mail
** registered users: 1223
** 192K hits
** 10K unique visitors

= download.osgeo.org =

* http://download.osgeo.org/stats/

= Gitea =

The [[SAC:Gitea]] service was setup in April 2016.

== March 2020 ==

The Gitea database holds:
- 192 users
- 25 organizations
- 186 repositories

= LDAP users (OSGeo Userid) =

Statistics about the [[SAC:LDAP]] service

== Number of registrations per year ==

- Users registered in 2019: 422
- Users registered in 2018: 464
- Users registered in 2017: 453 -- Mantra requirement added
- Users registered in 2016: 2121
- Users registered in 2015: 6670
- Users registered in 2014: 2595

== May 15 2020 ==

- Currently registered users: 22016

== September 2019 ==

- Currently registered users: 21744

20715+291+464+274

== April 2017 ==

- Currently registered users: 20715
- Unique registered emails: 19935 (780 duplicated email)

- Different mail domain used: 5201
- Mail domains used by a single user: 4374

- Different .gov mail domains: 48
- Users with .gov mail address: 114

- Different .edu mail domains: 194
- Users with .edu mail address: 287

- Users with username only composed by numbers: 254
- Top 20 most used mail domains (spammers most likely still hiding here):

users domain
----------------------
7195 gmail.com
949 yahoo.com
740 hotmail.com
234 googlemail.com
225 web.de
200 arcor.de
197 gmx.de
192 yahoo.de
189 t-online.de
183 bigstring.com
177 zoho.com
177 inbox.com
172 gawab.com
171 freenet.de
171 aol.com
133 gmx.net
104 autodesk.com
89 yahoo.fr
84 163.com
69 live.com

= Mailing list subscribers =

For the command used to obtain these statistics,
see https://wiki.osgeo.org/wiki/SAC:Mailing_Lists#List_Statistics)

''Source: [[User:Neteler|M Neteler]]'s monthly cronjob:'' [1]
* OSGeo mailman server unique subscribers 2024_08_01: 34696
* OSGeo mailman server unique subscribers 2024_07_01: 34693
* OSGeo mailman server unique subscribers 2024_06_01: 34591
* OSGeo mailman server unique subscribers 2024_05_01: 34696
* OSGeo mailman server unique subscribers 2024_04_01: 34666
* OSGeo mailman server unique subscribers 2024_03_01: 34631
* OSGeo mailman server unique subscribers 2024_02_01: 34633
* OSGeo mailman server unique subscribers 2024_01_01: 34699
* OSGeo mailman server unique subscribers 2023_12_01: 34623
* OSGeo mailman server unique subscribers 2023_11_01: 34583
* OSGeo mailman server unique subscribers 2023_10_01: 36482
* OSGeo mailman server unique subscribers 2023_09_01: 36453
* OSGeo mailman server unique subscribers 2023_08_01: 36426
* OSGeo mailman server unique subscribers 2023_07_01: 36438
* OSGeo mailman server unique subscribers 2023_05_01: 36401
* OSGeo mailman server unique subscribers 2023_04_01: 36622
* OSGeo mailman server unique subscribers 2023_03_01: 36618
* OSGeo mailman server unique subscribers 2023_02_01: 36621
* OSGeo mailman server unique subscribers 2023_01_01: 36827
* OSGeo mailman server unique subscribers 2022_12_01: 36812
* OSGeo mailman server unique subscribers 2022_11_01: 36706
* OSGeo mailman server unique subscribers 2022_10_01: 36717
* OSGeo mailman server unique subscribers 2022_09_01: 36706
* OSGeo mailman server unique subscribers 2022_08_01: 36713
* OSGeo mailman server unique subscribers 2022_07_01: 36699
* OSGeo mailman server unique subscribers 2022_06_01: 36697
* OSGeo mailman server unique subscribers 2022_05_01: 36693
* OSGeo mailman server unique subscribers 2022_04_01: 36603
* OSGeo mailman server unique subscribers 2022_03_01: 36603
* OSGeo mailman server unique subscribers 2022_02_01: 36599
* OSGeo mailman server unique subscribers 2022_01_01: 36292
* OSGeo mailman server unique subscribers 2021_12_01: 36286
* OSGeo mailman server unique subscribers 2021_11_01: 36256
* OSGeo mailman server unique subscribers 2021_10_01: 36252
* OSGeo mailman server unique subscribers 2021_09_01: 36249
* OSGeo mailman server unique subscribers 2021_08_01: 36229
* OSGeo mailman server unique subscribers 2021_07_01: 36178
* OSGeo mailman server unique subscribers 2021_06_01: 36155
* OSGeo mailman server unique subscribers 2021_05_01: 36201
* OSGeo mailman server unique subscribers 2021_04_01: 36268
* OSGeo mailman server unique subscribers 2021_03_01: 36203
* OSGeo mailman server unique subscribers 2021_02_01: 36121
* OSGeo mailman server unique subscribers 2021_01_01: 36108
* OSGeo mailman server unique subscribers 2020_12_01: 36001
* OSGeo mailman server unique subscribers 2020_11_01: 35925
* OSGeo mailman server unique subscribers 2020_10_01: 35901
* OSGeo mailman server unique subscribers 2020_09_01: 35839
* OSGeo mailman server unique subscribers 2020_08_01: 35783
* OSGeo mailman server unique subscribers 2020_07_01: 35725
* OSGeo mailman server unique subscribers 2020_06_01: 35659
* OSGeo mailman server unique subscribers 2020_05_01: 35176
* OSGeo mailman server unique subscribers 2020_04_01: 34971
* OSGeo mailman server unique subscribers 2020_03_01: 34524
* OSGeo mailman server unique subscribers 2020_02_01: 34423
* OSGeo mailman server unique subscribers 2020_01_01: 34370
* OSGeo mailman server unique subscribers 2019_12_01: 34259
* OSGeo mailman server unique subscribers 2019_11_01: 34158
* OSGeo mailman server unique subscribers 2019_10_01: 33983
* OSGeo mailman server unique subscribers 2019_09_01: 33945
* OSGeo mailman server unique subscribers 2019_08_01: 33790
* OSGeo mailman server unique subscribers 2019_07_01: 33790
* OSGeo mailman server unique subscribers 2019_07_01: 33659
* OSGeo mailman server unique subscribers 2019_06_01: 33539
* OSGeo mailman server unique subscribers 2019_05_01: 33446
* OSGeo mailman server unique subscribers 2019_04_01: 33193
* OSGeo mailman server unique subscribers 2019_03_01: 33062
* OSGeo mailman server unique subscribers 2019_02_01: 32874
* OSGeo mailman server unique subscribers 2019_01_01: 32879
* OSGeo mailman server unique subscribers 2018_12_01: 33225
* OSGeo mailman server unique subscribers 2018_11_13: 31418
* OSGeo mailman server unique subscribers 2018_11_01: 31356
* OSGeo mailman server unique subscribers 2018_10_01: 31204
* OSGeo mailman server unique subscribers 2018_09_01: 31057
* OSGeo mailman server unique subscribers 2018_08_01: 30846
* OSGeo mailman server unique subscribers 2018_06_01: 30587
* OSGeo mailman server unique subscribers 2018_05_01: 30460
* OSGeo mailman server unique subscribers 2018_04_01: 30356
* OSGeo mailman server unique subscribers 2018_03_01: 30235
* OSGeo mailman server unique subscribers 2018_02_01: 30181
* OSGeo mailman server unique subscribers 2018_01_01: 30049
* OSGeo mailman server unique subscribers 2017_12_01: 30005
* OSGeo mailman server unique subscribers 2017_11_01: 29610
* OSGeo mailman server unique subscribers 2017_10_01: 29574
* OSGeo mailman server unique subscribers 2017_09_01: 29531
* OSGeo mailman server unique subscribers 2017_08_01: 29476
* OSGeo mailman server unique subscribers 2017_07_01: 29410
* OSGeo mailman server unique subscribers 2017_06_01: 28857
* OSGeo mailman server unique subscribers 2017_05_01: 28735
* OSGeo mailman server unique subscribers 2017_04_01: 28937
* OSGeo mailman server unique subscribers 2017_03_01: 28852
* OSGeo mailman server unique subscribers 2017_02_01: 28672
* OSGeo mailman server unique subscribers 2017_01_01: 28635
* OSGeo mailman server unique subscribers 2016_12_01: 28538
* OSGeo mailman server unique subscribers 2016_11_01: 28410
* OSGeo mailman server unique subscribers 2016_10_01: 28343
* OSGeo mailman server unique subscribers 2016_09_01: 28290
* OSGeo mailman server unique subscribers 2016_08_01: 28404
* OSGeo mailman server unique subscribers 2016_07_01: 28343
* OSGeo mailman server unique subscribers 2016_06_01: 28297
* OSGeo mailman server unique subscribers 2016_05_01: 28202
* OSGeo mailman server unique subscribers 2016_04_01: 27663
* OSGeo mailman server unique subscribers 2016_03_01: 27636
* OSGeo mailman server unique subscribers 2016_02_01: 27417
* OSGeo mailman server unique subscribers 2016_01_01: 27329
* OSGeo mailman server unique subscribers 2015_12_01: 27243
* OSGeo mailman server unique subscribers 2015_11_01: 27159
* OSGeo mailman server unique subscribers 2015_10_09: 27123
* OSGeo mailman server unique subscribers 2015_10_01: 27083
* OSGeo mailman server unique subscribers 2015_09_01: 26933
* OSGeo mailman server unique subscribers 2015_08_01: 26792
* OSGeo mailman server unique subscribers 2015_07_01: 26673
* OSGeo mailman server unique subscribers 2015_06_01: 26570
* OSGeo mailman server unique subscribers 2015_05_01: 26395
* OSGeo mailman server unique subscribers 2015_04_01: 26004
* OSGeo mailman server unique subscribers 2015_03_01: 25842
* OSGeo mailman server unique subscribers 2015_02_01: 25366
* OSGeo mailman server unique subscribers 2015_01_01: 25283
* OSGeo mailman server unique subscribers 2014_12_01: 25195
* OSGeo mailman server unique subscribers 2014_11_01: 25134
* OSGeo mailman server unique subscribers 2014_10_01: 24997
* OSGeo mailman server unique subscribers 2014_09_01: 24811
* OSGeo mailman server unique subscribers 2014_08_01: 24472
* OSGeo mailman server unique subscribers 2014_07_01: 24303
* OSGeo mailman server unique subscribers 2014_06_01: 24171
* OSGeo mailman server unique subscribers 2014_05_01: 24046
* OSGeo mailman server unique subscribers 2014_04_01: 23882
* OSGeo mailman server unique subscribers 2014_03_01: 23846
* OSGeo mailman server unique subscribers 2014_02_01: 23326
* OSGeo mailman server unique subscribers 2014_01_01: 23140
* OSGeo mailman server unique subscribers 2013_12_01: 22482
* OSGeo mailman server unique subscribers 2013_10_01: 22101
* OSGeo mailman server unique subscribers 2013_09_01: 22598
* OSGeo mailman server unique subscribers 2013_08_01: 22471
* OSGeo mailman server unique subscribers 2013_07_01: 22365
* OSGeo mailman server unique subscribers 2013_06_01: 22227
* OSGeo mailman server unique subscribers 2013_05_01: 21995
* OSGeo mailman server unique subscribers 2013_04_06: n/a
* OSGeo mailman server unique subscribers 2013_03_06: 19160
* OSGeo mailman server unique subscribers 2013_02_06: n/a
* OSGeo mailman server unique subscribers 2013_01_01: 19160
* OSGeo mailman server unique subscribers 2012_12_01: 19160
* OSGeo mailman server unique subscribers 2012_11_01: 19160
* OSGeo mailman server unique subscribers 2012_10_01: n/a
* OSGeo mailman server unique subscribers 2012_09_01: 19160
* OSGeo mailman server unique subscribers 2012_08_01: 19160
* OSGeo mailman server unique subscribers 2012_07_01: 19160
* OSGeo mailman server unique subscribers 2012_05_01: 18947
* OSGeo mailman server unique subscribers 2012_04_01: 18769
* OSGeo mailman server unique subscribers 2012_03_01: 18631
* OSGeo mailman server unique subscribers 2012_02_01: 18492
* OSGeo mailman server unique subscribers 2012_01_01: 18314
* OSGeo mailman server unique subscribers 2011_12_01: 18156
* OSGeo mailman server unique subscribers 2011_11_01: 18001
* OSGeo mailman server unique subscribers 2011_10_01: 17837
* OSGeo mailman server unique subscribers 2011_09_01: 17697
* OSGeo mailman server unique subscribers 2011_08_01: 17598
* OSGeo mailman server unique subscribers 2011_07_01: 17183
* OSGeo mailman server unique subscribers 2011_06_01: 16992
* OSGeo mailman server unique subscribers 2011_05_01: 16811
* OSGeo mailman server unique subscribers 2011_04_01: 16571
* OSGeo mailman server unique subscribers 2011_03_01: 16376
* OSGeo mailman server unique subscribers 2011_02_01: 15662
* OSGeo mailman server unique subscribers 2011_01_01: 15450
* OSGeo mailman server unique subscribers 2010_12_01: 15277
* OSGeo mailman server unique subscribers 2010_11_01: 15061
* OSGeo mailman server unique subscribers 2010_10_01: 14833
* OSGeo mailman server unique subscribers 2010_09_01: 14202
* OSGeo mailman server unique subscribers 2010_08_01: 14056
* OSGeo mailman server unique subscribers 2010_07_01: 13891
* OSGeo mailman server unique subscribers 2010_06_01: 13744
* OSGeo mailman server unique subscribers 2010_05_01: 13465
* OSGeo mailman server unique subscribers 2010_04_01: 13268
* OSGeo mailman server unique subscribers 2010_03_01: 12976
* OSGeo mailman server unique subscribers 2010_02_01: 12596
* OSGeo mailman server unique subscribers 2010_01_01: 12426
* OSGeo mailman server unique subscribers 2009_12_01: 12187
* OSGeo mailman server unique subscribers 2009_11_01: 11974
* OSGeo mailman server unique subscribers 2009_10_01: 11773
* OSGeo mailman server unique subscribers 2009_09_01: 11605
* OSGeo mailman server unique subscribers 2009_08_01: 11531
* OSGeo mailman server unique subscribers 2009_07_01: 11362
* OSGeo mailman server unique subscribers 2009_06_01: 11088
* OSGeo mailman server unique subscribers 2009_05_01: 10046

* May 2, 2009:
** Total number of enabled subscribers in [http://lists.osgeo.org/mailman/listinfo all OSGeo hosted lists]: 15941
** Unique number of enabled subscribers in [http://lists.osgeo.org/mailman/listinfo all OSGeo hosted lists]: 9791
** Note that these metrics only include OSGeo lists, there are a number of lists maintained on other servers.
*** Source Metrics collated in a spreadsheet at: http://spreadsheets.google.com/ccc?key=r_y6-xiF3ZvE-rDJ5y30GfA
* May 2, 2009: [http://lists.osgeo.org/mailman/listinfo/announce announce]: 871, [http://lists.osgeo.org/mailman/listinfo/discuss discuss]: 866
* Dec 1, 2008: [http://lists.osgeo.org/mailman/listinfo/announce announce]: 761, [http://lists.osgeo.org/mailman/listinfo/discuss discuss]: 814
* Jan 26, 2007: [http://lists.osgeo.org/mailman/listinfo/announce announce]: 579, [http://lists.osgeo.org/mailman/listinfo/discuss discuss]: 402

[1] runs on server [[SAC_Service_Status#osgeo6|osgeo6]], in /home/neteler/osgeo_mailman_stats/

= wiki.osgeo.org =

from [[Special:Statistics]]

* 3. Sep 2023: 4,053 content pages, 5,839 registered users (list of members)
* 22 Jul 2022: 3,993 content pages, 5,751 users (now linked to LDAP single sign-on system)
* 14 Feb 2018: 3,672 content pages, 5,208 users
* 25 Sep 2017: 3,529 content pages, 4,923 users (views no longer listed in [[Special:Statistics]])
** some massive spam user cleanup was done in 2016
* 1 May 2015: 3,152 pages, 18,391 users, 31M views
* 1 August 2014: 3,026 pages, 17,384 users, 24.1M views
* 2 June 2014: 3,016 pages, 17,270 users, 23.4M views
* 1 May 2014: 2,995 pages, 16,985 users, 22.2M views
* 6 March 2013: 2,741 pages, 12,609 users, 17.5M views
* 4 February 2013: 2,720 pages, 12,550 users, 17M views
* 4 June 2008: 2360 pages, 5513 users, 2.7M views
* Jan 27, 2007: 349 active pages, 569 registered users, 646K page views
* Oct 24, 2006: 272 active pages, 383 registered users, 323K page views
* June 11, 2006: 141 active pages, 201 registered users, 104K page views

= Debian download statistics =

* https://qa.debian.org/popcon.php?package=gdal
* https://qa.debian.org/popcon.php?package=grass
* https://qa.debian.org/popcon.php?package=mapserver
* https://qa.debian.org/popcon.php?package=proj
* https://qa.debian.org/popcon.php?package=qgis
* ...

= Google Hits for "osgeo" =

as per [[http://www.google.com/search?hl=en&q=osgeo Google Query]]
* 16 Sep 2023: 805.000
* 22 Jul 2022: 885,000
* 25 Sep 17: 543,000
* 01 Jun 15: 430,000
* 02 Jun 14: 1,380,000
* 01 May 14: 1,180,000
* 06 Mar 13: 1,370,000
* 04 Feb 13: 1,350,000
* 03 May 09: 616,000
* 17 Nov 08: 636,000
* 04 Jun 08: 538,000
* 24 Mar 08: 318,000
* 24 Sep 07: 760,000
* 16 Aug 07: 440,000
* 19 Jul 07: 486,000
* 16 Apr 07: 395,000
* 24 Feb 07: 352,000
* 26 Jan 07: 360,000
* 12 Jan 07: 214,000
* 22 Nov 06: 209,000
* 01 Nov 06: 230,000
* 23 Oct 06: 177,000
* 26 Sep 06: 156,000
* 11 Sep 06: 150,000
* 09 Sep 06: 137,000
* 29 Aug 06: 127,000
* 19 Jul 06: 110,000
* 11 Jul 06: 99,700
* 21 Jun 06: 103,000
* 11 Jun 06: 101,000
* 05 Jun 06: 96,700
* 15 May 06: 109,000
* 05 May 06: 115,000
* 25 Apr 06: 113,000
* 18 Apr 06: 107,000
* 16 Mar 06: 56,200
* 13 Mar 06: 37,000
* 10 Mar 06: 17,500
* 04 Feb 06: 0

= Alexa Stats =

[http://www.alexa.com/data/details/traffic_details/osgeo.org?site0=osgeo.org&y=r&z=3&h=400&w=700&u%5B%5D=osgeo.org&x=2008-03-24T22%3A10%3A53.000Z&check=www.alexa.com&signature=1im6JB6UH8t7BRv9p46mY0ZMolM%3D&range=3y&size=Large Link]

Global traffic rank (smaller is better):

* (Alexa.com retired on May 1, 2022)
* 25 Sep 17: 60,867 (China rank: 29,063)
* 24 Mar 08: 208,609
* 04 Jun 08: 159,273
* 17 Nov 08: 121,594
* 03 May 09: 117,381
* 04 Feb 13: 82,198
* 06 Mar 13: 74,176
* 01 May 14: 62,812
* 01 Jun 15: 73,210

= OSGeo Foundation Charter Members =

* See list of https://www.osgeo.org/about/charter-members/
* Election statistics years by year: https://wiki.osgeo.org/wiki/Category:Elections

= Wikipedia EN OSGeo Article stats =

* http://stats.grok.se/en/latest90/Open_Source_Geospatial_Foundation
** 2015_06_01: viewed 2902 times in the last 30 days

= References =
See also:

* [[Project_Stats]] which aims to capture some project specific stats.
* [http://live.osgeo.org/en/metrics.html OSGeo Live metrics] is a page that presents OpenHub (formerly Ohloh) statistics for many FOSS4G projects.

[[Category:Statistics]]
[[Category:Visibility]]
[[Category:Marketing]]

SAC

2025-10-02T07:07:05Z

Strk: drop Drone

= Mission =
The OSGeo System Administration Committee (SAC) manages [[SAC_Service_Status|computer systems]] operated by OSGeo. Responsibilities include:

* Develop published policies and procedures for managing systems, and system services.
* Solicit input from stakeholders on required system services, and to prioritize which to offer and when.
* Assign appropriate security and other responsibilities to administrators and users for access to systems.
* Ensure core OSGeo system services are well maintained, highly available and recoverable in case of system failure.
* Recommend system expenditures to the Board.

= Members =

([[SAC:Primary Administrators]])

A [[SAC:LDAP|LDAP]] group holds the [https://id.osgeo.org/ldap/shell?group=sac authoritative list of current SAC administrators] (need an [https://www.osgeo.org/osgeo_userid OSGeo account to read).

== Active ==
* [[User:strk|Sandro Santilli]] aka strk (General Administration, [[Trac Instances|trac]], [[SAC:Gitea|Gitea]]
* [[User:robe|Regina Obe]] ( general server administration and management which includes server patches, osgeo3-osgeo9 lxd hosts, DNS changes)
* [[User:Cvvergara| Vicky Vergara]] ( website administration, lists administration, general server administration )
* [[User:Jef|Jürgen Fischer]] (QGIS, OSGeo4W, Downloads, various)
* [[User:jive| Jody Garnett]] (website administration, repository)
* [[User:lnicola| Laurențiu Nicola]] (Download, wiki, website, Mantra, ldap, Gitea)
* [[Jorge Sanz]] ([[SAC:Mailing Lists|Mailing Lists]], [[PlanetOSGeo]])
* [[User:Neteler|Markus Neteler]] (GRASS CMS + Wiki, fail2ban, various)
* [[Jeff McKenna]] (Wiki, Mapserver website and demo, WebExtra, Tracsvn)
* [[User:tomkralidis|Tom Kralidis]] (Observer, OSGeo Board)
* Frank Warmerdam (Downloads, [[SAC:Mailing Lists|Mailing Lists]], [[SAC:LDAP|LDAP Scripts]])
* [[User:Martin|Martin Spott]] (Backups, everything else)

== InActive ==
* Eli Adam (Foss4g Archives)
* Shawn Barnes
* Wolf Bergenheim
* Alan Boudreault
* Hamish Bowman (OSGeo Live)
* Howard Butler
* [[Paolo Corti]] ([[PlanetOSGeo]])
* Richard Duivenvoorde (QGIS)
* [[User:wildintellect|Alex Mandel]] '''Chair''' (General)
* [[User:TemptorSent| Chris Giorgi]] aka TemporSent (funtoo setup, osgeo7, eventually wiki/ldap integration)
* John Graham
* Harrison Grundy
* Swapnil Hajare
* [[User:ajolma|Ari Jolma]]
* [[Mateusz Loskot]] ([[SAC:Mailing Lists|Nabble, Mailing Lists (Jobs)]], [[PlanetOSGeo]])
* Daniel Morissette
* [[User:Jgrocha|Jorge Rocha]]
* Larry Shaffer (Apple Signing Certificates)
* Chris Schmidt (OAM, Vmap0, Sr.org)
* Gary Sherman ([[IRC|IRC Bots]])
* Christian Willmes (Journal, Wiki)
* Norman Vine ([[IRC]])

= Meetings =
* [[SAC_Meeting-2020-06| Jun 2020 Agenda Notes]]
* [[SAC_Meeting-2020-04| Apr 2020 Agenda Notes]]
* [[SAC_Meeting-2020-03| Mar 2020 Agenda Notes]]
* [[SAC_Metting_2020-01| Jan 2020 Agenda Notes]]
* [[SAC_Meeting_2019-11| Nov 7th Agenda Notes]]
* [[SAC_Meeting_2019-10| Oct 24th Agenda Notes]]
* [[SAC_Meeting_2019-09| Sept 12th-26th Agenda Notes]]
* [[SAC_Meeting_2019-08| Aug 1st-29th Agenda Notes]]
* [[SAC_Meeting_2019-06| Jun 6th-20th Agenda Notes]]
* [[SAC_Meeting_2019-05| May 9th-23rd Agenda Notes]]
* [[SAC_Meeting_2019-04| Apr 11th-25th Agenda Notes]]
* [[SAC_Meeting_2019-03| Mar 14th-28th Agenda Notes]]
* [[SAC_Meeting_2019-02| Feb 14th-28th Agenda Notes]]
* [[SAC_Meeting_2019-01| Jan 3rd-31st Agenda Notes]]
* [[SAC_Meeting_2018-11| Nov 15th-29th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-10| Oct 4th-25th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-09| Sept 13th-27th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-08| Aug 9th-30th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-08-02| Aug 2nd 2018 Agenda Notes]]
* [[SAC_Meeting_2018-07-26| Jul 26th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-07-12| Jul 12th 2018 Agenda (Started Jul 5th, will reconvene July 12th) & Notes]]
* [[SAC_Meeting_2018-06-24| Jun 24th 2018 Agenda (Canceled) & Notes]]
* [[SAC_Meeting_2018-06-07| Jun 7th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-05-27| May 27th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-05-10| May 10th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-04-29| April 29th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-04-14| April 14th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-29| March 29th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-15| March 15 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-02| March 2nd 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-02-15| February 15th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-02-01| February 1st 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-01-18| January 18th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-01-04| January 4th 2018 Agenda & Notes]]
* [[SAC_Meeting_2017-12-21| December 21st 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-12-07| December 7th 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-11-23| November 23rd 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-11-09| November 9th 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-10-26| October 26th 2017 Agenda & Notes]]
* [[SAC:Oct122017| October 12th 2017 Agenda & Notes]]
* [[SAC:Sep2016| September 2016 Agenda & Notes]]
* [[SAC:May2016| May 2016 Agenda & Notes]]
* [[SAC:June2010_meeting|June 2010 SAC OSL Transition Meeting]]
* 1/22/07 [[SAC:1_22_07_agenda]] [[SAC:1_25_07_minutes]]
* 2/22/07 [[SAC:2_22_07_agenda]] [[SAC:2_22_07_minutes]]
* For a complete list, see [[:Category:SAC_Meetings]]

= Communication =
* Mailing list: [https://lists.osgeo.org/mailman/listinfo/sac Subscribe], [http://lists.osgeo.org/pipermail/sac Archives]
* IRC in #osgeo-sac on libera.chat (quick access: https://web.libera.chat/)
* Matrix in #sac:osgeo.org (quick access: https://matrix.to/#/#sac:osgeo.org)
* Forum: https://discourse.osgeo.org/c/committees/sac-global-category

= Task Tracking =

Infrastructure problems should be filed as trac ticket to SAC:
* [http://trac.osgeo.org/osgeo/login login] and [http://trac.osgeo.org/osgeo/newticket?component=Systems%20Admin Submit Trac Ticket]

Open issues:
* [http://trac.osgeo.org/osgeo/query?status=new&status=assigned&status=reopened&component=Systems%20Admin&order=priority Open SAC Issues]
* Old [[SAC TODO List]] (need to migrate any remaining issues to Trac).

= Procedures =

See [[:Category:SysAdminProcedure]] for a list of pages describing procedures.

The procedure to describe procedures is to create a wiki page and add a <nowiki>[[Category:SysAdminProcedure]]</nowiki> snippet in the page.

= Documents =

* [[SAC 2018 Annual Report]]
* [[Osgeo7 | Infrastructure Transition 2018-2019 Purchase and move of services to osgeo7]]
* [[Infrastructure Transition Plan 2010]]
* [[2007 Annual Report]]
* [[OSL]] - Information on our use of system services at the OSU Open Source Labs (OSL).

== Budget ==

* [[SAC:Budget| Past, Current and Proposed Budgets]]

= Services =

* See [[:Category:Services]]
* [[SAC Service Status]] indicates what services are setup, where and known issues (OSUOSL and other locations).

= Projects with SAC involved =
* [[Geodata processing at telascience.org]] - by [[Geodata Packaging Working Group]]
* The [[Software Stack]] page talks about the ''Reference Stack'' of software we would like to setup for demonstration and testing purposes.
* [[Kids GIS Portal]] - hosted at telascience, a wee bit of systems help.

= Migration to new Infrastructure =

* [[Osgeo7 | Infrastructure Transition 2018-2019 Purchase and move of services to osgeo7]]
* [[Infrastructure Transition Plan 2010]]
* [[Infrastructure Transition Plan 2014]]

== Old migration documents for historical review. ==

* [[Migration Documentation]] - assorted services on www.osgeo.org
* [[Drupal Upgrade Plan]] - Wolf's fall 2007 plan to upgrade Drupal to 5.3.
* The [[Project Infrastructure Migration]] page talks about migration issues of the projects in incubation and provides hints to some services we should be trying to provide.
* [[Migration Tasks and Milestones]]
* [[Migration Documentation]]
* [[Infrastructure Transition Plan | Infrastructure Transition Plan 2006]]

[[Category:Infrastructure]]
[[Category:Committees]]

SAC:Budget

2025-10-01T15:44:27Z

Strk: /* SysAmin contracts details */

Please help fill in the based on this [https://drive.google.com/open?id=0ByfEHeRRT620SnliNDhJT25HTms pdf report] from the treasurer.
Budget allocations can be found via general budget pages on the wiki.

== 2025 ==

'''''[[OSGeo_Budget_2025]]'''''

=== Overall ===

{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 55850 [16000] || 0 || Total Requested
|-
| Hosting || 6,500 [0] || 0 ||OSUOSL for hosting services $6500
|-
| Wordpress ACF Pro Plugin || 150[0] || 0 || https://www.advancedcustomfields.com/pro/?utm_source=ACF+PRO (needed for both prod and dev)
|-
| Limesurvey || 100 [0] || 0 || ComfUpdate payment
|-
| Hardware Supplies || 2,500 [0] || 0 || Emergency reserve for replacing parts as needed (drives, power supplies etc) and new hard drives, but not planned any change
|-
| Donations open source infra projects || 4,000 [0] || 0 || See https://wiki.osgeo.org/wiki/SAC:Budget#Donations_open_source_infra_projects
|-
| Domains || 300 [300] ||0 || Renewals, expect 5 domains (~$15 x 5 years each)
|-
| Sysadmin || 44800 [15,360] || 7680 (vicky) || 350 hrs contract time (120 hrs approved) to be split up as needed -- Specific or General support contracts. See [[SAC:Budget#SysAmin contracts]] for details.
|-
| General In-kind support || || || Discourse moderation (~25 hrs) , Mailman moderation (~15 hrs), Weblate Moderation (~5 hrs), Pretalx Moderation (~ 5 hrs) , Mantra Moderation ~90 hrs (guesstimate)
|}

=== SysAmin contracts details ===
{| class="wikitable sortable"
|-
! Name !! Hours !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Sandro || 60 [0] || 7680 [0] || 7680 || New mail system (major upgrade to be used by mailman, discourse, gitea, and all other osgeo services), ansible standardization; General support. This should significantly reduce spam and also make our mail less prone to being flagged as spam by google etc
|-
| Vicky ||60 [0] || 7680 [0] || 7680 || Mailing lists to Discourse migration and mirroring, website/wordpress fixes to support newer PHP, General support
|}

== 2024 ==

'''''[[OSGeo_Budget_2024]]'''''
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 51950 [21500] || 0 || Total Requested
|-
| Hosting || 6,500 [0] || 0 ||OSUOSL for hosting services $6500
|-
| Wordpress ACF Pro Plugin || 150[0] || 0 || https://www.advancedcustomfields.com/pro/?utm_source=ACF+PRO (needed for both prod and dev)
|-
| Limesurvey || 100 [0] || 0 || ComfUpdate payment
|-
| Hardware Supplies || 2,500 [0] || 0 || Emergency reserve for replacing parts as needed (drives, power supplies etc) and new hard drives, but not planned any change
|-
| Donations open source infra projects || 4,000 [0] || 0 || See https://wiki.osgeo.org/wiki/SAC:Budget#Donations_open_source_infra_projects
|-
| Domains || 300 [0] ||341 || Renewals, 13 renewals and registrations for 1 year $21.85/year
|-
| Sysadmin || 38,400 [19200] || ~19200 || Specific or General support contracts. Can be used in any hours desired and rate/hr, to be approved by SAC PSC. Key items for this year: Upgrade LDAP, Osgeo6, OSGeo7, secure, pretalx, wiki, matrix, mail system, migrate mailing lists to discourse, standardize infra on ansible, update documentation on our system setup

|}

=== Donations open source infra projects ===
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Pretalx || 500 [0] || 0 ||
|-
| weblate || 500 [0] || 0 ||
|-
| Matrix || 500 [0] || 0 ||
|-
| LiberaChat || 500 [0] || 0 ||
|-
| Trac || 500 [0] || 0 ||
|-
| gitea || 500 [0] || 0 ||
|-
| LXD/Incus (main contributor) || 500 [0] || 0 ||
|-
| jitsi || 500 [0] || 0 ||
|}

=== SysAmin contracts ===
{| class="wikitable sortable"
|-
! Name !! Hours !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Sandro || 100 [50] || 12800 [6400] || || Upgrade mail (major upgrade to be used by mailman and discourse), matrix (newer clients will not be able to use soon without upgrade); ansible standardization; General support
|-
| Vicky || 100 [50] || 12800 [6400] || || Discourse migration and mirroring, website/wordpress, ansible standardization, nginx, General support
|}

== 2023 ==

'''''[[OSGeo_Budget_2023| Submitted to Board]]'''''
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 32550 [32550] || ? || Total Requested
|-
| Hosting || 6000 [6000] || ? || Donation to OSUOSL for hosting services $6000
|-
| Hardware Supplies || 2,500 [0] || 0 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 1,000 [1000] || 0 || Fund for utilizing 3rd party cloud services
|-
| Donations open source infra projects || 4,000 [4000] || $2582? || Given: Pretalx, weblate, Matrix, LiberaChat, Limesurvey, Trac, gitea, incus/lxd (main contributor), LimeSurvey Comfupdate ($82)
|-
| Domains || 300 [300] || 136 || Renewals, expect 3 domains (~$15 x 5 years each)
|-
| Sysadmin || 18750 [18750] || ~$18592 || 150 hours, ~3x 50 hour general support contracts (~6250 USD each)

|}

=== Donations open source infra projects ===
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Pretalx || 500 || 500 ||
|-
| weblate || 500 || 500 ||
|-
| Matrix || 500 || 0 ||
|-
| LiberaChat || 500 || 500 ||
|-
| Trac || 500 || ? ||
|-
| gitea || 500 [0] || ? ||
|-
| LXD/Incus (main contributor) || 500 [0] || 500 ||
|-
| jitsi || 500 [0] || ? ||
|-
| Limesurvey || 82 || 82 ||
|}

== 2022 ==

'''''[[OSGeo_Budget_2022| Submitted to Board]]'''''
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 32550 [32,550] || 26905.32 || Total Requested
|-
| Hosting || 5000 [5000] || 5000 || Donation to OSUOSL for hosting services $5000
|-
| Hardware Supplies || 2,500 [2,500] || ~$526 || Drives for osgeo8 and osgeo9
|-
| Cloud Hosting || 2,000 [2,000] || 0 || Fund for utilizing 3rd party cloud services
|-
| Donations open source infra projects || 4,000 [4,000] || ~2582 USD || Currently dispensed: Pretalx , Weblate, Limesurvey (78 Euro) for comfort update tool), gitea, LiberaChat , Matrix. Help keep software we use FOSS in particular projects with very few developers
|-
| Domains || 300 [300] || 22.65 + 377.5 + 22.65 = 422.80 || Renewals, expect 3 domains (~$15 x 5 years each)
|-
| Sysadmin || 18750 [18750] || 5975 + 6200 + 1891 + 1891 + 1580 + 713 + 124 ($18374) || 150 hours, ~3x 50 hour general support contracts (~6250 USD each)

|}

== 2021 ==

'''''[[OSGeo_Budget_2021| Submitted to Board]]''''' - [[http://osgeo-org.1560.x6.nabble.com/SAC-2021-Budget-Vote-td5454922.html vote]]
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 35100 [30,700] || 0 || Total Requested - New amount is $31600 + (with $3500 carried from 2020 contract - see below)
|-
| Hosting || 4,600 || 0 || Donation to OSUOSL for hosting services $4600
|-
| Hardware Supplies || 1,000 || 0 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 6,000 || 0 || Fund for utilizing 3rd party cloud services as needed includes Travis ($5000) + $1000 set aside for others
|-
| Domains || 300 || 0 || Renewals, expect 3 domains (~$15 x 5 years each), expect a few transfers from Eclipse Foundation.
|-
| Sysadmin || 13200 [8800] || 0 || 120 hours, ~3x 40 hour general support contracts (~4400 USD each)
|-
| Wiki LDAP Completion || $6,500 || $8050 || Contract to complete migration Wiki logins to LDAP, OSGeo single sign on. This amount is the maximum, it could cost less based on actual hours required to complete.
|-
| Wiki LDAP || $3,500 || $3,500 || Existing contract commitment from 2020.
|}

* Regina - I think funtoo we should discontinue because we only had limesurvey on there and I have since moved that to osgeo3. We will be using more OSUOSL resources for the osgeo8 and osgeo9 so that $600 saved on funtoo should be allocated to OSUOSL to compensate for the extra rackspace and support we'll need.
* Alex - Wiki LDAP project was split for easier accounting and the need to carry an already contracted amount over. Compromise in terms of total support hours, +20 from 100 hours in light of budget constraints, and the ongoing Wiki LDAP project costs. We only spent 100 hours last year, the remaining being spent on the Wiki LDAP project. On mailing list somewhere between 2-4 contracts was suggested 100-200 hours.
* Jody - isolated prior commitment into a distinct line, board does not hold over budget annually so I wanted to phrase this as a existing contract commitment.

== 2020 ==

{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 28350 || ~12632 || Total Requested
|-
| Hosting || 4,600 || ? || Donation to OSUOSL for hosting services $4000, $500 to funtoo (as monthly payments of $50/mth).
|-
| Hardware Supplies || 1,000 || 742 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 6,000 || ? || Fund for utilizing 3rd party cloud services as needed includes Travis ($5000) + $1000 set aside for others
|-
| Domains || 250 || 390 || Renewals and new ones: postgis.net, gdal.org, proj.org, geotools.org, mapserver.org
|-
| Sysadmin || 16500 || 16500[Contracted, ~$11,500 spent] || 3x 50 hour support contracts (~5500 USD each), 1 for Wiki/LDAP, 2 for general support/upgrade
|}

== 2019 ==
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 23750 || 15351.72 || Total Requested and Approved
|-
| Hosting || 5,000 || $4000+6*50?/month || Donation to OSUOSL for hosting services $4000, to make up for last year, $1000 to funtoo (as monthly payments of $50).
|-
| Hardware Supplies || 1,000 || 776 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 1,000 || || Fund for utilizing 3rd party cloud services as needed
|-
| Domains || 250 || 275.72 (65+56+24.72+65+65) || Renewals and new ones: postgis.net, gdal.org, proj.org, geotools.org, mapserver.org
|-
| Sysadmin || 16500? || 10000 || 3x 50 hour support contracts (~5500 USD each), at least 1 for wordpress, 1 for wiki LDAP migration, and 1 for general server support.
|}

== 2018 ==
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 20,250[20,000] || 10201 ||
|-
| Hosting || 2,000 || 0 || Donation to OSUOSL for hosting services - Was held up waiting for board to add more funds.
|-
| OSGeo7 || 6,000 || 7,221 ||New machine to replace OSGeo3. Was budgeted last year but not spent/purchased due to logistics.
|-
| Cloud Hosting || 1,000 || Travis?? ||Fund for utilizing 3rd party cloud services as needed
|-
| Domains || 250 || 230 || Renewals and new ones (65+56+19+45+45)
|-
| Sysadmin || 11,000 || ~2,750 || 2x 50 hour support contracts
|}

== 2017 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || 15,000 || (+$3000 for new website if needed)
|-
| WebSite Hosting Transfer || -384.03 || GetInteractive
|-
| Cloud Hosting || -100.00 || 34.95 Euro/month, estimated cost 2.5 months.
|-
| Sysadmin || -5533.05 || strk, 5000 EUR (USD approximate)
|}

== 2016 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || 12,800 ||
|-
| SSL Certs || -744.51 || 3 yr.
|-
| Domains || -195.97 ||
|-
| Sysadmin || -5200 || strk, 5000 EUR (USD approximate)
|}

== 2015 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2015|Budget]] || 8,700.00 ||
|-
| OSGeo6 || -5,580.82 ||
|-
| Domains || -214.00 ||
|-
| CodeHaus Move Contract || -800.00 ||
|}

== 2014 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2014|Budget]] || 12054 ||
|-
| Hard Drive & PSU Replacement || -245.06 || 3 yr.
|-
| PEER1 Hosting || -1,903.73 ||
|}

== 2013 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2013|Budget]] || 12054 ||
|-
| Backup Server || -2,403.00 ||
|-
| PEER 1 Hosting || -1,204.51 ||
|-
| OSUOSL Hosting (Donation) || -3150.00 ||
|}

== 2012 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2012|Budget]] || 12600 ||
|-
| PEER 1 Hosting || -7,820.15 ||
|}

== 2011 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || -1,499 || 5 yr. OV
|-
| PEER 1 Hosting || -6,993.68 ||
|}

== 2010 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2010|Budget]] || 9900 ||
|-
| OSGeo 3/4 || -15,239.69 ||
|-
| Domains || -440.00 ||
|-
| Peer Directed Projects Center / Freenode || -77.00 || Anyone remember what this was for?
|-
| PEER 1 Hosting || -13,851.98 ||
|-
| Perflect / PSD2HTML || -533.00 || Anyone remember what this was for?
|}

== 2009 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || ? || 3 yr.
|-
| Domains || ? ||
|}

== 2008 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || ? || 3 yr.
|-
| Domains || ? ||
|}

== 2007 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || ? || 3 yr.
|-
| Domains || ? ||
|}

[[Category:Budget]]
[[Category:Infrastructure]]

SAC:LDAP

2025-09-30T14:09:55Z

Strk: /* User registration */

OSGeo endevours to offer a "single signon" for OSGeo services. User help is available in [[Osgeo Userid Help]].

It is currently used for [[Subversion]], [[Trac Instances|Trac]], [[SAC_Service_Status#Web|Drupal]], [[SAC_Service_Status#QGIS|QGIS services]] (hub.qgis.org and plugins.qgis.org), www.osgeo.org, [[SAC:Gitea|Gitea]], [[SAC_Service_Status#Nextcloud_nextcloud.osgeo.org|Nextcloud]], [[SAC:MatrixSynapse|Matrix-Synapse]] and shell access (opt-in).

A staged migration to internal LDAP for [[SAC_Service_Status#Wiki|mediawiki]] was initiated in 2021. Other [[SAC_Service_Status|services]] may be possible in the future.

LDAP management is the responsibility of [[SAC]] (the System Administration Committee).

= LDAP Server (OpenLDAP) =

The userid database is kept in LDAP on ldap.osgeo.org ([[SAC_Service_Status#Secure|secure vm]]).
It is served by OpenLDAP ([http://www.openldap.org/doc/admin/ OpenLDAP Admin Guide]).

The ldap daemon can manipulated as 'root' user with,
$ service slapd [start|stop|restart]

We have moved to OLC:

http://www.zytrax.com/books/ldap/ch6/slapd-config.html#intro

So config file is in:
/etc/ldap/slapd.d/cn-config # should be modified with ldapmodify

IP access filter is set by via OSGeo7 ufw firewall:
refer to [https://git.osgeo.org/gitea/sac/osgeo7 OSGeo7 host for details]

== LDAP structure ==

Currently ldap structure is pretty basic. The purpose for keeping this structure simple is to allow for a more complex structure to be evolved as ldap becomes increasingly integrated into the full osgeo systems structure.

*dc=osgeo,dc=org
**cn=Manager
**ou=people
***Separate entity for each user
*:uid=login,ou=people,dc=osgeo,dc=org
*:objectClass=inetOrgPerson
*:cn=firstName lastName
*:sn=lastName
*:uid=login
*:mail=email@address
*:userPassword={md5}YPTyViiMKhiuWKEmFUOKLA==
*:Also contains posixAccount and shadowAccount fields if this account is login enabled.
**ou=projects,dc=osgeo,dc=org
*:objectClass=organizationalUnit
*:ou=project
*:description=separate entity for each osgeo project with list of members
***Separate entity for each project group
*:cn=admin,ou=projects,dc=osgeo,dc=org
*:objectClass=groupOfNames
*:cn=admin
*:description=osgeo sysadmin group
**ou=svn
*:objectClass=organizationalUnit
*:ou=svn
*:description=separate entity for each repository with list of members with commit rights
***separate entity for each svn group (for example FDO)
*:cn=fdo,ou=svn,dc=osgeo,dc=org
*:objectClass=groupOfNames
*:cn=fdo
*:member= dn of member
**ou=Shell (parent for "login" groups)
*:description=NextUID:nnnnn (the next unix uidNumber value to assign)
***cn=telascience,ou=Shell,dc=osgeo,dc=org (list of all userids with telascience login access)
*:uniqueMember=dn of member

'''Example ldif file'''
<pre>
version: 1

dn: dc=osgeo,dc=org
objectClass: dcObject
objectClass: organization
description: OSGeo ldap dit
o: OSGeo
dc: osgeo

dn: cn=Manager,dc=osgeo,dc=org
objectClass: organizationalRole
cn: Manager

dn: ou=people,dc=osgeo,dc=org
ou: people
description: all users of osgeo
objectClass: organizationalUnit

dn: uid=jsmith,ou=people,dc=osgeo,dc=org
objectClass: inetOrgPerson
uid: jsmith
cn: Jon Smith
sn: Smith
givenName: Jon
mail: jsmith@somewhere.com
userPassword: {md5}5Or4zfzGqo3jh/6iIUgKcA==

dn: uid=jbrown,ou=people,dc=osgeo,dc=org
objectClass: inetOrgPerson
uid: jbrown
cn: Jane Brown
sn: Brown
givenName: Jane
mail: jbrown@someotherplace.com
userPassword: {md5}1iWhTyvkK2m4Uuar+Dp/IA==

dn: ou=projects,dc=osgeo,dc=org
ou: projects
description: separate entity for each osgeo project with list of members
objectClass: organizationalUnit

dn: cn=admin,ou=projects,dc=osgeo,dc=org
cn: admin
description: osgeo sysadmin group
objectClass: groupOfNames
member: uid=jbrown,ou=people,dc=osgeo,dc=org
member: uid=jsmith,ou=people,dc=osgeo,dc=org

dn: ou=svn,dc=osgeo,dc=org
ou: svn
description: separate entity for for each repository.list of members with commit rights
objectClass: organizationalUnit

dn: cn=fdo,ou=svn,dc=osgeo,dc=org
objectClass: groupOfNames
cn: fdo
member: uid=jsmith,ou=people,dc=osgeo,dc=org
member: uid=jbrown,ou=people,dc=osgeo,dc=org

dn: cn=gdal,ou=svn,dc=osgeo,dc=org
cn: gdal
objectClass: groupOfNames
objectClass: top
member: uid=jbrown,ou=people,dc=osgeo,dc=org
member: uid=jsmith,ou=people,dc=osgeo,dc=org

dn: cn=mapbender,ou=svn,dc=osgeo,dc=org
objectClass: groupOfNames
cn: mapbender
member: uid=jsmith,ou=people,dc=osgeo,dc=org

dn: cn=mapguide,ou=svn,dc=osgeo,dc=org
objectClass: groupOfNames
cn: mapguide
member: uid=jbrown,ou=people,dc=osgeo,dc=org
</pre>

= LDAP Clients =

== Web interface ==

The LDAP web admin tools were initially written by Frank Warmerdam and subsequently improved by Sandro Santilli.
They are written in python and can currently be found in /usr/lib/cgi-bin on the "old-web" container on OSGeo7 (ie. id.osgeo.org).
From may 12, 2016, cgi-bin scripts are managed with a local git repository (<code>/usr/lib/cgi-bin/.git</code>). A clone of the git repository is published as a [https://git.osgeo.org/gitea/sac/web-cgi-bin private repository] (you will get a 404 unless you are part of the SAC team) on the [[SAC:Gitea]] service.

The scripts read the LDAP manager password from a credentials file that will need to be updated anytime the master LDAP manager password is changed.

Some public notes on OSGeo userids available at:

http://www.osgeo.org/osgeo_userid

=== User registration ===

The main entry point for OSGeo users is the registration form:

https://id.osgeo.org/ldap/create

'''''NOTE''': as of June 2016 the public user registration form may require entering a "mantra" (a pseudo-secret passphrase) - already registered trusted users can find out what the mantra is and how to share on https://gitea.osgeo.org/sac/userid-mantra/wiki (requires login and access grant, otherwise the page will appear as 404).''

=== User edit ===

To edit an individual userid use /ldap/edit (ldap_user_edit.py). If you add ?userid=''osgeo_userid'' you can edit someone elses ldap entry as long as you are in the admins group.

https://id.osgeo.org/ldap/edit
https://id.osgeo.org/ldap/edit?userid=osgeotest123

=== Password reset ===

Users can request a password reset using this form:

https://id.osgeo.org/ldap/reset

=== Users lookup ===

Administrators can login to this special ldap search tool, and will see email address, and will have a link to edit the LDAP entries. You need to be in the cn=admin,ou=projects listing.

https://id.osgeo.org/ldap/admin/search

There is also a non-admin version of the search, but will not show email nor links to edit:

https://id.osgeo.org/ldap/search

=== Groups management ===

SVN and other groups can be administered with the group editor. You need to either be in the group being viewed/modified or in the cn=admin,ou=projects group in order to edit a group.

Edit GDAL commit list:
https://id.osgeo.org/ldap/group?group=gdal

Edit Admins list:
https://id.osgeo.org/ldap/group?group=admin&ou=projects

=== Shell group management ===

To edit the list of people who have shell access to the various projects servers, including the download server use the following url. You have to be in the group already, or in the Admins group in order to add and remove people. Adding someone will add the required posixAccount and related attributes to the users LDAP entry.

https://id.osgeo.org/ldap/shell

The ldap_shell.py script can also operate on other groups used for shell access using the group attribute. Currently the only other group is the sac group used for shell access on the core services VMs at OSU OSL.

https://id.osgeo.org/ldap/shell?group=sac

== Command line interface ==

The commandline interface can be used by any of the OSGeo machines but not from outside the network.
The tools are from the ''ldap-utils'' debian package.

All ``ldap-utils`` commands will use systemwide or user-specific files for default configuration so things like LDAP Base (-b dc=osgeo,dc=org) and LDAP URI (-H ldaps://ldap.osgeo.org) need not be specified on each commandline from properly configured machines (grep URI /etc/ldap/ldap.conf; grep BASE /etc/ldap/ldap.conf).

=== Editing the LDAP database users and groups ===

Editing LDAP database requires an admin password or root access to secure container. The -W switch asks for a password prompt (known by [[SAC:Primary Administrators]]).

Loading an ldif file into an ldap directory:

$ ldapadd -a -W -x -D "cn=Manager,dc=osgeo,dc=org" -f fileName.ldif

Deleting an account (by uid) from the database through "ldapdelete":

$ uid="account-to-be-deleted" ldapdelete -W -D cn=Manager,dc=osgeo,dc=org -x "uid=${uid},ou=People,dc=osgeo,dc=org"

Deleting an account (by uid) from the database through an ad-hoc script from the "''www.osgeo.org''" machine:
$ /osgeo/tools/ldap/ldap_delete_user "account-to-be-deleted"

Resetting a user password:

$ uid="account-to-be-reset" ldappasswd -S -W -D cn=Manager,dc=osgeo,dc=org -x "uid=${uid},ou=People,dc=osgeo,dc=org"
# Or from the "www.osgeo.org" machine, run:
$ /osgeo/tools/ldap/ldap_reset_user_password "account-to-be-reset"
# A new random password will be sent to the user. Asks for confirmation.

Modifying the email of a user:

Create a file ''change_mail.ldif'' with the following contents

dn: uid=<osgeoid>,ou=People,dc=example,dc=com
changetype: modify
replace: mail
mail: newmail@newmail.new

Execute the command

$ ldapmodify -v -W -D cn=Manager,dc=osgeo,dc=org -f /path/to/change_mail.ldif
# Remove the created `.ldif`
rm /path/to/change_mail.ldif

=== Editing the LDAP database config ===

Increasing default page limit -

$ ssh root@osgeo9-secure
$ ldapmodify -H ldapi:/// -Y EXTERNAL -f modify_max_page_limit.ldif
$ systemctl restart slapd
$ ldapsearch -H ldapi:/// -Y EXTERNAL -b cn=config | grep olcSizeLimit #to confirm change

Where modify_max_page_limit.ldif looks something like

dn: olcDatabase={-1}frontend,cn=config
changetype: modify
replace: olcSizeLimit
olcSizeLimit: 500

=== Querying the LDAP database ===

The ldapsearch command is used to query a LDAP database.

This command dumps the first 500 entries of the ldap database. Note that secure-dev on osgeo4 has limit set to 40000 for easier pull by admins. refer to modify section for instructions how to set the limits.

$ ldapsearch -x

Refine your search based on the LDAP structure listed above.

Example: list all SVN groups (override BASE to limit the ou to svn, then search for objects with the right objectClass).

$ ldapsearch -s one -b ou=svn,dc=osgeo,dc=org -x "objectClass=groupOfNames" | grep ^cn

Example: list all entries created after April 1st 2016:

$ ldapsearch -x "createTimestamp>=20160401100000Z"

Example: list all entries created in 2019:

$ ldapsearch -x '(&(createTimestamp>=20190101000000Z)(!(createTimestamp>=20200101000000Z)))'

The fields to be shown in the output can be specified as additional parameters, like:

$ ldapsearch -x "uid=strk" createtimestamp modifytimestamp

Find the email addresses of all members in the GRASS GIS core group:
$ ldapsearch -x '(|'`ldapsearch -x 'cn=grass' | grep ^member | sed 's/.* uid=$[^,]*$,.*/(uid=\1)/' | tr -d '\n'`')' | grep ^mail | sed 's/^mail: //'

Find the email addresses of all members in the GRASS GIS core group and store as CSV file (ID, name, email):
$ ldapsearch -x '(|'`ldapsearch -x 'cn=grass' | grep ^member | sed 's/.* uid=$[^,]*$,.*/(uid=\1)/' | tr -d '\n'`')' | \
grep '^u: /\n|/'| sed 's/^cn: //' | sed 's/^sn: //' | sed 's/^mail: //' | sed 's/^cn:: //' | sed 's/^sn:: //' \
| tr '\n' ',' | tr '|' '\n' | sed 's+,,$++g'

If you are on a server that is whitelisted to query osgeo, but the ldap.conf is not setup, you migh need to explicitly specify the host like so

$ ldapsearch -x "uid=robe" -b "dc=osgeo,dc=org" -H ldaps://ldap.osgeo.org

If you get an error you can debug source with:

$ ldapsearch -x "uid=robe" -b "dc=osgeo,dc=org" -H ldaps://ldap.osgeo.org -d 1
For more complex queries, see http://www.ldapexplorer.com/en/manual/109010000-ldap-filter-syntax.htm

= Monitoring =

Web-based users creation and editing can be monitored looking at the '/var/log/apache2/www_access.log' files on 'www.osgeo.org'.

A cronjob on [[TracsvnVM]] is setup to run hourly ('/etc/cron.hourly/check_excessive_new_ldap_users')
and report to the [https://lists.osgeo.org/mailman/listinfo/sac SAC mailing list] if more than a given max users are created in that timespam (check the script for details). The scripts to generate the reports are again on 'trac.osgeo.org' machine under '/osgeo/tools/ldap', where a git repository exists.

= Troubleshooting =

* "sudo" unavailable to LDAP-authenticated users on Debian7. See:
*:https://bugs.launchpad.net/ubuntu/+source/gnutls26/+bug/926350 and
*:https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=579647
** Short form: "libgnutls" in Debian7 is linked against "libgcrypt" which refuses to work in setuid-binaries - like "sudo".
** Solution: Rebuild "libgnutls" using "libnettle" instead of "libgcrypt":
*** aptitude install libhogweed2 libnettle4 nettle-dev libp11-kit-dev
*** apt-get remove libgnutls-dev
*** apt-get source gnutls26
*** # remove --with-libgcrypt from the debian/rules file
*** # build using this command:
*** debuild -i -uc -us -b
** Functional GnuTLS packages available on "secure" in /home/martin/GnuTLS.Deb/

* "sudo" unavailable to LDAP-authenticated users on Debian6 with backports. See:
*:http://lists.osgeo.org/pipermail/sac/2012-October/004120.html
** Solution:
<hostname>:~# cat /etc/apt/preferences.d/sudo.pref
Package: sudo
Pin: version 1.7.4*
Pin-Priority: 1000

[[Category:Infrastructure]]
[[Category:Services]]

SAC:Budget

2025-09-30T13:52:29Z

Strk: /* 2025 */

Please help fill in the based on this [https://drive.google.com/open?id=0ByfEHeRRT620SnliNDhJT25HTms pdf report] from the treasurer.
Budget allocations can be found via general budget pages on the wiki.

== 2025 ==

'''''[[OSGeo_Budget_2025]]'''''

=== Overall ===

{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 55850 [16000] || 0 || Total Requested
|-
| Hosting || 6,500 [0] || 0 ||OSUOSL for hosting services $6500
|-
| Wordpress ACF Pro Plugin || 150[0] || 0 || https://www.advancedcustomfields.com/pro/?utm_source=ACF+PRO (needed for both prod and dev)
|-
| Limesurvey || 100 [0] || 0 || ComfUpdate payment
|-
| Hardware Supplies || 2,500 [0] || 0 || Emergency reserve for replacing parts as needed (drives, power supplies etc) and new hard drives, but not planned any change
|-
| Donations open source infra projects || 4,000 [0] || 0 || See https://wiki.osgeo.org/wiki/SAC:Budget#Donations_open_source_infra_projects
|-
| Domains || 300 [300] ||0 || Renewals, expect 5 domains (~$15 x 5 years each)
|-
| Sysadmin || 44800 [15,360] || 7680 (vicky) || 350 hrs contract time (120 hrs approved) to be split up as needed -- Specific or General support contracts. See [[SAC:Budget#SysAmin contracts]] for details.
|-
| General In-kind support || || || Discourse moderation (~25 hrs) , Mailman moderation (~15 hrs), Weblate Moderation (~5 hrs), Pretalx Moderation (~ 5 hrs) , Mantra Moderation ~90 hrs (guesstimate)
|}

=== SysAmin contracts details ===
{| class="wikitable sortable"
|-
! Name !! Hours !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Sandro || 60 [0] || 7680 [0] || || New mail system (major upgrade to be used by mailman, discourse, gitea, and all other osgeo services), ansible standardization; General support. This should significantly reduce spam and also make our mail less prone to being flagged as spam by google etc
|-
| Vicky ||60 [0] || 7680 [0] || 7680|| Mailing lists to Discourse migration and mirroring, website/wordpress fixes to support newer PHP, General support
|}

== 2024 ==

'''''[[OSGeo_Budget_2024]]'''''
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 51950 [21500] || 0 || Total Requested
|-
| Hosting || 6,500 [0] || 0 ||OSUOSL for hosting services $6500
|-
| Wordpress ACF Pro Plugin || 150[0] || 0 || https://www.advancedcustomfields.com/pro/?utm_source=ACF+PRO (needed for both prod and dev)
|-
| Limesurvey || 100 [0] || 0 || ComfUpdate payment
|-
| Hardware Supplies || 2,500 [0] || 0 || Emergency reserve for replacing parts as needed (drives, power supplies etc) and new hard drives, but not planned any change
|-
| Donations open source infra projects || 4,000 [0] || 0 || See https://wiki.osgeo.org/wiki/SAC:Budget#Donations_open_source_infra_projects
|-
| Domains || 300 [0] ||341 || Renewals, 13 renewals and registrations for 1 year $21.85/year
|-
| Sysadmin || 38,400 [19200] || ~19200 || Specific or General support contracts. Can be used in any hours desired and rate/hr, to be approved by SAC PSC. Key items for this year: Upgrade LDAP, Osgeo6, OSGeo7, secure, pretalx, wiki, matrix, mail system, migrate mailing lists to discourse, standardize infra on ansible, update documentation on our system setup

|}

=== Donations open source infra projects ===
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Pretalx || 500 [0] || 0 ||
|-
| weblate || 500 [0] || 0 ||
|-
| Matrix || 500 [0] || 0 ||
|-
| LiberaChat || 500 [0] || 0 ||
|-
| Trac || 500 [0] || 0 ||
|-
| gitea || 500 [0] || 0 ||
|-
| LXD/Incus (main contributor) || 500 [0] || 0 ||
|-
| jitsi || 500 [0] || 0 ||
|}

=== SysAmin contracts ===
{| class="wikitable sortable"
|-
! Name !! Hours !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Regina || 100 [50] || 12800 [6400] || || Upgrades: wiki (major upgrade, our version is EOL), pretalx (major upgrade flip to postgres, new preferred db), osgeo7, osgeo6, ldap (this is a major upgrade since requires db upgrade); Other upgrades as needed; General support
|-
| Sandro || 100 [50] || 12800 [6400] || || Upgrade mail (major upgrade to be used by mailman and discourse), matrix (newer clients will not be able to use soon without upgrade); ansible standardization; General support
|-
| Vicky || 100 [50] || 12800 [6400] || || Discourse migration and mirroring, website/wordpress, ansible standardization, nginx, General support
|}

== 2023 ==

'''''[[OSGeo_Budget_2023| Submitted to Board]]'''''
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 32550 [32550] || ? || Total Requested
|-
| Hosting || 6000 [6000] || ? || Donation to OSUOSL for hosting services $6000
|-
| Hardware Supplies || 2,500 [0] || 0 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 1,000 [1000] || 0 || Fund for utilizing 3rd party cloud services
|-
| Donations open source infra projects || 4,000 [4000] || $2582? || Given: Pretalx, weblate, Matrix, LiberaChat, Limesurvey, Trac, gitea, incus/lxd (main contributor), LimeSurvey Comfupdate ($82)
|-
| Domains || 300 [300] || 136 || Renewals, expect 3 domains (~$15 x 5 years each)
|-
| Sysadmin || 18750 [18750] || ~$18592 || 150 hours, ~3x 50 hour general support contracts (~6250 USD each)

|}

=== Donations open source infra projects ===
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Pretalx || 500 || 500 ||
|-
| weblate || 500 || 500 ||
|-
| Matrix || 500 || 0 ||
|-
| LiberaChat || 500 || 500 ||
|-
| Trac || 500 || ? ||
|-
| gitea || 500 [0] || ? ||
|-
| LXD/Incus (main contributor) || 500 [0] || 500 ||
|-
| jitsi || 500 [0] || ? ||
|-
| Limesurvey || 82 || 82 ||
|}

== 2022 ==

'''''[[OSGeo_Budget_2022| Submitted to Board]]'''''
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 32550 [32,550] || 26905.32 || Total Requested
|-
| Hosting || 5000 [5000] || 5000 || Donation to OSUOSL for hosting services $5000
|-
| Hardware Supplies || 2,500 [2,500] || ~$526 || Drives for osgeo8 and osgeo9
|-
| Cloud Hosting || 2,000 [2,000] || 0 || Fund for utilizing 3rd party cloud services
|-
| Donations open source infra projects || 4,000 [4,000] || ~2582 USD || Currently dispensed: Pretalx , Weblate, Limesurvey (78 Euro) for comfort update tool), gitea, LiberaChat , Matrix. Help keep software we use FOSS in particular projects with very few developers
|-
| Domains || 300 [300] || 22.65 + 377.5 + 22.65 = 422.80 || Renewals, expect 3 domains (~$15 x 5 years each)
|-
| Sysadmin || 18750 [18750] || 5975 + 6200 + 1891 + 1891 + 1580 + 713 + 124 ($18374) || 150 hours, ~3x 50 hour general support contracts (~6250 USD each)

|}

== 2021 ==

'''''[[OSGeo_Budget_2021| Submitted to Board]]''''' - [[http://osgeo-org.1560.x6.nabble.com/SAC-2021-Budget-Vote-td5454922.html vote]]
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 35100 [30,700] || 0 || Total Requested - New amount is $31600 + (with $3500 carried from 2020 contract - see below)
|-
| Hosting || 4,600 || 0 || Donation to OSUOSL for hosting services $4600
|-
| Hardware Supplies || 1,000 || 0 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 6,000 || 0 || Fund for utilizing 3rd party cloud services as needed includes Travis ($5000) + $1000 set aside for others
|-
| Domains || 300 || 0 || Renewals, expect 3 domains (~$15 x 5 years each), expect a few transfers from Eclipse Foundation.
|-
| Sysadmin || 13200 [8800] || 0 || 120 hours, ~3x 40 hour general support contracts (~4400 USD each)
|-
| Wiki LDAP Completion || $6,500 || $8050 || Contract to complete migration Wiki logins to LDAP, OSGeo single sign on. This amount is the maximum, it could cost less based on actual hours required to complete.
|-
| Wiki LDAP || $3,500 || $3,500 || Existing contract commitment from 2020.
|}

* Regina - I think funtoo we should discontinue because we only had limesurvey on there and I have since moved that to osgeo3. We will be using more OSUOSL resources for the osgeo8 and osgeo9 so that $600 saved on funtoo should be allocated to OSUOSL to compensate for the extra rackspace and support we'll need.
* Alex - Wiki LDAP project was split for easier accounting and the need to carry an already contracted amount over. Compromise in terms of total support hours, +20 from 100 hours in light of budget constraints, and the ongoing Wiki LDAP project costs. We only spent 100 hours last year, the remaining being spent on the Wiki LDAP project. On mailing list somewhere between 2-4 contracts was suggested 100-200 hours.
* Jody - isolated prior commitment into a distinct line, board does not hold over budget annually so I wanted to phrase this as a existing contract commitment.

== 2020 ==

{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 28350 || ~12632 || Total Requested
|-
| Hosting || 4,600 || ? || Donation to OSUOSL for hosting services $4000, $500 to funtoo (as monthly payments of $50/mth).
|-
| Hardware Supplies || 1,000 || 742 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 6,000 || ? || Fund for utilizing 3rd party cloud services as needed includes Travis ($5000) + $1000 set aside for others
|-
| Domains || 250 || 390 || Renewals and new ones: postgis.net, gdal.org, proj.org, geotools.org, mapserver.org
|-
| Sysadmin || 16500 || 16500[Contracted, ~$11,500 spent] || 3x 50 hour support contracts (~5500 USD each), 1 for Wiki/LDAP, 2 for general support/upgrade
|}

== 2019 ==
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 23750 || 15351.72 || Total Requested and Approved
|-
| Hosting || 5,000 || $4000+6*50?/month || Donation to OSUOSL for hosting services $4000, to make up for last year, $1000 to funtoo (as monthly payments of $50).
|-
| Hardware Supplies || 1,000 || 776 ||Reserve for replacing parts as needed (drives, power supplies etc)
|-
| Cloud Hosting || 1,000 || || Fund for utilizing 3rd party cloud services as needed
|-
| Domains || 250 || 275.72 (65+56+24.72+65+65) || Renewals and new ones: postgis.net, gdal.org, proj.org, geotools.org, mapserver.org
|-
| Sysadmin || 16500? || 10000 || 3x 50 hour support contracts (~5500 USD each), at least 1 for wordpress, 1 for wiki LDAP migration, and 1 for general server support.
|}

== 2018 ==
{| class="wikitable sortable"
|-
! Item !! Amount(Proposed)[Approved] !! Amount(Spent) !!Notes
|-
| Budget || 20,250[20,000] || 10201 ||
|-
| Hosting || 2,000 || 0 || Donation to OSUOSL for hosting services - Was held up waiting for board to add more funds.
|-
| OSGeo7 || 6,000 || 7,221 ||New machine to replace OSGeo3. Was budgeted last year but not spent/purchased due to logistics.
|-
| Cloud Hosting || 1,000 || Travis?? ||Fund for utilizing 3rd party cloud services as needed
|-
| Domains || 250 || 230 || Renewals and new ones (65+56+19+45+45)
|-
| Sysadmin || 11,000 || ~2,750 || 2x 50 hour support contracts
|}

== 2017 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || 15,000 || (+$3000 for new website if needed)
|-
| WebSite Hosting Transfer || -384.03 || GetInteractive
|-
| Cloud Hosting || -100.00 || 34.95 Euro/month, estimated cost 2.5 months.
|-
| Sysadmin || -5533.05 || strk, 5000 EUR (USD approximate)
|}

== 2016 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || 12,800 ||
|-
| SSL Certs || -744.51 || 3 yr.
|-
| Domains || -195.97 ||
|-
| Sysadmin || -5200 || strk, 5000 EUR (USD approximate)
|}

== 2015 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2015|Budget]] || 8,700.00 ||
|-
| OSGeo6 || -5,580.82 ||
|-
| Domains || -214.00 ||
|-
| CodeHaus Move Contract || -800.00 ||
|}

== 2014 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2014|Budget]] || 12054 ||
|-
| Hard Drive & PSU Replacement || -245.06 || 3 yr.
|-
| PEER1 Hosting || -1,903.73 ||
|}

== 2013 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2013|Budget]] || 12054 ||
|-
| Backup Server || -2,403.00 ||
|-
| PEER 1 Hosting || -1,204.51 ||
|-
| OSUOSL Hosting (Donation) || -3150.00 ||
|}

== 2012 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2012|Budget]] || 12600 ||
|-
| PEER 1 Hosting || -7,820.15 ||
|}

== 2011 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || -1,499 || 5 yr. OV
|-
| PEER 1 Hosting || -6,993.68 ||
|}

== 2010 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| [[OSGeo Budget 2010|Budget]] || 9900 ||
|-
| OSGeo 3/4 || -15,239.69 ||
|-
| Domains || -440.00 ||
|-
| Peer Directed Projects Center / Freenode || -77.00 || Anyone remember what this was for?
|-
| PEER 1 Hosting || -13,851.98 ||
|-
| Perflect / PSD2HTML || -533.00 || Anyone remember what this was for?
|}

== 2009 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || ? || 3 yr.
|-
| Domains || ? ||
|}

== 2008 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || ? || 3 yr.
|-
| Domains || ? ||
|}

== 2007 ==
{| class="wikitable sortable"
|-
! Item !! Amount !! Notes
|-
| Budget || ? ||
|-
| SSL Certs || ? || 3 yr.
|-
| Domains || ? ||
|}

[[Category:Budget]]
[[Category:Infrastructure]]

SAC

2025-09-21T09:21:40Z

Strk: /* Services */

= Mission =
The OSGeo System Administration Committee (SAC) manages [[SAC_Service_Status|computer systems]] operated by OSGeo. Responsibilities include:

* Develop published policies and procedures for managing systems, and system services.
* Solicit input from stakeholders on required system services, and to prioritize which to offer and when.
* Assign appropriate security and other responsibilities to administrators and users for access to systems.
* Ensure core OSGeo system services are well maintained, highly available and recoverable in case of system failure.
* Recommend system expenditures to the Board.

= Members =

([[SAC:Primary Administrators]])

A [[SAC:LDAP|LDAP]] group holds the [https://id.osgeo.org/ldap/shell?group=sac authoritative list of current SAC administrators] (need an [https://www.osgeo.org/osgeo_userid OSGeo account to read).

== Active ==
* [[User:strk|Sandro Santilli]] aka strk (General Administration, [[Trac Instances|trac]], [[SAC:Gitea|Gitea]], [[Drone]])
* [[User:robe|Regina Obe]] ( general server administration and management which includes server patches, osgeo3-osgeo9 lxd hosts, DNS changes)
* [[User:Cvvergara| Vicky Vergara]] ( website administration, lists administration, general server administration )
* [[User:Jef|Jürgen Fischer]] (QGIS, OSGeo4W, Downloads, various)
* [[User:jive| Jody Garnett]] (website administration, repository)
* [[User:lnicola| Laurențiu Nicola]] (Download, wiki, website, Mantra, ldap, Gitea)
* [[Jorge Sanz]] ([[SAC:Mailing Lists|Mailing Lists]], [[PlanetOSGeo]])
* [[User:Neteler|Markus Neteler]] (GRASS CMS + Wiki, fail2ban, various)
* [[Jeff McKenna]] (Wiki, Mapserver website and demo, WebExtra, Tracsvn)
* [[User:tomkralidis|Tom Kralidis]] (Observer, OSGeo Board)
* Frank Warmerdam (Downloads, [[SAC:Mailing Lists|Mailing Lists]], [[SAC:LDAP|LDAP Scripts]])
* [[User:Martin|Martin Spott]] (Backups, everything else)

== InActive ==
* Eli Adam (Foss4g Archives)
* Shawn Barnes
* Wolf Bergenheim
* Alan Boudreault
* Hamish Bowman (OSGeo Live)
* Howard Butler
* [[Paolo Corti]] ([[PlanetOSGeo]])
* Richard Duivenvoorde (QGIS)
* [[User:wildintellect|Alex Mandel]] '''Chair''' (General)
* [[User:TemptorSent| Chris Giorgi]] aka TemporSent (funtoo setup, osgeo7, eventually wiki/ldap integration)
* John Graham
* Harrison Grundy
* Swapnil Hajare
* [[User:ajolma|Ari Jolma]]
* [[Mateusz Loskot]] ([[SAC:Mailing Lists|Nabble, Mailing Lists (Jobs)]], [[PlanetOSGeo]])
* Daniel Morissette
* [[User:Jgrocha|Jorge Rocha]]
* Larry Shaffer (Apple Signing Certificates)
* Chris Schmidt (OAM, Vmap0, Sr.org)
* Gary Sherman ([[IRC|IRC Bots]])
* Christian Willmes (Journal, Wiki)
* Norman Vine ([[IRC]])

= Meetings =
* [[SAC_Meeting-2020-06| Jun 2020 Agenda Notes]]
* [[SAC_Meeting-2020-04| Apr 2020 Agenda Notes]]
* [[SAC_Meeting-2020-03| Mar 2020 Agenda Notes]]
* [[SAC_Metting_2020-01| Jan 2020 Agenda Notes]]
* [[SAC_Meeting_2019-11| Nov 7th Agenda Notes]]
* [[SAC_Meeting_2019-10| Oct 24th Agenda Notes]]
* [[SAC_Meeting_2019-09| Sept 12th-26th Agenda Notes]]
* [[SAC_Meeting_2019-08| Aug 1st-29th Agenda Notes]]
* [[SAC_Meeting_2019-06| Jun 6th-20th Agenda Notes]]
* [[SAC_Meeting_2019-05| May 9th-23rd Agenda Notes]]
* [[SAC_Meeting_2019-04| Apr 11th-25th Agenda Notes]]
* [[SAC_Meeting_2019-03| Mar 14th-28th Agenda Notes]]
* [[SAC_Meeting_2019-02| Feb 14th-28th Agenda Notes]]
* [[SAC_Meeting_2019-01| Jan 3rd-31st Agenda Notes]]
* [[SAC_Meeting_2018-11| Nov 15th-29th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-10| Oct 4th-25th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-09| Sept 13th-27th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-08| Aug 9th-30th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-08-02| Aug 2nd 2018 Agenda Notes]]
* [[SAC_Meeting_2018-07-26| Jul 26th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-07-12| Jul 12th 2018 Agenda (Started Jul 5th, will reconvene July 12th) & Notes]]
* [[SAC_Meeting_2018-06-24| Jun 24th 2018 Agenda (Canceled) & Notes]]
* [[SAC_Meeting_2018-06-07| Jun 7th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-05-27| May 27th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-05-10| May 10th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-04-29| April 29th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-04-14| April 14th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-29| March 29th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-15| March 15 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-02| March 2nd 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-02-15| February 15th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-02-01| February 1st 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-01-18| January 18th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-01-04| January 4th 2018 Agenda & Notes]]
* [[SAC_Meeting_2017-12-21| December 21st 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-12-07| December 7th 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-11-23| November 23rd 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-11-09| November 9th 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-10-26| October 26th 2017 Agenda & Notes]]
* [[SAC:Oct122017| October 12th 2017 Agenda & Notes]]
* [[SAC:Sep2016| September 2016 Agenda & Notes]]
* [[SAC:May2016| May 2016 Agenda & Notes]]
* [[SAC:June2010_meeting|June 2010 SAC OSL Transition Meeting]]
* 1/22/07 [[SAC:1_22_07_agenda]] [[SAC:1_25_07_minutes]]
* 2/22/07 [[SAC:2_22_07_agenda]] [[SAC:2_22_07_minutes]]
* For a complete list, see [[:Category:SAC_Meetings]]

= Communication =
* Mailing list: [https://lists.osgeo.org/mailman/listinfo/sac Subscribe], [http://lists.osgeo.org/pipermail/sac Archives]
* IRC in #osgeo-sac on libera.chat (quick access: https://web.libera.chat/)
* Matrix in #sac:osgeo.org (quick access: https://matrix.to/#/#sac:osgeo.org)
* Forum: https://discourse.osgeo.org/c/committees/sac-global-category

= Task Tracking =

Infrastructure problems should be filed as trac ticket to SAC:
* [http://trac.osgeo.org/osgeo/login login] and [http://trac.osgeo.org/osgeo/newticket?component=Systems%20Admin Submit Trac Ticket]

Open issues:
* [http://trac.osgeo.org/osgeo/query?status=new&status=assigned&status=reopened&component=Systems%20Admin&order=priority Open SAC Issues]
* Old [[SAC TODO List]] (need to migrate any remaining issues to Trac).

= Procedures =

See [[:Category:SysAdminProcedure]] for a list of pages describing procedures.

The procedure to describe procedures is to create a wiki page and add a <nowiki>[[Category:SysAdminProcedure]]</nowiki> snippet in the page.

= Documents =

* [[SAC 2018 Annual Report]]
* [[Osgeo7 | Infrastructure Transition 2018-2019 Purchase and move of services to osgeo7]]
* [[Infrastructure Transition Plan 2010]]
* [[2007 Annual Report]]
* [[OSL]] - Information on our use of system services at the OSU Open Source Labs (OSL).

== Budget ==

* [[SAC:Budget| Past, Current and Proposed Budgets]]

= Services =

* See [[:Category:Services]]
* [[SAC Service Status]] indicates what services are setup, where and known issues (OSUOSL and other locations).

= Projects with SAC involved =
* [[Geodata processing at telascience.org]] - by [[Geodata Packaging Working Group]]
* The [[Software Stack]] page talks about the ''Reference Stack'' of software we would like to setup for demonstration and testing purposes.
* [[Kids GIS Portal]] - hosted at telascience, a wee bit of systems help.

= Migration to new Infrastructure =

* [[Osgeo7 | Infrastructure Transition 2018-2019 Purchase and move of services to osgeo7]]
* [[Infrastructure Transition Plan 2010]]
* [[Infrastructure Transition Plan 2014]]

== Old migration documents for historical review. ==

* [[Migration Documentation]] - assorted services on www.osgeo.org
* [[Drupal Upgrade Plan]] - Wolf's fall 2007 plan to upgrade Drupal to 5.3.
* The [[Project Infrastructure Migration]] page talks about migration issues of the projects in incubation and provides hints to some services we should be trying to provide.
* [[Migration Tasks and Milestones]]
* [[Migration Documentation]]
* [[Infrastructure Transition Plan | Infrastructure Transition Plan 2006]]

[[Category:Infrastructure]]
[[Category:Committees]]

SAC Service Status

2025-09-21T09:21:03Z

Strk: /* weblate */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)

For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

Download Container

2025-09-21T09:16:37Z

Strk:

Runs in [[osgeo7]].

* Provides [[Upload Server]].
* Provides hop for osgeo7 containers (via ssh hop.osgeo7.osgeo.org)

[[Category:Infrastructure]]

Download Container

2025-09-21T09:15:09Z

Strk:

Runs in [[osgeo7]].

* Provides [[Upload Server]].
* Provides hop for osgeo7 containers (via ssh hop.osgeo7.osgeo.org)

Upload Server

2025-09-21T09:12:58Z

Strk: Created page with "Runs in Download Container Provides https://upload.osgeo.org where OSGeo project's release manager can upload artifacts. '''IMPORTANT''': download.osgeo.org should not b..."

Runs in [[Download Container]]

Provides https://upload.osgeo.org where OSGeo project's release manager can upload artifacts.

'''IMPORTANT''': download.osgeo.org should not be used as it is a round robin that floats between osgeo7, osgeo8, and osgeo9 to balance load.

The downloadable tree is found in /osgeo/download on the server. (mirrored at https://ftp.osuosl.org/pub/osgeo)

The virtual host declaration is found in /etc/nginx/sites-available

Logs are in /var/log/nginx

Download Container

2025-09-21T09:11:01Z

Strk:

Runs in [[osgeo7]].

* Provides [[Download Server]].
* Provides [[Upload Server]].
* Provides hop for osgeo7 containers (via ssh hop.osgeo7.osgeo.org)

Download Container

2025-09-21T09:08:26Z

Strk: Created page with "Runs in osgeo7. Provides Download Server. It is the hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org"

Runs in [[osgeo7]].
Provides [[Download Server]].

It is the hop container for osgeo7.
Accessible via ssh hop.osgeo7.osgeo.org

Download Server

2025-09-21T09:06:54Z

Strk:

The OSGeo Download Server runs in a container of [[osgeo7]] host, see [[Download Container]]

Houses the following sites:

- https://upload.osgeo.org
- https://bottle.download.osgeo.org

The https://download.osgeo.org site goes thru [[osgeo8]] and [[osgeo9]], but data is pulled from this container

* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

= Configuration =

The download container on osgeo7, ssh via upload.osgeo.org (requires SSH key) Refer to [[SAC_Service_Status#Download|SAC_Service_Status Download Container]]

* download.osgeo.org should not be used as it is a round robin that floats between osgeo7, osgeo8, and osgeo9 to balance load.
* The upload.osgeo.org DNS name only points to the osgeo7 download container
* The downloadable tree is found in /osgeo/download on the server. (mirrored at https://ftp.osuosl.org/pub/osgeo)
* The virtual host declaration is found in /etc/nginx/sites-available
* Logs are in /var/log/nginx

* bottle.download.osgeo.org (Mac Bottles) is also hosted on this server and in folder /osgeo/bottle mirrored at https://ftp.osuosl.org/pub/osgeo/bottle

= Management =

It is intended that each interested project should have a directory under /osgeo/download with appropriate permissions so a project member can manage the subdirectories and files. Scp, or sftp can be used to bring files onto the server. Someone from each project will need to add their SSH Public Key(s) into the [https://id.osgeo.org/ldap/edit LDAP OSGeo Userid], for ssh/scp access.
Any administrator can create new project directories, and chown them to a project representative.

= End Users =

End users should be referred to downloads similarly to:

https://download.osgeo.org/gdal/gdal-1.3.2.tar.gz

Directory indexing is left on so requesting a directory will give a file list.

= Rsync =

The /osgeo/download area is exported for anonymous rsync read access as a module named "download". The following can be used to pull a local copy of the gdal data tree for instance:

rsync -av upload.osgeo.org::download/gdal/data .

This is controlled by the rsync configuration file at /etc/rsyncd.conf. It is possible that rsyncd will not automatically restart on reboot in which case "rsyncd --daemon" as root may be necessary to start it.

= Webdav =

Some projects using Maven as their build tool require webdav in order to work. There is a standalone webdav in nginx setup
for geoserver/geotools use using a htpasswd file in /etc/nginx/auth/geotools

= Backup =

Nightly backups of the /osgeo/download tree are managed using rsync to /mirror/rsync/download.osgeo.org on backup.osgeo.org by root's crontab.
/home/other_backups/download directory backup.osgeo.org by a nightly cronjob, and this mirror is available at the url download2.osgeo.org and http://ftp.osuosl.org/pub/osgeo/download/ if needed
(NOTE: that rsync does not delete file on backup.osgeo.org, if they were removed from download.osgeo.org).

There is a weekly backup of the whole download container backed up as stopped container on osgeo4 and called download-backup.

[[Category:Infrastructure]]
[[Category:Services]]

Download Server

2025-09-21T09:06:19Z

Strk:

The OSGeo Download Server runs in a container of [[osgeo7]] host, see [[Download-Container]]

Houses the following sites:

- https://upload.osgeo.org
- https://bottle.download.osgeo.org

The https://download.osgeo.org site goes thru [[osgeo8]] and [[osgeo9]], but data is pulled from this container

* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

= Configuration =

The download container on osgeo7, ssh via upload.osgeo.org (requires SSH key) Refer to [[SAC_Service_Status#Download|SAC_Service_Status Download Container]]

* download.osgeo.org should not be used as it is a round robin that floats between osgeo7, osgeo8, and osgeo9 to balance load.
* The upload.osgeo.org DNS name only points to the osgeo7 download container
* The downloadable tree is found in /osgeo/download on the server. (mirrored at https://ftp.osuosl.org/pub/osgeo)
* The virtual host declaration is found in /etc/nginx/sites-available
* Logs are in /var/log/nginx

* bottle.download.osgeo.org (Mac Bottles) is also hosted on this server and in folder /osgeo/bottle mirrored at https://ftp.osuosl.org/pub/osgeo/bottle

= Management =

It is intended that each interested project should have a directory under /osgeo/download with appropriate permissions so a project member can manage the subdirectories and files. Scp, or sftp can be used to bring files onto the server. Someone from each project will need to add their SSH Public Key(s) into the [https://id.osgeo.org/ldap/edit LDAP OSGeo Userid], for ssh/scp access.
Any administrator can create new project directories, and chown them to a project representative.

= End Users =

End users should be referred to downloads similarly to:

https://download.osgeo.org/gdal/gdal-1.3.2.tar.gz

Directory indexing is left on so requesting a directory will give a file list.

= Rsync =

The /osgeo/download area is exported for anonymous rsync read access as a module named "download". The following can be used to pull a local copy of the gdal data tree for instance:

rsync -av upload.osgeo.org::download/gdal/data .

This is controlled by the rsync configuration file at /etc/rsyncd.conf. It is possible that rsyncd will not automatically restart on reboot in which case "rsyncd --daemon" as root may be necessary to start it.

= Webdav =

Some projects using Maven as their build tool require webdav in order to work. There is a standalone webdav in nginx setup
for geoserver/geotools use using a htpasswd file in /etc/nginx/auth/geotools

= Backup =

Nightly backups of the /osgeo/download tree are managed using rsync to /mirror/rsync/download.osgeo.org on backup.osgeo.org by root's crontab.
/home/other_backups/download directory backup.osgeo.org by a nightly cronjob, and this mirror is available at the url download2.osgeo.org and http://ftp.osuosl.org/pub/osgeo/download/ if needed
(NOTE: that rsync does not delete file on backup.osgeo.org, if they were removed from download.osgeo.org).

There is a weekly backup of the whole download container backed up as stopped container on osgeo4 and called download-backup.

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-09-21T09:00:02Z

Strk: /* Services on osgeo7 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)
For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====

See [[Download Server]]

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-09-21T08:59:31Z

Strk: /* download8 */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====

Replica of download that is on osgeo7.
Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

See [[Download Server]]

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)
For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====
* Houses: https://upload.osgeo.org, https://bottle.download.osgeo.org download sites
** '''Moved 5/5/2019 from osgeo3'''
* Setup of https://upload.osgeo.org detailed in [https://git.osgeo.org/gitea/sac/osgeo7/wiki/Download-Container OSGeo7 Download container]
* https://download.osgeo.org goes thru osgeo8 and osgeo9, but data is pulled from this container
* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* It's a debian 10 container (now locked down to only allow ssh key access / ldap auth) for ssh. It is running nginx instead of apache that the old ran. <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC:Jitsi

2025-09-21T08:58:42Z

Strk:

This is OSGeo's instance of Jitsi service accessible via https://meet.osgeo.org.

Requires [[SAC:LDAP|OSGeo LDAP]] account for moderation of a room, but other users are allowed in as guests.

SAC Service Status

2025-09-21T08:57:49Z

Strk: /* jitsi */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====
Replica of download that is on osgeo7. Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====

See [[SAC:Jitsi]] (for video meetings)

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)
For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====
* Houses: https://upload.osgeo.org, https://bottle.download.osgeo.org download sites
** '''Moved 5/5/2019 from osgeo3'''
* Setup of https://upload.osgeo.org detailed in [https://git.osgeo.org/gitea/sac/osgeo7/wiki/Download-Container OSGeo7 Download container]
* https://download.osgeo.org goes thru osgeo8 and osgeo9, but data is pulled from this container
* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* It's a debian 10 container (now locked down to only allow ssh key access / ldap auth) for ssh. It is running nginx instead of apache that the old ran. <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC:Git Service

2025-09-21T08:55:10Z

Strk: drop obsoleted services

The [[TracSVN]] machine hosts a few git related services. This page describes where GIT repositories are and how they can be accessed.

= Repositories =

There are currently git repositories under <code>/var/www/git/repos</code> (served by Apache) and under <code>/home/git/gitea-repositories</code> (served by Gitea).

Apache runs as user ''www-data'' and thus user ''www-data'' owns the files in <code>/var/www/git/repos</code>.

[[SAC:Gitea|Gitea]] runs as user ''git'' and thus user ''git'' owns the files in <code>/home/git/gitea-repositories</code>.

There are also a bunch of git repositories used for various system configurations, but they are not exposed to public services as such.

Some of the repositories from <code>/var/www/git/repos</code> are being transformed to symlinks to repos under <code>/var/www/git/repos</code>.
These repositories will only be writable by the ``git`` user, but are made readable also by the rest of the world.

= GIT Remote URIs =

== HTTPS (Read/Write) ==

{|
! style="text-align:left;"| Repo
! URL
|-
|<code>/var/www/git/repos</code>
|<code>https://git.osgeo.org/git/REPONAME</code>
|-
|<code>/home/git/gitea-repositories</code>
|<code>https://git.osgeo.org/gitea/REPONAME</code>
|}

In both cases, [[SAC:LDAP|LDAP]] authentication is allowed.
For the <code>/git/REPONAME</code> LDAP authentication is _required_, and you need to use the Git protocol access for an anonymous checkout.

In both cases, ''http'' access redirects to ''https''.

== GIT protocol (Read Only) ==

Repos in <code>/var/www/git/repos</code> are served via git protocol with <code>git://git.osgeo.org/REPONAME</code> as long as they contain a file named <code>git-daemon-export-ok</code>

Repos in <code>/home/git/gitea-repositories</code> are '''NOT accessible''' via git protocol, unless made available via symlinks from <code>/var/www/git/repos</code> (as done for the GEOS repository, for example)

The handling server is [[SAC:GitDaemon]]

= Web Interfaces =

== gitea ==

Gitea allows anyone with an OSGeo Userid to create public or private repositories, manage access to them (individual or organization based), manage git hooks on the repositories and much more. It can be
accessed at the url https://git.osgeo.org/gitea
See [[SAC:Gitea]] for more details.

== trac ==

Any [[Trac_Instances|trac instance]] administrator can expose any git repository on the system by simply referencing full path to it from the repository section of the administration panel. This may be a problem for private repositories if trac instance administrators are not careful.

Commits in a so-mapped git repository can be referenced in trac ticket comments, and git commit logs can update trac tickets. Creating a git repository via Trac is not possible at the time of writing (2016-04-19)

= See Also =

* [[GitInfrastructureComparison]]
* [[GitServiceRequirement]]

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-09-21T08:49:00Z

Strk: /* tracsvn (trac, svn, git) */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====
Replica of download that is on osgeo7. Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====
https://meet.osgeo.org. Requires LDAP for moderation of a room, but other users are allowed in as guests.

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)
For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====
* Houses: https://upload.osgeo.org, https://bottle.download.osgeo.org download sites
** '''Moved 5/5/2019 from osgeo3'''
* Setup of https://upload.osgeo.org detailed in [https://git.osgeo.org/gitea/sac/osgeo7/wiki/Download-Container OSGeo7 Download container]
* https://download.osgeo.org goes thru osgeo8 and osgeo9, but data is pulled from this container
* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* It's a debian 10 container (now locked down to only allow ssh key access / ldap auth) for ssh. It is running nginx instead of apache that the old ran. <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Git Service|Git]] and [[Subversion]] services.

See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-09-21T08:48:10Z

Strk: /* tracsvn (trac, svn, git) */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====
Replica of download that is on osgeo7. Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====
https://meet.osgeo.org. Requires LDAP for moderation of a room, but other users are allowed in as guests.

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)
For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====
* Houses: https://upload.osgeo.org, https://bottle.download.osgeo.org download sites
** '''Moved 5/5/2019 from osgeo3'''
* Setup of https://upload.osgeo.org detailed in [https://git.osgeo.org/gitea/sac/osgeo7/wiki/Download-Container OSGeo7 Download container]
* https://download.osgeo.org goes thru osgeo8 and osgeo9, but data is pulled from this container
* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* It's a debian 10 container (now locked down to only allow ssh key access / ldap auth) for ssh. It is running nginx instead of apache that the old ran. <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[SAC:Gitea|Gitea]] and [[Subversion]] service.
See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC Service Status

2025-09-21T08:47:43Z

Strk: /* tracsvn (trac, svn, git) */

Infrastructure of OSGeo System Administration Committee ([[SAC]])

For emergency plans see: [[SAC:Admin and Troubleshooting]]

= Servers at OSL =
[[OSL | Open Source Labs]] - 7 physical machines of which 5 ar lxd hosts containing ''x'' virtual machines/containers.

== Logging into Physical Machines ==

Currently we have osgeo6 and backup.osgeo.osuosl.org that are physical machines under LDAP control.

'''Note this does not apply to osgeo3, osgeo4, osgeo7, osgeo8, osgeo9 lxd hosts'''. Refer to those sections for instructions on logging in.
If hanging, see [[OSL]] for how to open a ticket with OSUOSL's support.

This section currently only applies to '''osgeo6''' and '''backup'''.

All [[SAC#Members|SAC administrators]] have LDAP auth to the OSL Machines.

To ssh into a server using your LDAP account, you can do the following replacing '''your_osgeo_login''' with your OSGeo login and '''vmname''' with the vm name of the server at OSL.

ssh '''your_osgeo_login'''@'''servername'''.osgeo.osuosl.org

When prompted for password, use your OSGeo Login password.

[[SAC:Primary Administrators]] also have ssh key access in case LDAP is down and that will also apply to the physical machines. Worst case scenario use the information on [[OSL | Open Source Labs]] to file a ticket (SAC members only). Direct connection to virtual machines is by appending it's vm alias to .osgeo.osuosl.org.

== Logging into LXD Hosts ==

OSGeo3, OSGeo4, OSGeo7, OSGeo8, and OSGeo9 are all Ubuntu servers running LXD.
LXD is a management system for LXC containers and QEMU VMS. LXD has a [https://www.youtube.com/channel/UCuP6xPt0WTeZu32CkQPpbvA channel] that covers its features.

To directly access the host, you go thru port 2222

ssh tech_dev@''server_name''.osgeo.osuosl.org -p 2222

Only [[SAC:Primary Administrators]] have their ssh key installed under that account. In order to access via KVM of these in event servers do not come up on a reboot, you need to go thru OSU OSL OpenVPN. To get an OpenVPN account, you need to put in a support ticket to support@osuosl.org. In order to qualify for an OpenVPN account, you need to be an OSGeo SAC administrator. You will also need to install [https://openvpn.net/community-downloads/ OpenVPN client]) to use your OpenVPN account.

Each host on the private KVM side is named https://'''osgeo8'''.osuosl.oob -- where replace '''osgeo8''' with the relevant host. The .oob is the private network, so doesn't work unless you are connected to via OpenVPN.

The browser interface is sometimes clunky, so you might want to use '''ipmitool''' installable on linux/unix or wsl using relevant package manager. KVM passwords are stored in [https://git.osgeo.org/gitea/sac/password-store SAC password-store].

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosts follows:

Host osgeo?
User tech_dev
HostName %h.osgeo.osuosl.org
Port 2222

Then you would be able to log into those hosts with commands like:

ssh osgeo7

== Logging into LXD Containers and VMs ==

A convenient block to add to your ~/.ssh/config to easily login to osgeo's LXD hosted containers and vms is the following:

# This stanza is only needed if you have an IdentityFile configured below.
# The IdentityFile from a target host is not automatically applied to the hop host, so we need to make it explicit:
Host hop.*.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo*-*
ProxyCommand ssh hop.$(sed -e "s/-.*//" <<< "%h").osgeo.org -W $(sed -e "s/^osgeo[^-*]-//;s/$/.lxd/" <<< "%h"):%p
# this is only needed if you you use different private keys for different servers
IdentityFile "path/to/your/private/key"

Then you'll be able to access a LXC Container or QEMU VM on machine `osgeo3` with:

ssh yourusername@osgeo3-matrix

And one on machine `osgeo7` with:

ssh yourusername@osgeo7-download

Note you still need to know where each LXC host is hosted... See successive sections to know what's on which machine.

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

== osgeo 8 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203036/https://hardware.openstreetmap.org/servers/stormfly-01.openstreetmap.org/

Intended to provide additional LXD capacity and backup.

[[osgeo8|Configuration Details]]

=== Services running on osgeo8 ===

==== hop ====
hop.osgeo8.osgeo.org - jump host for accessing containers/vms on osgeo8

==== nginx ====
http, https Proxy for all containers on osgeo8 and also provides mirror proxy for download.osgeo.org

==== centtie-7-pgrouting ====
Centos 7 running PostgreSQL 15, PostGIS 3.3.2, gcc-4.8.5, cmake 3
Configured to be a github self-hosted runner for testing centos for pgrouting project

[https://github.com/pgRouting/admin/wiki/CI%3A-Centos-7-GHA-runner Details of Github Action runner setup]

==== download8 ====
Replica of download that is on osgeo7. Mirrors download and home folders from osgeo7.
https://download-cache.osgeo.org

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== grass-wiki ====

See [[SAC:GrassWiki]]

==== grass ====
https://grass.osgeo.org upgraded to Bullseye debian 11.

GRASS GIS server

Current DNS name: grass.osgeo.org

Debian 11 Bullseye

Web: Apache + Hugo (generated through cronjob from https://github.com/OSGeo/grass-website/), see https://github.com/OSGeo/grass-addons/tree/grass8/utils/cronjobs_osgeo_lxd

`unattended-upgrades` for automatic installation of security upgrades is installed and running

ssh: reachable via jumphost.

==== meshcentral ====
https://remote.osgeo.org
This is a remoting tool currently setup to test livecd vms via a web browser.

4 VMS currently set up on osgeo8 accessible from this. Currently based on livecd 16rc1 snapshots, with wm install script run.

==== pgrouting-dev ====
For pgrouting development use to do things like pushing docker images on a scheduled basis.
Perhaps later for demo sites. WIP.

==== woodie-client-vm ====

Separate agent for woodie-server, this one is a true VM rather than container.

==== woodie-server ====

See [[Woodie]]

== osgeo 9 ==
Server added April 2021, donated by OpenStreetMap project.

Likely machine: https://web.archive.org/web/20191112203042/https://hardware.openstreetmap.org/servers/stormfly-02.openstreetmap.org/

Is an LXD host. Also Stores lxd images used by other lxd hosts.

[[osgeo9|Configuration Details]]

=== Services running on osgeo9 ===
==== hop ====
hop.osgeo9.osgeo.org. For LDAP users allows them to hop thru to get to other containers.

==== Secure (LDAP ) ====
[https://git.osgeo.org/gitea/sac/osgeo9/wiki/secure-container secure] -- ldap.osgeo.org [[SAC:LDAP]] used for ldap service (a rebuild of old secure.osgeo.osuosl.org) now on Debian 11
Moved from osgeo7

==== ldap-web ====

Currently housing https://id.osgeo.org/ for LDAP management.
Deployed via ansible
Moved from osgeo9

* id.osgeo.org

==== jitsi ====
https://meet.osgeo.org. Requires LDAP for moderation of a room, but other users are allowed in as guests.

==== nextcloud ====
https://nextcloud.osgeo.org

Ubuntu 22.04 LXD/nginx/postgresql 14 container for document sharing similar to dropbox/google drive - nextcloud.lxd - https://nextcloud.osgeo.org [https://git.osgeo.org/gitea/sac/osgeo9/wiki/Nextcloud-container Nextcloud Setup]

home of https://nextcloud.osgeo.org
This server does not use ssh osgeo-ldap as it was the first container built. However nextcloud.osgeo.org does authenticate with osgeo ldap.

TODO: add special page for this

==== nginx ====
nginx (for web proxy of traffic of osgeo9 containers) additional mirror proxy for download.osgeo.org

==== adventure (WIP)====
https://adventure.osgeo.org runs https://github.com/thecodingmachine/workadventure software

==== dronie-client ====
a ci bot for dronie.osgeo.org which is used for git.osgeo.org/gitea ci jobs

==== limesurvey ====
Debian 10, PostgreSQL 13, PHP 8 with ldap/ssh. https://limesurvey.osgeo.org
Setup detailed on [https://git.osgeo.org/gitea/sac/osgeo3/wiki/limesurvey-container limesurvey container]

==== pixelfed ====

SHUT OFF (both container and website) cause of lack of interest. Container is still there.
[[Pixelfed]] instance reachable on https://photo.osgeo.org to house community photos

==== peertube ====

[[Peertube]] instance reachable on https://video.osgeo.org

==== pretalx ====
Ubuntu 20.04 with OSGeo LDAP and Docker installed. pretalx software runs in Docker.
https://talks.osgeo.org - for OSGeo Talk collection and voting See [[Pretalx]]

==== weblate ====
'''Container Name:''' weblate (for doc translation)

Houses: https://weblate.osgeo.org (for document translation to different languages)
For further details refer to [[SAC:Weblate]]

==== wordpress ====

See [[SAC:Wordpress]]

==== wiki ====

See [[OSGeo Wiki]]

==== discourse ====

See [[SAC:Discourse]]

== osgeo 7 ==

Server added June 2018. Intended to replace osgeo3 and old osgeo4 (before reformat).
See [[Osgeo7]] for configuration details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages Container setup of all the osgeo7 servers is located in https://git.osgeo.org/gitea/sac/osgeo7/wiki/_pages]

Running LXD 3 snap based container management -- LXD version 3.17 as of 2019-09-15

=== Accessing osgeo7 containers via ssh ===

Only the download.osgeo.org is directly exposed ssh via port 22. To access the other containers, you can tunnel thru
download.osgeo.org -- You need to be in the shell group to be able to access download and the other servers. If you are not already put in a [https://trac.osgeo.org/osgeo/newticket SAC Ticket Request]. You also need to have your public key registered. To do so edit your profile [https://id.osgeo.org/ldap/edit] (and put in your public key)

A convenient block to add to your own `.ssh/config` file follows:

Host osgeo7-*
ProxyCommand ssh your_osgeo_id@hop.osgeo7.osgeo.org -W $(sed -e "s/^osgeo7-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

With the above in place, you can connect to any container using:

ssh your_id@osgeo7-<container_name>

'''Troubleshooting:''' In case of "Permission denied (publickey)." after an update to a modern openSSH version, it might well be that your ssh key (RSH key) is disabled in your client in favour of more modern cyphers.

Ugly workaround: add one line `PubkeyAcceptedKeyTypes ...` in `.ssh/config`, to re-enable RSA keys for now (consider to generate a new key):

vim .ssh/config
...
Host *
...
PubkeyAcceptedKeyTypes +ssh-rsa

... but better read e.g. [https://dev.to/bowmanjd/upgrade-ssh-client-keys-and-remote-servers-after-fedora-33-s-new-crypto-policy-47ag here]!

=== Services on osgeo7 ===

==== Download ====
* Houses: https://upload.osgeo.org, https://bottle.download.osgeo.org download sites
** '''Moved 5/5/2019 from osgeo3'''
* Setup of https://upload.osgeo.org detailed in [https://git.osgeo.org/gitea/sac/osgeo7/wiki/Download-Container OSGeo7 Download container]
* https://download.osgeo.org goes thru osgeo8 and osgeo9, but data is pulled from this container
* It is also the official hop container for osgeo7. Accessible via ssh hop.osgeo7.osgeo.org
* It's a debian 10 container (now locked down to only allow ssh key access / ldap auth) for ssh. It is running nginx instead of apache that the old ran. <del>It has webdav with single local htaccess account geotools for geotools bot use.</del>

In order to be able to log in or sftp

* You must be a member of the OSGeo shell group which can be granted from another person in shell group - [https://id.osgeo.org/ldap/shell Shell]
* Once you are in shell group, go to https://id.osgeo.org/ldap/edit and put in your public key.

You should then be able to log into download (and all other hop servers on the other hosts) with your private key.

You can put in a [https://trac.osgeo.org/osgeo/newticket ticket] to request such access.

==== nginx ====
Proxy that routes all http/https traffic for the other containers (can be accessed via osgeo7 host lxc or ubuntu@osgeo7-nginx if your key is installed on ubuntu user).
The nginx container holds the letsencrypt https SSL certs for all the containers and handles the renewal of the letsencrypt certs using certbot renew cronjob.
Prometheus server to collect all monitoring logs from OSGeo7 (only accessible by OSGeo3), these get queried via monitor.osgeo.org (running on osgeo3) via grafana server.

==== tracsvn (trac, svn, git) ====

Home of [[Trac]], [[Gitea]] and [[Subversion]] service.
See [[TracSVN]] for full details.

==== old-wiki (stopped) ====
This used to be housed on osgeo3, and was moved 2019-09-14 to osgeo7 as old-wiki container.
wiki.osgeo.org moved back to osgeo3 on 2020-05-22 and in wiki container. The wiki container is a complete rebuild with files and database restored and upgraded.
Refer to the osgeo3 section for more details.

[https://git.osgeo.org/gitea/sac/osgeo7/wiki/old-wiki-container old wiki container] -- used for wiki service (it is an lxd2pc created image of wiki.osgeo.osuosl.org VM that was on osgeo3)

See [[OSGeo Wiki]]

==== nextcloud-ubuntu (stopped) ====
Moved to osgeo9

==== collabora (stopped) ====
# https://collabora.osgeo.org
Ubuntu 18.04 LXD container for LibreOffice/MS Office online document editor currently used exclusively by nextcloud.osgeo.org. Setup detailed in Nextcloud setup.
No longer needed now that nextcloud is using a self-contained collabora instance.

==== live ====
Home of live.osgeo.org (created 2021-10-05ish
Running Ubuntu 20.04 with OSGeo LDAP SSH

==== dronie-server ====

See [[Dronie]]

==== old-projects (stopped) ====
-- this is the old projects.osgeo.osuosl.org migrated from osgeo4 as an lxd container, so more or less the same as it was before, with the exception that all the websites are now proxied thru the nginx container. Websites on it are community-review.foss4g.org and spatialreference.org

To access you need to go thru download.osgeo.org -> old-projects

==== old-web (stopped) ====
The old web.osgeo.osuosl.org (was on osgeo3)

* mapguide.osgeo.org

==== old-webextra ====
This is a replica of webextra.osgeo.osuosl.org that was hosted on osgeo3

Started move on November 29th 2019 and completed December 8th, 2019
* foss4g.org
* europe.foss4g.org
* video.foss4g.org
* planet.osgeo.org
* various old foss4g.org years
* <del>live.osgeo.org</del> moved to dedicated container
* journal.osgeo.org (not sure what this is for, should be retired?)
* <del>vmap0.tiles.osgeo.org</del> #removed site

==== pycsw ====
'''Container Name:''' pycsw

* https://demo.pycsw.org
* '''OGC CSW Reference Implementation and Server demo'''
* deployment setup at https://github.com/geopython/demo.pycsw.org
* running hourly teardown/setup cron via docker-compose
* migrated from [[AdhocVM#Existing_services_hosted_on_the_Ad-hoc_VM:|Adhoc VM]] thanks to [https://trac.osgeo.org/osgeo/ticket/2452 SAC] (May 2020)

==== mapserver ====

See [[MapServer_at_osgeo7]]

=== osgeo7 decommissioned containers ===

==== <del>old-adhoc</del> ====

'''SHUTOFF as of 2022-01-29'''

[[AdhocVM|old-adhoc]] -- this is the old adhoc.osgeo.osuosl.org migrated 2019-05-08 from osgeo4 as an lxd container.
Used by osgeo-live for there test docs and by grass for earthquake, and mapserver for demo.
Note that there is a new live (container that osgeo-live will more to), there is also a mapserver container (which mapserver have started to move their demo to)

To access via ssh you should go thru download.osgeo.org -> old-adhoc.lxd
It is accessible via https://adhoc.osgeo.org and http://adhoc.osgeo.osuosl.org

* VM used for projects for various adhoc purposes. Risks to system stability that would be unacceptable on the Projects VM may be ok here.
* See [[AdhocVM]] for full details, and some notes on services running here.
* eg http://adhoc.osgeo.osuosl.org/livedvd/docs/en/quickstart/

== osgeo6 ==

* Mail
* lists.osgeo.org
See [[Osgeo6]] for full details

== Backup (osgeo5) ==
* Backup now runs on dedicated hardware
* Provides Rsync backups of download.osgeo.org
* Provides Bacula backups of various VMs.
* See [[SAC:Backups]] for details.

== osgeo4 ==

osgeo4 is a real server managed by OSUOSL - can be access via ssh tech_dev@osgeo4.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

In August 2019 the server had new power supply put in and replacement disks. It was reformatted with Ubuntu 18.04.3 to serve as secondary LXD host to osgeo7
zfsutils-linux was installed so lxd can use zfs for storage.

=== sshing into osgeo4 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo4.osgeo.org. To access the other containers, you need to hop through hop.
hop container has port 22 open but requires ssh access so users who’ve been granted rights can hop thru it to other containers using hop.osgeo4.osgeo.org as name.

A convenient block to add to your own .ssh/config file follows where your_id could be your osgeo id or a local account on that container

Host osgeo4-*
ProxyCommand ssh your_osgeo_id@hop.osgeo4.osgeo.org -W $(sed -e "s/^osgeo4-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"
User your_id

Then to access say the wordpress-dev container, you'd do the below

ssh osgeo4-wordpress-dev

=== osgeo4 baremetal features ===
It's makeup is as follows:
{| class="wikitable"
|-
! Item !! Settings
|-
| Disks || 6 1.8 TB drives
|-
| Memory || 48 GB
|-
| CPUs || 8 Intel(R) Xeon(R) CPU E5540 @ 2.53GHz (8192kb cache)
|}
<pre>lsblk -i
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
|-sda1 8:1 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sda2 8:2 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdb 8:16 0 1.8T 0 disk
|-sdb1 8:17 0 953M 0 part
| `-md0 9:0 0 952M 0 raid1 /boot
`-sdb2 8:18 0 46.6G 0 part
`-md1 9:1 0 46.5G 0 raid1
|-lvm-root 253:0 0 37.3G 0 lvm /
`-lvm-swap 253:1 0 7.5G 0 lvm [SWAP]
sdc 8:32 0 1.8T 0 disk
sdd 8:48 0 1.8T 0 disk
sde 8:64 0 1.8T 0 disk
sdf 8:80 0 1.8T 0 disk
</pre>

<pre>
sdc,sdd,sde,sdf form a zfs osgeo4_lxd partition (sdc,sdd) mirrors sde,sdf for total lxd capacity of 3.62 TB
</pre>

Nightly backups of osgeo3, osgeo7, and osgeo4 containers are kept here and named <container>-backup and be kept in a stopped state.

== Services running on osgeo4 ==

=== hop ===
'''Container Name:''' hop - this is the only container with direct ssh access via ssh hop.osgeo4.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access

=== ansible-dev ===
'''Container Name:''' ansible-dev, has ansible 2.9.27 installed and all plugins needed to manage OSGeo ansible infrastructure.
DEPRECATED, use `ansible-dev`

=== ansible-control ===
'''Container Name:''' ansible-control, can be used to deploy OSGeo ansible infrastructure. Replaces `ansible-dev`

=== osgeo4-nginx ===
'''Container Name:''' osgeo4-nginx ->> all web traffick from other containers on osgeo4 get proxied thru here

=== old-web-staging ===
'''Container Name:''' old-web-staging - used primarily for experimenting with changes to id.osgeo.org (old-web on osgeo7) like testing out OS and software upgrade etc, changes to LDAP forms and registration, before applying to id.osgeo.org. - https://id.staging.osgeo.org

=== pretalx-staging ===
'''Container Name:''' pretalx-staging - used primarily for experimenting with changes to talks.osgeo.org (pretalx on osgeo3) like testing out Docker builds and software upgrade etc, before applying to talks.osgeo.org. - https://talks.staging.osgeo.org

=== wordpress-dev ===
'''Container Name:''' wordpress-dev - used primarily for osgeo.org main website development - https://staging.www.osgeo.org, https://dev.www.osgeo.org

=== wiki-dev ===
'''Container Name:''' wiki-dev - used primarily for experimenting with changes to wiki.osgeo.org like testing out OS and software upgrade etc before appying to wiki.osgeo.org. - https://dev.wiki.osgeo.org

=== wiki-staging ===
'''Container Name:''' wiki-staging - used primarily for upgrade changes to wiki.osgeo.org like testing out OS and software upgrade etc before applying to wiki.osgeo.org. - https://staging.wiki.osgeo.org. The construction of this container is managed by sac ansible-deployment.

=== tracsvn-dev ===
'''Container Name:''' tracsvn-dev - This is a 2019-09-05 lxd2pc image of tracsvn.osgeo.osuosl.org (now on osgeo7 as tracsvn) used primarily for experimenting like testing out OS, git and software upgrade etc before appying to production. -- https://dev.git.osgeo.org, https://dev.tracsvn.osgeo.org Has the following sites: https://dev.trac.osgeo.org, https://dev.git.osgeo.org/gitea, https://dev.svn.osgeo.org.

It was upgraded to Debian 11 on 2024-08-21.

=== dronie-client ===
'''Container Name:''' dronie-client - This is a debian 10 machine, with OSGeo LDAP authentication and a drone-agent docker running. To be used with https://dronie.osgeo.org

== osgeo3 ==
osgeo3 physical server refer to [[osgeo3|Configuration Details]] for hardware specs. It is used to run production, but moderately risky things. Refer to [[SAC:Old-osgeo3]] for past history before osgeo3 was rebuilt.
osgeo3 is a hosted by OSUOSL - can be accessed via ssh tech_dev@osgeo3.osgeo.osuosl.org -p 2222 (only people with their access keys installed can log in and doesn't allow password access) - password for tech_dev is in the secure container (on osgeo7) / access folder.

=== sshing into osgeo3 containers ===
Note that all the containers are closed off from direct ssh access except for the hop.osgeo3.osgeo.org. To access the other containers, you need to hop through hop.osgeo3.osgeo.org.
hop container has port 22 open but requires ssh key access, you need to be added to shell group and have your ssh keys registered on your profile https://id.osgeo.org/ldap/edit). Users who’ve been granted rights can hop thru it to other containers using hop.osgeo3.osgeo.org as name. Other containers may or may not allow password access. It's up to the those who manage the internal containers.

A convenient block to add to your own .ssh/config file follows
# this is only needed if you you use different private keys for different servers
Host hop.osgeo3.osgeo.org
IdentityFile "path/to/your/private/key"

Host osgeo3-*
ProxyCommand ssh '''your_osgeo_id'''@hop.osgeo3.osgeo.org -W $(sed -e "s/^osgeo3-//;s/$/.lxd/" <<< "%h"):%p
IdentityFile "path/to/your/private/key"

Then to access say the nexus container, you'd do the below where your_id could be your osgeo id or a local account on that container

ssh '''your_id'''@osgeo3-nexus

=== hop ===
This is the only container with direct ssh access via ssh hop.osgeo3.osgeo.org. To get to other containers, you need to hop thru this one. Requires ssh key access which you can register by editing your ldap profile.

=== osgeo3-nginx ===
nginx proxy all web-traffic via the (using IP: 140.211.15.6 web-osgeo3.osgeo.osuosl.org), the second ip is not in use, but may be used for a secondary nginx, to temporarily host osgeo7/osgeo8/osgeo9 containers in case of major hardware upgrades

=== dronie-client ===
This is a debian 10 lxd container running docker. Currently has just one running docker osgeo-drone-agent to serve as a client for dronie-server (dronie.osgeo.org running on osgeo7)

=== geo-docs ===
Debian 11 houses the following:

* lastools.osgeo.org (as of 2021-10-06 snapshot of https://www.cs.unc.edu/~isenburg/lastools/ see [https://trac.osgeo.org/osgeo/ticket/2649 2649]
* https://planet.osgeo.org
* https://docs.geoserver.org
* https://docs.geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]
* https://geotools.org [https://trac.osgeo.org/osgeo/ticket/2944 2944]

planned home of ? docs.geowebcache.org

=== geoserver-cite ===
Houses OGC site certification for geoserver https://cite.geoserver.org

=== matrix ===
'''Container Name:''' matrix - lxd container with ldap/ssh.
Hosts [[Matrix]] homeserver ([[SAC:MatrixSynapse]]) and IRC bridges ([[SAC:Heisenbridge]])

See https://git.osgeo.org/gitea/sac/osgeo3/wiki/matrix-container for full detail on how the container is setup

=== nexus (repo.osgeo.org, docker.osgeo.org) ===
See [[SAC:Repo]] this is a debian 10 lxd container running docker 19.
It currently has one docker container running within it called nexus -- exposed as repo.osgeo.org on nginx.

Also exposed as project dockers for pushing images: postgis-docker.osgeo.org, geoserver-docker.osgeo.org, geos-docker.osgeo.org, sac-docker.osgeo.org

=== monitor ===
debian10 lxd container with ldap/ssh. https://monitor.osgeo.org (houses grafana dashboard (for all servers) and prometheus server for osgeo3 containers and pulls basic container metrics using node exporters pulled via prometheus servers. Requirs ldap to log into the web console.

Configuring servers for monitoring is detailed [https://git.osgeo.org/gitea/sac/prometheus-config Git Prometheus Config]

=== gallery ===

Picture gallery.
See [[Gallery]]

== WebExtra ==
** Retired December 8th, 2019 -- and moved to osgeo7 as container old-webextra

* See [[WebExtraVM]] for full details (server: http://webextra.osgeo.osuosl.org)
* hosts http://planet.osgeo.org, http://mum03.mapserver.org, http://live.osgeo.org
* http://foss4g.org (main portal) and archive of old sites 2006-2014
* http://conference.osgeo.org - [[Conference System]] (also: [[SAC:Setup_OCS]])
* http://journal.osgeo.org / osgeo.org/ojs - [[Journal System]]
* Redirects for many chapter and other urls handled via /etc/httpd/conf.d/rewrite.conf

= Cloud Hosted Servers and other external under SAC Control =

== Future Hosting Plans for Windows / Mac Building ==

[[SAC_Shared_Building_Services|SAC Shared Building Services]]

== Atlantic.net ==

* host.postgis.net -p 2222 is an LXD Ubuntu 18.04 16GB RAM/ 6 vCPU, 350GB data, 250GB block storage
* Currenlty running two lxd containers:
debbie: debian 10 postgis.net, planet.postgis.net, debbie.postgis.net (jenkins build bot)
debbie-docker.host.postgis.net - runs docker and serves as a 1.0 agent for dronie.osgeo.org

= QGIS off OSGeo =
Services on separated machines rented and managed by the QGIS project at hetzner

* website including documentation http://www.qgis.org
* website building, documentation building, debian/ubuntu nightlies, plugins.qgis.org
* issues.qgis.org: redmine

= Historical servers (not more in use) =

- [[Telascience Blades (Historical)]]

== web18a.osgeo.osuosl.org ==
NO LONGER USED - turned off
'''2019-09-03 Production services www.osgeo.org, 2018.foss4g.org moved to wordpress container on [[osgeo7]]
Staging services (staging.www.osgeo.org, dev.www.osgeo.org move to wordpress-dev container on [[osgeo4]]
Grass wordpress is disabled as grass decided to go with another solution, so have grass container on osgeo7'''
(Cloud hosted server on OSUOSL hardware (not ours) )
* Debian 9.3 4GB server, host name: web18a.osgeo.osuosl.org require ssh key to log in.
* Hosts wordpress sites staging.www.osgeo.org,www.osgeo.org, staging.grass.osgeo.org, foss4g2018.osgeo.org
* Setup details on [https://git.osgeo.org/gitea/osgeo/www_apache_configs/wiki/Web18a-setup Web18a setup]

== OSGeo funtoo ==

For lxd experimentation it's an lxd container running other lxd containers and provided by funtoo.org.

OSGeo is paying funtoo via treasurer at osgeo.org.

* [https://git.osgeo.org/gitea/sac/osgeo_funtoo OSGeo Funtoo] osgeo.host.funtoo.org

* funtoo LXDs currently running:
** <del>[https://limesurvey.osgeo.org LimeSurvey] -this may be in future migrated to osgeo7 or osgeo3</del>
Migrated to osgeo3 2020-11-28 -- see https://trac.osgeo.org/osgeo/ticket/2362

[[Category:Infrastructure]]
[[Category:Services]]

SAC

2025-09-21T07:38:09Z

Strk: /* Communication */ add forum

= Mission =
The OSGeo System Administration Committee (SAC) manages [[SAC_Service_Status|computer systems]] operated by OSGeo. Responsibilities include:

* Develop published policies and procedures for managing systems, and system services.
* Solicit input from stakeholders on required system services, and to prioritize which to offer and when.
* Assign appropriate security and other responsibilities to administrators and users for access to systems.
* Ensure core OSGeo system services are well maintained, highly available and recoverable in case of system failure.
* Recommend system expenditures to the Board.

= Members =

([[SAC:Primary Administrators]])

A [[SAC:LDAP|LDAP]] group holds the [https://id.osgeo.org/ldap/shell?group=sac authoritative list of current SAC administrators] (need an [https://www.osgeo.org/osgeo_userid OSGeo account to read).

== Active ==
* [[User:strk|Sandro Santilli]] aka strk (General Administration, [[Trac Instances|trac]], [[SAC:Gitea|Gitea]], [[Drone]])
* [[User:robe|Regina Obe]] ( general server administration and management which includes server patches, osgeo3-osgeo9 lxd hosts, DNS changes)
* [[User:Cvvergara| Vicky Vergara]] ( website administration, lists administration, general server administration )
* [[User:Jef|Jürgen Fischer]] (QGIS, OSGeo4W, Downloads, various)
* [[User:jive| Jody Garnett]] (website administration, repository)
* [[User:lnicola| Laurențiu Nicola]] (Download, wiki, website, Mantra, ldap, Gitea)
* [[Jorge Sanz]] ([[SAC:Mailing Lists|Mailing Lists]], [[PlanetOSGeo]])
* [[User:Neteler|Markus Neteler]] (GRASS CMS + Wiki, fail2ban, various)
* [[Jeff McKenna]] (Wiki, Mapserver website and demo, WebExtra, Tracsvn)
* [[User:tomkralidis|Tom Kralidis]] (Observer, OSGeo Board)
* Frank Warmerdam (Downloads, [[SAC:Mailing Lists|Mailing Lists]], [[SAC:LDAP|LDAP Scripts]])
* [[User:Martin|Martin Spott]] (Backups, everything else)

== InActive ==
* Eli Adam (Foss4g Archives)
* Shawn Barnes
* Wolf Bergenheim
* Alan Boudreault
* Hamish Bowman (OSGeo Live)
* Howard Butler
* [[Paolo Corti]] ([[PlanetOSGeo]])
* Richard Duivenvoorde (QGIS)
* [[User:wildintellect|Alex Mandel]] '''Chair''' (General)
* [[User:TemptorSent| Chris Giorgi]] aka TemporSent (funtoo setup, osgeo7, eventually wiki/ldap integration)
* John Graham
* Harrison Grundy
* Swapnil Hajare
* [[User:ajolma|Ari Jolma]]
* [[Mateusz Loskot]] ([[SAC:Mailing Lists|Nabble, Mailing Lists (Jobs)]], [[PlanetOSGeo]])
* Daniel Morissette
* [[User:Jgrocha|Jorge Rocha]]
* Larry Shaffer (Apple Signing Certificates)
* Chris Schmidt (OAM, Vmap0, Sr.org)
* Gary Sherman ([[IRC|IRC Bots]])
* Christian Willmes (Journal, Wiki)
* Norman Vine ([[IRC]])

= Meetings =
* [[SAC_Meeting-2020-06| Jun 2020 Agenda Notes]]
* [[SAC_Meeting-2020-04| Apr 2020 Agenda Notes]]
* [[SAC_Meeting-2020-03| Mar 2020 Agenda Notes]]
* [[SAC_Metting_2020-01| Jan 2020 Agenda Notes]]
* [[SAC_Meeting_2019-11| Nov 7th Agenda Notes]]
* [[SAC_Meeting_2019-10| Oct 24th Agenda Notes]]
* [[SAC_Meeting_2019-09| Sept 12th-26th Agenda Notes]]
* [[SAC_Meeting_2019-08| Aug 1st-29th Agenda Notes]]
* [[SAC_Meeting_2019-06| Jun 6th-20th Agenda Notes]]
* [[SAC_Meeting_2019-05| May 9th-23rd Agenda Notes]]
* [[SAC_Meeting_2019-04| Apr 11th-25th Agenda Notes]]
* [[SAC_Meeting_2019-03| Mar 14th-28th Agenda Notes]]
* [[SAC_Meeting_2019-02| Feb 14th-28th Agenda Notes]]
* [[SAC_Meeting_2019-01| Jan 3rd-31st Agenda Notes]]
* [[SAC_Meeting_2018-11| Nov 15th-29th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-10| Oct 4th-25th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-09| Sept 13th-27th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-08| Aug 9th-30th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-08-02| Aug 2nd 2018 Agenda Notes]]
* [[SAC_Meeting_2018-07-26| Jul 26th 2018 Agenda Notes]]
* [[SAC_Meeting_2018-07-12| Jul 12th 2018 Agenda (Started Jul 5th, will reconvene July 12th) & Notes]]
* [[SAC_Meeting_2018-06-24| Jun 24th 2018 Agenda (Canceled) & Notes]]
* [[SAC_Meeting_2018-06-07| Jun 7th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-05-27| May 27th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-05-10| May 10th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-04-29| April 29th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-04-14| April 14th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-29| March 29th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-15| March 15 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-03-02| March 2nd 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-02-15| February 15th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-02-01| February 1st 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-01-18| January 18th 2018 Agenda & Notes]]
* [[SAC_Meeting_2018-01-04| January 4th 2018 Agenda & Notes]]
* [[SAC_Meeting_2017-12-21| December 21st 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-12-07| December 7th 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-11-23| November 23rd 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-11-09| November 9th 2017 Agenda & Notes]]
* [[SAC_Meeting_2017-10-26| October 26th 2017 Agenda & Notes]]
* [[SAC:Oct122017| October 12th 2017 Agenda & Notes]]
* [[SAC:Sep2016| September 2016 Agenda & Notes]]
* [[SAC:May2016| May 2016 Agenda & Notes]]
* [[SAC:June2010_meeting|June 2010 SAC OSL Transition Meeting]]
* 1/22/07 [[SAC:1_22_07_agenda]] [[SAC:1_25_07_minutes]]
* 2/22/07 [[SAC:2_22_07_agenda]] [[SAC:2_22_07_minutes]]
* For a complete list, see [[:Category:SAC_Meetings]]

= Communication =
* Mailing list: [https://lists.osgeo.org/mailman/listinfo/sac Subscribe], [http://lists.osgeo.org/pipermail/sac Archives]
* IRC in #osgeo-sac on libera.chat (quick access: https://web.libera.chat/)
* Matrix in #sac:osgeo.org (quick access: https://matrix.to/#/#sac:osgeo.org)
* Forum: https://discourse.osgeo.org/c/committees/sac-global-category

= Task Tracking =

Infrastructure problems should be filed as trac ticket to SAC:
* [http://trac.osgeo.org/osgeo/login login] and [http://trac.osgeo.org/osgeo/newticket?component=Systems%20Admin Submit Trac Ticket]

Open issues:
* [http://trac.osgeo.org/osgeo/query?status=new&status=assigned&status=reopened&component=Systems%20Admin&order=priority Open SAC Issues]
* Old [[SAC TODO List]] (need to migrate any remaining issues to Trac).

= Procedures =

See [[:Category:SysAdminProcedure]] for a list of pages describing procedures.

The procedure to describe procedures is to create a wiki page and add a <nowiki>[[Category:SysAdminProcedure]]</nowiki> snippet in the page.

= Documents =

* [[SAC 2018 Annual Report]]
* [[Osgeo7 | Infrastructure Transition 2018-2019 Purchase and move of services to osgeo7]]
* [[Infrastructure Transition Plan 2010]]
* [[2007 Annual Report]]
* [[OSL]] - Information on our use of system services at the OSU Open Source Labs (OSL).

== Budget ==

* [[SAC:Budget| Past, Current and Proposed Budgets]]

= Services =

* See [[:Category:Services]]
* [[SAC Service Status]] indicates what services are setup, where and known issues (OSUOSL and other locations).
* [[Download Server]] for storing source code, VMS, project installation files
* [[SAC:Gitea]] for git repos for projects and committees. Can be used for both public and private git repos, trackers, and todos
* [[Trac Instances]]
* [[SAC:Jitsi]] For video meetings
* [[SAC:Weblate]] for document translation
* OBSOLETE: [[Drupal Portal]] - transition notes for www project, talks about issues transitioning to new web site portal.
* [[Subversion]] - Subversion services and configuration
* [[SAC:Mailing Lists]]
* [[SAC:LDAP]]
* [[Postgrey]] - spam filter for postfix
* [[OSGeo_Wiki|Mediawiki]]

== Retired services ==

* [[BuildBot Configuration]]
* [[Moodle]] - educational server for training and courses

= Projects with SAC involved =
* [[Geodata processing at telascience.org]] - by [[Geodata Packaging Working Group]]
* The [[Software Stack]] page talks about the ''Reference Stack'' of software we would like to setup for demonstration and testing purposes.
* [[Kids GIS Portal]] - hosted at telascience, a wee bit of systems help.

= Migration to new Infrastructure =

* [[Osgeo7 | Infrastructure Transition 2018-2019 Purchase and move of services to osgeo7]]
* [[Infrastructure Transition Plan 2010]]
* [[Infrastructure Transition Plan 2014]]

== Old migration documents for historical review. ==

* [[Migration Documentation]] - assorted services on www.osgeo.org
* [[Drupal Upgrade Plan]] - Wolf's fall 2007 plan to upgrade Drupal to 5.3.
* The [[Project Infrastructure Migration]] page talks about migration issues of the projects in incubation and provides hints to some services we should be trying to provide.
* [[Migration Tasks and Milestones]]
* [[Migration Documentation]]
* [[Infrastructure Transition Plan | Infrastructure Transition Plan 2006]]

[[Category:Infrastructure]]
[[Category:Committees]]

SAC:Message Submission Agent

2025-09-20T09:58:35Z

Strk: /* Prerequisites */

= Message Submission Agent =

With this [https://en.wikipedia.org/wiki/Message_submission_agent Message Submission Agent] (MSA) service, OSGeo provides the ability to send emails with the <code>@osgeo.org</code> domain for community members. Note that this is '''not''' a full email service with an inbox to manage and store messages.

== Prerequisites ==

* Get an [[Osgeo_Userid_Help|OSGeo ID]].
* [https://trac.osgeo.org/osgeo/newticket Open a ticket] in the OSGeo Trac for an admin to grant this service to your user. Remember to assign to the <code>SysAdmin</code> component for faster routing.
** An admin should [[SAC:Message_Transport_Agent#Setting_up_mail_alias|create an alias]] for you to receive replies ( communicate a stable, working, email to forward to ).
** An admin should add you to the [[SAC:LDAP#Shell_group_management|shell management LDAP group]]

== MUA set up ==

Configure your e-mail client (Mail User Agent) with new SMTP outgoing server with the following settings (using Thunderbird terminology):

* Server Name: <code>lists.osgeo.org</code>
* Port: <code>465</code>
* User Name: <code>Your OSGeo ID</code>
* Authentication method: <code>Normal password</code>
* Connection security: <code>SSL/TLS</code>

= See Also =

[[SAC:Message Transport Agent]]

[[Category:Services]]