OSGeo - User contributions [en]

Java 2017 Code Sprint

2017-01-18T20:23:53Z

Wiki-Mikepumphrey: Adding Mike Pumphrey to the list of potential attendees

The current plan is for the Java tribe to meet in Italy at the start of March. This page will allow us to plan the event.

== Location ==

We will be hosted at the GeoSolutions offices in beautiful Tuscany for a week long sprint.
Available seats are limited to 10 to 15!

Questions:

# Who would be interested in joining as a participating?
# Who would be interested in sponsoring? ;-)
# Do you have any preferred week between say March 13 and end of March?

== Participants ==

Please add your name and the projects you are planning to sprint and note the likehood of your attendance.

{| style="border: solid grey 1px; width:100%" class="sortable"
|+ Participants
|-
| # || Participant || Country || Organization || Arrival || Departure || Project Work on || Notes || Attendance
|-
| 1 || Andrea Aime || Italy || GeoSolutions || || || CITE or REST API switch || Preference for CITE, I'm game for the REST API switch too || Local
|-
| 2 || Ian Turton || UK || Astun || || || CITE, Java 8 upgrade || Planning
|-
| 3 || Andrea Antonello || Italy || HydroloGIS || || || gvSIG and cross-project ideas || I have a strong preference for the end of March || Planning
|-
| 4 || Jody Garnett || Canada || Boundless || || || GeoServer and GeoTools || Enthusiastic about CITE and REST API work || Planning
|-
| 5 || Niels Charlier || Belgium || Scitus Development || || || GeoServer and GeoTools || Keen to do REST API work, MapBox seems interesting too. || Tentatively planning, possibly partially
|-
| 6 || Torben Barsballe || Canada || Boundless || || || REST API or CITE || Preference for REST API, would also be fine with CITE || Planning
|-
| 7 || Mike Pumphrey || USA || Boundless || || || Documentation || I'll help out with whatever you all decide on || Depends on what dates we decide

|}

== Sponsors ==

We have the following sponsorship levels:

{| class="wikitable"
|-
| Gold
| style="text-align:right;" | $1000 USD
| style="text-align:right;" | €950 EUR
|-
| Silver
| style="text-align:right;" | $500 USD
| style="text-align:right;" | €470 EUR
|-
| Bronze
| style="text-align:right;" | $250 USD
| style="text-align:right;" | €235 EUR
|-
| Beer || colspan="3" | In-kind contributions are graciously accepted
|}

Contributions will be put towards travel costs for overseas sprinters who would be otherwise unable to attend. Any surplus at the end of the event will be turned over to OSGeo or used for a future code sprint. We have set-up the sprint to minimize travel and accommodation costs.

Sponsors will receive the following honors:

* Your logo at the top of this page
* Mention in all of our public communication, including GeoServer 2.9 release announcement
* Our gratitude :)

For more information on sponsorship, please contact [[Jody Garnett]], [[User:Aaime|Andrea Amie]].

=== How to Sponsor ===

Sponsorship is accepted through PayPal:

# Navigate to the [http://www.osgeo.org/ OSGeo website]
# Click on the "Donate" button in the top right corner
# Donations are handled through PayPal, when making the donation be sure to:
#* Check the currency (USD rates are provided above)
#* Use the "Add special instructions to the seller" field on the confirmation page to mention the event (example "GeoServer code sprint sponsorship")
#* To make alternative arrangements contact OSGeo [[Treasurer]]
# The OSGeo [[Treasurer]] will contact both you and the event organizers to acknowledge your sponsorship
#* Please have a logo ready for your organization if you wish to be acknowledged publicly
#* Your event sponsorship, at your request, can contribute towards [http://www.osgeo.org/sponsorship being recognized] as an OSGeo Foundation sponsor

We can also ask that OSGeo provide an invoice for payment (contact [[Jody Garnett]], [[User:Aaime|Andrea Amie]] to make arrangements).

=== Sponsorship Outreach ===

We are reaching out to organizations to see if there is interest in sponsorship:

* International organizations (OSGeo, GeoSolutions, Boundless);
* Local organizations

If there is a lot of local sponsorship we expect to drag the developers away from the task at hand and meet the local community (at a social evening or similar).

=== OSGeo Funding Request ===

The following information is requested by OSGeo Board [[Code_Sprint_Guidelines]]:

* [[Java_2017_Code_Sprint_Budget_:_Budget|Java 2017 Code Sprint Budget]]

== GeoServer ==

The GeoServer team really benefited from [[GeoServer Code Sprint 2016|geoserver code sprint 2016]] and is eager to repeat the success.

=== GeoServer Plans (choose ONE of the following) ===

We are still at the planning stage so please let us know if a particular topic interests you or would be a deal breaker. The sprint does not have to be a single topic, if we can swarm a large beast good, but if someone wants to join and work on a side topic to leverage the presence of others, that’s good too.

==== CITE ====

The [http://cite.opengeospatial.org OGC Compliance Program] provides the CITE tool for testing standards compliance. Our build process makes heavy use of this tool ... ensuring that each and every release of GeoServer correctly implements WMS, WFS, and WCS.

There are three problems with this:

* We last updated our CITE build tool 2012 (so our testing is quite out of date).
* Our geoserver.org website can only say we are a "compliant implementation", rather than a "certified implementation" of the WCS, WMS and WFS standards.
* New services such as WPS and CSW are not "blackbox" tested.

The OGC provide the CITE Team Engine both as a web service and as an open source project that can be used to check a single instance of GeoServer. This is a little awkward as we would like to integrate these tests into our build server; as such our build server stands up a geoserver instance, performance the tests, and publishes the results [http://ares.boundlessgeo.com/jenkins/view/testing-cite/ here]. These tests also require a database - and modify that database over the course of the tests (so our build server needs a PostGIS running).

Armed with a positive test result we can ask OSGeo to pay for OGC certification, allowing us to update our website. As an alternative to paying money the OGC allows open source projects to be listed as a "reference implementation" (providing an instance of the server is available online for potential clients to test against).

Rough planning:

* Upgrade the test harness
* Make sure the tests are still passing (probably they won’t),
* Add new test that we are missing
** WFS 2.0,
** WCS 2.0
** CSW
** WMTS 1.0
** WPS 1.0,
** maybe GML and KML and GeoPackage
* OGC Certification
** Submit required paperwork, and test results, update website
* Reference Implementation
** Maybe stand up a reference server for OGC to use (if OSGeo or OGC provide hardware) with one test per workspace/virtual service?

==== REST API ====

The REST API for GeoServer is popular, but not well maintained, collecting a large number of outstanding bugs. Many of these complain about functionality and lack of documentation. The large number of bugs (API called correctly but produced an error) may be producing more requests for documentation (developer assumed they called it incorrectly, and asks for improved documentation with an example that works).

Internally the REST API is written using an early java library called "restlet" (http://restlet.com/). There is a desire to migrate to spring rest api which is annotation driven and better supported. The risk in performing a migration to Spring MVC is introducing more bugs than are fixed. This is somewhat offset by having a larger pool of developers familiar with the codebase and the technologies used.

/**
* API endpoint to get details on a specific layer
* @param wsName The workspace name
* @param name The layer name
* @param req The HTTP request
* @return The layer, encoded as a JSON object
*/
@RequestMapping(value="/{wsName}/{name:.+}", method = RequestMethod.GET)
public @ResponseBody JSONObj get(@PathVariable String wsName, @PathVariable String name, HttpServletRequest req) {

Rough plan:

* Create a rest-ng module (alongside existing rest, restconfig, importer-rest, ....)
** Module based on Spring MVC - see simple [https://github.com/boundlessgeo/suite/blob/master/geoserver/webapp/src/main/java/com/boundlessgeo/geoserver/api/controllers/ProjController.java PrjController.java] example and complex [https://github.com/boundlessgeo/suite/blob/master/geoserver/webapp/src/main/java/com/boundlessgeo/geoserver/api/controllers/LayerController.java LayerController.java] example.
** Set up converters/encoders for resources
* Migrate restconfig functionality
* Migrate importer-rest functionality
* resource-rest-api
* rest-upload
* Audit functionality against GUI
** shortlist missing functionality for proposal and implementation (examples recalculate feature type columns, rest layer bounds from SRS boudns, ...)
* Test cases should remain unchanged
* Documentation
** Set up documentation team operating concurrently, capturing each resource as it is completed
** Go for a resource description, json and xml example, example of each kind of request (GET, PUT, POST, DELETE) as appropriate. See [https://www.mapbox.com/api-documentation/?language=cURL#styles mapbox example] and [https://github.com/boundlessgeo/suite/wiki/Layers-API boundless example].
** Consider auto generating example output from test case (see [https://projects.spring.io/spring-restdocs/ spring-restdocs])

This activity will require quite a bit of people (all hands on deck).

Reference:

* [https://osgeo-org.atlassian.net/issues/?jql=project%20%3D%20GEOS%20AND%20status%20%3D%20Open%20AND%20component%20%3D%20REST Searching for REST]
* [https://osgeo-org.atlassian.net/issues/?jql=project%20%3D%20GEOS%20AND%20status%20%3D%20Open%20AND%20component%20%3D%20REST Searching for Module] (not always properly assigned)

==== Mapbox Style ====

The GeoServer application can be extended to work with multiple styling languages (SLD, CSS, YSLD). Mapbox has recently defined an open standard for drawing vector tiles that has been picked up by not only their own software but by the OpenLayers team. Initial investigation into this standard shows that it is a "whole" map standard similar to "sld" describing both the layers that make up the map, and the symbology used to represent them visually.

While some features (3d extrusions, camera and lighting angle) are not suitable for use by GeoServer the rest of it looks quite fun.

References:

* https://www.mapbox.com/mapbox-gl-style-spec/

* https://boundlessgeo.com/2017/01/using-mapbox-style-objects-open-layers/

Rough planning:

* Focus on styling a single layer using a mapbox style
** Requires a parser for mapbox style capable of producing the internal geotools style objects; package as a geotools community module.
** Setup geoserver extension and integration for new style format
* Whole map styling (optional)
** LayerGroup defines both an order of layers, and the style associated with each layer - this information can be defined from a single mapbox style
** (Optional) Consider offering SLD the same ability to define a LayerGroup

==== Library upgrades ====

Last year's sprint was devoted to updating a key library and required all hands on deck to help make the transition a smooth one. Ideally we would like to stay on top of library upgrades; however often a change to one has a cascade effect as we need to update (and test) each library in turn.

{| style="border: solid grey 1px; width:100%" class="sortable"
|+ Libraries
|-
| Library || Version || Latest || Description ||
|-
| Wicket || 7.1.0 || 7.6.0 || user interface (note 8.x milestones being released presently)
|-
| hsql || 2.3.0 || 2.3.4 || java database
|-
| h2 || 1.1.119 || 1.3.176 || java database (1.4.x beta currently available)
|-
| commons-dbcp || 1.4 || 2.2 || database connection pool
|-
| commons-beanutils || 1.9.2 || 1.9.3 || java bean utility library
|-
| commons-collections || 3.2.2 || 4.1 | java collection classes
|-
| guava || 17.0 || 21.0 || java collection classes and more
|-
| log4j || 1.2.12 || 2.7 || supports java 8 lambda, consider migrating to yaml/json config?
|-
| (and much more) || ||
|}

Note:

* We may wish to migrate from guava from java 8 and commons collections; as guava often produces conflicts for downstream projects

== GeoTools ==

=== GeoTools Plans ===

The GeoTools codebase has a number of smaller of ideas that may of be of interest to volunteers:

* JDK 9 + maybe JDK 8 updates in the code base (like stream ready support for feature collection, where we can use lambda for profit)
* JDK 9 replacement for plugin system (service registry) is required

The above ideas may also be suitable to anyone attending remotely who like the focus and support of a dedicated code sprint block on the calendar.

[[Category:Code Sprints]]
[[Category:Java Tribe Code Sprint]]

GeoServer Code Sprint 2016

2016-01-11T21:48:38Z

Wiki-Mikepumphrey: /* Participation */

== Purpose ==

The GeoServer web administration console is built on top of the [https://wicket.apache.org/ Wicket] 1.4.x series,
which is pretty old and unmaintaned. The purpose of the sprint is to update it to Wicket 7.x, the current stable version.

[[File:Wicket-upgrade.png|center|Upgrade from Wicket 1.3 to Wicket 7]]

Due to the large distance between the two releases and the number of backwards incompatible changes accumulated
by Wicket in the years this will require the concerted effort of a handful of developers over a few days, including the
changes to upgrade the code, and the thorough hand testing of the resulting modified interface.

== Sponsors ==

We would like to extend our thanks to the following sponsors:

=== Gold Sponsors ===

{| cellpadding="20"
| [[File:OSGeo logo 750 317.png|250px|link=http://www.osgeo.org]]
| [[File:Boundless_Logo.png|250px|link=http://boundlessgeo.com]]
| [[File:Vivid_Logo.png|250px|link=http://www.vividsolutions.com]]
|}

=== Silver Sponsors ===

{| cellpadding="20"
| [[File:How2map logo.png|250px|link=http://www.how2map.com]]
|}

=== Bronze Sponsors ===

{| cellpadding="20"
| [[File:Geoserver sprint sjwc.png|250px|link=https://www.sjwater.com]]
| [[File:Transient-banner.png|250px|link=http://transient.nz/]]
| [[File:Logo_geobeyond.jpg|250px|link=http://www.geobeyond.it]]
|}

=== In-Kind Sponsors ===

{| cellpadding="20"
| [[File:Scitus_logo.png|250px|link=http://www.scitus.be]]
| [[File:Geosolutions_logo.png|250px|link=http://www.geo-solutions.it]]
| [[File:CCRi_Logo.png|250px|link=http://www.ccri.com]]
| [[File:AstunLogo.png|250px|link=http://astuntechnology.com]]
|}

== Organizers ==

* Jody Garnett - Boundless
* Andrea Aime - GeoSolutions

== Venue and dates ==

The code sprint will be held in Victoria BC to minimize travel costs. Boundless has offered to provide a venue (either the Boundless Victoria offices or a local technology centre).

The date is tentatively set for the week of January 18th.

This date is selected towards of the GeoServer 2.9 release cycle prior to the code freeze in February, keeping resource availability in mind.

== Accommodation and costs ==

Participants should plan the travel, accommodation and meals.

* Depending on sponsorship level guests to Victoria will be hosted at or billeted with local community.
* At the time of writing accommodation for four guests is available (thanks to Jody Garnett and Martin Davis).

We hope to raise enough financial support to cover overseas travel, and possibly meals.

== Sponsorship ==

We have the following sponsorship levels:

{| class="wikitable"
|-
| Gold
| style="text-align:right;" | $1000 CAD
| style="text-align:right;" | $720 USD
| style="text-align:right;" | €656 EUR
|-
| Silver
| style="text-align:right;" | $500 CAD
| style="text-align:right;" | $360 USD
| style="text-align:right;" | €328 EUR
|-
| Bronze
| style="text-align:right;" | $250 CAD
| style="text-align:right;" | $180 USD
| style="text-align:right;" | €164 EUR
|-
| Beer || colspan="3" | In-kind contributions are graciously accepted
|}

Contributions will be put towards travel costs for overseas sprinters who would be otherwise unable to attend. Any surplus at the end of the event will be turned over to OSGeo or used for a future code sprint. We have set-up the sprint to minimize travel and accommodation costs.

Sponsors will receive the following honors:

* Your logo at the top of this page
* Mention in all of our public communication, including GeoServer 2.9 release announcement
* Our gratitude :)

For more information on sponsorship, please contact [[Jody Garnett]], [[User:Aaime|Andrea Amie]] or the OSGeo [[Treasurer]].

=== How to Sponsor ===

# Navigate to the [http://www.osgeo.org/ OSGeo website]
# Click on the "Donate" button in the top right corner
# Donations are handled through PayPal, when making the donation be sure to:
#* Check the currency (USD rates are provided above)
#* Use the "Add special instructions to the seller" field on the confirmation page to mention the event (example "GeoServer code sprint sponsorship")
#* To make alternative arrangements contact OSGeo [[Treasurer]]
# The OSGeo [[Treasurer]] will contact both you and the event organizers to acknowledge your sponsorship
#* Please have a logo ready for your organization if you wish to be acknowledged publicly
#* Your event sponsorship, at your request, can contribute towards [http://www.osgeo.org/sponsorship being recognized] as an OSGeo sponsor

=== Sponsorship Outreach ===

We are reaching out to organizations to see if there is interest in sponsorship:

* International organizations (OSGeo, Boundless, GeoSolutions);
* Local organizations (BC Government, Refractions, Vivid Solutions)

If there is a lot of local sponsorship we expect to drag the developers away from the task at hand and meet the local community (at a social evening or similar).

=== OSGeo Funding Request ===

The following information is requested by OSGeo Board [[Code_Sprint_Guidelines]]:

* [https://docs.google.com/spreadsheets/d/1mp2xWq95t1rqwle6_WCQ0qD8D9-1icitLH0AiJQ7r4Y/edit?usp=sharing GeoServer Code Sprint 2016 Budget]
* TLDR: Looking to raise $6000 CAD ($4500 USD) to assist with overseas travel expenses

== Participation ==

{| style="border: solid grey 1px; width:100%" class="sortable"
|+ Participants Attending Victoria Code-Sprint
|-
| # || Participant || Country || Availability || Accommodation || Capacity || Notes
|-
| 1 || Andrea Aime || Italy || Monday-Thursday || TBD || Dev || -
|-
| 2 || Jody Garnett || - || Monday-Friday || - || Dev || limited experience with wicket.
|-
| 3 || Kevin Smith || - || Monday-Friday || - || Dev || -
|-
| 4 || Torben Barsballe || - || Monday-Friday || - || Dev || Some experienced with Javascript and wicket.
|-
| 5 || Justin Deoliveira || - || Monday-Tuesday || TBD || Dev || -
|-
| 6 || Mike Pumphrey || USA || Monday-Friday || Parkside || Docs || GeoServer documentation maintainer performing final checks & screenshots.
|-
| 7 || Devon Tucker || - || Monday-Friday || - || Dev || Some experienced with JavaScript and wicket.
|-
| 8 || Niels Charlier || Belgium || - || TBD || Dev || Experienced with wicket.
|-
| 9 || Jim Hughes || USA|| Monday-Friday || TBD || Test/Dev || Now can attend full sprint
|-
| 10 || Martin Davis || - || Wednesday || - || Test || Available for testing (has oracle development environment)
|}

If you cannot attend in person you may still be in position to update screens or assist with testing a nightly build overnight. Close collaboration for manual testing will require use of IRC/Skype/Hangout as appropriate for the parties involved.

{| style="border: solid grey 1px; width:100%" class="sortable"
|+ Participants helping out Remotely
|-
| # || Participant || Country || Communication || Notes
|-
| 1 || Ian Turton || United Kingdom || Hangout || Hapless volunteer
|-
| 2 || Ben Caradoc-Davies || New Zealand || Email/Skype/Hangout || Moral support and build nanny
|-
| 3 || Gabriel Roland || Argentina || Email/Hangout || Experienced with wicket
|-

|}

== Sprint ==

The schedule has been broken down by day to help plan activities for those with limited availability. If you can stop by for an afternoon to help with testing, or volunteer online to test a nightly build, please let the team know.

In scope:

* Use of Java 8 syntax to reduce wicket boiler plate code
* Mike Pumphrey will be on hand to update user guide as each screen is completes manual testing

Out of scope:

* Changing the codebase to use a different library (the effort would be at least an order of magnitude bigger)
* Improve the behavior of the current UI (we can make improvements at the end, once everything works, if time remains)

=== Preflight ===

Sprint tasks on the GeoServer wiki:

* https://github.com/geoserver/geoserver/wiki/Wicket-migration-code-sprint

Andrea has done the bulk changes - and good news you can start from eclipse! Bad news 200 compile errors.

Please: Review the above wiki page and the documentation links provided prior to the start of the sprint.

=== Monday 18 Jan ===

Activities:
* change wicket Dependency
* wicket 7 bootcamp / [https://cwiki.apache.org/confluence/display/WICKET/Migrating+to+Wicket+1.3 migration guide]
* migrate to wicket 7

=== Tuesday 19 Jan ===

* migrate to wicket 7
* migration/testing: workspace configuration screens
* migration/testing: datastore configuration screens
** oracle: martin

=== Wednesday 20 Jan ===

* migration/testing: global configuration screens
* migration/testing: service configuration screens (jody/volunteer)
* migration/testing: layer configuration screens
** vector:
** raster:
** image mosaic:

availability: martin

=== Thursday 21 Jan ===

* migration/testing: tile cache configuration screens (kevin/volunteer)
* migration/testing: security configuration screens
* migration/testing: demos

=== Friday 22 Jan ===

* manual testing: demos
* manual testing: extensions
* manual testing: select community modules

[[Category:Code Sprints]]

GeoServer Code Sprint 2016

2015-11-18T23:23:23Z

Wiki-Mikepumphrey:

== Purpose ==

The GeoServer web administration console is built on top of the [https://wicket.apache.org/ Wicket] 1.4.x series,
which is pretty old and unmaintaned.

The purpose of the sprint is to update it to Wicket 7.x, the current stable version. Due to the large distance
between the two releases and the number of backwards incompatible changes accumulated by Wicket in the years
this will require the concerted effort of a handful of developers over a few days, including the changes to
upgrade the code, and the thorough hand testing of the resulting modified interface.

Out of scope:
* Changing the codebase to use a different library (the effort would be at least an order of magnitude bigger)
* Improve the behavior of the current UI (we can make improvements at the end, once everything works, if time remains)

== Organizers ==

* Jody Garnett - Boundless
* Andrea Aime - GeoSolutions

== Venue and dates ==

The code sprint will be held in Victoria BC to minimize travel costs. Boundless has offered to provide a venue (either the Boundless Victoria offices or a local technology centre).

The date is tentatively set for the week of January 18th.

This date is selected towards of the GeoServer 2.9 release cycle prior to the code freeze in February, keeping resource availability in mind.

== Accomodation and costs ==

Participants should plan the travel, accomodation and meals.

We hope to raise enough financial support to cover long hauls from Europe, and possibly meals.

== Sponsorship ==

We have setup the sprint to minimize travel and accommodation costs, and are looking for sponsors primarily to cover residual travel costs.

* OSGeo (pending)
* Boundless
* GeoSolutions

We will reach out to local organizations (BC Government, Refractions, Vivid Solutions) to see if there is interest in sponsorship. If so we expect to drag the developers away from the task at hand and meet the local community (at a social evening or similar).

== Participation ==

Participation can be either in person or remote via IRC/Skype/Hangout (specific tool TBD based on who's participating)

*In person*

{| style="border: solid grey 1px; width:100%" class="sortable"
|+ Participants
|-
| # || Participant || Country || Arrival || Departure || Accommodation || Notes
|-
| 1 || Andrea Aime || Italy || - || - || TBD || -
|-
| 2 || Jody Garnett || Canada || - || - || Home || -
|-
| 3 || Kevin Smith || Canada || - || - || Home || -
|-
| 4 || Torben Barsballe || Canada || - || - || Home || -
|-
| 5 || Justin Deoliveira || Canada || - || - || TBD || -
|-
| 6 || Elizabeth Thiry || USA || - || - || TBD || -
|-
| 7 || Mike Pumphrey || USA || - || - || TBD || -
|-
|}

TBD: Depending on sponsorship level guests to Victoria will be hosted at or billeted with local community.

== OSGeo Funding Request ==

The following information is requested by OSGeo Board [[Code_Sprint_Guidelines]]:

=== Basic Information ===

* Audience: 10 people are expected
* Region: Victoria, British Columbia
* Projects: GeoServer
* Length: 5 days
* Venue: Boundless has generously offered their Victoria office for the activity, and offered to rent a local shared office space if necessitated by the number of attendees.

=== Expected budget ===

Costs:

* Attendee Registration: n/a
* Venue: $1250 (at http://forttectoria.ca)
* In-kind: Above Venue

Travel costs:

* Cost per attendee (Local): $0
* Cost per attendee (Italy): $1400 CAD (airfare)
* Cost per attendee (DC): $900 CAD (airfare)
* Cost per attendee (Calgary, Canada): $400 CAD (airfare)
* Cost per attendee (Rosario, Argentina): $3200 CAD (airfare)

Sponsorship:

* Third party sponsorship:
* OSGeo sponsorship: $3000 towards travel costs

We would like to briefly acknowledge the difficulty of recording in-kind contributions of resources and staff given the OSGeo template. The bulk of the cost associated with code-sprint participation is reflected in staff availability, often far outstripping airfare and accommodation costs.

* Boundless: 5-8 people
* GeoSolutions: 2-3 people

=== Financials ===

This event is planned to incur a loss, given the short lead up time.

If any profit is amassed from sponsorship it will be returned to the OSGeo foundation.

[[Category:Code Sprints]]