On April 20th, 2011, CUGOS ([http://www.cugos.org/ www.cugos.org],[http://cugos.posterous.com]) will be holding a special all-day "spring fling" event at University of Washington Seattle Campus in place of our regular monthly meeting. We will provide FREE food and drinks, thanks to following sponsors:
'''TerraGIS'''([http://terragis.net]), '''Spatialdev'''([http://spatialdev.com]), '''Zonar System'''([http://zonarsystem.com]) & '''UW Geospatial Club'''.

 

The basic idea of this event is to come in the morning to learn something new (tools and real workflows)... stick around and apply it in the afternoon on some semi-structured hack sessions... and then learn some high level stuff in the evening.  As such, the day will be broken up as follows: 

*'''9-12: morning session -- "speed" workshops '''
*'''12-1: lunch '''
*'''1-4: afternoon session -- open hacking '''
*'''4-6: dinner '''
*'''6-8: evening session -- regular meeting '''

Details are given below, but be aware that all agendas and times are approximate -- we'll be loose and agile and nimble and react to changing events and schedules as our whimsies take us. 

All skill and interest levels are welcome! -- please join us for as much of the day as you can. 

 

= Morning Session: Workshops (9am to 12pm) =

Sponsor by '''TerraGIS''' & '''Spatialdev'''

'''Venue:''' Forest Club Room, Anderson Hall 

'''12 - 10 minute slots''' (10 min lightning instruction, 5 minutes Q&A each): Idea is a progression from server to desktop to web... hopefully utilizing common test data '''4 slots on server side tools:'''

#Install and setup of PostgresSQL/PostGIS on Linux system - RogerA 
#R, PostgreSQL, and PostGIS: techniques for processing large data sets - Phil Hurvitz 
#Does the World Need a Lidar Data Server?  - mpg
#gdal/ogr tips and tricks (VRT's, etc) - Aaron 
*tbd (basic batch processing with bash and python) AaronR? 
*tbd (maybe basic dev env tools like git/svn) GregC? 

 '''4 slots on desktop tools:'''

#gvSIG spatial analysis basics - Karsten 
#elevation data processing - Roger 
#Workflow Migration from ESRI to Open Source (python scripting) - Allison Bailey
#Introduction to GeoScript - Jared Erickson 

 '''4 slots on web tools:'''

#OSM rendering (comparison of rendering tools and OpenLayers setup for OSM) - Matt K
#How to style maps with [http://tilemill.com/ TileMill] and deploy them with TileStream - Dane Springmeyer

*tbd (maybe "Subverting the dominant paradigm: a critical look at the concept of Neo-postcounterhegemonic source") 
*tbd (maybe basic AJAX and jQuery) ??? 
*tbd (maybe OpenLayers) ??? 

= Meal Session: Lunch (12pm to 1pm) =

'''Venue:''' Forest Club Room, Anderson Hall 

Lunch is sponsor by '''Zonar System'''& '''UW Geospatial Club'''.
 

 

= Afternoon Session: Open (yet organized!) Hacking (1pm to 4pm) =

'''Venue:''' Forest Club Room, Anderson Hall Idea is to have 2-3 pre-planned projects (topics) that small groups can self organize and hack on some code. There would be a group leader that will have much of the infrastructure set up ahead of time (test data, code repo, etc). Here are some ideas:: 

*"Does the World Need an Open Source Server Framework for Lidar Data, and If So, How Would We Build It?":: Leader mpg 
<pre>- mpg will lead a 30 minute idea-gathering session, based on his lightning talk on this topic
- goal is to see if we can identify what existing tools we can use/extend to satisfy the goal
- this will proceed AaronR's OBM session
</pre>

*OSM rendering test framework:: Leader MattK and GregC

- Idea is to create as many rendering instances of OSM data as posible on the OBM server
- Come up with test cases that will stress all rendering engines
- Come up with jMeter test suites to run
- Maybe a django project to run tests, visualize results, and even add and remove tests.

 

*Restful interface to all OBM services:: Leader AaronR

- Idea is to create a django project to wrap all OBM services (NAIP images, OSM rendering, etc) into a logical restful interface
- Sub-projects include coming up with URL structures, implementing the restful interface, and finally implementing the pages (metadata, tests, examples, etc)

 

= Dinner Session (4pm to 6pm) =

We will be walking over to the University Ave for a no-host dinner sometime after 4pm, returning around 6pm.  Exact venue to be determined on the fly; this session might even split into parallel tracks. 

= Evening Session: Monthly Meeting and prepared talks (6pm to 8pm) =

'''Venue:''' 121 Raitt Hall First 10 minutes will be CUGOS intro and mini meeting::

*Aaron intro the group and what we are and invite new folks to participate as well as recap of rest of day 
*MPG will be be presenting a short (~5 min) recap of last month's Montreal codesprint and suggest CUGOS to host the 2012 event 

 2 hours of talks -> 6 - 20 minute talks (hard stop on timing)::

#"Open Data Kit project (http://code.google.com/p/opendatakit)" -Yaw Anokwa of UW 
#"Publishing Data to GeoNetwork/GeoServer from ArcGIS using GeoCat bridge" from Jubal Harpster.
#"ArcGIS, OpenGeoData, and R or Why I use the tools I do: the sordid life of a spatial statistics post doc" - Chris Fowler
#"Open Source Lidar State of the Union" - MPG 
#"OSM in Disaster Response - Humanitarian OpenStreetMap (HOT)" - Dane Springmeyer
#"ERMA and the Gulf Coast - Open Source tools in government disaster response" - Aaron Racicot

 

= Directions and Transportation =
'''Parking:''' [http://www.washington.edu/facilities/transportation/commuterservices/parking/daily www.washington.edu/facilities/transportation/commuterservices/parking/daily] 

'''Driving:''' [http://www.washington.edu/facilities/transportation/commuterservices/drive www.washington.edu/facilities/transportation/commuterservices/drive]

'''Walking: '''[http://www.washington.edu/facilities/transportation/commuterservices/walk www.washington.edu/facilities/transportation/commuterservices/walk] 

'''Bus/Train:''' [http://www.washington.edu/facilities/transportation/commuterservices/bus-train www.washington.edu/facilities/transportation/commuterservices/bus-train] and [http://www.washington.edu/facilities/transportation/commuterservices/bus-train/routes www.washington.edu/facilities/transportation/commuterservices/bus-train/routes] 

 

One person noted that "my personal experience is that one can find street parking north of 50th, west of I-5, and down by University Village shopping center, if one is willing to walk 30 to 45 minutes () . But many of those areas were also being converted to resident restricted zones. Bus is really easy." 

Another noted that "There are a ton of routes which stops near Anderson hall (Forest Club Room): [http://bit.ly/eKKmHE bit.ly/eKKmHE] (OneBusAway pointing to nearest bus stops north of Anderson)

 '''Maps of event locations:'''

*Anderson Hall (Forest Club room 207): [http://www.washington.edu/home/maps/southcentral.html?AND www.washington.edu/home/maps/southcentral.html]
*Raitt Hall (room 121): [http://www.washington.edu/home/maps/northcentral.html?RAI www.washington.edu/home/maps/northcentral.html] 

 

If you are interested in an '''Olympia-based carpool''', contact Webb Sprague (webb.sprague=AT=gmail.com) 

= Contacts =

Local arrangements chair: Matt Dunbar -- dunbar.matt(AT)gmail.com 

Wiki chair: mpg -- mpg^AT^flaxen.com 

 

= Attendees =

Michael P. Gerlek (mpg) - Flaxen Geo 

Peter Keum - King County DNRP - Wastewater Treatment Division

Greg Corradini

E. Ryan Small

Ruben Rodriguez

Aaron Racicot - Z-Pulley Inc.

Matthew Kenny - RIDOLFI Inc.

Matt Dunbar - UW Center for Studies in Demography and Ecology (CSDE)

Holly Glaser

Leah Saunders

<insert your name here>

Benchmarking 2011

2011-01-13T19:16:42Z

Wiki-Springmeyer: /* Next IRC meeting */

2010-08-18T14:21:07Z

Wiki-Springmeyer: /* Mapnik */

== Basic Premise ==

Following up on [[Benchmarking 2009|last year's exercise]], the performance shoot-out presentation at [[FOSS4G2010]] will test how long each Web mapping server takes to generate a map image, from a common set of spatial data, on a common platform. The data will be served by each Web mapping server through the WMS standard, which will serve exactly the same set of LAYERS. A JMeter load will be run on the testing box to measure various aspects of those layers.

== Participants ==

{| border="1"
|-
| '''Mapping Server'''
| '''Development Team Leader'''
| '''IRC nick'''
| '''Server status'''
|-
| Cadcorp GeognoSIS
| [mailto:martin.daly--@--cadcorp.com Martin Daly]
| mpdaly
| Production release of server installed with preliminary configuration for SHP, PostGIS, TIF and ECW
|-
| Constellation-SDI
| [[User:Cedricbr|Cédric Briançon]]
| cedricbr
| Running on port 8280. Installation done for Shapefiles.
|-
| Erdas Apollo
| [mailto:dimitri.monie@erdas.com Dimitri Monie begin_of_the_skype_highlighting end_of_the_skype_highlighting begin_of_the_skype_highlighting end_of_the_skype_highlighting begin_of_the_skype_highlighting end_of_the_skype_highlighting begin_of_the_skype_highlighting end_of_the_skype_highlighting]
| dmonie
| Install and configuration on-going on windows server, ecw WMS configuration done, shape and DB WMS configuration on going. Port 80, port 8080
|-
| GeoServer
| Andrea Aime
| aaime
| Normally running on port 8080 on the Linux server. Shapefiles and TIFF mosaic have been configured.
|-
| <s>MapGuide Open Source</s>
| <s>Zac Spitzer</s>
| <s>zacspitzer</s>
| ''inactive''
|-
| Mapnik
| [[User:Springmeyer|Dane Springmeyer]]
| springmeyer
| Running on port 8090 (paleoserver) 8091 (mod_mapnik_wms). Shapefiles styles ready, postgis and raster still to come.
|-
| MapServer
| [[User:Jmckenna|Jeff McKenna]]
| jmckenna
| linux_wms_bm serving WMS requests for shps, on port 8081. windows wms_bm serving requests for shps, on port 8081.
|-
| Oracle MapViewer
| [[User:msmitherdc|Michael Smith]]
| msmith_
| Set up on port 8088
|-
| QGIS mapserver
| Marco Hugentobler
| marco___
|}

== Timeline ==

{| border="1"
|-
| January 1st, 2010
| begin contacting all mapping servers
|-
| June 1st, 2010
| commitment due by all interested mapping servers
|-
| June 2nd, 2010
| exercise begins (and weekly meetings)
|-
| August 1st, 2010
| final testing begins
|-
| August 23rd, 2010
| no further testing
|-
| September 6-9, 2010
| present results at FOSS4G2010
|}

== Rules of Engagement ==

# All parties must contribute any changes that they make to their software for this exercise, back to their community. Note that the changes don't have to be contributed before the conference, just in a reasonable period of time.
# Comparisons will be made of the best available version of the software, be it a formal release or a development version.
# Two tests will be run: one 'baseline' test with the data in its raw format (with spatial indexes), and another 'best effort' test where 'the sky is the limit' for what changes you want to make to the data (change format, generalize, etc)
# Teams must document all steps they did to manipulate the data/server for both the 'baseline' and 'best effort' tests. If a team does not document the steps on this wiki then that team's test results will not be used.
# Data formats to be used will be shapefiles for vectors, and uncompressed geotiffs for rasters.
# WMS output formats to be used will be png8 and png24 where possible

== Documenting Server Details and Differences ==

It is the responsibility of each team to document their setup with regard to data.

Please keep your notes in your servers directory in svn: http://svn.osgeo.org/osgeo/foss4g/benchmarking/

One particular thing that will differ is each team's use of spatial indexes on shapefiles.

Teams are '''not''' allowed to modify the .shp, .shx, .dbf or .prj files of the vector data (for the baseline benchmark). They can, however, create auxiliary files for spatial indexes and the like.

{| border="1"
| '''Mapping Server''' || '''ext''' || '''type''' || '''command to create'''
|-
| MapServer || .qix || quadtree || shptree <shpfile> ([[shptree notes]])
|-
| GeoServer || .qix || quadtree || Using the ones generated for MapServer atm
|-
| Mapnik || .index || quadtree || shapeindex <shpfile> ([[Benchmarking_2010/Mapnik_notes#shpindex_depth]])
|-
|Erdas || .rtr || RTree || RTreeBuilder basedir shapename max min ([[RTreeBuilder notes]])
|-
|Cadcorp || *.shp.idx || RTree || GUI command in desktop SIS
|-
| Constellation || .qix || quadtree || Using the ones generated by MapServer
|-
| MapViewer || .oix || RTree || GUI option in MapBuilder.jar, java map/theme/style builder
|}

* Note: in your server setup documentation be sure to record the EXACT command used to create the indexes, with appropriate options passed (e.g depth)

== Datasets ==

A set of data published by the spanish National Mapping Agency will be used. This data is free for non-commercial use, so it's perfectly OK to use it in the benchmark.

Vector data will be a topographic map, composed of several shapefiles (one shapefile per theme). Raster data will be 50cm/px aerial photography.

We still do not have the definitive datasets, due to their size and the processing time needed to put them together. You can get some sample data by reading [[Benchmarking 2010/How to get some sample data]].

== SVN ==

The project files (minus data) are stored in Subversion (http://svn.osgeo.org/osgeo/foss4g/benchmarking/).

== Hardware ==

Machine A (windows server)
* System Type: Dell PowerEdge R410
* Ship Date: 7/7/2010
* Processor: Intel® Xeon® E5630 2.53Ghz, 12M Cache,Turbo, HT, 1066MHz Max Mem
* 8GB Memory (4x2GB), 1333MHz Dual Ranked RDIMMs for 1Processor, Optimized
* 2TB 7.2K RPM SATA
* OS: Windows Server 64bit

Machine B (linux server)
* System Type: Dell PowerEdge R410
* Ship Date: 7/7/2010
* Processor: Intel® Xeon® E5630 2.53Ghz, 12M Cache,Turbo, HT, 1066MHz Max Mem
* 8GB Memory (4x2GB), 1333MHz Dual Ranked RDIMMs for 1Processor, Optimized
* 2TB 7.2K RPM SATA
* OS: Centos 5.5 x86-64

Machine C (DB Host)
* System Type: Gateway E6610D
* Processor, Intel Core2 Duo - E6750 2.66 Ghz
* 4Gb Ram
* 250Gb Hard Drive 7200 rpm
* OS: Centos 5.5 x86-64

Machine D (testing server (JMeter))
* System Type: Dell Precision Workstation 390
* Ship Date: 9/7/2006
* Processor, 6300, 1.86, 2M, Core Duo-conroe, Burn 2
* 2Gb RAM
* 160 Gb Hard drive 7200 rpm
* Service Tag: 5Q5LQB1
* OS: Centos 5.5 i386

== Communication ==

Coordination/communication is primarily via the Benchmarking mailing list: http://lists.osgeo.org/mailman/listinfo/benchmarking

Weekly meetings will occur through IRC chat in the #foss4g channel on irc.freenode.net

=== Next IRC meeting ===

* Wed August 18th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=08&day=18&hour=15&min=0&sec=0 15:00:00 UTC]
** Provisional Agenda:
*** baseline test styling equivalence: are we there yet?
*** starting and stopping all servers
*** slotting times for each team to run benchmarks
*** cleaning up the rendering benchmark blank tiles
*** graphic access to the JMeter machine

=== Previous IRC meeting ===

* Wed August 11th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=08&day=11&hour=15&min=0&sec=0 15:00:00 UTC]
** Provisional Agenda:
*** Jmeter testing
**** what output formats will be requested?
**** what projections will be requested? (Platte-carré is not conformal)
**** what layer combinations will be requested? (All vector layers or various mixed subsets?)
**** what envelopes will be issued? (Frank's 2009 query generation script forces a hard cutoff at the largest scale)
**** what output metrics will be created?
**** how will the jmx file be designed? (need one .csv file per thread so all requests are different)
*** Status report from each team
*** Testing deadline: shall we extend it?
*** Can all server provide links to the sample requests and allow to build more? (style comparison, are we all doing the same work?)
*** Vector data
**** Changes in rendering (missing values for some attributes)
**** Gaps: what to do with the 9 missing sheets?
** Summary: [http://logs.qgis.org/foss4g/%23foss4g.2010-08-11.log log]

* Wed August 4th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=08&day=4&hour=15&min=0&sec=0 15:00:00 UTC]
** Provisional Agenda:
*** Machine status / issues
*** Data status / issues
**** Characters mis-encoded in shapefiles (e.g. catalan in labels): fixable? impact on PostGIS database?
**** Raster conversion to GeoTIFF (torrent of results?)
*** Styles status / issues
*** Jmeter testing
**** what output formats will be requested?
**** what projections will be requested? (Platte-carré is not conformal)
**** what layer combinations will be requested? (All vector layers or various mixed subset?)
**** what envelopes will be issued? (Frank's 2009 query generation script forces a hard cutoff at the largest scale)
**** what output metrics will be created?
**** how will the jmx file be designed? (need one .csv file per thread so all requests are different)
** Summary: [[Benchmarking 2010 IRC meeting logs Aug 4th]]

* Wed July 28th
(no info)

* Wed July 21st @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=07&day=21&hour=15&min=0&sec=0 15:00:00 UTC]
** Agenda:
*** update on data processing for all of Spain
*** update on server setup
*** update on data styling
*** checkin on server installs / library dependencies

* Wed July 14th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=07&day=14&hour=15&min=0&sec=0 15:00:00 UTC]
** Agenda:
*** update on data processing for all of Spain
*** update on server setup
*** data styling discussions
**** scales to use for layers
**** missing full road network
**** layer to use for labels along lines
** Summary: ([http://logs.qgis.org/foss4g/%23foss4g.2010-07-14.log log])
*** Attendance:
**** Jeff McKenna (jmckenna)
**** Andrea Aime (aaime)
**** Iván Sánchez (IvanSanchez)
**** Michael Smith (msmith_)
**** Dimitri Monie (dmonie)
**** Dane Springmeyer (springmeyer)
*** Discussion:
**** data:
***** full dataset of Spain, vector and raster, has been processed by IvanSanchez, and he is checking it and will create a torrent for transfer, by the end of the week
***** because of shapefile size limit some layers may have to be split (contour-1.shp, contour-2.shp)
**** servers:
***** msmith has received both server machines
***** T1 router is being installed, it will be a dedicated line for this project
***** he is adding 2 TB drives to each
**** layer styling:
***** we notice that the Spain dataset we are using (BCN25) does not include street files (zoomed in road network)
***** we agreed to use contours for curved label tests instead
***** jmckenna will test the layer scales provided by Marco (QGIS mapserver)
***** aaime pointed out problem with the posted SLDs, in terms of the label property (jmckenna to look into it)
***** aaime pointed out that we should make sure that all servers compute the scales the same way
****** OGC recommends 90 DPI (GeoServer, Mapnik use the recommended 90...MapServer defaults to 72, but should be configurable)
****** all teams should look into how their engine handles this and report to group
**** other:
***** IvanSanchez reported that a Spanish custom-made WMS server may join the exercise (they access raster files only)
***** dmonie pointed out that Erdas has been quiet lately because one of the team leaders is on holiday

* Wed June 30th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=06&day=30&hour=15&min=0&sec=0 15:00:00 UTC]
** Summary: [http://logs.qgis.org/foss4g/%23foss4g.2010-06-30.log log]

* Wed June 30th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=06&day=30&hour=15&min=0&sec=0 15:00:00 UTC]
** Summary: [http://logs.qgis.org/foss4g/%23foss4g.2010-06-30.log log]

* Wed June 23rd @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=06&day=23&hour=15&min=0&sec=0 15:00:00 UTC]
** Agenda:
*** update on proposed layer styling
*** update on available server specs
** Summary: ([http://logs.qgis.org/foss4g/%23foss4g.2010-06-23.log log])

* Wed June 16th @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=06&day=16&hour=15&min=0&sec=0 15:00:00 UTC]
** Agenda:
*** update on server infrastructure
*** update on OSGeo-es dataset ([[Benchmarking 2010/How to get some sample data|Sample data download instructions]])
** Summary: ([http://logs.qgis.org/foss4g/%23foss4g.2010-06-16.log log])
*** Attendance:
**** Jeff McKenna (jmckenna)
**** Andrea Aime (aaime)
**** Iván Sánchez (IvanSanchez)
**** Michael Smith (msmith_)
**** Cédric Briançon (cedricbr)
*** Discussion:
**** "base" run will use only shapefiles, "best" run will be any format (raster/vector)
**** teams can optionally test Oracle, PostGIS, Ingres connections during the "best" run
**** layers tested will be: labelled roads (with labels that follow the lines), thematic polygon map, and a test with labelled roads + thematic polygon + point layer in a single request (3 separate runs)
***** msmith and jmckenna to examine styling for one sheet (Barcelona, sheet# 420)
**** each base and best run will test data in raw projection (ETRS89 + UTM28/29/30/31) and then reprojected on-the-fly to the Google Mercator projection
**** threads (number of concurrent requests) will be: 1-2-4-8-16-32-64
**** US Army Corps is proposing to provide 4 desktop machines. 2 identical for testing ( win/lin ) and 1 for jmeter and 1 for databases
***** msmith will find out availability of 2-cpu machines this week

* Wed June 2nd @ [http://timeanddate.com/worldclock/fixedtime.html?year=2010&month=06&day=02&hour=15&min=0&sec=0 15:00:00 UTC]
** Agenda:
*** team representative introductions
*** Establish this year's 'Rules of Engagement' ([http://wiki.osgeo.org/wiki/Benchmarking_2009#Rules_of_Engagement previous RoE])
*** Discuss dataset to be used (including how to share the large dataset, for running local tests)
*** Discuss server infrastructure
*** Discuss possible changes to the test script parameters
*** Set next meeting date
** Summary: ([http://logs.qgis.org/foss4g/%23foss4g.2010-06-02.log log])
*** Attendance:
**** Jeff McKenna, MapServer (jmckenna)
**** Cédric Briançon - Constellation (cedricbr)
**** Michael Smith - Oracle Mapviewer and Oracle connections in MapServer (msmith_)
**** Zac Spitzer - MapGuide (zacspitzer)
**** Martin Daly - Cadcorp (mpdaly)
**** Anne-Sophie Collignon - ERDAS (ascollignon)
**** Marco Hugentobler - QGIS mapserver (marco___)
**** Andrea Aime - GeoServer (aaime)
**** Dimitri Monie - ERDAS (dmonie)
**** Frank Warmerdam - MapServer, possibly Ingres as well (FrankW)
**** Iván Sánchez - provide geodata from Spanish sources and help out Mapnik (IvanSanchez)
**** Dane Springmeyer - Mapnik (springmeyer)
**** Johann Sorel - GeotoolKit / Constellation (Eclesia)
**** Adrian Custer - Constellation (acuster)
**** Pirmin Kalberer - QGIS mapserver (pirmin_k)
**** Trevor Wekel - MapGuide (trevorw)
**** Daniel Morissette - MapServer (danmo)
*** Discussion:
**** All agreed to this year's "Rules of Engagement"
***** All parties must contribute any changes that they make to their software for this exercise, back to their community. Note that the changes don't have to be contributed before the conference, just in a reasonable period of time.
***** Comparisons will be made of the best available version of the software, be it a formal release or a development version.
***** Two tests will be run: one 'baseline' test with the data in its raw format (with spatial indexes), and another 'best effort' test where 'the sky is the limit' for what changes you want to make to the data (change format, generalize, etc)
***** Teams must document all steps they did to manipulate the data/server for both the 'baseline' and 'best effort' tests. If a team does not document the steps on this wiki then that team's test results will not be used.
***** Data formats to be used will be shapefiles for vectors, and uncompressed geotiffs for rasters.
***** WMS output formats to be used will be png8 and png24 where possible
**** Dataset
***** Iván Sánchez Ortega from OSGeo-es is willing to provide local Spain datasets
***** data is for non-commercial use only
***** 10 GB of shapefiles
***** 100 GB of uncompressed rasters
**** Server infrastructure
***** possible hosts are msmith (US Army Corps) or Skygone (http://www.skygoneinc.com/)
***** need two identical servers, one running Unix and another Windows, plus a client machine
***** specs could be: quad core, 8GB of memory, 1TB hard drive
***** need fast pipe to server, as large datasets will be transferred
**** Next meeting date
***** all agreed to use same day and time next week, but limit the meeting length to one hour

== Sample Dataset Styling ==

* download [http://download.osgeo.org/benchmarking/barcelona-sample-dataset.zip sample dataset]
* layer [http://wiki.osgeo.org/wiki/Benchmarking_2010/How_to_get_some_sample_data#Vector_data_issues styling rules]
{| border="1"
|-
| '''Mapping Server'''
| '''GetMap'''
| '''SLD'''
|-
| MapServer
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 all layers]
| --
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=settlement&SRS=EPSG:25831&BBOX=426633,4579926,429740,4582528&FORMAT=image/png&WIDTH=950&HEIGHT=600 settlement]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/settlement-sld.xml settlement-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=building&SRS=EPSG:25831&BBOX=426633,4579926,429740,4582528&FORMAT=image/png&WIDTH=950&HEIGHT=600 building]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/building-sld.xml building-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=industry&SRS=EPSG:25831&BBOX=424932,4575961,427328,4577812&FORMAT=image/png&WIDTH=950&HEIGHT=600 industry]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/industry-sld.xml industry-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=contour_lines&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 contour lines]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/contour-sld.xml contour-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=motorway&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 motorway]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/motorway-sld.xml motorway-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=road&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 road]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/road-sld.xml road-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=ramp&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 ramp]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/ramp-sld.xml ramp-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=track&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 track]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/track-sld.xml track-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=point_geometry&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 point labels with geometry]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/point-geom-sld.xml point-geom-sld.xml]
|-
|
| [http://labs.gatewaygeomatics.com/cgi-bin/benchmark2010?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=point_nogeom&SRS=EPSG:25831&BBOX=400637.456357,4576080.998882,456535.105266,4594947.942275&FORMAT=image/png&WIDTH=950&HEIGHT=600 point labels without geometry]
| [http://labs.gatewaygeomatics.com/benchmarking/sld/point-nogeom-sld.xml point-nogeom-sld.xml]
|}

== Benchmarking setup ==

Tests are going to be run using JMeter, using a progression of 1, 2, 4, 8, 16, 32, and 64 threads, each thread group doing 100, 200, 200, 400, 400, 800 requests respectively, for a total of 2200 requests.
The requests bounds and sizes are going to be picked up from a csv file generated by a random generator script.

The scripts to be run for the baseline tests, and repeated for the best effort one, are:
* raster data, JPEG output, EPSG:25831, scales between 1:1M and 1:10k
* raster data, JPEG output, EPSG:3857, scales between 1:1M and 1:10k
* vector data, PNG24 output, EPSG:4326, scales between 1:300k and 1:1k
* vector data, PNG24 output, EPSG:3875, scales between 1:300k and 1:1k
* raster + vector, JPEG output, EPSG:25831, scales between 1:300k and 1:1k
* raster + vector, JPEG output, EPSG:3785, scales between 1:300k and 1:1k

The areas to be tested are:
* 6 E, 38 N, -1 E, 43 N for vector tests
* 372360,4557880,484490,4631460 for raster tests

The raster layer in the baseline test is going to be the mosaic of GeoTIFF files Frank prepared out of the ECW files on the Linux server.

The vector data set is composed of a stack of individual layers to be stacked in the following order (bottom to top):
* settlements
* contour-0
* contour-1
* contour-2
* contour-3
* contour-4
* contour-5
* contour-6
* contour-7
* building
* industry
* track
* ramp
* road
* motorway
* point-labels-for-geometry
* point-labels-no-geometry

The best effort will use its own custom set of layers (e.g., it's likely contours will be merged into one, and so on)

== Live Benchmark WMS GetMap Requests ==

Note: sample bbox's fixed on Aug 12 to fit the proper aspect ratio of an 800/600 image request (springmeyer). Previous bbox for barcelona request was '1.8,41,2.4,42', new one used below is: '1.43333333333,41.0,2.76666666667,42.0'. Previous request for focused view was '2.1076723642349,41.407828508849,2.1178733654021,41.414271246429', new one is '2.10767236423,41.4072245022,2.1178733654,41.4148752531'. This was done to sidestep a deficiency in mapnik for affine transformation of geometries according to the WMS spec when the image w/h aspect does not match the bbox aspect, but was agreed upon as useful for these demo links by jeff and andrea in IRC.

=== MapServer ===

* Windows 64bit Server
** [http://12.189.158.75:8081/cgi-bin/mapserv.exe?MAP=C:/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600&srs=EPSG:4326&FORMAT=image/png Shapefiles, MapServer 5.7-dev] (Barcelona extents)
** [http://12.189.158.75:8081/cgi-bin/mapserv.exe?MAP=C:/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600&srs=EPSG:4326&FORMAT=image/png Shapefiles, MapServer 5.7-dev] (with labelled contours)

* Linux
** [http://12.189.158.78:8081/cgi-bin/mapserv?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600&srs=EPSG:4326&FORMAT=image/png Shapefiles, MapServer 5.7-dev] (Barcelona extents)
** [http://12.189.158.78:8081/cgi-bin/mapserv?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600&srs=EPSG:4326&FORMAT=image/png Shapefiles, MapServer 5.7-dev] (with labelled contours)
** [http://12.189.158.78:8081/cgi-bin/mapserv_label?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600&srs=EPSG:4326&FORMAT=image/png Shapefiles, MapServer 5.7-dev-label-fix] (with labelled contours)
** [http://12.189.158.78:8081/cgi-bin/mapserv_label?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600&srs=EPSG:4326&FORMAT=image/png Shapefiles, MapServer 5.7-dev-label-fix] (labelled contours, larger view)

=== GeoServer ===

* [http://12.189.158.78:8080/geoserver/wms?SRS=EPSG%3A4326&LAYERS=shp_alllayers_label&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600 Shapefiles GeoServer 2.1.x] (Barcelona extents)
*[http://12.189.158.78:8080/geoserver/wms?SRS=EPSG%3A4326&LAYERS=shp_alllayers_label&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600 Shapefiles GeoServer 2.1.x] (with labelled contours)
* [http://12.189.158.78:8080/geoserver/wms?EXCEPTIONS=application%2Fvnd.ogc.se_inimage&LAYERS=shp_alllayers_label&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326&BBOX=2.10767236423,41.4072245022,2.1178733654,41.41487525316&WIDTH=800&HEIGHT=600 Shapefiles GeoServer 2.1.x] (labelled contours, larger view)
* [http://12.189.158.78:8080/geoserver/wms?LAYERS=ras%3Amosaic_tif&STYLES=&FORMAT=image%2Fjpeg&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A25831&BBOX=449647.84729003,4594968.4096903,450085.85510253,4595260.9852213&WIDTH=512&HEIGHT=342 TIFF mosaic, zoomed in, GeoServer 2.1.x]
* [http://12.189.158.78:8080/geoserver/wms?LAYERS=ras%3Amosaic_tif&STYLES=&FORMAT=image%2Fjpeg&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A25831&BBOX=441127.2265625,4590970.3051752,455143.4765625,4600332.7221674&WIDTH=512&HEIGHT=342 TIFF mosaic, mid zoom, GeoServer 2.1.x]
* [http://12.189.158.78:8080/geoserver/wms?LAYERS=ras%3Amosaic_tif&STYLES=&FORMAT=image%2Fjpeg&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A25831&BBOX=316295,4519985.6640625,540555,4669784.3359375&WIDTH=512&HEIGHT=342 TIFF mosaic, whole area, GeoServer 2.1.x]

=== Mapnik ===
* [http://12.189.158.78:8090/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600 Shapefiles Mapnik2 / paleoserver] (Barcelona extents)
* [http://12.189.158.78:8091/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600 Shapefiles Mapnik0.7.2 / mod_mapnik_wms] (Barcelona extents)
* [http://12.189.158.78:8090/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600 Shapefiles Mapnik2 / paleoserver] (larger view - labeled contours)

=== Constellation ===
* [http://12.189.158.78:8280/constellation/WS/wms?SRS=EPSG%3A4326&LAYERS=shp:settlement,shp:contour-0,shp:contour-1,shp:contour-2,shp:contour-3,shp:contour-4,shp:contour-5,shp:contour-6,shp:contour-7,shp:building,shp:industry,shp:track,shp:ramp,shp:road,shp:motorway,shp:point-labels-for-geometry,shp:point-labels-no-geometry&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600 Shapefiles Constellation] (Barcelona extents)
* [http://12.189.158.78:8280/constellation/WS/wms?LAYERS=shp:settlement,shp:contour-0,shp:contour-1,shp:contour-2,shp:contour-3,shp:contour-4,shp:contour-5,shp:contour-6,shp:contour-7,shp:building,shp:industry,shp:track,shp:ramp,shp:road,shp:motorway,shp:point-labels-for-geometry,shp:point-labels-no-geometry&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326&BBOX=2.10767236423,41.4072245022,2.1178733654,41.41487525316&WIDTH=800&HEIGHT=600 Shapefiles Constellation] (labelled contours, larger view)

=== Oracle MapViewer ===
*[http://12.189.158.78:8088/mapviewer/wms?REQUEST=GetMap&BASEMAP=spain_oracle&LAYERS=&SERVICE=WMS&VERSION=1.1.1&STYLES=&BBOX=1.43333333333,41.0,2.76666666667,42.0&width=800&height=600&srs=EPSG:4326&FORMAT=image/png&aa=TRUE Oracle DB / MapViewer] (Barcelona Extents)

*[http://12.189.158.78:8088/mapviewer/wms?REQUEST=GetMap&BASEMAP=spain_oracle&LAYERS=&SERVICE=WMS&VERSION=1.1.1&STYLES=&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600&srs=EPSG:4326&FORMAT=image/png&aa=TRUE Oracle DB / MapViewer] (with labeled contours)

=== Cadcorp GeognoSIS ===
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-shp&BGCOLOR=0xFFFFFF&BBOX=1.43333333333,41.0,2.76666666667,42.0&width=800&height=600 Shapefiles, GeognoSIS 7.0] (Barcelona Extents)
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-shp&BGCOLOR=0xFFFFFF&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600 Shapefiles, GeognoSIS 7.0] (with labelled contours - see note)
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-postgis&BGCOLOR=0xFFFFFF&BBOX=1.43333333333,41.0,2.76666666667,42.0&width=800&height=600 PostGIS, GeognoSIS 7.0] (Barcelona Extents)
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-postgis&BGCOLOR=0xFFFFFF&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600 PostGIS, GeognoSIS 7.0] (with labelled contours - see note)
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-oracle&BGCOLOR=0xFFFFFF&BBOX=1.43333333333,41.0,2.76666666667,42.0&width=800&height=600 Oracle, GeognoSIS 7.0] (Barcelona Extents)
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-oracle&BGCOLOR=0xFFFFFF&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600 Oracle, GeognoSIS 7.0] ('''no contours''' - under investigation)
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=bcn-tif&BGCOLOR=0xFFFFFF&SRS=EPSG%3A25831&BBOX=449647.84729003,4594968.4096903,450085.85510253,4595260.9852213&WIDTH=512&HEIGHT=342 TIFF mosaic, zoomed in, GeognoSIS 7.0]
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=bcn-tif&BGCOLOR=0xFFFFFF&SRS=EPSG%3A25831&BBOX=441127.2265625,4590970.3051752,455143.4765625,4600332.7221674&WIDTH=512&HEIGHT=342 TIFF mosaic, mid zoom, GeognoSIS 7.0]
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=bcn-tif&BGCOLOR=0xFFFFFF&SRS=EPSG%3A25831&BBOX=316295,4519985.6640625,540555,4669784.3359375&WIDTH=512&HEIGHT=342 TIFF mosaic, whole area, GeognoSIS 7.0]
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=bcn-ecw&BGCOLOR=0xFFFFFF&SRS=EPSG%3A25831&BBOX=449647.84729003,4594968.4096903,450085.85510253,4595260.9852213&WIDTH=512&HEIGHT=342 ECW, zoomed in, GeognoSIS 7.0]
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=bcn-ecw&BGCOLOR=0xFFFFFF&SRS=EPSG%3A25831&BBOX=441127.2265625,4590970.3051752,455143.4765625,4600332.7221674&WIDTH=512&HEIGHT=342 ECW, mid zoom, GeognoSIS 7.0]
* [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=bcn-ecw&BGCOLOR=0xFFFFFF&SRS=EPSG%3A25831&BBOX=316295,4519985.6640625,540555,4669784.3359375&WIDTH=512&HEIGHT=342 ECW, whole area, GeognoSIS 7.0]

'''N.B.''' The current GeognoSIS Label Theme "label along lines" option does not work well with this data. We hope to have an alternative option ready in time for the tests

=== QGIS mapserver ===
* [http://12.189.158.78:8081/fcgi-bin/qgis_mapserv.fcgi?MAP=/opt/qgisms/fcgi-bin/vector.qgs&SRS=EPSG:4326&LAYERS=shp_vector&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=1.43333333333,41.0,2.76666666667,42.0&WIDTH=800&HEIGHT=600 QGIS mapserver shapefile] (Barcelona Extents)
* [http://12.189.158.78:8081/fcgi-bin/qgis_mapserv.fcgi?MAP=/opt/qgisms/fcgi-bin/vector.qgs&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=shp_vector&STYLES=&BBOX=2.10767236423,41.4072245022,2.1178733654,41.4148752531&width=800&height=600&srs=EPSG:4326&FORMAT=image/png QGIS mapserver shapefile] (with labeled contours)

=== Scale dependent rules checking requests ===

These requests show the behavior of scale dependent styling around the critical scales.
The geographic area requested is always the same:

<tt>BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102</tt>

The image size changes instead to alter the scale:

* roughly 1:29k: <tt>WIDTH=824&HEIGHT=472</tt>
* roughly 1:31k: <tt>WIDTH=771&HEIGHT=442</tt>
* roughly 1:49k: <tt>WIDTH=488&HEIGHT=280</tt>
* roughly 1.51k: <tt>WIDTH=469&HEIGHT=269</tt>

The table allows to compare the various servers output. The GeoServer links use a vendor option to get the actual scale, as computed by the server, displayed at the bottom/right of the map.

{| border="1"
|-
| '''Server'''
| '''1:29k'''
| '''1:31k'''
| '''1:49k'''
| '''1:51k'''
|-
| Constellation
| [http://12.189.158.78:8280/constellation/WS/wms?LAYERS=shp:settlement,shp:contour-0,shp:contour-1,shp:contour-2,shp:contour-3,shp:contour-4,shp:contour-5,shp:contour-6,shp:contour-7,shp:building,shp:industry,shp:track,shp:ramp,shp:road,shp:motorway,shp:point-labels-for-geometry,shp:point-labels-no-geometry&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472 1:29k]
| [http://12.189.158.78:8280/constellation/WS/wms?LAYERS=shp:settlement,shp:contour-0,shp:contour-1,shp:contour-2,shp:contour-3,shp:contour-4,shp:contour-5,shp:contour-6,shp:contour-7,shp:building,shp:industry,shp:track,shp:ramp,shp:road,shp:motorway,shp:point-labels-for-geometry,shp:point-labels-no-geometry&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442 1:31k]
| [http://12.189.158.78:8280/constellation/WS/wms?LAYERS=shp:settlement,shp:contour-0,shp:contour-1,shp:contour-2,shp:contour-3,shp:contour-4,shp:contour-5,shp:contour-6,shp:contour-7,shp:building,shp:industry,shp:track,shp:ramp,shp:road,shp:motorway,shp:point-labels-for-geometry,shp:point-labels-no-geometry&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280 1:49k]
| [http://12.189.158.78:8280/constellation/WS/wms?LAYERS=shp:settlement,shp:contour-0,shp:contour-1,shp:contour-2,shp:contour-3,shp:contour-4,shp:contour-5,shp:contour-6,shp:contour-7,shp:building,shp:industry,shp:track,shp:ramp,shp:road,shp:motorway,shp:point-labels-for-geometry,shp:point-labels-no-geometry&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269 1:51k]
|-
| GeoServer
| [http://12.189.158.78:8080/geoserver/wms?LAYERS=shp_alllayers_label&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472&format_options=layout:scale 1:29k]
| [http://12.189.158.78:8080/geoserver/wms?LAYERS=shp_alllayers_label&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442&format_options=layout:scale 1:31k]
| [http://12.189.158.78:8080/geoserver/wms?LAYERS=shp_alllayers_label&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280&format_options=layout:scale 1:49k]
| [http://12.189.158.78:8080/geoserver/wms?LAYERS=shp_alllayers_label&STYLES=&FORMAT=image%2Fpng&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269&format_options=layout:scale 1:51k]
|-
| Mapnik
| [http://12.189.158.78:8090/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472 1:29k]
| [http://12.189.158.78:8090/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442 1:31k]
| [http://12.189.158.78:8090/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280 1:49k]
| [http://12.189.158.78:8090/?SRS=EPSG%3A4326&LAYERS=__all__&STYLES=&FORMAT=image/png&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269 1:51k]
|-
| MapServer
| [http://12.189.158.78:8081/cgi-bin/mapserv_label?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472 1:29k]
| [http://12.189.158.78:8081/cgi-bin/mapserv_label?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442 1:31k]
| [http://12.189.158.78:8081/cgi-bin/mapserv_label?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280 1:49k]
| [http://12.189.158.78:8081/cgi-bin/mapserv_label?MAP=/benchmarking/mapserver/spain-shapefiles.map&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=vector_benchmarking_2010&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269 1:51k]
|-
| MapViewer
| [http://12.189.158.78:8088/mapviewer/wms?REQUEST=GetMap&BASEMAP=spain_oracle&LAYERS=&SERVICE=WMS&VERSION=1.1.1&STYLES=&srs=EPSG:4326&FORMAT=image/png&aa=TRUE&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472 1:29k]
| [http://12.189.158.78:8088/mapviewer/wms?REQUEST=GetMap&BASEMAP=spain_oracle&LAYERS=&SERVICE=WMS&VERSION=1.1.1&STYLES=&srs=EPSG:4326&FORMAT=image/png&aa=TRUE&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442 1:31k]
| [http://12.189.158.78:8088/mapviewer/wms?REQUEST=GetMap&BASEMAP=spain_oracle&LAYERS=&SERVICE=WMS&VERSION=1.1.1&STYLES=&srs=EPSG:4326&FORMAT=image/png&aa=TRUE&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280 1:49k]
| [http://12.189.158.78:8088/mapviewer/wms?REQUEST=GetMap&BASEMAP=spain_oracle&LAYERS=&SERVICE=WMS&VERSION=1.1.1&STYLES=&srs=EPSG:4326&FORMAT=image/png&aa=TRUE&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269 1:51k]
|-
|-
| GeognoSIS
| [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-shp&BGCOLOR=0xFFFFFF&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472 1:29k]
| [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-shp&BGCOLOR=0xFFFFFF&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442 1:31k]
| [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-shp&BGCOLOR=0xFFFFFF&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280 1:49k]
| [http://12.189.158.75/cadcorp/geognosis-70.exe?VERSION=1.1.1&SERVICE=WMS&REQUEST=GetMap&STYLES=&FORMAT=image%2fpng%3bPhotometricInterpretation=RGB&SRS=EPSG:4326&LAYERS=spain-shp&BGCOLOR=0xFFFFFF&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269 1:51k]
|-
|-
| QGIS mapserver
| [http://12.189.158.78:8081/fcgi-bin/qgis_mapserv.fcgi?MAP=/opt/qgisms/fcgi-bin/vector.qgs&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=shp_vector&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=824&HEIGHT=472 1:29k]
| [http://12.189.158.78:8081/fcgi-bin/qgis_mapserv.fcgi?MAP=/opt/qgisms/fcgi-bin/vector.qgs&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=shp_vector&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=771&HEIGHT=442 1:31k]
| [http://12.189.158.78:8081/fcgi-bin/qgis_mapserv.fcgi?MAP=/opt/qgisms/fcgi-bin/vector.qgs&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=shp_vector&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=488&HEIGHT=280 1:49k]
| [http://12.189.158.78:8081/fcgi-bin/qgis_mapserv.fcgi?MAP=/opt/qgisms/fcgi-bin/vector.qgs&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&LAYERS=shp_vector&STYLES=&srs=EPSG:4326&FORMAT=image/png&BBOX=0.58671954345704,40.73922127533,0.64684991455078,40.773670967102&WIDTH=469&HEIGHT=269 1:51k]
|}

== External Related Links ==

*[[FOSS4G Benchmark|FOSS4G WMS Benchmark]]
*[http://sourceforge.net/projects/wmstester/ WMSTester - tool for testing not from OSGeo]

----

[[Category:FOSS4G2010]] [[Category:FOSS4G]]

Benchmarking 2010/Mapnik notes

2010-08-12T17:23:26Z

Wiki-Springmeyer:

= Mapnik Processing Notes =

''(for the [[Benchmarking_2010]] exercise)''

== Installation ==

Exact Installation details can be seen at: http://svn.osgeo.org/osgeo/foss4g/benchmarking/mapnik/scripts/install_mapnik_rhel_5.5.sh

Library versions used:

* libxml2-2.7.7
* zlib-1.2.5
* libpng-1.4.3
* freetype-2.4.1
* proj-4.7.0
* icu4c-4_4_1
* boost_1_43_0
* httpd-2.2.16 (only used for mod_mapnik_wms)
* gdal-1.7.2 (used only for raster plugin)
* postgis from RHEL packages - 8.1 headers
* libjpeg from RHEL packages - old

Mapnik versions used:

* 0.7.2 pre-release - http://trac.mapnik.org/milestone/0.7.2
* Trunk (aka Mapnik2)

WMS Servers being tested:

* mod_mapnik_wms - trunk - http://wiki.openstreetmap.org/wiki/Mod_mapnik_wms
* paleoserver - trunk - http://github.com/springmeyer/paleoserver

== shpindex depth ==

As Mapnik's shapeindex utility does not have optimized defaults, I matched the Mapserver depths used exactly ([[shptree notes]]):

::
shapeindex -d 21 building.shp
shapeindex -d 16 contour-0.shp
shapeindex -d 17 contour-1.shp
shapeindex -d 17 contour-2.shp
shapeindex -d 17 contour-3.shp
shapeindex -d 17 contour-4.shp
shapeindex -d 15 contour-5.shp
shapeindex -d 17 contour-6.shp
shapeindex -d 17 contour-7.shp
shapeindex -d 17 industry.shp
shapeindex -d 10 motorway.shp
shapeindex -d 15 point-labels-for-geometry.shp
shapeindex -d 18 point-labels-no-geometry.shp
shapeindex -d 14 ramp.shp
shapeindex -d 14 road.shp
shapeindex -d 16 settlement.shp
shapeindex -d 16 track.shp

[[Category:FOSS4G2010]] [[Category:FOSS4G]]

Benchmarking 2010/Mapnik notes

2010-08-12T17:23:08Z

Benchmarking 2010

2010-08-11T16:33:24Z

Wiki-Springmeyer: /* Documenting Server Details and Differences */

Benchmarking 2010

2010-08-11T16:32:52Z

Wiki-Springmeyer: /* Documenting Server Details and Differences */

Benchmarking 2010/Mapnik notes

2010-08-11T16:30:12Z

Wiki-Springmeyer:

= Mapnik Processing Notes =

''(for the [[Benchmarking_2010]] exercise)''

== installation ==

Installation details can be seen at: http://svn.osgeo.org/osgeo/foss4g/benchmarking/mapnik/scripts/install_mapnik_rhel_5.5.sh

== shpindex depth ==

As Mapnik's shapeindex utility does not have optimized defaults, I matched the Mapserver depths used exactly:

::
shapeindex -d 21 building.shp
shapeindex -d 16 contour-0.shp
shapeindex -d 17 contour-1.shp
shapeindex -d 17 contour-2.shp
shapeindex -d 17 contour-3.shp
shapeindex -d 17 contour-4.shp
shapeindex -d 15 contour-5.shp
shapeindex -d 17 contour-6.shp
shapeindex -d 17 contour-7.shp
shapeindex -d 17 industry.shp
shapeindex -d 10 motorway.shp
shapeindex -d 15 point-labels-for-geometry.shp
shapeindex -d 18 point-labels-no-geometry.shp
shapeindex -d 14 ramp.shp
shapeindex -d 14 road.shp
shapeindex -d 16 settlement.shp
shapeindex -d 16 track.shp

[[Category:FOSS4G2010]] [[Category:FOSS4G]]

Benchmarking 2010/Mapnik notes

2010-08-11T16:28:23Z

Wiki-Springmeyer: Created page with '= Mapnik Processing Notes = ''(for the Benchmarking_2010 exercise)'' == shpindex depth == As Mapnik's shapeindex utility does not have optimized defaults, I matched the Ma…'

= Mapnik Processing Notes =

''(for the [[Benchmarking_2010]] exercise)''

== shpindex depth ==

As Mapnik's shapeindex utility does not have optimized defaults, I matched the Mapserver depths used exactly:

::
shapeindex -d 21 building.shp
shapeindex -d 16 contour-0.shp
shapeindex -d 17 contour-1.shp
shapeindex -d 17 contour-2.shp
shapeindex -d 17 contour-3.shp
shapeindex -d 17 contour-4.shp
shapeindex -d 15 contour-5.shp
shapeindex -d 17 contour-6.shp
shapeindex -d 17 contour-7.shp
shapeindex -d 17 industry.shp
shapeindex -d 10 motorway.shp
shapeindex -d 15 point-labels-for-geometry.shp
shapeindex -d 18 point-labels-no-geometry.shp
shapeindex -d 14 ramp.shp
shapeindex -d 14 road.shp
shapeindex -d 16 settlement.shp
shapeindex -d 16 track.shp

[[Category:FOSS4G2010]] [[Category:FOSS4G]]

Benchmarking 2010

2010-08-11T15:02:36Z

Wiki-Springmeyer:

Benchmarking 2010

2010-07-29T16:26:07Z

Wiki-Springmeyer: /* Participants */