Database Output Storage for PyWPS - Revision history

Wiki-Janpisl at 17:33, 13 August 2018

2018-08-13T17:33:25Z

Wiki-Janpisl at 15:57, 29 July 2018

2018-07-29T15:57:06Z

Wiki-Janpisl at 19:35, 24 July 2018

2018-07-24T19:35:00Z

Wiki-Janpisl at 07:07, 23 July 2018

2018-07-23T07:07:45Z

Wiki-Janpisl at 20:23, 15 July 2018

2018-07-15T20:23:06Z

Wiki-Janpisl at 15:05, 8 July 2018

2018-07-08T15:05:20Z

Wiki-Janpisl at 14:50, 24 June 2018

2018-06-24T14:50:39Z

Wiki-Janpisl at 17:39, 17 June 2018

2018-06-17T17:39:40Z

Wiki-Janpisl: /* Week 4 report */

2018-06-10T17:24:35Z

Week 4 report

Wiki-Janpisl at 17:12, 10 June 2018

2018-06-10T17:12:17Z

@@ Line 598: / Line 598: @@
 '''
-- I might not have access to stable internet connection in the next week so I might . I have informed my mentor about this
+- I might not have access to stable internet connection in the next week. I have informed my mentor about this.
 - My code will now go through testing and review from the PyWPS community so once these tests are done I will know what do I have to improve before I can make a pull request.

← Older revision		Revision as of 15:57, 29 July 2018
Line 575:		Line 575:

	[4] https://github.com/janpisl/pywps/commit/15e2fc9f250cdf24bc490e6c6d8e6f8cc39d98ff		[4] https://github.com/janpisl/pywps/commit/15e2fc9f250cdf24bc490e6c6d8e6f8cc39d98ff
		+
		+
		+
		+	===Week 11===
		+
		+
		+	'''What did you get done this period?
		+	'''
		+
		+
		+	- I resolved an error caused by test configuration being set only after initialization of the PgStorage class. [1]
		+
		+	- I squashed all commits into one [2]
		+
		+	- I created another branch (called database) where all the code for storing output to database is stored [3]
		+
		+	- Some other minor changes and updates to the code and fixing bugs [4]
		+
		+
		+
		+	'''What do you plan on doing next week (period) ?
		+	'''
		+
		+	- I might not have access to stable internet connection in the next week so I might . I have informed my mentor about this
		+
		+	- My code will now go through testing and review from the PyWPS community so once these tests are done I will know what do I have to improve before I can make a pull request.
		+
		+
		+
		+	'''Are you blocked on anything?
		+	'''
		+
		+	No.
		+
		+
		+
		+
		+	[1] https://github.com/janpisl/pywps/commit/eb4bcb6f5695564adb1a2e09ae2614816ec11a26
		+
		+	[2] https://github.com/janpisl/pywps/commit/07327e0280d817db640064792fe349f24e296823
		+
		+	[3] https://github.com/janpisl/pywps/tree/database/pywps/inout
		+
		+	[4] https://github.com/janpisl/pywps/commits/master
		+


	[[Category: Google Summer of Code]]		[[Category: Google Summer of Code]]

← Older revision		Revision as of 19:35, 24 July 2018
Line 531:		Line 531:


		+	===Week 10 ===

		+
		+	'''What did you get done this period?
		+	'''
		+
		+
		+	- First draft of a script for generating MapFiles automatically with arguments retrieved from PostGIS. [1].
		+
		+	- Template MapFile. Individual MapFiles are generated based on this template. [2]
		+
		+	- MapFile for raster data in PostGIS (raster layer) [3]
		+
		+	- Implement generating MapFilese into tests (for vector data in PostGIS) [4]
		+
		+
		+
		+	'''What do you plan on doing next week (period) ?
		+	'''
		+
		+
		+	- Finish automatization of generating MapFiles for testing
		+
		+	- Implement WMS for raster output data
		+
		+
		+
		+	'''Are you blocked on anything?
		+	'''
		+
		+	No.
		+
		+
		+
		+
		+
		+
		+	[1] https://github.com/janpisl/pywps/commit/fda5a9613d39c5fd3079c8ae6d0e9ec3403d9877
		+
		+	[2] https://github.com/janpisl/pywps/commit/04f2ef89b516bd00845bc27818613f939fa8ec54
		+
		+	[3] https://github.com/janpisl/pywps/commit/03167218ab0dd8f8946c33ddc77446967e3a58c8
		+
		+	[4] https://github.com/janpisl/pywps/commit/15e2fc9f250cdf24bc490e6c6d8e6f8cc39d98ff


	[[Category: Google Summer of Code]]		[[Category: Google Summer of Code]]

← Older revision		Revision as of 07:07, 23 July 2018
Line 441:		Line 441:


−	===Week 8 ~~reportú~~===	+	===Week 8===


Line 493:		Line 493:


−	===Week 9 ~~report~~===	+	===Week 9===

← Older revision		Revision as of 20:23, 15 July 2018
Line 490:		Line 490:

	[5] https://github.com/janpisl/pywps/commits/master		[5] https://github.com/janpisl/pywps/commits/master
		+
		+
		+
		+	===Week 9 report===
		+
		+
		+	'''What did you get done this period?
		+	'''
		+
		+
		+	- Together with my mentor we decided not to implement a functionality for handling metadata at this time.
		+
		+	- I established a connection between PostgreSQL and SQLite and Mapserver [1]. This allows sample output data to be served as a WMS service and viewed in e.g. QGIS.
		+
		+	- I created sample requests for both PostgreSQL and SQLite [2]
		+
		+
		+
		+	'''What do you plan on doing next week (period) ?
		+	'''
		+
		+	- Edit current code and automatize connection with MapServer so any output data can be viewed as a WMS service.
		+
		+
		+
		+	'''Are you blocked on anything?
		+	'''
		+
		+	No.
		+
		+
		+
		+
		+
		+
		+	[1] https://github.com/janpisl/pywps/commit/d88106eecfa08c30b945a6105f2eeaf978bfda8a
		+
		+	[2] https://github.com/janpisl/pywps/commit/b50360d42f48ac8c99df1af005cbdf3951692465
		+
		+
		+



	[[Category: Google Summer of Code]]		[[Category: Google Summer of Code]]

← Older revision		Revision as of 15:05, 8 July 2018
Line 438:		Line 438:
	[9] https://github.com/janpisl/pywps/commits/master		[9] https://github.com/janpisl/pywps/commits/master

		+
		+
		+
		+	===Week 8 reportú===
		+
		+
		+	'''What did you get done this period?
		+	'''
		+
		+
		+	- PgStorage and SQLiteStorage classes inherit from DbStorage [1]
		+
		+	- The "store" method is now implemented in the parent class DbStorage
		+
		+	- Method for storing vector outputs is now implemented in the parent class DbStorage [2]
		+
		+	- Method for storing outputs such as CSV, plain text, etc. is now implemented in the parent class DbStorage [3]
		+
		+	- Each class inheriting from DbStorage now implements a method for initializating database (create schema, etc.) [4]
		+
		+	- Fixing bugs and some other minor changes and updates to the code [5]
		+
		+
		+
		+	'''What do you plan on doing next week (period) ?
		+	'''
		+
		+
		+	- Download, compile and run MapServer
		+
		+	- Establish a connection between MapServer and PostgreSQL
		+
		+
		+
		+	'''Are you blocked on anything?
		+	'''
		+
		+	No.
		+
		+
		+
		+
		+
		+	[1] https://github.com/janpisl/pywps/commit/889ce577747815554970c3c39cebed15fe1d1ca6
		+
		+	[2] https://github.com/janpisl/pywps/commit/68d193aed029e4c6c4d6e8ec73ac44de8c183b71
		+
		+	[3] https://github.com/janpisl/pywps/commit/341f8a8eb8d99663e15796e373c5bf78fc9364a6
		+
		+	[4] https://github.com/janpisl/pywps/commit/321d6d8d6caf28131062134a5188eaa61c3e4b38
		+
		+	[5] https://github.com/janpisl/pywps/commits/master



	[[Category: Google Summer of Code]]		[[Category: Google Summer of Code]]

← Older revision		Revision as of 14:50, 24 June 2018
Line 383:		Line 383:
	[3] https://github.com/janpisl/pywps/commit/50cd11ffa2486ee3de7cac3340874179d81d4e2e		[3] https://github.com/janpisl/pywps/commit/50cd11ffa2486ee3de7cac3340874179d81d4e2e

		+
		+
		+
		+	===Week 6 ===
		+
		+
		+	'''What did you get done this period?
		+	'''
		+
		+	- Database schema gets created automatically when the DbStorage class is initialized. [1]
		+
		+	- I developed "test_storage" module for testing storing output data [2]
		+
		+	- I implemented unittest classes for testing file storage [3], PostgreSQL storage [4] [5] [6] and SQLite [7] [8]
		+
		+	- Some other minor changes and updates to the code and fixing bugs [9]
		+
		+
		+
		+
		+
		+	'''What do you plan on doing next week (period) ?
		+	'''
		+
		+	- Address issues revealed by testing
		+
		+	- Handle metadata
		+
		+
		+
		+	'''Are you blocked on anything?
		+	'''
		+
		+	No.
		+
		+
		+
		+	[1] https://github.com/janpisl/pywps/commit/524d65f2cb5cdfe5f0bbdf769a9850c32886952e
		+
		+	[2] https://github.com/janpisl/pywps/commit/1c36dd1ee3b1c61d819b92f5a195792f488b1193
		+
		+	[3] https://github.com/janpisl/pywps/commit/2896d7670ed2f38470eab54790ed2e822c42583d
		+
		+	[4] https://github.com/janpisl/pywps/commit/97c8255a9ea3ad52a022d84315eb4e725afe4fc6
		+
		+	[5] https://github.com/janpisl/pywps/commit/16afbea95f1fea31dd3ac9e7a30d63b5d309ad12
		+
		+	[6] https://github.com/janpisl/pywps/commit/b08dee2644888379d08c25919d112b0e29f2423d
		+
		+	[7] https://github.com/janpisl/pywps/commit/c406e21d8ee844e468fe672d236285664a8fde76
		+
		+	[8] https://github.com/janpisl/pywps/commit/a1493e70024d06b3d29d1522edca64af4574de0b
		+
		+	[9] https://github.com/janpisl/pywps/commits/master

← Older revision	Revision as of 17:39, 17 June 2018
Line 341:	Line 341:


	+
	+
	+	===Week 5===
	+
	+
	+
	+	'''What did you get done this period?
	+	'''
	+
	+
	+	- I updated the store_vector_output method in the SQLite class [1]
	+
	+	- I implemented a method for storing raster outputs in SQLite [2]
	+
	+	- I implemented a method for storing output data of other datatypes in PostgreSQL [3]
	+
	+
	+
	+
	+
	+	'''What do you plan on doing next week (period) ?
	+	'''
	+
	+	- Write test_storage, a unit test that would test all storage options and their correct functionality
	+
	+	- Handle metadata
	+
	+
	+
	+	'''Are you blocked on anything?
	+	'''
	+
	+	No.
	+
	+
	+
	+	[1] https://github.com/janpisl/pywps/commit/44e9130c8bbb73841c51a09266a9db62ff2809f9
	+
	+	[2] https://github.com/janpisl/pywps/commit/5bf8eb883343f0caacd47470bf79152ac751d480
	+
	+	[3] https://github.com/janpisl/pywps/commit/50cd11ffa2486ee3de7cac3340874179d81d4e2e

← Older revision		Revision as of 17:24, 10 June 2018
Line 294:		Line 294:


−	===Week 4 ~~report~~ ===	+	===Week 4 ===

	'''What did you get done this period?		'''What did you get done this period?

← Older revision		Revision as of 17:12, 10 June 2018
Line 290:		Line 290:

	[4] https://github.com/janpisl/pywps/commit/7f00fa06ac5fd7823d79a363f6163dcc38e7bbb0		[4] https://github.com/janpisl/pywps/commit/7f00fa06ac5fd7823d79a363f6163dcc38e7bbb0
		+
		+
		+
		+
		+	===Week 4 report ===
		+
		+	'''What did you get done this period?
		+	'''
		+
		+	-I changed the structure of the code. Classes PgStorage and SQLiteStorage are now stored in separate files in the db folder. FileStorage is in a separate file, too. Rest of the code is in the __init__ files. [1]
		+
		+	- I added the data_type attribute to inout/formats/__init__.py. At the moment, allowed values are either vector or raster using the enum module. This was done so when storing output data it can be differed between raster and vector data and appropriate method can be used. [2]
		+
		+	- The Dbstorage class has been simplified. Instead of creating an instance of the class in outputs.py and calling the get_db_type method in the constructor, get_db_type is now a static method and gets called directly in outputs.py [3]
		+
		+	- PgStorage accesses the data_type value and calls appropriate method (store_vector_output or store_raster_output) [4]
		+
		+	- I implemented the store_raster_output method in the PgStorage class [5]
		+
		+
		+
		+	'''What do you plan on doing next week (period) ?
		+	'''
		+
		+	- Implement store_raster_output for SQLiteStorage
		+
		+	- Implement another method for storing other types of data (string, CSV, etc.)
		+
		+	- Write a script that tests whether different data types get stored correctly
		+
		+	- Submit the Phase 1 evaluation.
		+
		+
		+
		+	'''Are you blocked on anything?
		+	'''
		+
		+	No.
		+
		+
		+
		+	[1] https://github.com/janpisl/pywps/commit/18c46864ff75fb01e3c7d76f3f4a1b6d2457a22f[[2] https://github.com/janpisl/pywps/commit/4bb079bfcde0b4fcc42393f531e86c47a91507d4
		+
		+	[3] https://github.com/janpisl/pywps/commit/80c61c92e183c06af741fe94d0b172f9a5940609
		+
		+	[4] https://github.com/janpisl/pywps/commit/e024b1e5d1eb8df1a79989a59b14276b2757d98d
		+
		+	[5] https://github.com/janpisl/pywps/commit/a09dfc61729b36eb81ddd0d9adb5bda2effe3029
		+
		+
		+
		+
		+
		+


	[[Category: Google Summer of Code]]		[[Category: Google Summer of Code]]