Spatial Data Managers Meeting, April 24, 2014
Willamette R. Fish DB and Query Tools for ODF/NACSE
Matt Viehdorfer, graduate student in Computer Science/Graphics/also at COF help desk
Ongoing fish samples are collected along the Willamette River (Stan Gregory/FW Department and ODFW). Started with many Excel datasets, all with different fields, inconsistent. 56,000 samples as of 2012, awaiting 2013 data.
Includes 67 designations of fish.
Data needed to be normalized and cleaned up. Used PostGRES and PostGIS for spatial data. Defined a controlled vocabulary. An Excel unload template was created for easily importing future data.
Missing locations but data includes WR ‘Slice’ location so use slice centroids to assign a location to the missing sites.
Missing air temperatures from “FetchClimate” a Microsoft service.
Used “F#’ for Scripting. What is F#? -- A Microsoft scripting language similar to Python, used in Visual Studio. “WorldWide Telescope” to make video
Uses JSON/AJAX , lots of indexing (B-tree & GIST) to increase performance.
SchemaSpy makes a graphic of the schema, really just one big table
Approach allowed a variety of other query tools to be quickly added to interface.
“Bootstrap” used to generate mobile device interfaces.
Uses an algorithm with Euclidean distance to parse locations for symbolization.
Does interactive graphical, river mile, or slice queries and generates pie charts.
Uses Google maps, usage # is currently under the limit for pay. Graphics are generated from jquery and javascript(not using a toolkit like Dojo).
Other javascript libraries used are “BootStrap” “Moustache.js” “Spin.JS” a Memory cursor in PHP.
Attendees: TJV, Matt, Keith, Kuuipo, Patti, Terralyn, Dave H-W
Moderator: Keith
Software/hardware: Matt – Would like to have “deskpot”? Switches desktops like in UNIX? Not at COF
ArcServer – Terralyn still has 9.3 and 10 running. Terralyn says that in Feb fee structure will be changed, user fees/disk storage not changing, backup costs dropping. Cost of media has drastically dropped as well. Still doing tapes for at least another year, hardware is still good. The COF IT staff are investigating bu to raid disk in the future but costs are a concern and equipment still works fine….
Patti – BCAL software for lidar
Also from Terralyn, about 250 gb of old data on an ancient UNIX server that isn’t being cared for, various people are long gone but the data is still there. Who can take a look at it? Lefsky, Barbara Marks, lots of people long gone have data still there
Data: Nothing to report
Meetings: No one going to ESRI, Matt going to FOSS4G, Patti went to BLM lidar meeting,
IALE, ForestSat both no one attending
Mid Willamette GIS meeting in Albany
Training: Introduction to Web remote sensing webinar by NASA, 5 sessions, this was also was on GISInfo list
Round Table
Matt G. – GNN data released for 2012. OR/WA, N. CA. 1984-2012 is available if interested. Matt working ½ for Warren’s Lab. He will be building an Ensemble Model for Disturbance History. Using a bunch of models to put onto Google Earth Engine to generate the output on the fly. David Bell – new Janet guy, arrives in Mid May. May or may not engage with the existing team.
LandTrenr data will be released as part of CMonster at some point.
Matt V. – helped advisor to get two Zenon massive 61 core machines that might be available for large processing, 32 GB memory and Intel compilers.
Terralyn: Nothing
Patti: Nothing else
Dave HW: Network Analyst for network distance matrix work
Theresa: Steve – Theresa’s new intern is digitizing roads, also some GPS work
Kuuipo: Still waiting for Associate Professor decision. Mark Myers who has done GIS labs, is retiring, will be looking for a replacement to manage GIS labs and do a little teaching.
Next meeting:
Date :May 22
Notes: TJV
Facilitator: Patti
Room: Terralyn said she’ll work on the room, maybe get the lab, could interrupt our treats.
Subject: Python with Matt G.