Scenario 2A Extreme Currents Progress

[birdage]

Progress: 2A Extreme Currents

Successes

• Obtain multiple years of observation data from NDBC (via thredds & DAP
  
  )
• Generate annual max current speed, markers are scaled by how much data is available
  
• Generation of current rose plots for each station
  
• Generation of an interactive map indicating the number of viable stations, addition of station relevant popups
  

Easy Challenges: Identified and Fixed

• Generated code to process long time series requests (i.e date ranges exceeding max day requirements are broken down)
• COOPS offers 3 SOS methods to obtain data from current sensors (currentPoint,currentProfile,CurrentProfileSurvey)
• Update to base folium library to allow for marker color and icons inline making map generation easier
• NDBC offers DAP endpoints to obtain current data

Longer-term Challenges Identified

• Current services dont really seems to be setup for long time series extraction of currents data (i.e DAP is not available for CO-OPS stations)
• Requesting long term current time series from COOPS via web services is difficult as requests need to be split up in to either <= 4 day or < 30 day chunks (CO-OPS SOS service only allows 4 day current requests #101), for around 10 years work of data over 900 requests need to be made for current profiles(COOPS) NDBC and COOPS SOS collectors should split requests over time limit boundaries pyoos#35 is looking in to solving the request issue, but a large number of requests seem to cause an issue.
• The NDBC and COOPS SOS services allow only 31 days of data to be extracted per request (NDBC and COOPS SOS only provides a maximum of 31days per sos request #81). For this notebook, time series data was extracted at the maximum possible datetime span. For long timeseries data this caused an issue.
• COOPS current profiles have a 4 day (max) request limit and generate large amount of data (around 8meg per request) due to the amount of fields available, that means for around 10 years over 7200meg (7.2gig) (900 requests * 8meg) would be downloaded from the server.
• COOPS current points have a 31 day (max) request limit, this request generates less data, at ~1meg per 30 days

Spin Off Notebooks:

• HF Radar/Obs comparison notebook link