CO-OPS SOS service only allows 4 day current requests

[birdage]

at present when performing a get observation request (like this) the user recieves an error Max 4 days of data can be requested. 10.04 days were requested.

meaning that only 4 days of currents can be requested, this makes obtaining long time series difficult via SOS

[rsignell-usgs]

@mchaouchi, could this limit be extended from four days to something longer?
What are the constraints?

[mchaouchi]

The time constrain is enforced for now across different data products and it varies depending on the overall quantity of the data. There is an ongoing conversation to increase those time limits and we are working to eventually make that a reality. For now, we have created sample clients that show how one can access multiple years of data from multiple stations.
http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/ClientGetter?p=15
All we are asking when looping is to put a sleep statement between requests so that not to overwhelm the systems and that your requests will be fulfilled correctly.

[birdage]

@mchaouchi, thanks for the reply. i see the wait of 4 seconds (Thread.sleep(4000);) would you want us to adopt a similar wait time?

This might be in the application layer, but is there a chance we could get the data over multiple threads i.e make 12 threads to get 12 months of data (somewhat simultaneously)

[mchaouchi]

Adopting similar approach as highlighted by the sample code will be good. You can use threads to accomplish this. If there aren’t too many competing requests, this should work well.

[birdage]

@mchaouchi Thanks for the response

[rsignell-usgs]

@mchaouchi, who should we contact at CO-OPS for thredds issues now that you have changed jobs?

[mchaouchi]

For THREDDS' requests, please contact Dave at Xiangdong.Xia@noaa.gov

For SOS Web Services inquiries, please contact Xiaoyan at
Xiaoyan.Li@noaa.gov

Thank you.

[rsignell-usgs]

Thanks @mchaouchi!