getData function not working #191

seandres11 · 2021-01-28T06:16:47Z

Hi!

I am having issues downloading worldclim data through the raster package.

See code below for error message, and let me know if I can provide any other information to help!

r<-getData('CMIP5', var='bio', res=2.5, rcp=85, model="CN" , year=70, lon=151.0034, lat=-33.8136, download=TRUE)
trying URL 'https://biogeo.ucdavis.edu/data/climate/cmip5/2_5m/cn85bi70.zip'
Content type 'application/zip' length 183455516 bytes (175.0 MB)

downloaded 8.1 MB

Error in utils::download.file(url = aurl, destfile = fn, method = "auto", :
download from 'https://biogeo.ucdavis.edu/data/climate/cmip5/2_5m/cn85bi70.zip' failed
In addition: Warning messages:
1: In utils::download.file(url = aurl, destfile = fn, method = "auto", :
downloaded length 8454144 != reported length 183455516
2: In utils::download.file(url = aurl, destfile = fn, method = "auto", :
URL 'https://data.biogeo.ucdavis.edu/data/climate/cmip5/2_5m/cn85bi70.zip': Timeout of 60 seconds was reached

rhijmans · 2021-04-07T03:56:34Z

This works for me, so this was probably a temporary glitch (the webserver not working well).

KaraLayton · 2021-04-27T12:01:09Z

I'm having this same problem now, but haven't had this problem in the past. Just wondering if this is a server issue or if there's another way to fix this? Thanks!

seandres11 · 2021-04-27T21:00:22Z

Hey! Are you on a mac?? I fixed my issue by changing my cran mirror to Mac. Theres also a new version of r now which updating might also help. https://cran.r-project.org/bin/macosx/ Let me know if that helps! Cheers, Sam Sent via the Samsung Galaxy S9, an AT&T 5G Evolution capable smartphone Get Outlook for Android<https://aka.ms/AAb9ysg>

…

________________________________ From: Kara Layton ***@***.***> Sent: Tuesday, April 27, 2021 10:01:36 PM To: rspatial/raster ***@***.***> Cc: Samantha Andres ***@***.***>; Author ***@***.***> Subject: Re: [rspatial/raster] getData function not working (#191) I'm having this same problem now, but haven't had this problem in the past. Just wondering if this is a server issue or if there's another way to fix this? Thanks! — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#191 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/APRBRVSRKNQ6ZV24PZYUTUTTK2RRVANCNFSM4WWOJQIA>.

KaraLayton · 2021-04-28T09:59:42Z

Thanks Sam! I tried installing the newest version of R and still having the issue. If you don't mind me asking, which mirror are you using? I don't see an option for a Mac mirror specifically.

seandres11 · 2021-04-28T23:30:48Z

Hmm, are you on a mac? At the moment, I am using the CDN Global mirror. Perhaps the function you are using is masked by another package? Cheers, Sam Samantha E. Andres Plant Ecologist and PhD Candidate Hawkesbury Institute for the Environment +61 (435)-411-549 WSU Postgraduate Page<https://www.westernsydney.edu.au/hie/people/postgraduate_students/current_postgraduate_students/samantha_andres>

…

________________________________ From: Kara Layton ***@***.***> Sent: Wednesday, 28 April 2021 8:00 PM To: rspatial/raster ***@***.***> Cc: Samantha Andres ***@***.***>; Author ***@***.***> Subject: Re: [rspatial/raster] getData function not working (#191) Thanks Sam! I tried installing the newest version of R and still having the issue. If you don't mind me asking, which mirror are you using? I don't see an option for a Mac mirror specifically. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<#191 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/APRBRVRR76WI2HMLL5V32DTTK7MCHANCNFSM4WWOJQIA>.

rlfrench · 2021-05-24T17:47:19Z

I've been encountering the same issue for the past two days. Like others who have posted in this thread, I've used the getData function many times (most recently in March) and have never encountered this problem before!

Each time, I've tried running getData as follows:

bioclimdat <- raster::getData(name = "worldclim", var = "bio", res = 2.5)

and every time, I get this message (although the size of the "downloaded" file has ranged from 89.5 - 109.3 MB across my 5 or 6 unsuccessful attempts):

trying URL 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/grid/cur/bio_2-5m_bil.zip'
Content type 'application/zip' length 129319755 bytes (123.3 MB)
====================================
downloaded 89.5 MB

Error in utils::download.file(url = aurl, destfile = fn, method = "auto",  : 
  download from 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/grid/cur/bio_2-5m_bil.zip' failed
In addition: Warning messages:
1: In utils::download.file(url = aurl, destfile = fn, method = "auto",  :
  downloaded length 93880320 != reported length 129319755
2: In utils::download.file(url = aurl, destfile = fn, method = "auto",  :
  URL 'https://data.biogeo.ucdavis.edu/data/climate/worldclim/1_4/grid/cur/bio_2-5m_bil.zip': Timeout of 60 seconds was reached

I have access to .bil and .hdr files for each of the 19 bioclimatic variables from my last successful getData run in March. Is there a way of using those files to create a raster stack while the webserver is down/malfunctioning (if that is the source of the issue)?

marcoplebani85 · 2021-10-07T12:22:01Z

I've been encountering the same issue for the past two days. Like others who have posted in this thread, I've used the getData function many times (most recently in March) and have never encountered this problem before!

Each time, I've tried running getData as follows:

bioclimdat <- raster::getData(name = "worldclim", var = "bio", res = 2.5)

and every time, I get this message (although the size of the "downloaded" file has ranged from 89.5 - 109.3 MB across my 5 or 6 unsuccessful attempts):
trying URL 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/grid/cur/bio_2-5m_bil.zip'
Content type 'application/zip' length 129319755 bytes (123.3 MB)
====================================
downloaded 89.5 MB

Error in utils::download.file(url = aurl, destfile = fn, method = "auto",  : 
  download from 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/grid/cur/bio_2-5m_bil.zip' failed
In addition: Warning messages:
1: In utils::download.file(url = aurl, destfile = fn, method = "auto",  :
  downloaded length 93880320 != reported length 129319755
2: In utils::download.file(url = aurl, destfile = fn, method = "auto",  :
  URL 'https://data.biogeo.ucdavis.edu/data/climate/worldclim/1_4/grid/cur/bio_2-5m_bil.zip': Timeout of 60 seconds was reached
I have access to .bil and .hdr files for each of the 19 bioclimatic variables from my last successful getData run in March. Is there a way of using those files to create a raster stack while the webserver is down/malfunctioning (if that is the source of the issue)?

I'm having the same problem.
I'm using raster version 3.4-13 on:
R version 4.1.1 (2021-08-10)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Mojave 10.14.5

Example: getData() cannot access https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/tiles/cur/tmin_23.zip.

I could download the zip file, but it contains 12 .bil files and 12 .hdr files, and I have no idea of what to use. How to fix this? Is there a way to load worldclim data into R from local files? If so, how?

rhijmans · 2021-10-07T12:34:41Z

perhaps you need to increase the timeout setting before using getData. Something like this:

options(timeout = 600)

marcoplebani85 · 2021-10-07T14:13:01Z

Hello @rhijmans thank you for the tip. I did not know about it and it might come in handy some other time. Upon closer inspection, my problem is not the same as @rlfrench had though. I should have been more thorough, my bad. Here is my code and error message:

raster::getData('worldclim', var='tmin', res=0.5, lon = -88.35507, lat = 17.19497)

trying URL 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/tiles/cur/tmin_23.zip'
Error in utils::download.file(url = aurl, destfile = fn, method = "auto",  : 
  cannot open URL 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/tiles/cur/tmin_23.zip'
In addition: Warning message:
In utils::download.file(url = aurl, destfile = fn, method = "auto",  :
  URL 'https://biogeo.ucdavis.edu/data/climate/worldclim/1_4/tiles/cur/tmin_23.zip': status was 'Peer certificate cannot be authenticated with given CA certificates'

rhijmans · 2021-10-07T17:18:23Z

Hi @marcoplebani85
The error message Peer certificate cannot be authenticated with given CA certificates would seem to be related to your system.
It works for me on a similar macOS. Can you try on another computer?
To create a RasterStack from the files, you can do stack(filenames)

marcoplebani85 · 2021-10-08T10:45:39Z

Hello,

sessionInfo()
R version 4.1.1 (2021-08-10)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Mojave 10.14.5

I don't think their server is the issue because I can download the data by opening the link that getData can't access using my browser. Good to know about stack(), thanks. I managed to download worldclim files on my computer via my browser, then I got getData() to load them into R. First I unzipped them, took them out of their folders, and put them in a new folder called "wc0.5" in my work directory. Then I run raster::getData('worldclim', var='tmin', res=0.5, lon = -88.35507, lat = 17.19497, download=F). Cheers!

rhijmans closed this as completed Apr 7, 2021

rhijmans mentioned this issue Oct 8, 2021

Server down? #169

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

getData function not working #191

getData function not working #191

seandres11 commented Jan 28, 2021

rhijmans commented Apr 7, 2021

KaraLayton commented Apr 27, 2021

seandres11 commented Apr 27, 2021 via email

KaraLayton commented Apr 28, 2021

seandres11 commented Apr 28, 2021 via email

rlfrench commented May 24, 2021

marcoplebani85 commented Oct 7, 2021

rhijmans commented Oct 7, 2021

marcoplebani85 commented Oct 7, 2021

rhijmans commented Oct 7, 2021 •

edited

Loading

marcoplebani85 commented Oct 8, 2021 •

edited

Loading

getData function not working #191

getData function not working #191

Comments

seandres11 commented Jan 28, 2021

r<-getData('CMIP5', var='bio', res=2.5, rcp=85, model="CN" , year=70, lon=151.0034, lat=-33.8136, download=TRUE) trying URL 'https://biogeo.ucdavis.edu/data/climate/cmip5/2_5m/cn85bi70.zip' Content type 'application/zip' length 183455516 bytes (175.0 MB)

rhijmans commented Apr 7, 2021

KaraLayton commented Apr 27, 2021

seandres11 commented Apr 27, 2021 via email

KaraLayton commented Apr 28, 2021

seandres11 commented Apr 28, 2021 via email

rlfrench commented May 24, 2021

marcoplebani85 commented Oct 7, 2021

rhijmans commented Oct 7, 2021

marcoplebani85 commented Oct 7, 2021

rhijmans commented Oct 7, 2021 • edited Loading

marcoplebani85 commented Oct 8, 2021 • edited Loading

r<-getData('CMIP5', var='bio', res=2.5, rcp=85, model="CN" , year=70, lon=151.0034, lat=-33.8136, download=TRUE)
trying URL 'https://biogeo.ucdavis.edu/data/climate/cmip5/2_5m/cn85bi70.zip'
Content type 'application/zip' length 183455516 bytes (175.0 MB)

rhijmans commented Oct 7, 2021 •

edited

Loading

marcoplebani85 commented Oct 8, 2021 •

edited

Loading