download url for GBIF Backbone Taxonomy?
Regarding the archive available for:
https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c
I attempted to download the archive using a command-line tool but cannot because:
We’re sorry, but GBIF doesn’t work properly without JavaScript enabled.
I started the download from my browser and the expected download time keeps bouncing between 8 hours and 12 hours.
Two questions:
1. Is there a location on the Internet where I can download that file in a reasonable timeframe?
2. Is there a url that will function properly to download the file without requiring javascript?
Is there any interest in developing mirrors or a CDN to host some of these things within the community?
Thanks,
Dan Stoner iDigBio / ACIS Laboratory University of Florida
Hi Dan, you can find all backbone data here, it should not be a terribly long download: http://rs.gbif.org/datasets/backbone/
best, Markus
On 15. Mar 2018, at 19:04, Stoner, Dan <dstoner@acis.ufl.edumailto:dstoner@acis.ufl.edu> wrote:
Regarding the archive available for:
https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c
I attempted to download the archive using a command-line tool but cannot because:
We’re sorry, but GBIF doesn’t work properly without JavaScript enabled.
I started the download from my browser and the expected download time keeps bouncing between 8 hours and 12 hours.
Two questions:
1. Is there a location on the Internet where I can download that file in a reasonable timeframe?
2. Is there a url that will function properly to download the file without requiring javascript?
Is there any interest in developing mirrors or a CDN to host some of these things within the community?
Thanks,
Dan Stoner iDigBio / ACIS Laboratory University of Florida
_______________________________________________ API-users mailing list API-users@lists.gbif.org https://lists.gbif.org/mailman/listinfo/api-users
Yes, thanks, that worked well.
One thing I noticed and is a bit confusing is that the dataset page [1] indicates:
Last Modified 16 November 2017
whereas the rs.gbif.org site [2] indicates "newer" files (based on timestamps, directory names) created in 2018.
The backbone-current.zip from the dataset page and from the rs.gibf.org site appear to be identical (same byte count and md5sum), but I could not determine this without actually downloading both.
Links:
[1] https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c
[2] http://rs.gbif.org/datasets/backbone/
- Dan Stoner
________________________________ From: Markus Döring mdoering@gbif.org Sent: Thursday, March 15, 2018 3:07 PM To: Stoner, Dan Cc: api-users@lists.gbif.org Subject: Re: [API-users] download url for GBIF Backbone Taxonomy?
Hi Dan, you can find all backbone data here, it should not be a terribly long download: http://rs.gbif.org/datasets/backbone/https://urldefense.proofpoint.com/v2/url?u=http-3A__rs.gbif.org_datasets_backbone_&d=DwMGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=UzZo4hGcdFimU6rXUUDpY2wxoDNTdCHOTG82ttnXcl4&m=X1yWo8M0Svfofg74yIynxoH64RJvqSj8PtnWcuK9ljs&s=9dZoI7d1WUUF9heKwem4CovbAytgzGlpyOY8aFKKlz0&e=
best, Markus
On 15. Mar 2018, at 19:04, Stoner, Dan <dstoner@acis.ufl.edumailto:dstoner@acis.ufl.edu> wrote:
Regarding the archive available for:
https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36chttps://urldefense.proofpoint.com/v2/url?u=https-3A__www.gbif.org_dataset_d7dddbf4-2D2cf0-2D4f39-2D9b2a-2Dbb099caae36c&d=DwMGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=UzZo4hGcdFimU6rXUUDpY2wxoDNTdCHOTG82ttnXcl4&m=X1yWo8M0Svfofg74yIynxoH64RJvqSj8PtnWcuK9ljs&s=rkVqYGOCNEi6RP8PN5JYLQANSrCGPTXwoosSI-nhGR4&e=
I attempted to download the archive using a command-line tool but cannot because:
We're sorry, but GBIF doesn't work properly without JavaScript enabled.
I started the download from my browser and the expected download time keeps bouncing between 8 hours and 12 hours.
Two questions:
1. Is there a location on the Internet where I can download that file in a reasonable timeframe?
2. Is there a url that will function properly to download the file without requiring javascript?
Is there any interest in developing mirrors or a CDN to host some of these things within the community?
Thanks,
Dan Stoner iDigBio / ACIS Laboratory University of Florida
_______________________________________________ API-users mailing list API-users@lists.gbif.org https://lists.gbif.org/mailman/listinfo/api-users
Hi Dan,
I agree that the "last modified" date is confusing. At the moment, it shows the last time the description or other dataset metadata was changed. I've suggested we changed that: https://github.com/gbif/portal-feedback/issues/1267
However, I'm confused about the links to the backbone ZIP files. As far as I can see, they end up at the same URL.
The link under "Download" at the top, and the link by "Endpoint" at the bottom, is http://rs.gbif.org/datasets/backbone/backbone-current.zip in both cases.
That is the same as the link to backbone-current.zip in http://rs.gbif.org/datasets/backbone/
Either
curl -O http://rs.gbif.org/datasets/backbone/backbone-current.zip
or
wget http://rs.gbif.org/datasets/backbone/backbone-current.zip
is what I'd expect to use on the command line.
The server hosting rs.gbif.org has a 1Gb/s internet connection (=125MB/s), and GBIF overall has a 10Gb/s connection into the European academic backbone network. You should be able to download http://rs.gbif.org/datasets/backbone/backbone-current.zip in 8-12 seconds from North America.
Cheers,
Matt Blissett
On 16/03/18 14:41, Stoner, Dan wrote:
Yes, thanks, that worked well.
One thing I noticed and is a bit confusing is that the dataset page [1] indicates:
Last Modified 16 November 2017
whereas the rs.gbif.org site [2] indicates "newer" files (based on timestamps, directory names) created in 2018.
The backbone-current.zip from the dataset page and from the rs.gibf.org site appear to be identical (same byte count and md5sum), but I could not determine this without actually downloading both.
Links:
[1] https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c
[2] http://rs.gbif.org/datasets/backbone/
- Dan Stoner
*From:* Markus Döring mdoering@gbif.org *Sent:* Thursday, March 15, 2018 3:07 PM *To:* Stoner, Dan *Cc:* api-users@lists.gbif.org *Subject:* Re: [API-users] download url for GBIF Backbone Taxonomy? Hi Dan, you can find all backbone data here, it should not be a terribly long download: http://rs.gbif.org/datasets/backbone/ https://urldefense.proofpoint.com/v2/url?u=http-3A__rs.gbif.org_datasets_backbone_&d=DwMGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=UzZo4hGcdFimU6rXUUDpY2wxoDNTdCHOTG82ttnXcl4&m=X1yWo8M0Svfofg74yIynxoH64RJvqSj8PtnWcuK9ljs&s=9dZoI7d1WUUF9heKwem4CovbAytgzGlpyOY8aFKKlz0&e=
best, Markus
On 15. Mar 2018, at 19:04, Stoner, Dan <dstoner@acis.ufl.edu mailto:dstoner@acis.ufl.edu> wrote:
Regarding the archive available for:
https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c https://urldefense.proofpoint.com/v2/url?u=https-3A__www.gbif.org_dataset_d7dddbf4-2D2cf0-2D4f39-2D9b2a-2Dbb099caae36c&d=DwMGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=UzZo4hGcdFimU6rXUUDpY2wxoDNTdCHOTG82ttnXcl4&m=X1yWo8M0Svfofg74yIynxoH64RJvqSj8PtnWcuK9ljs&s=rkVqYGOCNEi6RP8PN5JYLQANSrCGPTXwoosSI-nhGR4&e=
I attempted to download the archive using a command-line tool but cannot because:
We’re sorry, but GBIF doesn’t work properly without JavaScript enabled.
I started the download from my browser and the expected download time keeps bouncing between 8 hours and 12 hours.
Two questions:
- Is there a location on the Internet where I can download that file
in a reasonable timeframe?
- Is there a url that will function properly to download the file
without requiring javascript?
Is there any interest in developing mirrors or a CDN to host some of these things within the community?
Thanks,
Dan Stoner iDigBio / ACIS Laboratory University of Florida
API-users mailing list API-users@lists.gbif.org https://lists.gbif.org/mailman/listinfo/api-users
API-users mailing list API-users@lists.gbif.org https://lists.gbif.org/mailman/listinfo/api-users
participants (3)
-
Markus Döring
-
Matthew Blissett
-
Stoner, Dan