[API-users] download url for GBIF Backbone Taxonomy?

[Matthew Blissett]

Hi Dan,


I agree that the "last modified" date is confusing. At the moment, it 
shows the last time the description or other dataset metadata was 
changed. I've suggested we changed that: 
https://github.com/gbif/portal-feedback/issues/1267


However, I'm confused about the links to the backbone ZIP files. As far 
as I can see, they end up at the same URL.


The link under "Download" at the top, and the link by "Endpoint" at the 
bottom, is http://rs.gbif.org/datasets/backbone/backbone-current.zip in 
both cases.


That is the same as the link to backbone-current.zip in 
http://rs.gbif.org/datasets/backbone/


Either

   curl -O http://rs.gbif.org/datasets/backbone/backbone-current.zip

or

   wget http://rs.gbif.org/datasets/backbone/backbone-current.zip

is what I'd expect to use on the command line.



The server hosting rs.gbif.org has a 1Gb/s internet connection 
(=125MB/s), and GBIF overall has a 10Gb/s connection into the European 
academic backbone network. You should be able to download 
http://rs.gbif.org/datasets/backbone/backbone-current.zip in 8-12 
seconds from North America.


Cheers,


Matt Blissett


On 16/03/18 14:41, Stoner, Dan wrote:
>
> Yes, thanks, that worked well.
>
>
>
> One thing I noticed and is a bit confusing is that the dataset page 
> [1] indicates:
>
>
> Last Modified 16 November 2017
>
>
> whereas the rs.gbif.org site [2] indicates "newer" files (based 
> on timestamps, directory names) created in 2018.
>
>
>
> The backbone-current.zip from the dataset page and from the 
> rs.gibf.org site appear to be identical (same byte count and md5sum), 
> but I could not determine this without actually downloading both.
>
>
>
> Links:
>
>
>   [1] https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c
>
>
>   [2] http://rs.gbif.org/datasets/backbone/
>
>
>
> - Dan Stoner
>
>
>
> ------------------------------------------------------------------------
> *From:* Markus Döring <mdoering at gbif.org>
> *Sent:* Thursday, March 15, 2018 3:07 PM
> *To:* Stoner, Dan
> *Cc:* api-users at lists.gbif.org
> *Subject:* Re: [API-users] download url for GBIF Backbone Taxonomy?
> Hi Dan,
> you can find all backbone data here, it should not be a terribly long 
> download:
> http://rs.gbif.org/datasets/backbone/ 
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__rs.gbif.org_datasets_backbone_&d=DwMGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=UzZo4hGcdFimU6rXUUDpY2wxoDNTdCHOTG82ttnXcl4&m=X1yWo8M0Svfofg74yIynxoH64RJvqSj8PtnWcuK9ljs&s=9dZoI7d1WUUF9heKwem4CovbAytgzGlpyOY8aFKKlz0&e=>
>
> best,
> Markus
>
>
>> On 15. Mar 2018, at 19:04, Stoner, Dan <dstoner at acis.ufl.edu 
>> <mailto:dstoner at acis.ufl.edu>> wrote:
>>
>> Regarding the archive available for:
>>
>> https://www.gbif.org/dataset/d7dddbf4-2cf0-4f39-9b2a-bb099caae36c 
>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.gbif.org_dataset_d7dddbf4-2D2cf0-2D4f39-2D9b2a-2Dbb099caae36c&d=DwMGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=UzZo4hGcdFimU6rXUUDpY2wxoDNTdCHOTG82ttnXcl4&m=X1yWo8M0Svfofg74yIynxoH64RJvqSj8PtnWcuK9ljs&s=rkVqYGOCNEi6RP8PN5JYLQANSrCGPTXwoosSI-nhGR4&e=>
>>
>>
>> I attempted to download the archive using a command-line tool but 
>> cannot because:
>>
>>
>>    We’re sorry, but GBIF doesn’t work properly without JavaScript 
>> enabled.
>>
>>
>> I started the download from my browser and the expected download time 
>> keeps bouncing between 8 hours and 12 hours.
>>
>> Two questions:
>>
>> 1. Is there a location on the Internet where I can download that file 
>> in a reasonable timeframe?
>>
>> 2. Is there a url that will function properly to download the file 
>> without requiring javascript?
>>
>>
>> Is there any interest in developing mirrors or a CDN to host some of 
>> these things within the community?
>>
>> Thanks,
>>
>> Dan Stoner
>> iDigBio / ACIS Laboratory
>> University of Florida
>>
>> _______________________________________________
>> API-users mailing list
>> API-users at lists.gbif.org
>> https://lists.gbif.org/mailman/listinfo/api-users
>
>
>
> _______________________________________________
> API-users mailing list
> API-users at lists.gbif.org
> https://lists.gbif.org/mailman/listinfo/api-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.gbif.org/pipermail/api-users/attachments/20180316/ea5e773d/attachment-0001.html>