<div dir="ltr"><div><div>Hi Nico,<br><br></div>For the point 3, I wrote some scripts in order to add data using the GBIF API. It helps me a lot especially for contacts and institutions.<br>I will clean up and test a little bit more then I can put it on my github if that can help. <br><br></div><div>Cheers from Madagascar !<br></div><div>Marie<br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 11, 2015 at 10:33 AM, Tim Robertson <span dir="ltr"><<a href="mailto:trobertson@gbif.org" target="_blank">trobertson@gbif.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><span class=""><blockquote type="cite"><div style="word-wrap:break-word"><div>1) My understanding is the GBIF API has been bombarded recently and they have now put in place a limit of the number of concurrent downloads to 3. The collectory currently attempts 10 download at a time - hence our problem. </div>
<div>We’ll try and push out an update to fix this very soon.</div></div></blockquote><div><br></div></span><div>I’d like to just explain why this was rushed out.</div>This was a necessary step as <a href="http://GBIF.org" target="_blank">GBIF.org</a> was exposed to DOS attacks (often inadvertently) which was happening. In addition the GBIF R library now makes it trivial to download from GBIF and users can easily write a loop in code and trigger huge numbers of download which would block the system for others.</div><div><br></div><div>We’ll continue to tune the values by monitoring operations, and probably introduce higher per-user limits so we can e.g. increase the concurrency for known ALA accounts.</div><div><br></div><div>Please contact me if this causes any issue Nico.</div><span class=""><div><div><br></div><br><blockquote type="cite"><div style="word-wrap:break-word"><div>
<div>
<blockquote type="cite">
<div>On 10 Jun 2015, at 1:59 pm, Nicolas Noé <<a href="mailto:n.noe@biodiversity.be" target="_blank">n.noe@biodiversity.be</a>> wrote:</div>
<br>
<div>
<div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">Hi all,<br>
<br>
I'm trying to set-up an experimental instance of ALA for Belgium. The idea is to present all data published by our belgian institutions, in order to give those institutations / collections / datasets more visibility.<br>
<br>
What's the recommended way to load this data (everything at GBIF published by Belgian institutions). I used the "Add all GBIF resource for a country" from the Collectory admin interface, but<br>
<br>
1) I encountered some errors. All datasets detected correctly, but only 10 are loaded - for the rest I get the message "Failed. Please check your authentication credentials are valid". The authentication credentials are indeed correct, since I only entered
once (so, also for the working dataset). When looking at my downloads on the GBIF website, I can see no track those "failed" datasets. Can I get debugging information ? Should I fill a bug report ? In the ala-collectory repository ? Or some other ?<br>
<br>
2) Also, the /collectory/manage/gbifLoadCountry pages states that "This is a simple method of bootstrapping an installation with data provided by GBIF web services. This is not intended for long-term production use.". So maybe I should use another method to
load all the data for my country.<br>
<br>
3) How are the (dataset) metadata populated when using this method ? It seems the basic metadata is there, but not much more. Should we do it by hand ? Should we write a tool to do it ? How about updates?<br>
<br>
Thanks a lot!<br>
</font></font></div>
_______________________________________________<br>
Ala-portal mailing list<br>
<a href="mailto:Ala-portal@lists.gbif.org" target="_blank">Ala-portal@lists.gbif.org</a><br>
<a href="http://lists.gbif.org/mailman/listinfo/ala-portal" target="_blank">http://lists.gbif.org/mailman/listinfo/ala-portal</a><br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
_______________________________________________<br>Ala-portal mailing list<br><a href="mailto:Ala-portal@lists.gbif.org" target="_blank">Ala-portal@lists.gbif.org</a><br><a href="http://lists.gbif.org/mailman/listinfo/ala-portal" target="_blank">http://lists.gbif.org/mailman/listinfo/ala-portal</a><br></blockquote></div><br></span></div><br>_______________________________________________<br>
Ala-portal mailing list<br>
<a href="mailto:Ala-portal@lists.gbif.org">Ala-portal@lists.gbif.org</a><br>
<a href="http://lists.gbif.org/mailman/listinfo/ala-portal" target="_blank">http://lists.gbif.org/mailman/listinfo/ala-portal</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><img src="https://mail.google.com/mail/u/0/?ui=2&ik=f2990c326c&view=fimg&th=143720bd12d267c4&attid=0.1&disp=inline&safe=1&attbid=ANGjdJ-dPPvdDXYTQLEz3sMkSC8MXmmlvNMhRcnZ-5COf76BRKDzNBzALARmrD-ZLTteeCriuqRYcwDCZxnWA6ZjOt8rVgydWnc6h2aRU_hfLDYFdDAPI0uUiC8Do9o&ats=1389188740078&rm=143720bd12d267c4&zw&sz=w1325-h522"><br></div></div>
</div>