<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<font size="-1"><font face="Verdana">Thanks to the three of you for
your complementary answers, that's really helpful.<br>
<br>
Dave, I confirm that we are really interested in an improved
version that triggers download in a more gentle way to avoid
triggering GBIF's defense mechanism. And Marie-Elise, we are
also very interested in your scripts. Don't hesitate if we can
be of any help to one of you!<br>
<br>
Have a great weekend,<br>
<br>
Nico<br>
</font></font><br>
<div class="moz-cite-prefix">Le 11/06/15 09:42, Marie Elise Lecoq a
écrit :<br>
</div>
<blockquote
cite="mid:CA+89QhZVdQU5XboGUhf=NmfECfMn-1CttQDZLy3rx0TLMUg87g@mail.gmail.com"
type="cite">
<div dir="ltr">
<div>
<div>Hi Nico,<br>
<br>
</div>
For the point 3, I wrote some scripts in order to add data
using the GBIF API. It helps me a lot especially for contacts
and institutions.<br>
I will clean up and test a little bit more then I can put it
on my github if that can help. <br>
<br>
</div>
<div>Cheers from Madagascar !<br>
</div>
<div>Marie<br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Jun 11, 2015 at 10:33 AM, Tim
Robertson <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:trobertson@gbif.org" target="_blank">trobertson@gbif.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<div><span class="">
<blockquote type="cite">
<div style="word-wrap:break-word">
<div>1) My understanding is the GBIF API has been
bombarded recently and they have now put in
place a limit of the number of concurrent
downloads to 3. The collectory currently
attempts 10 download at a time - hence our
problem. </div>
<div>We’ll try and push out an update to fix this
very soon.</div>
</div>
</blockquote>
<div><br>
</div>
</span>
<div>I’d like to just explain why this was rushed out.</div>
This was a necessary step as <a moz-do-not-send="true"
href="http://GBIF.org" target="_blank">GBIF.org</a>
was exposed to DOS attacks (often inadvertently) which
was happening. In addition the GBIF R library now makes
it trivial to download from GBIF and users can easily
write a loop in code and trigger huge numbers of
download which would block the system for others.</div>
<div><br>
</div>
<div>We’ll continue to tune the values by monitoring
operations, and probably introduce higher per-user
limits so we can e.g. increase the concurrency for known
ALA accounts.</div>
<div><br>
</div>
<div>Please contact me if this causes any issue Nico.</div>
<span class="">
<div>
<div><br>
</div>
<br>
<blockquote type="cite">
<div style="word-wrap:break-word">
<div>
<div>
<blockquote type="cite">
<div>On 10 Jun 2015, at 1:59 pm, Nicolas Noé
<<a moz-do-not-send="true"
href="mailto:n.noe@biodiversity.be"
target="_blank">n.noe@biodiversity.be</a>>
wrote:</div>
<br>
<div>
<div bgcolor="#FFFFFF" text="#000000"><font
size="-1"><font face="Verdana">Hi all,<br>
<br>
I'm trying to set-up an experimental
instance of ALA for Belgium. The
idea is to present all data
published by our belgian
institutions, in order to give those
institutations / collections /
datasets more visibility.<br>
<br>
What's the recommended way to load
this data (everything at GBIF
published by Belgian institutions).
I used the "Add all GBIF resource
for a country" from the Collectory
admin interface, but<br>
<br>
1) I encountered some errors. All
datasets detected correctly, but
only 10 are loaded - for the rest I
get the message "Failed. Please
check your authentication
credentials are valid". The
authentication credentials are
indeed correct, since I only entered
once (so, also for the working
dataset). When looking at my
downloads on the GBIF website, I can
see no track those "failed"
datasets. Can I get debugging
information ? Should I fill a bug
report ? In the ala-collectory
repository ? Or some other ?<br>
<br>
2) Also, the
/collectory/manage/gbifLoadCountry
pages states that "This is a simple
method of bootstrapping an
installation with data provided by
GBIF web services. This is not
intended for long-term production
use.". So maybe I should use another
method to load all the data for my
country.<br>
<br>
3) How are the (dataset) metadata
populated when using this method ?
It seems the basic metadata is
there, but not much more. Should we
do it by hand ? Should we write a
tool to do it ? How about updates?<br>
<br>
Thanks a lot!<br>
</font></font></div>
_______________________________________________<br>
Ala-portal mailing list<br>
<a moz-do-not-send="true"
href="mailto:Ala-portal@lists.gbif.org"
target="_blank">Ala-portal@lists.gbif.org</a><br>
<a moz-do-not-send="true"
href="http://lists.gbif.org/mailman/listinfo/ala-portal"
target="_blank">http://lists.gbif.org/mailman/listinfo/ala-portal</a><br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
_______________________________________________<br>
Ala-portal mailing list<br>
<a moz-do-not-send="true"
href="mailto:Ala-portal@lists.gbif.org"
target="_blank">Ala-portal@lists.gbif.org</a><br>
<a moz-do-not-send="true"
href="http://lists.gbif.org/mailman/listinfo/ala-portal"
target="_blank">http://lists.gbif.org/mailman/listinfo/ala-portal</a><br>
</blockquote>
</div>
<br>
</span></div>
<br>
_______________________________________________<br>
Ala-portal mailing list<br>
<a moz-do-not-send="true"
href="mailto:Ala-portal@lists.gbif.org">Ala-portal@lists.gbif.org</a><br>
<a moz-do-not-send="true"
href="http://lists.gbif.org/mailman/listinfo/ala-portal"
target="_blank">http://lists.gbif.org/mailman/listinfo/ala-portal</a><br>
<br>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
<div class="gmail_signature">
<div dir="ltr"><img moz-do-not-send="true"
src="https://mail.google.com/mail/u/0/?ui=2&ik=f2990c326c&view=fimg&th=143720bd12d267c4&attid=0.1&disp=inline&safe=1&attbid=ANGjdJ-dPPvdDXYTQLEz3sMkSC8MXmmlvNMhRcnZ-5COf76BRKDzNBzALARmrD-ZLTteeCriuqRYcwDCZxnWA6ZjOt8rVgydWnc6h2aRU_hfLDYFdDAPI0uUiC8Do9o&ats=1389188740078&rm=143720bd12d267c4&zw&sz=w1325-h522"><br>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Ala-portal mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Ala-portal@lists.gbif.org">Ala-portal@lists.gbif.org</a>
<a class="moz-txt-link-freetext" href="http://lists.gbif.org/mailman/listinfo/ala-portal">http://lists.gbif.org/mailman/listinfo/ala-portal</a>
</pre>
</blockquote>
<br>
</body>
</html>