<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">Hi Nico<br><div><br><blockquote type="cite"><div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">- Shouldn't the secretariat update the documentation to say the
limit is 200.000 instead of 1.000.000 ?<br></font></font></div></blockquote><div><br></div><div>Yes</div><br><blockquote type="cite"><div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">
- Is there a plan to incrementally remove/lessen this limitation
? 200K is quite a limit compared to the 500M+ total records
available.<br></font></font></div></blockquote><div><br></div><div>Not until the Lucene committers fix their deep paging issues. This is a common problem in Lucene and you’ll find similar limitations on the likes of Google search results paging etc.</div><div>Paging over more than 200k records is not all that sensible in general though, when a far more efficient mechanism exists with the download API.</div><div><br></div><div>Cheers,</div><div>Tim</div><div><br></div><div><br></div><blockquote type="cite"><div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana"><br>
</font></font>
<div class="moz-cite-prefix">Le 12/02/15 20:20, Markus Döring a
écrit :<br>
</div>
<blockquote cite="mid:4C4FC62F-5C23-4C86-A02C-9A3F8739DE82@gbif.org" type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
Hi Nico,
<div>see anserws inline below.</div>
<div>Makrus</div>
<div><br>
<div>
<div><br>
</div>
<div><br>
</div>
<blockquote type="cite">
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
<div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">I'm having some doubts about how the
hard limits work when using the occurrence search API.
I think this is a documentation/error message issue
rather than a technical one:<br>
<br>
Here is what the doc says:<br>
<br>
- max value for "limit" = 300<br>
- max total records = 1.000.000 (does that means limit
* offset?)<br>
</font></font></div>
</blockquote>
no, it means offset + limit</div>
<div>and like you discovered below the limit is actually at
200.000 not 1 million</div>
<div><br>
</div>
<div><br>
<blockquote type="cite">
<div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">What my tests says:<br>
<br>
-
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://api.gbif.org/v1/occurrence/search?hasCoordinate=true&limit=300&offset=3335">http://api.gbif.org/v1/occurrence/search?hasCoordinate=true&limit=300&offset=3335</a><br>
=> works, but shouldn't since 300*3335 = 1000500
total records<br>
</font></font></div>
</blockquote>
the offset is not in pages but absolute records. So you
actually are looking at records 3335 to 3634</div>
<div><br>
<blockquote type="cite">
<div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">-
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://api.gbif.org/v1/occurrence/search?hasCoordinate=true&limit=1&offset=200000">http://api.gbif.org/v1/occurrence/search?hasCoordinate=true&limit=1&offset=200000</a><br>
=> "maximum offset allowed is 200000", but offset
IS 200000 (message should be "less than"? 199999
works) Also, this limit on the offset parameter should
be stated in the doc page.<br>
</font></font></div>
</blockquote>
I believe we have not updated the docs and the 1 million limit
actually is 200.000 which you can see here in your example!</div>
<div><br>
<blockquote type="cite">
<div bgcolor="#FFFFFF" text="#000000"><font size="-1"><font face="Verdana">-
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://api.gbif.org/v1/occurrence/search?hasCoordinate=true&limit=300&offset=199998">http://api.gbif.org/v1/occurrence/search?hasCoordinate=true&limit=300&offset=199998</a><br>
=> "maximum offset allowed is 200000": here, we
probably hit the 1.000.000 total limit, but the error
message refer to the undocumented (and not hit here)
max offset limit.<br>
<br>
Could you clarify a bit ? <br>
<br>
All the best,<br>
<br>
Nico<br>
<br>
<br>
</font></font> </div>
_______________________________________________<br>
API-users mailing list<br>
<a moz-do-not-send="true" href="mailto:API-users@lists.gbif.org">API-users@lists.gbif.org</a><br>
<a class="moz-txt-link-freetext" href="http://lists.gbif.org/mailman/listinfo/api-users">http://lists.gbif.org/mailman/listinfo/api-users</a><br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
_______________________________________________<br>API-users mailing list<br><a href="mailto:API-users@lists.gbif.org">API-users@lists.gbif.org</a><br>http://lists.gbif.org/mailman/listinfo/api-users<br></blockquote></div><br></body></html>