[API-users] FW: [datacite-allusers] Delays in DOI registrations and updates

[Tim Robertson]

Dear GBIF community

Please be aware of this communication from DataCite which will likely cause some disruption on GBIF services with relation to DOI issuing.

Many thanks,
Tim


From: Martin Fenner <martin.fenner at datacite.org>
Reply-To: "allusers at datacite.org" <allusers at datacite.org>
Date: Friday, 2 August 2019 at 08.22
To: DataCite Allmembers <allmembers at datacite.org>, DataCite Allusers <allusers at datacite.org>
Subject: [datacite-allusers] Delays in DOI registrations and updates

Dear DataCite members and users,

processing of DOI registrations is currently delayed by up to 12 hours, affecting registration in the handle system and inclusion in the search index. This is caused by an unusually very large number of maintenance jobs running in our system, and we expect this to be resolved by the end of the day. This is a delay in processing, all DOI registrations and updates are successfully captured by our system. Requesting or searching DOI metadata is not affected. Please check https://status.datacite.org for updated status information, or subscribe to email updates at this site.

The reason for the very large number of maintenance jobs is two important updates to better handle malformed dates in DOI metadata and to prepare for affiliation identifier support in the upcoming schema 4.3. The load on the system for these two tasks is much higher than expected, causing the delays described above. I sincerely apologize for the inconvenience this is causing, and going forward we will be better in giving advance notice with scheduled maintenances for situations like this.

What is happening today is unrelated to the service incident we reported on July 24 (https://status.datacite.org/incidents/d00gnm05ps3k). That incident was caused by a very high number (> 1 million in 24 hours) of DOI registration requests by a single client, temporarily overloading the system. To prevent this from happening in the future, we have this Monday implemented rate-limiting of 3,000 requests per IP address within 5 min, which translates to 10 requests per second or 36,000 requests per hour per IP address. Please reach out to support at datacite.org<mailto:support at datacite.org> if you need higher rate-limits temporarily or generally, and we can adjust the rate-limits for your IP addresses. This is the first time we implemented rate-limiting, but we had to take this step to make sure DOI registrations for all users are not affected by high numbers of requests by a single user. We have also increased the number of servers and improved monitoring to better handle these kinds of situations in the future.

Please reach out to me via support at datacite.org<mailto:support at datacite.org> if you have any comments or feedback.

Kind regards,

Martin Fenner

--
Martin Fenner
DataCite Technical Director
http://orcid.org/0000-0003-1419-2405
--
You received this message because you are subscribed to the Google Groups "DataCite Allusers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to allusers+unsubscribe at datacite.org<mailto:allusers+unsubscribe at datacite.org>.
To view this discussion on the web visit https://groups.google.com/a/datacite.org/d/msgid/allusers/CAG9q6AbF31-QENqcf2yJeJb8RFKFWx%3DL5zdndSTr4FTwyO7%3Dww%40mail.gmail.com<https://groups.google.com/a/datacite.org/d/msgid/allusers/CAG9q6AbF31-QENqcf2yJeJb8RFKFWx%3DL5zdndSTr4FTwyO7%3Dww%40mail.gmail.com?utm_medium=email&utm_source=footer>.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.gbif.org/pipermail/api-users/attachments/20190802/4727d339/attachment.html>