The DOI Foundation Status - Incident History

<?xml version="1.0" encoding="UTF-8"?> <feed xml:lang="en-US" xmlns="http://www.w3.org/2005/Atom"> <id>tag:doi.statuspage.io,2005:/history</id> <link rel="alternate" type="text/html" href="https://doi.statuspage.io"/> <link rel="self" type="application/atom+xml" href="https://doi.statuspage.io/history.atom"/> <title>The DOI Foundation Status - Incident History</title> <updated>2024-10-29T20:26:16Z</updated> <author> <name>The DOI Foundation</name> </author> <entry> <id>tag:doi.statuspage.io,2005:Incident/20913167</id> <published>2024-05-29T01:46:59Z</published> <updated>2024-06-20T02:17:06Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/f4hrmd88c94l"/> <title>doi.org outage</title> <content type="html">May <var data-var='date'>29</var>, <var data-var='time'>01:46</var> UTC Resolved - doi.org resolution services were inaccessible for approximately an hour from 00:30 to 01:30 UTC on 2024-05-29. The issue seems to be caused by some failure of Cloudflare's "Load Balancing" product which is used by doi.org to steer global traffic to appropriate backend servers. We have worked around this issue in order to restore doi.org resolution services, but were not immediately able to restore full geo-steering functionality or determine why the failure happened. We will add information as it becomes available. By roughly 03:30 UTC we restored geo-steering by routing through AWS's "Global Accelerator" product. We are still working with Cloudflare to determine the source of the issue. As of 2024-05-31, Cloudflare has escalated thiis internally, but has still not fixed the issue or provided more information. We are evaluating AWS Global Accelerator as a permanent replacement to Cloudflare Load Balancing.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/17495382</id> <published>2023-06-07T00:00:00Z</published> <updated>2023-06-07T00:31:08Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/6t1brzsdvfv1"/> <title>doi.org outage due to Cloudflare HTTPS configuration issues</title> <content type="html">Jun <var data-var='date'> 7</var>, <var data-var='time'>00:00</var> UTC Resolved - Shortly after 2023-06-07 0:00Z, doi.org became inaccessible due to HTTPS issues. This was eventually tracked down to Cloudflare configuration, but we do not yet have an explanation for how this suddenly changed. We are working with Cloudflare to analyze the issue.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/11034296</id> <published>2022-09-01T09:00:00Z</published> <updated>2022-09-01T16:10:53Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/t8n2r9rwpg6y"/> <title>Possible doi.org slowdowns related to heavy traffic</title> <content type="html">Sep <var data-var='date'> 1</var>, <var data-var='time'>09:00</var> UTC Resolved - From roughly 5:00 to 10:00 this morning EDT (UTC-04:00) there was unusually heavy traffic on doi.org servers. We believe the traffic was sufficient to cause slowdowns in ordinary DOI resolution. We are investigating the cause of the traffic and in possible mitigations to prevent similar problems in the future.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/10371295</id> <published>2022-06-21T06:30:00Z</published> <updated>2022-06-21T16:03:43Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/z18sfpz1syg8"/> <title>doi.org outage due to widespread Cloudflare outage</title> <content type="html">Jun <var data-var='date'>21</var>, <var data-var='time'>06:30</var> UTC Resolved - An outage at Cloudflare made doi.org (and many many other sites) unusable for some 30-60 minutes starting around 06:30 UTC. Cloudflare's discussion of the outage is here: https://blog.cloudflare.com/cloudflare-outage-on-june-21-2022/ Cloudflare outages are notably difficult to deal with. We have a project related to bypassing Cloudflare, but any method to temporarily bypass Cloudflare requires use of Cloudflare services that are often (but not always) down as part of the outage. Luckily, Cloudflare outages (which often seem to affect "half the internet") tend to be resolved quickly.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/9395350</id> <published>2022-02-25T05:00:30Z</published> <updated>2022-02-25T05:00:30Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/jjfv7lh20fp2"/> <title>DOI proxy service maintenance</title> <content type="html">Feb <var data-var='date'>25</var>, <var data-var='time'>05:00</var> UTC Completed - The scheduled maintenance has been completed.Feb <var data-var='date'>25</var>, <var data-var='time'>04:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Feb <var data-var='date'>24</var>, <var data-var='time'>04:53</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/4644483</id> <published>2020-07-17T22:20:09Z</published> <updated>2020-07-17T22:20:09Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/c2v8d18l22ys"/> <title>doi.org proxy and website outage</title> <content type="html">Jul <var data-var='date'>17</var>, <var data-var='time'>22:20</var> UTC Resolved - The DOI Proxy service and the DOI website have not been available to users from multiple geographical regions, roughly between 17:20 to 17:40 EDT. The issue seems to be resolved now. Post-mortem: The DNS resolution of doi.org, which is provided by Cloudflare, has been determined to be the cause. This was a Cloudflare issue that apparently affected a large number of sites (including for example Discord, Patreon, npmjs, DigitalOcean, Coinbase, Zendesk, Medium, GitLab, Fiverr, Upwork, Udemy according to a post on ycombinator). It seems like this was a Cloudflare issue, although some commentators have suggested something more widespread. We anticipate a thorough post-mortem from Cloudflare. We determined the outage time based on both Nagios service that CNRI internally runs as well as the externally-run Pingdom service that we use to monitor the DOI services.Jul <var data-var='date'>17</var>, <var data-var='time'>21:49</var> UTC Monitoring - We can confirm the issue has been caused by Cloudflare infrastructure. Things seem to have been resolved. We will monitor for a few more minutes before confirming resolution on the issue.Jul <var data-var='date'>17</var>, <var data-var='time'>21:36</var> UTC Investigating - We noticed doi.org website and proxy services are currently not available for users from multiple geographical regions, possibly due to issues on the Cloudflare side. We are currently investigating.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/3165367</id> <published>2019-10-31T21:00:38Z</published> <updated>2019-10-31T21:00:39Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/460k499n2chn"/> <title>DOI proxy service notification</title> <content type="html">Oct <var data-var='date'>31</var>, <var data-var='time'>21:00</var> UTC Completed - The scheduled maintenance has been completed.Oct <var data-var='date'>31</var>, <var data-var='time'>17:01</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Oct <var data-var='date'>31</var>, <var data-var='time'>15:07</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to change the behavior for non-DOI resolutions to monitor but not prevent them. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/3131127</id> <published>2019-10-22T22:30:32Z</published> <updated>2019-10-22T22:30:32Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/x3zk7bb7n5ms"/> <title>DOI proxy service notification</title> <content type="html">Oct <var data-var='date'>22</var>, <var data-var='time'>22:30</var> UTC Completed - The scheduled maintenance has been completed.Oct <var data-var='date'>22</var>, <var data-var='time'>14:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Oct <var data-var='date'>22</var>, <var data-var='time'>14:21</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users, and to make the proxy more responsive to copy-and-pasted DOIs which sometime end up with strange characters needing to be trimmed. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/3102803</id> <published>2019-10-15T22:30:30Z</published> <updated>2019-10-15T22:30:31Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/x5k2ygpc1140"/> <title>DOI proxy service notification</title> <content type="html">Oct <var data-var='date'>15</var>, <var data-var='time'>22:30</var> UTC Completed - The scheduled maintenance has been completed.Oct <var data-var='date'>15</var>, <var data-var='time'>10:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Oct <var data-var='date'>14</var>, <var data-var='time'>22:03</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users, and to change the behavior for non-DOI resolutions. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/3028246</id> <published>2019-09-24T22:30:30Z</published> <updated>2019-09-24T22:30:30Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/ycc0lvh0rrds"/> <title>DOI proxy service notification</title> <content type="html">Sep <var data-var='date'>24</var>, <var data-var='time'>22:30</var> UTC Completed - The scheduled maintenance has been completed.Sep <var data-var='date'>24</var>, <var data-var='time'>14:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'>23</var>, <var data-var='time'>18:56</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users, and to improve monitoring. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/3003389</id> <published>2019-09-17T22:30:35Z</published> <updated>2019-09-17T22:30:35Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/9yjqtprhj3j3"/> <title>DOI proxy service notification</title> <content type="html">Sep <var data-var='date'>17</var>, <var data-var='time'>22:30</var> UTC Completed - The scheduled maintenance has been completed.Sep <var data-var='date'>17</var>, <var data-var='time'>14:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'>16</var>, <var data-var='time'>16:10</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2980425</id> <published>2019-09-10T10:30:30Z</published> <updated>2019-09-10T10:30:30Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/sfn8vgd571nr"/> <title>DOI proxy service notification</title> <content type="html">Sep <var data-var='date'>10</var>, <var data-var='time'>10:30</var> UTC Completed - The scheduled maintenance has been completed.Sep <var data-var='date'>10</var>, <var data-var='time'>02:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'> 9</var>, <var data-var='time'>18:04</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to remove some excessive logging related to http-to-https redirection. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2953331</id> <published>2019-09-03T23:00:31Z</published> <updated>2019-09-03T23:00:31Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/1fwt4sqbw46f"/> <title>DOI proxy service notification</title> <content type="html">Sep <var data-var='date'> 3</var>, <var data-var='time'>23:00</var> UTC Completed - The scheduled maintenance has been completed.Sep <var data-var='date'> 3</var>, <var data-var='time'>15:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'> 3</var>, <var data-var='time'>13:48</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2918114</id> <published>2019-08-27T22:30:33Z</published> <updated>2019-08-27T22:30:33Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/m5fckc5jmmym"/> <title>DOI proxy service notification</title> <content type="html">Aug <var data-var='date'>27</var>, <var data-var='time'>22:30</var> UTC Completed - The scheduled maintenance has been completed.Aug <var data-var='date'>27</var>, <var data-var='time'>14:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Aug <var data-var='date'>26</var>, <var data-var='time'>14:46</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2856375</id> <published>2019-08-13T22:32:22Z</published> <updated>2019-08-13T22:32:22Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/m2l0dzsmcx9h"/> <title>DOI proxy service notification</title> <content type="html">Aug <var data-var='date'>13</var>, <var data-var='time'>22:32</var> UTC Completed - The scheduled maintenance has been completed.Aug <var data-var='date'>13</var>, <var data-var='time'>14:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Aug <var data-var='date'>13</var>, <var data-var='time'>13:04</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a (larger) subset of users. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2822610</id> <published>2019-08-06T22:30:05Z</published> <updated>2019-08-06T22:30:05Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/ljr0bjw65ky8"/> <title>DOI proxy service notification</title> <content type="html">Aug <var data-var='date'> 6</var>, <var data-var='time'>22:30</var> UTC Completed - The scheduled maintenance has been completed.Aug <var data-var='date'> 6</var>, <var data-var='time'>14:30</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Aug <var data-var='date'> 6</var>, <var data-var='time'>13:51</var> UTC Scheduled - We will be performing backend maintenance on the doi.org system to enable http-to-https redirection for a subset of users. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2722239</id> <published>2019-07-23T21:00:45Z</published> <updated>2019-07-23T21:00:45Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/pv2t8qhj3yg8"/> <title>DOI proxy service notification</title> <content type="html">Jul <var data-var='date'>23</var>, <var data-var='time'>21:00</var> UTC Completed - The scheduled maintenance has been completed.Jul <var data-var='date'>23</var>, <var data-var='time'>13:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jul <var data-var='date'>17</var>, <var data-var='time'>15:31</var> UTC Scheduled - Some backend improvements will be made to the DOI Resolution Service infrastructure specifically to better deal with certain request spikes. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2610968</id> <published>2019-07-02T18:53:34Z</published> <updated>2019-07-02T18:53:34Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/k45bryy14t7w"/> <title>DOI proxy service notification</title> <content type="html">Jul <var data-var='date'> 2</var>, <var data-var='time'>18:53</var> UTC Completed - The scheduled maintenance has been completed.Jul <var data-var='date'> 2</var>, <var data-var='time'>12:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jun <var data-var='date'>26</var>, <var data-var='time'>15:16</var> UTC Scheduled - Some backend improvements will be made to the DOI Resolution Service infrastructure specifically to better deal with certain request spikes. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2642921</id> <published>2019-07-02T13:50:41Z</published> <updated>2019-07-02T15:17:46Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/htxch31wgrzn"/> <title>DOI proxy service notification</title> <content type="html">Jul <var data-var='date'> 2</var>, <var data-var='time'>13:50</var> UTC Resolved - DOI proxy service was unavailable for a few minutes due to a Cloudflare[1] issue. DOI services were impacted between 13:50 (UTC) and 14:07. This is unrelated to today's planned maintenance as no change had yet been made. [1] https://www.cloudflarestatus.com/incidents/tx4pgxs6zxdr</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2604934</id> <published>2019-06-24T10:41:30Z</published> <updated>2019-06-25T15:31:20Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/1zq9rtlgnwsr"/> <title>DOI proxy service notification</title> <content type="html">Jun <var data-var='date'>24</var>, <var data-var='time'>10:41</var> UTC Resolved - DOI proxy service was unavailable for a few hours due to a “widespread BGP routing leak” today which affected especially Cloudflare [1] and many other internet services. DOI services were impacted between 10:41 (UTC) and 11:00, with further partial failures until 11:24, followed by another brief failure for a few minutes at 11:55. It is possible there were other intermittent failures for users that are not reflected at the monitors; Cloudflare did not mark their incident as resolved until 13:02. [1] https://www.cloudflarestatus.com/incidents/46z55mdhg0t5</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2261269</id> <published>2019-03-15T21:12:36Z</published> <updated>2019-03-15T21:12:36Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/0pjpxrkl674h"/> <title>DOI proxy service notification</title> <content type="html">Mar <var data-var='date'>15</var>, <var data-var='time'>21:12</var> UTC Completed - The scheduled maintenance has been completed.Mar <var data-var='date'>15</var>, <var data-var='time'>13:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'>14</var>, <var data-var='time'>21:41</var> UTC Scheduled - Some backend improvements will be made to the DOI Resolution Service infrastructure. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2190452</id> <published>2019-02-05T21:18:52Z</published> <updated>2019-02-05T21:18:52Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/098qhfkfp5t6"/> <title>DOI proxy service notification</title> <content type="html">Feb <var data-var='date'> 5</var>, <var data-var='time'>21:18</var> UTC Completed - The scheduled maintenance has been completed.Feb <var data-var='date'> 5</var>, <var data-var='time'>13:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Feb <var data-var='date'> 4</var>, <var data-var='time'>21:34</var> UTC Scheduled - Some backend improvements will be made to the DOI Resolution Service infrastructure. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2165079</id> <published>2019-01-29T20:47:46Z</published> <updated>2019-01-29T20:47:46Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/qp1nkd68z6hx"/> <title>DOI proxy service maintenance</title> <content type="html">Jan <var data-var='date'>29</var>, <var data-var='time'>20:47</var> UTC Completed - The scheduled maintenance has been completed.Jan <var data-var='date'>29</var>, <var data-var='time'>13:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jan <var data-var='date'>23</var>, <var data-var='time'>19:17</var> UTC Scheduled - Some backend improvements will be made to the DOI Resolution Service infrastructure. We anticipate no service interruptions during this maintenance period.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/2117476</id> <published>2018-12-22T04:33:00Z</published> <updated>2018-12-27T03:03:20Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/z36mp8l2wy42"/> <title>DOI proxy service notification</title> <content type="html">Dec <var data-var='date'>22</var>, <var data-var='time'>04:33</var> UTC Resolved - One of the proxy servers was down for 2 minutes on December 22, 2018 between 04:13 - 04:14 UTC and 04:32 - 04:33 UTC. This had minimal to no effect on the service availability. Statuspage incorrectly reported Major Outage in spite of the services being operational. We have manually corrected the Statuspage reporting error.</content> </entry> <entry> <id>tag:doi.statuspage.io,2005:Incident/1796591</id> <published>2018-07-02T21:04:55Z</published> <updated>2018-07-02T21:08:11Z</updated> <link rel="alternate" type="text/html" href="https://doi.statuspage.io/incidents/qkykn9blwbq6"/> <title>DOI proxy service notification</title> <content type="html">Jul <var data-var='date'> 2</var>, <var data-var='time'>21:04</var> UTC Resolved - We are in the process of transitioning to a more robust DOI proxy service infrastructure. That robust infrastructure includes an extended set of proxy servers and geo-load balancing capabilities. During this transition process, we have seen minor to moderate service interruptions. On one end, customers from Asia and Latin America may not have been able to connect to the service occasionally, although we have resolved that issue now. On the other end, for approximately 30 minutes between the time period 19:30 and 20:00 UTC some clients connecting using the HTTPS endpoint saw service interruptions. This issue has also been fixed now. We apologize for any inconvenience. We are still in the middle of the transition process, and we will continue to monitor the service availability. We will report back when we have completed the move.Jul <var data-var='date'> 2</var>, <var data-var='time'>06:52</var> UTC Monitoring - Asian and Latin American customers might be experiencing brief network issues when using the DOI proxy service. We are currently trying to resolve the underlying issue. We will post an update as soon as the issue is resolved. Customers from other regions should not see any service issues.</content> </entry> </feed>

CINXE.COM

The DOI Foundation Status - Incident History