CINXE.COM
Codecov Status - Incident History
<?xml version="1.0" encoding="UTF-8"?> <feed xml:lang="en-US" xmlns="http://www.w3.org/2005/Atom"> <id>tag:status.codecov.com,2005:/history</id> <link rel="alternate" type="text/html" href="https://status.codecov.com"/> <link rel="self" type="application/atom+xml" href="https://status.codecov.com/history.atom"/> <title>Codecov Status - Incident History</title> <updated>2025-03-29T10:02:56Z</updated> <author> <name>Codecov</name> </author> <entry> <id>tag:status.codecov.com,2005:Incident/24316654</id> <published>2025-03-12T17:51:17Z</published> <updated>2025-03-12T17:51:18Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/lks0s63jvz3d"/> <title>System Degraded</title> <content type="html"><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>17:51</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>17:28</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/24294699</id> <published>2025-03-10T22:11:19Z</published> <updated>2025-03-10T22:11:21Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/0xwghldv8hm0"/> <title>Slower processing</title> <content type="html"><p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>22:11</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>19:37</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/24167584</id> <published>2025-02-27T03:14:08Z</published> <updated>2025-02-27T03:14:08Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/ghsntx1zrc6j"/> <title>Slack Notification issues</title> <content type="html"><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>03:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>17:51</var> UTC</small><br><strong>Investigating</strong> - We are currently experiencing issues with sending notifications to Slack due to an ongoing incident: https://slack-status.com/2025-02/1b757d1d0f444c34</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23912622</id> <published>2025-02-14T03:27:56Z</published> <updated>2025-02-14T03:27:56Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/4jpzsp52f1dv"/> <title>DB Maintenance</title> <content type="html"><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>03:27</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>18:54</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23749329</id> <published>2025-02-04T03:24:31Z</published> <updated>2025-02-04T03:24:31Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/fdh5qlhxw96k"/> <title>DB Maintenance</title> <content type="html"><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>03:24</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'> 4</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>18:38</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23820726</id> <published>2025-02-03T18:35:12Z</published> <updated>2025-02-03T18:35:14Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/28qv34t55cgd"/> <title>Degraded Performance</title> <content type="html"><p><small>Feb <var data-var='date'> 3</var>, <var data-var='time'>18:35</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'> 3</var>, <var data-var='time'>16:03</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23749954</id> <published>2025-01-28T17:00:00Z</published> <updated>2025-01-30T19:42:51Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/4b7mmn98vp7k"/> <title>Error processing uploads using the global upload token</title> <content type="html"><p><small>Jan <var data-var='date'>28</var>, <var data-var='time'>17:00</var> UTC</small><br><strong>Resolved</strong> - On 28 January from 12:00 to 30 January 13:00 EST<br /><br />There was a disruption to global upload token validation that resulted in the Codecov system accepting uploads but internally denying the upload. This resulted in failed upload processing for repositories configured to use the global upload token. We now have increased monitoring for this scenario and have put measures in place to prevent it altogether. The underlying issue has been resolved and global upload token uploads should again be working as expected.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23641468</id> <published>2025-01-22T01:04:35Z</published> <updated>2025-01-22T01:04:36Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/ng98pcttnfx8"/> <title>Db Maintenance</title> <content type="html"><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>01:04</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>01:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>16:51</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing DB maintenance. Uploads may be delayed to process, and downloading raw uploads from codecov.io may be disrupted.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23583551</id> <published>2025-01-16T21:50:09Z</published> <updated>2025-01-16T21:50:09Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/v56m02gpbs6x"/> <title>Queue backup resulting in delayed reporting</title> <content type="html"><p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>21:50</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>19:20</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>18:58</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23566640</id> <published>2025-01-15T16:15:24Z</published> <updated>2025-01-16T03:49:45Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/800xntkwdsdv"/> <title>Degraded UI</title> <content type="html"><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>16:15</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>14:26</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23566144</id> <published>2025-01-15T14:03:19Z</published> <updated>2025-01-15T14:13:50Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/jkvpnt5tjqcz"/> <title>Unable to login to Codecov</title> <content type="html"><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>14:03</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>13:50</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>10:30</var> UTC</small><br><strong>Investigating</strong> - It looks like uploads are unaffected, user are not able to login to Codecov using any service at this time. We are investigating.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23498464</id> <published>2025-01-09T22:40:58Z</published> <updated>2025-01-09T22:40:58Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/rcsf6y1cpv5f"/> <title>Delayed notifications</title> <content type="html"><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>22:40</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>21:21</var> UTC</small><br><strong>Monitoring</strong> - Queue levels are approaching normal. Notification times should be back to normal as well.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>20:24</var> UTC</small><br><strong>Investigating</strong> - We are experiencing high volumes and are seeing some queue back ups resulting in longer than normal notification times.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23486049</id> <published>2025-01-09T00:00:12Z</published> <updated>2025-01-09T02:13:26Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/bmk4g2gdm7n0"/> <title>Intermittent CLI Verification Issues</title> <content type="html"><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>00:00</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>22:54</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>21:40</var> UTC</small><br><strong>Investigating</strong> - We are having a problem with CLI distribution related to our caching layer. The cache is now bypassed and the issue is being investigated.<br /><br />This will have resulted in unexpected CLI verification failures when downloading/verifying the Codecov CLI.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/23054971</id> <published>2024-12-03T22:37:44Z</published> <updated>2024-12-03T22:37:45Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/v48ygws9bpsw"/> <title>Delays with Report Processing</title> <content type="html"><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>22:37</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>19:03</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>18:18</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/22962595</id> <published>2024-12-03T18:18:06Z</published> <updated>2024-12-03T18:18:06Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/5zrgrqtfp51r"/> <title>Backend Maintenance</title> <content type="html"><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>18:18</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>18:17</var> UTC</small><br><strong>Update</strong> - We will be undergoing scheduled maintenance during this time.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>14:40</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/22977303</id> <published>2024-11-26T21:00:39Z</published> <updated>2024-11-26T21:00:39Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/stfpv6tjzsj8"/> <title>Delays with Report Processing</title> <content type="html"><p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>21:00</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>20:35</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'>26</var>, <var data-var='time'>18:44</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/22697338</id> <published>2024-10-29T04:18:12Z</published> <updated>2024-10-29T04:18:12Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/hbw5dyfn66g4"/> <title>Delays with Report Processing</title> <content type="html"><p><small>Oct <var data-var='date'>29</var>, <var data-var='time'>04:18</var> UTC</small><br><strong>Resolved</strong> - A large backlog of reports caused the system to lag behind processing. This has been remedied and the system is now fully operational.</p><p><small>Oct <var data-var='date'>29</var>, <var data-var='time'>01:41</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'>29</var>, <var data-var='time'>00:57</var> UTC</small><br><strong>Investigating</strong> - Report processing is delayed. We are currently investigating the issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/22444644</id> <published>2024-10-07T18:17:30Z</published> <updated>2024-10-07T18:17:30Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/lxdltr9vtsd5"/> <title>UI is not operational</title> <content type="html"><p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>18:17</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 7</var>, <var data-var='time'>18:14</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/22353514</id> <published>2024-10-03T03:00:02Z</published> <updated>2024-10-03T03:00:02Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/jsbbczpg1rwy"/> <title>DB Maintenance</title> <content type="html"><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>02:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>16:03</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/22206839</id> <published>2024-09-18T12:52:03Z</published> <updated>2024-09-18T12:52:45Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/45v73xh2j7f3"/> <title>Reports failing</title> <content type="html"><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>12:52</var> UTC</small><br><strong>Resolved</strong> - From ~8:30 UTC - ~12:00 UTC Codecov failed to process reports. These reports will need to be uploaded again.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/21772880</id> <published>2024-08-17T03:58:39Z</published> <updated>2024-08-17T03:58:39Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/1g1pznmcxr8t"/> <title>intermittent failures for uploads</title> <content type="html"><p><small>Aug <var data-var='date'>17</var>, <var data-var='time'>03:58</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/21419261</id> <published>2024-07-15T13:56:48Z</published> <updated>2024-07-15T13:56:48Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/nt2x8l2gf7th"/> <title>Uploads are failing</title> <content type="html"><p><small>Jul <var data-var='date'>15</var>, <var data-var='time'>13:56</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>15</var>, <var data-var='time'>13:46</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jul <var data-var='date'>15</var>, <var data-var='time'>13:45</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/21205974</id> <published>2024-06-28T03:00:02Z</published> <updated>2024-06-28T03:00:02Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/4348jtjqwrn2"/> <title>DB Maintenance</title> <content type="html"><p><small>Jun <var data-var='date'>28</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'>28</var>, <var data-var='time'>02:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>24</var>, <var data-var='time'>14:07</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/21086396</id> <published>2024-06-12T17:51:58Z</published> <updated>2024-06-12T17:52:00Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/k13v8fzbfrq7"/> <title>Unable to login or very slow</title> <content type="html"><p><small>Jun <var data-var='date'>12</var>, <var data-var='time'>17:51</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>12</var>, <var data-var='time'>15:36</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jun <var data-var='date'>12</var>, <var data-var='time'>14:25</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jun <var data-var='date'>12</var>, <var data-var='time'>14:04</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p></content> </entry> <entry> <id>tag:status.codecov.com,2005:Incident/20952024</id> <published>2024-05-31T19:12:02Z</published> <updated>2024-05-31T19:12:02Z</updated> <link rel="alternate" type="text/html" href="https://status.codecov.com/incidents/ptzbps6wk4zp"/> <title>DB Maintenance</title> <content type="html"><p><small>May <var data-var='date'>31</var>, <var data-var='time'>19:12</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>May <var data-var='date'>31</var>, <var data-var='time'>18:11</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>31</var>, <var data-var='time'>18:11</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time.</p></content> </entry> </feed>