Resolved -
On June 17, 2025, between 19:32 UTC and 20:03 UTC, an internal routing policy deployment to a subset of network devices caused reachability issues for certain network address blocks within our datacenters.
Authenticated users of the github.com UI experienced 3-4% error rates for the duration. Authenticated callers of the API experienced 40% error rates. Unauthenticated requests to the UI and API experienced nearly 100% error rates for the duration. Actions service experienced 2.5% of runs being delayed for an average of 8 minutes and 3% of runs failing. Large File Storage (LFS) requests experienced 0.978% errors.
At 19:54 UTC, the deployment was rolled back, and network availability for the affected systems was restored. At 20:03 UTC, we fully restored normal operations.
To prevent similar issues, we are expanding our validation process for routing policy changes.
Jun 17, 20:22 UTC
Update -
Actions is operating normally.
Jun 17, 20:15 UTC
Update -
Codespaces is experiencing degraded performance. We are continuing to investigate.
Jun 17, 20:14 UTC
Update -
Webhooks is operating normally.
Jun 17, 20:13 UTC
Update -
Pull Requests is operating normally.
Jun 17, 20:12 UTC
Update -
API Requests is operating normally.
Jun 17, 20:10 UTC
Update -
Issues is operating normally.
Jun 17, 20:06 UTC
Update -
API Requests is experiencing degraded performance. We are continuing to investigate.
Jun 17, 20:05 UTC
Update -
We experienced problems with multiple services, causing disruptions for some users. We have identified the cause and are rolling out changes to restore normal service. Many services are recovering, but full recovery is ongoing.
Jun 17, 20:04 UTC
Update -
Copilot is operating normally.
Jun 17, 20:04 UTC
Update -
Pages is operating normally.
Jun 17, 20:03 UTC
Update -
Pull Requests is experiencing degraded performance. We are continuing to investigate.
Jun 17, 20:01 UTC
Update -
Pull Requests is experiencing degraded availability. We are continuing to investigate.
Jun 17, 19:55 UTC
Update -
Copilot is experiencing degraded performance. We are continuing to investigate.
Jun 17, 19:55 UTC
Update -
Actions is experiencing degraded performance. We are continuing to investigate.
Jun 17, 19:54 UTC
Update -
Webhooks is experiencing degraded performance. We are continuing to investigate.
Jun 17, 19:54 UTC
Update -
API Requests is experiencing degraded availability. We are continuing to investigate.
Jun 17, 19:53 UTC
Update -
We are investigating reports of issues with many services impacting segments of customers. We will continue to keep users updated on progress towards mitigation.
Jun 17, 19:53 UTC
Update -
API Requests is experiencing degraded performance. We are continuing to investigate.
Jun 17, 19:51 UTC
Update -
Pages is experiencing degraded performance. We are continuing to investigate.
Jun 17, 19:49 UTC
Update -
Copilot is experiencing degraded availability. We are continuing to investigate.
Jun 17, 19:49 UTC
Update -
Issues is experiencing degraded performance. We are continuing to investigate.
Jun 17, 19:47 UTC
Investigating -
We are investigating reports of degraded performance for Copilot
Jun 17, 19:42 UTC