GitHub header

Disruption with some GitHub services

Incident Report for GitHub

Resolved

On March 21st, 2025, between 11:45 UTC and 13:20 UTC, users were unable to interact with GitHub Copilot Chat in GitHub. The issue was caused by a recently deployed Ruby change that unintentionally overwrote a global value. This led to GitHub Copilot Chat in GitHub being misconfigured with an invalid URL, preventing it from connecting to our chat server. Other Copilot clients were not affected.

We mitigated the incident by identifying the source of the problematic query and rolling back the deployment.

We are reviewing our deployment tooling to reduce the time to mitigate similar incidents in the future. In parallel, we are also improving our test coverage for this category of error to prevent them from being deployed to production.
Posted Mar 21, 2025 - 13:44 UTC

Update

Copilot is operating normally.
Posted Mar 21, 2025 - 13:44 UTC

Update

Mitigation is complete and we are seeing full recovery for GitHub Copilot Chat in GitHub.
Posted Mar 21, 2025 - 13:43 UTC

Update

We have identified the problem and have a mitigation in progress.
Posted Mar 21, 2025 - 13:16 UTC

Update

Copilot is experiencing degraded performance. We are continuing to investigate.
Posted Mar 21, 2025 - 13:00 UTC

Update

We are investigating issues with GitHub Copilot Chat in GitHub. We will continue to keep users updated on progress toward mitigation.
Posted Mar 21, 2025 - 12:42 UTC

Investigating

We are currently investigating this issue.
Posted Mar 21, 2025 - 12:40 UTC
This incident affected: Copilot.