mastodon.social - Hetzner Connectivity Issues – Incident details

All systems operational

Hetzner Connectivity Issues

Resolved
Major outage
Started 1 day agoLasted 29 hours 18 minutes

Affected

Website & API

Major outage from 8:49 AM to 10:57 AM, Degraded performance from 10:57 AM to 3:07 PM, Operational from 3:07 PM to 2:07 PM

Background queues

Major outage from 8:49 AM to 10:57 AM, Degraded performance from 10:57 AM to 3:07 PM, Operational from 3:07 PM to 2:07 PM

Updates
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

  • Update
    UTC
    Update

    Performance has returned to normal. We will continue to keep an eye on the situation.

  • Monitoring
    UTC
    Monitoring

    Cluster connectivity is slowly returning, and all services are operation, though at reduced performance. We are continuing to monitor the situation.

  • Update
    UTC
    Update

    Hetzner is reporting vSwitch outages, which are likely the cause of our connectivity issues. We are monitoring and continuing to look for workarounds.

    https://status.hetzner.com/incident/288baeb9-5cb2-4e68-9074-b878dcd0d793

  • Investigating
    UTC
    Investigating

    We are experiencing connectivity issues with our servers within Hetzner. We are investigating the issue.