Modern Treasury - Degraded Availability on APIs – Incident details

Experiencing partially degraded performance

Degraded Availability on APIs

Resolved
Major outage
Started over 2 years agoLasted 23 minutes

Affected

Platform/API

Major outage from 6:40 PM to 7:03 PM

Ledgers API

Major outage from 6:40 PM to 7:03 PM

Updates
  • Resolved
    Resolved

    At around 11:40 AM (PT) on July 25, a faulty change to our tracing and metrics caused extended downtime on our API. For about 23 minutes the Modern Treasury API was in a degraded state, with 100% unavailability for 13 minutes within that period. Going forward, we commit to improving our CI/CD processes to ensure that similar faults are caught earlier in our pipelines and prevented from deployment.

  • Investigating
    Investigating

    We are experiencing a high number of http status code 500s on many of the APIs. We've identified the issue and working on restoring service.