Modern Treasury - Notice history

All systems operational

Platform/API - Operational

Ledgers API - Operational

Push to Warehouse - Operational

Marketing Website - Operational

Notice history

View current status

Oct 2022

Elevated Error Rates
ResolvedDegraded performance
  • ResolvedUTC

    This issue was resolved.

  • InvestigatingUTC

    We're experiencing an elevated level of API errors and are currently looking into the issue.

High API and application latencies
ResolvedPartial outage35 minutes
  • ResolvedUTC

    The issue is resolved and we've solved the underlying cause of the contention.

  • MonitoringUTC

    The issue is resolved and we've solved the underlying cause of the contention.

  • IdentifiedUTC

    We have identified the cause of the contention. Working to mitigate and ultimately resolve this issue.

  • InvestigatingUTC

    The Modern Treasury Ledger API may be experiencing degraded performance. We are investigating.

We are experiencing API and UI issues due to database contention.
ResolvedPartial outage17 minutes
  • ResolvedUTC

    We have addressed the underlying database contention and will follow-up with further improvements to the system to prevent reoccurrence.

  • IdentifiedUTC

    We have identified the issue inside our database.

  • InvestigatingUTC

    We are experiencing API and UI issues due to database contention.

Modern Treasury UI temporarily unavailable
ResolvedDegraded performance14 minutes
  • ResolvedUTC

    All services are operational and healthy.

  • IdentifiedUTC

    We had deployed a bad commit which fails to render UI. This downtime did not affect API calls.

Sep 2022

An automated up-time check has failed. (False positive)
Resolved35 minutes
  • ResolvedUTC

    This automated check has been resolved. No customer was impacted.

  • InvestigatingUTC

    We are in the process of changing the application and triggered a false positive alarm. No customer was impacted.

API outage due to load balancer misconfiguration
ResolvedMajor outage3 minutes
  • ResolvedUTC

    At 9:55 PM UTC, we recovered from 4 minutes outage due to load balancer misconfiguration. This incident has been resolved and services are now healthy to continue normal traffic.

  • InvestigatingUTC

    The Modern Treasury Ledger API may be experiencing degraded performance. We are investigating.

An automated up-time check has failed. (False Positive.)
Resolved1 minute
  • ResolvedUTC

    The issue is determined to be related to the service degradation of our integration with Plaid. For more details, please see Observability issues in Development and Sandbox with potential increased API errors rates.

    The Modern Treasury production application and API are NOT impacted by this.

  • InvestigatingUTC

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

Partner Issue: app.moderntreasury.com is experiencing login issues
ResolvedDegraded performance32 minutes
  • ResolvedUTC

    The authentication issue has been resolved by Auth0. Modern Treasury web application at app.moderntreasury.com is now fully functional.

  • MonitoringUTC

    `app.moderntreasury.com` is having authentication issues with Auth0. Some users may have trouble logging into the Modern Treasury web application. Our API, which does not depend on Auth0, remains 100% functional.

    For more information, please refer to the Auth0 status page: Elevated errors in Auth0.

Partial API and Application Outage
ResolvedMajor outage23 minutes
  • ResolvedUTC

    At around 9:22am PT on September 1, we were alerted about unexpected resource utilization across our system. For about 23 minutes, we experienced intermittent failures of API calls. Roughly 75% of incoming API calls failed.

  • InvestigatingUTC

    The Modern Treasury Ledger API may be experiencing degraded performance. We are investigating.

Aug 2022

High Application and API Latencies
ResolvedDegraded performance1 hour 41 minutes
  • ResolvedUTC

    We have resolved the underlying issue at the source of the latencies.

  • MonitoringUTC

    The high latencies have subsided. API performance is returning to normal. We are continuing to monitor.

  • InvestigatingUTC

    We are currently investigating this incident.

    The previous incidents were automatically generated from one of our monitoring tools. We apologize for the numerous emails. The check had entered a middling state where it passed and then failed several times as the latency of the responses changed.

Partial API and Application Outage
ResolvedMajor outage13 minutes
  • ResolvedUTC

    At around 10:13 PT on Aug 3, a faulty database upgrade caused downtime on our application and API. For approximately 13 minutes (until 10:26 PT), a large amount of calls against Modern Treasury’s platform failed.

  • MonitoringUTC

    We have implemented a fix and are monitoring our system for stability. More information will be provided as it becomes available.

  • InvestigatingUTC

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

Previous

Aug 2022 to Oct 2022

Next