Modern Treasury - Notice history

All systems operational

Platform/API - Operational

Ledgers API - Operational

Push to Warehouse - Operational

Marketing Website - Operational

Notice history

Apr 2023

Error in Payment Order Approvals
  • Resolved
    UTC
    Resolved

    We had an error this morning that impacted a subset of users. The result of this error was that payment orders could not be approved. This error was detected by our system and rolled back within 60 minutes of detection. You may notice duplicate audit record event from during the time of the incident. No payment orders were improperly processed as a result of this error.

  • Investigating
    UTC
    Investigating

    We are currently investigating an error where payment orders that need approval cannot be approved.

An automated up-time check has failed.
  • Resolved
    UTC
    Resolved

    The incident has been resolved.

  • Investigating
    UTC
    Investigating

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

Partner Issue: JPMC file transmission delays and increased API latency
  • Resolved
    UTC
    Resolved

    The issue has been resolved by JPMC.

  • Update
    UTC
    Update

    No change in status. JPMC is still experiencing delays for file transmissions and increased latency on the API for balances, transactions, and various payment initiation.

    Modern Treasury will continue to monitor and provide updates as we receive them.

  • Monitoring
    UTC
    Monitoring

    Host to host file transfers continue to be impacted (transactions & balances) along with API responses. Various payments are experiencing disruptions as well. Root cause is still unknown; JPMC is continuing to investigate.

    Modern Treasury will continue to monitor and provide updates as we receive them.

  • Identified
    UTC
    Identified

    JPMC is experiencing delays for files transmissions and increased latency for API responses. JPMC is aware of the issue and is working on a resolution.

    Internal Accounts at JPMC may experience delays in balances, transactions, payment statuses.

    Modern Treasury will continue to monitor the incident and provide updates as we receive them.

Mar 2023

An automated up-time check has failed. (False positive)
  • Resolved
    UTC
    Resolved

    The issue was caused by a disruption in a downstream provider, but this only affected our uptime check. No customer was impacted.

  • Investigating
    UTC
    Investigating

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

An automated up-time check has failed. (False Positive)
  • Resolved
    UTC
    Resolved

    The Modern Treasury website has recovered.

  • Investigating
    UTC
    Investigating

    The Modern Treasury website contact forms may be experiencing degraded performance. We are investigating.

An automated up-time check has failed. (False Positive)
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

  • Identified
    UTC
    Identified

    We've identified the problem. Our canary tests are affected, but no customers are impacted.

  • Investigating
    UTC
    Investigating

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

Partner Issue: Auth0
  • Resolved
    UTC
    Resolved

    The Modern Treasury web app login has recovered.

    For more details from Auth0 about this, see https://status.auth0.com/incidents/41gk3rcgm9vg

  • Monitoring
    UTC
    Monitoring

    Logging into Modern Treasury's web app via OAuth will take longer than usual, and may require a few tries. The payments and ledgers APIs are not affected. Existing payments are not affected.
    More information and updates will be available at https://status.auth0.com

High API Latencies
  • Resolved
    UTC
    Resolved

    The Modern Treasury API latency has recovered and all operations are normal.

    This incident was caused by resource contention in our shared database cluster that started at around 0100 PT. Our on-calls were paged within minutes, and began investigating the issue.

    Our API latencies began sporadically exceeding our internal SLOs at 0200 PT, and then were consistently above our SLOs at 0700 PT. Ultimately, the incident response team resolved the performance degradation through a combination of workload management and query optimizations. The API performance returned to SLO levels at around 0950 PT.

  • Monitoring
    UTC
    Monitoring

    The Modern Treasury API latency has recovered. We are currently monitoring.

  • Investigating
    UTC
    Investigating

    The Modern Treasury API may be experiencing degraded performance. We are investigating.

Feb 2023

An automated up-time check has failed. (False Positive)
  • Resolved
    UTC
    Resolved

    We just resolved the issue!

  • Investigating
    UTC
    Investigating

    The Modern Treasury application and API may be experiencing degraded performance. We are investigating.

An automated up-time check has failed. (Plaid Server Errors)
  • Resolved
    UTC
    Resolved

    Plaid has resolved the issue

  • Monitoring
    UTC
    Monitoring

    Plaid has implemented a fix and they are monitoring the issue.

  • Identified
    UTC
    Identified

    https://status.plaid.com/incidents/5hmjqm2h2nlp

    Plaid is experiencing API Errors. API calls against Modern Treasury using a Plaid integration will fail; everything else is operational.

Notice - Plaid Planned Maintenance
  • Resolved
    UTC
    Resolved

    https://status.plaid.com/incidents/kq147hcgkrgl

    Plaid is planning maintenance from 9:00pm to 1:00am PT from Tuesday, February 21st to February 22nd, 2023. During this time, API calls against Modern Treasury using a Plaid Integration may fail; everything else will continue to be operational.

An automated up-time check has failed. (Plaid scheduled maintenance)
  • Resolved
    UTC
    Resolved
  • Identified
    UTC
    Identified

    From 12:25 am PT to 12:38 am PT, Plaid was down for maintenance, causing API requests to Plaid to fail.

  • Investigating
    UTC
    Investigating

    Plaid API is down for maintenance.

Feb 2023 to Apr 2023

Next