Modern Treasury - Notice history

All systems operational

Platform/API - Operational

Ledgers API - Operational

Push to Warehouse - Operational

Marketing Website - Operational

Notice history

Jul 2024

Partner Issue: Goldman Sachs API service degraded
  • Resolved
    UTC
    Resolved

    This incident has been resolved by our partner bank.

  • Monitoring
    UTC
    Monitoring

    We are seeing requests to Goldman Sachs' API succeeding again. We will continue to monitor to ensure new and previously impacted requests complete as expected.

  • Investigating
    UTC
    Investigating

    We are currently investigating an issue with Goldman Sachs' API. We will provide updates as we learn more.

Bulk Imports functionality undergoing maintenance
  • Resolved
    UTC
    Resolved

    Bulk Imports functionality maintenance is complete, this feature is now available.

  • Investigating
    UTC
    Investigating

    Bulk Imports functionality is currently undergoing maintenance, this feature is currently unavailable. The team is working to complete necessary work as quickly as possible to restore functionality.

Database Upgrades
  • Completed
    July 28, 2024 at 6:50 AMUTC
    Completed
    July 28, 2024 at 6:50 AMUTC

    maintenance completed

  • Update
    July 28, 2024 at 6:11 AMUTC
    Update
    July 28, 2024 at 6:11 AMUTC

    starting maintenance window

  • In progress
    July 28, 2024 at 6:11 AMUTC
    In progress
    July 28, 2024 at 6:11 AMUTC
    Maintenance is now in progress.
  • Planned
    July 28, 2024 at 6:00 AMUTC
    Planned
    July 28, 2024 at 6:00 AMUTC

    Modern Treasury is planning to perform database maintenance in cell us000 on Saturday, July 27th at 11:00PM PDT. During this time, access to the platform for customers in cell us000 will be inaccessible. All operations will resume immediately after the maintenance window.

Partner Issue: Possible Multi-Bank
  • Resolved
    UTC
    Resolved

    This incident has been resolved by our partner banks.

  • Monitoring
    UTC
    Monitoring

    Partner banks have started reporting resolution. MT will continue to monitor.

  • Investigating
    UTC
    Investigating

    Modern Treasury is currently investigating possible impact for partner banks regarding an ongoing CrowdStrike issue.
    Customers of impacted banks could experience payment processing and reporting delays. MT systems are not impacted. 

Scheduled Maintenance: Push to Warehouse
  • Completed
    July 17, 2024 at 2:00 AMUTC
    Completed
    July 17, 2024 at 2:00 AMUTC
    Maintenance has completed successfully
  • In progress
    July 17, 2024 at 12:00 AMUTC
    In progress
    July 17, 2024 at 12:00 AMUTC
    Maintenance is now in progress
  • Planned
    July 17, 2024 at 12:00 AMUTC
    Planned
    July 17, 2024 at 12:00 AMUTC

    A Push to Warehouse maintenance window will take place per our regular schedule next week, on Tuesday 7/16, from 5 to 7 PM PST.

    During this time, we plan to cease syncing the tables associated with our discontinued Compliance service. This includes:

    • user_onboardings

    • cases

    • decisions

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

Jun 2024

Role Based Access-Control: Backend Upgrade
  • Completed
    June 06, 2024 at 10:42 PMUTC
    Completed
    June 06, 2024 at 10:42 PMUTC
    Maintenance has completed successfully.
  • In progress
    June 06, 2024 at 10:00 PMUTC
    In progress
    June 06, 2024 at 10:00 PMUTC
    Maintenance is now in progress
  • Planned
    June 06, 2024 at 10:00 PMUTC
    Planned
    June 06, 2024 at 10:00 PMUTC

    On Thursday 6/6 at 3 PM PT, we are migrating to a new backend system for the Roles Based Access-Control system. We do not anticipate any downtime, we will be actively monitoring for any access issues. There are no UI changes at this time.

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

Push to Warehouse: Data Store Upgrade
  • Completed
    June 05, 2024 at 12:00 AMUTC
    Completed
    June 05, 2024 at 12:00 AMUTC
    Maintenance has completed successfully
  • In progress
    June 04, 2024 at 10:00 PMUTC
    In progress
    June 04, 2024 at 10:00 PMUTC
    Maintenance is now in progress
  • Planned
    June 04, 2024 at 10:00 PMUTC
    Planned
    June 04, 2024 at 10:00 PMUTC

    On Tuesday 6/4 at 3 PM PT, we plan to migrate to a new data store for customer Push to Warehouse data. We expect regularly-scheduled transfers to be paused for ~2 hours during this process. The migration will also require a re-sync of historical data for the following tables:

    • ledger_account_balances

    • ledger_account_settlements

    Please reach out to support@moderntreasury.com with any questions or concerns regarding the scope of this change.

May 2024

Partner Issue: Evolve Bank
  • Resolved
    UTC
    Resolved

    This issue has been resolved by our Partner. Please see their status page for further details.

  • Monitoring
    UTC
    Monitoring

    Monitoring partner updates: https://status.getevolved.com/

  • Identified
    UTC
    Identified

    Modern Treasury is actively monitoring a service disruption for one of our partners. Additional details can be located at https://status.getevolved.com/

    Impact: Missing or delayed transactions for Evolve Bank customers

Intermittent Connection Errors:API
  • Resolved
    UTC
    Resolved

    Modern Treasury has identified a network connectivity issue between two AWS regions is likely the cause of the errors a subset of customers experienced May 23rd. We’ve updated our systems to improve performance and reliability for our API services. We are seeing consistent and successful activity at this time.

  • Monitoring
    UTC
    Monitoring

    Currently monitoring as functionality appears stable.

  • Investigating
    UTC
    Investigating

    Modern Treasury is currently investigating reports of intermittent connection errors for a subset of API calls affecting US001

Scheduled Maintenance: Database Upgrades
  • Completed
    May 12, 2024 at 7:32 AMUTC
    Completed
    May 12, 2024 at 7:32 AMUTC

    Database maintenance is complete.

  • In progress
    May 12, 2024 at 6:01 AMUTC
    In progress
    May 12, 2024 at 6:01 AMUTC

    Database maintenance in cell us001 has begun. Expect intermittent API and web platform errors for the duration of the maintenance.

  • Planned
    May 12, 2024 at 6:00 AMUTC
    Planned
    May 12, 2024 at 6:00 AMUTC

    Modern Treasury is planning to perform database maintenance in cell us001 on Saturday, May 11th at 11:00PM PDT.

    During this time, access to the platform for customers in cell us001 will be inaccessible. All operations will resume immediately after the maintenance window.

Increased API Failures
  • Resolved
    UTC
    Resolved

    Between 18:11 and 18:37 we saw an increase in API error rates in us000. This mostly impacted operations related to ledgers listing. We have completed reverting the suspected database operation.

  • Monitoring
    UTC
    Monitoring

    We've identified a potential fix involving the rollback of a database optimization. Error levels are steadily decreasing and monitoring is ongoing.

  • Identified
    UTC
    Identified

    Only affecting customers in cell us000

  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.
Push to Warehouse: Transfers are not occurring as scheduled for some customers
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    All affected customers should have fresh data as of 8:30am PT. Regularly-scheduled Transfers have resumed and are succeeding. We are continuing to carefully monitor transfer health to validate the service is fully operational.

  • Identified
    UTC
    Identified

    We have identified the workload responsible for causing transfers to become stuck and deployed a fix to mitigate the issue. We have begun triggering catch-up transfers for affected warehouse destinations.

  • Investigating
    UTC
    Investigating

    The service responsible for conducting Push to Warehouse transfers is becoming stuck in some cases, delaying scheduled transfers. Customers may observe some data less fresh than usual.

May 2024 to Jul 2024

Next