Delays in travis-ci.org job state updates and notifications

Incident Report for Travis CI

Resolved

Job state updates and notifications are back to normal.
Posted Nov 11, 2016 - 09:46 UTC

Monitoring

At this time we've caught up with the backlog of job state updates and cancellations. We're continuing to investigate what caused the initial spike. If you're still seeing delays, please email support@travis-ci.com
Posted Nov 11, 2016 - 01:31 UTC

Identified

Due to a spike of messages in an internal queue, part of a backend service was hitting memory limits. We've increased the resources available to this service and we're working to catch up on the backlog from this.
Posted Nov 11, 2016 - 01:25 UTC

Investigating

We're seeing errors in part of the backend service which does job state updates and we're investigating.
Posted Nov 11, 2016 - 01:18 UTC