OS X Build Delays on .org

Incident Report for Travis CI

Resolved

We are sorry for the build delays this incident caused. At this time the backlog has been cleared. We will be reviewing our alerting to be detect this particular scenario in the future. Thanks for your patience while we resolved this issue.
Posted Sep 25, 2015 - 19:32 UTC

Monitoring

We determined that one of the workers, which provisions build VMs and executes the builds, did not recover gracefully from a network partition with our RabbitMQ server. This resulted a backlog of jobs. We've restarted the service and are now working through the backlog of public OS X builds. We'll provide an update when the backlog has been cleared.
Posted Sep 25, 2015 - 18:20 UTC

Identified

We have identified a situation where OS X builds are delayed due to a lack of our worker's capacity and we are working to resolve the issue.
Posted Sep 25, 2015 - 18:02 UTC