OS X build delays for public and private builds

Incident Report for Travis CI

Resolved

At this time we've caught up on the backlog of OSX builds for both public and private repositories. If you see any OS X builds that are not running, please email support@travis-ci.com. Thank you for your patience while we worked to resolve this incident.
Posted Sep 03, 2015 - 22:45 UTC

Monitoring

We are slowly resuming OSX builds and monitoring things. We'll be monitoring closely as we work through the backlog we've accumulated. We'll provide another update in 60 minutes.
Posted Sep 03, 2015 - 21:45 UTC

Update

We are working to finalize the cleanup and will provide another update in 30 minutes or sooner if the cleanup is finished before then. Thank you for your patience.
Posted Sep 03, 2015 - 21:14 UTC

Identified

We've identified a configuration issue that allowed our VM creation to go over our actual OSX VM capacity, which was causing a "pile up" of created VMs that were unable to boot due to a lack of available resources. We are currently running an aggressive cleanup process and hope to resume builds soon. We'll provide another update 30 minutes or sooner if the cleanup is finished by then. Thanks for your patience.
Posted Sep 03, 2015 - 20:44 UTC

Investigating

We are investigating an issue with new build VM creation in our OSX infrastructure and so we are temporarily pausing all OS X builds as part of troubleshooting. This will result in some temporary build delays for both public and private builds. We'll provide another update in 60 minutes or when we know more.
Posted Sep 03, 2015 - 20:35 UTC