Delayed builds on sudo-enabled GCE infrastructure for private builds

Incident Report for Travis CI

Resolved

GCE builds are stable. Everything is operating normally.
Posted Sep 01, 2016 - 12:00 UTC

Monitoring

At this time we've recovered from all the backlog this incident created and are processing things normally. We're still in the process of escalating with our infrastructure provider about the initial network issues.
Posted Sep 01, 2016 - 00:44 UTC

Identified

We've identified that a network interruption resulted in our GCE workers being unable to connect to external network resources. Network connectivity recovered for most of the workers and we've caught up on accrued backlog, but some are still unreachable and we're escalating this issue with our infrastructure provider.
Posted Sep 01, 2016 - 00:13 UTC

Investigating

We are currently seeing delays for private builds running on our sudo-enabled Precise and Trusty infrastructure. We are looking into it and will update this incident as soon as we know more. Thank you for your patience.
Posted Aug 31, 2016 - 23:31 UTC