GCE builds are stable. Everything is operating normally.
Posted Sep 01, 2016 - 12:00 UTC
Monitoring
At this time we've recovered from all the backlog this incident created and are processing things normally. We're still in the process of escalating with our infrastructure provider about the initial network issues.
Posted Sep 01, 2016 - 00:44 UTC
Identified
We've identified that a network interruption resulted in our GCE workers being unable to connect to external network resources. Network connectivity recovered for most of the workers and we've caught up on accrued backlog, but some are still unreachable and we're escalating this issue with our infrastructure provider.
Posted Sep 01, 2016 - 00:13 UTC
Investigating
We are currently seeing delays for private builds running on our sudo-enabled Precise and Trusty infrastructure. We are looking into it and will update this incident as soon as we know more. Thank you for your patience.