We're continuing to process the remaining backlog and all things are looking stable. Thank you for your patience during this lengthy incident. We'll be preparing a public post-mortem that we should publish soon.
Posted Jan 20, 2016 - 04:21 UTC
Monitoring
The backlog is going down steadily and we're monitoring things closely for stability and errors.
Posted Jan 20, 2016 - 03:03 UTC
Update
Our infrastructure provider has pushed a fix for the underlying issue and it's working as expected. We're running at full capacity again and are working through the backlog. We'll provider another update once the backlog is cleared.
Posted Jan 20, 2016 - 02:20 UTC
Update
We're slowly working through the backlog, we've caught up on ~ 600 jobs in the last two hours. We continue to work our infrastructure provider on the fixes needed to let us resume full capacity.
Posted Jan 20, 2016 - 01:34 UTC
Update
We are beginning to run builds at a reduced capacity while we continue to work our infrastructure provider on the fixes needed to let us resume full capacity.
Posted Jan 20, 2016 - 00:01 UTC
Update
Unfortunately we've discovered an issue which is preventing us from working through the backlog yet. We're working closely with our infrastructure provider to get this resolved as quickly as possibe.
Posted Jan 19, 2016 - 23:23 UTC
Update
Due to a series of issues which resulting in some cascading backlogs, which required a few rounds of multiple clean-up, this issue took a while to get to where we can start working on the backlog. We're starting to ramp up capacity and will provide another update in 60 minutes.
Posted Jan 19, 2016 - 21:52 UTC
Update
We are continuing to work with our infrastructure provider to stabilize things, we'll provide another update in 60 minutes, or sooner if things change. Thanks for your patience.
Posted Jan 19, 2016 - 21:00 UTC
Update
We're continuing to work with our infrastructure provider to stabilize things, we'll provide another update in 60 minutes, or sooner if things change. Thanks for your patience.
Posted Jan 19, 2016 - 20:10 UTC
Update
We're continuing to work with our infrastructure provider to stabilize things, we'll provide another update in 60 minutes, or sooner if things change. Thank you for your patience.
Posted Jan 19, 2016 - 19:08 UTC
Update
We're continuing to work with our infrastructure provider to stabilize things, we'll provide another update in 60 minutes, or sooner if things change.
Posted Jan 19, 2016 - 17:59 UTC
Update
We're continuing to work with our infrastructure provider to stabilize things, so we can begin catching up on the backlog
Posted Jan 19, 2016 - 17:11 UTC
Identified
We've identified some misbehaving build hosts that are causing Build delays for Precise (Legacy) builds on travis-ci.com and are working with the infrastructure provider to get them back on track.