Slow web page loads on some repositories

Incident Report for Travis CI

Resolved

All components are operating normally.
Posted May 12, 2015 - 01:28 UTC

Update

Database load is back to normal; Web and API are operational. We are still working through back logs.
Posted May 12, 2015 - 00:15 UTC

Update

We are tracking down the source of database load fluctuation before ending the maintenance.
Posted May 11, 2015 - 23:39 UTC

Update

We are extending the maintenance to clear the back logs.
Posted May 11, 2015 - 23:01 UTC

Update

We have put Web and API to emergency maintenance mode to expedite status update processing.
Posted May 11, 2015 - 22:25 UTC

Update

Database performance issues caused by a recent deployment are resulting in delayed build status updates. We are working through the status update back logs.
Posted May 11, 2015 - 22:17 UTC

Monitoring

We have identified a recent change that affected database performance. We have rolled it back, and are monitoring the system performance.
Posted May 11, 2015 - 22:06 UTC

Update

We have narrowed down the incident impact to API loading issues for some repositories
Posted May 11, 2015 - 22:01 UTC

Update

We are still investigating the reports of stalled Linux builds.
Posted May 11, 2015 - 21:46 UTC

Investigating

We are investigating reports of stalled Linux builds in both container based and fully virtualized Linux infrastructure.
Posted May 11, 2015 - 20:53 UTC