Things have remained stable and we've caught up on all the backlog. Thank you for your patience while we worked through this.
Posted Dec 05, 2015 - 01:38 UTC
Monitoring
We've been experiencing some intermittent connectivity issues between our Mac private cloud provider and our central message queue service, which was resulting in a higher than normal number of jobs to be re-queued and this was creating the additional backlog. The connectivity issues appear to be clearing up, we're monitoring things closely and doing a little cleanup but we anticipate things remaining stable now.
Posted Dec 04, 2015 - 23:45 UTC
Identified
We are experiencing an unusually high job backlog on the open-source OS X job execution infrastructure.
We're currently working with our infrastructure provider to expand our capacity, but have run into some additional capacity issues at the moment, which we are working on rectifying.