Operational System Status

February 2017

DEV@cloud Nexus cache HTTPS certificate issue
We rolled back the certificate. Everything is fine now.
Feb 10, 10:20-10:25 UTC

January 2017

DEV@cloud upgrade 2.32.2.3
The DEV@cloud upgrade to 2.32.2.3 is now complete. Please raise a support request if you are experiencing any issues accessing your DEV@cloud instance.
Jan 29, 22:38 - Jan 30, 05:41 UTC
jenkins.io DNS issues
All DNS servers are now consistent. You may need to restart services to make them pick up the correct records.
Jan 27, 23:40 - Jan 29, 03:21 UTC
DEV@cloud build queue
Everything is back up and running.
Jan 12, 08:33-12:07 UTC

December 2016

No incidents reported for this month.

November 2016

DEV@Cloud instances offline
This incident has been resolved.
Nov 25, 13:44-21:24 UTC
Security vulnerability impacting DEV@cloud
This incident has been resolved.
Nov 11, 16:51 - Nov 12, 16:52 UTC
Git over SSH not working
This incident has been resolved.
Nov 8, 20:39-23:48 UTC
[Scheduled] DEV@cloud scheduled maintenance - Upgrade to Jenkins 2.7.4
The scheduled maintenance has been completed.
Nov 7, 00:00-06:01 UTC

October 2016

Dev@Cloud builds
The builds are no longer stalled. System is fully operational now.
Oct 25, 16:05 - Oct 26, 01:21 UTC

September 2016

Git over HTTPs offline
Services have been restored.
Sep 27, 16:27-22:12 UTC
Git over HTTPS
Forge repositories are available over HTTPS again.
Sep 13, 21:01 - Sep 14, 00:21 UTC

August 2016

Forge/ssh errors
We have resolved the underlying issue and git-over-ssh checkouts are occuring again.
Aug 3, 13:45-14:19 UTC

July 2016

Some hosted sonar instances offline
All impacted sonar instances have been brought back online.
Jul 28, 14:44-16:21 UTC
Nexus repos offline for inftrastructure upgrade
We've completed the upgrade and services are back to normal.
Jul 21, 00:12-00:20 UTC
AWS Increased API errors
Services have returned to normal.
Jul 19, 18:29-20:38 UTC
Temporary interruption of builds
There was an interruption in the build service from 7am - 7:45am UTC (8th July 2016). DEV@cloud Jenkins instances were not able to start new builds due to a failure in the build broker during a scheduled restart. The problem with the broker has been resolved and all builds are now proceeding as normal. We are adding additional monitoring detect this failure mode in future.
Jul 8, 07:59 UTC
NPM resources unable to be downloaded
NPMJS have rolled out a fix for the issue. The registry is now operating correctly.
Jul 6, 12:00-18:11 UTC
[Scheduled] DEV@cloud maintenance restart
The scheduled maintenance has been completed.
Jul 5, 00:00-08:00 UTC
Maven repos may have brief periods of instability
All done with the migration.
Jul 2, 20:35-21:21 UTC

June 2016

[Scheduled] DEV@cloud maintenance restart
The scheduled maintenance has been completed.
Jun 20, 00:00-08:00 UTC
repo.cloudbees.com 503 errors
Our Nexus server (which you might know as repo.cloudbees.com) failed catastrophically due to rapid consumption of disk space. This had not been experienced before, and so took a little while to recover from. The outage occurred on 2016-06-16 from 0830 to 1035 (UTC) We are adding additional monitoring to detect this state in the future, and will be further investigating the root cause of the rapid disk usage.
Jun 16, 10:35 UTC

May 2016

repo.cloudbees.com 503 / 404 errors
Service is now restored (filesystem corruption that needed to be repaired)
May 27, 04:30-05:34 UTC
[Scheduled] DEV@cloud maintenance
The scheduled maintenance has been completed.
May 9, 00:25 - May 10, 08:00 UTC

April 2016

Authentication issues
Services have been restored and are working properly again.
Apr 19, 14:23-14:48 UTC
[Scheduled] Maintenance release of DEV@cloud
The scheduled maintenance has been completed.
Apr 11, 00:00-03:00 UTC

March 2016

[Scheduled] Upgrade of DEV@cloud to 1.642.2
The scheduled maintenance has been completed.
Mar 21, 00:00-04:00 UTC
DEV@cloud builds not scheduling
All builds are proceeding as normal.
Mar 15, 22:41 - Mar 16, 01:54 UTC

February 2016

[Scheduled] Maintenance release of DEV@cloud
The scheduled maintenance has been completed.
Feb 25, 00:00-02:06 UTC
DEV@cloud builds not scheduling
This incident has been resolved.
Feb 23, 03:58-11:00 UTC

January 2016

No incidents reported for this month.