All Systems Operational

Updated a few seconds ago

Locations

Skillable Orchestrator

Operational

Skillable Studio

Operational

Skillable Lab Admin

Operational

Hyper-V Fabric

Operational

ESX Fabric

Operational

Skillable TMS

Operational

Skillable Insights

Operational

Skillable.com

Operational

Security Response

Operational

3rd Party Service

Operational

External Services

3

Upcoming Maintenances

4

Incidents Last 30 Days

1

Maintenances Last 30 Days

Scheduled Maintenance

Schedule

October 13, 2024 2:00AM - 7:00AM UTC

Components

Skillable Orchestrator

Locations

US West Datacenter, US East Datacenter, EU North Datacenter, APAC Southeast Datacenter

Description

Please note that Skillable will perform general maintenance on our datacenter infrastructure in all regions on 10/13/2024, from 2:00 AM UTC (10/12/2024 7:00 PM PT) to 7:00 AM UTC (10/13/2024 12:00 AM PT). During this time, lab users may experience short, transient connectivity issues while infrastructure fails over to secondary resources. No data for running instances should be affected. Within the same timeframe, we will also perform maintenance on our core infrastructure for Skillable Studio. During this time, connectivity to lab instances may be impacted, and new launches may fail. This should also have no effect on current running instances data.

Schedule

November 10, 2024 2:00AM - 7:00AM UTC

Components

Skillable Studio

Locations

Description

Please note that Skillable will perform general maintenance on our datacenter infrastructure in all regions on 11/10/2024, from 2:00 AM UTC (11/09/2024 7:00 PM PT) to 7:00 AM UTC (11/10/2024 12:00 AM PT). During this time, lab users may experience short, transient connectivity issues while infrastructure fails over to secondary resources. No data for running instances should be affected. Within the same timeframe, we will also perform maintenance on our core infrastructure for Skillable Studio. During this time, connectivity to lab instances may be impacted, and new launches may fail. This should also have no effect on current running instances data.

Schedule

December 15, 2024 2:00AM - 7:00AM UTC

Components

Skillable Orchestrator

Locations

US West Datacenter, US East Datacenter, EU North Datacenter, APAC Southeast Datacenter

Description

Please note that Skillable will perform general maintenance on our datacenter infrastructure in all regions on 12/15/2024, from 2:00 AM UTC (12/14/2024 7:00 PM PT) to 7:00 AM UTC (12/15/2024 12:00 AM PT). During this time, lab users may experience short, transient connectivity issues while infrastructure fails over to secondary resources. No data for running instances should be affected. Within the same timeframe, we will also perform maintenance on our core infrastructure for Skillable Studio. During this time, connectivity to lab instances may be impacted, and new launches may fail. This should also have no effect on current running instances data.

History (Last 7 days)

Incident Status

Degraded Functionality


Components

Hyper-V Fabric, ESX Fabric


Locations

US West Datacenter, US East Datacenter, EU North Datacenter, APAC Southeast Datacenter




October 1, 2024 5:18PM UTC
[Resolved] All functionality has been restored.

September 27, 2024 7:51PM UTC
[Monitoring] A fix was deployed to resolve this issue resulting in improved performance. Monitoring will continue, especially during high usage times, to ensure the fix is effective. An RCA (root cause analysis) report is currently being prepared and will be distributed shortly. Thank you for your patience.

September 24, 2024 7:51PM UTC
[Monitoring] Skillable engineering has discovered a legacy component of architecture causing slowness in allowing a lab taker into a lab. We have successfully tested a workaround which requires disabling the "waiting for heartbeat" setting on a VM profile. With this setting disabled, the lab taker receives their lab within the expected timeframe. Skillable engineering is currently working towards a root cause fix and will provide an update as soon as available. Thank you for your patience.

September 24, 2024 2:45PM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV and ESX. While we have seen an improvement of launch times, some users may still see above average launch times. Engineers continue to investigate, and we will provide another update in 8 hours or less.

September 24, 2024 11:54AM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV. Mitigation efforts are continuing to decrease lab launch time. This includes adding compute and network resources to rule out any resource constraints. While we have seen an improvement of launch times, some users may still see slightly above average launch times. Engineers continue to investigate, and we will provide another update in 8 hours or less.

September 24, 2024 4:04AM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV. Mitigation efforts are continuing to decrease lab launch time. This includes adding compute and network resources to rule out any resource constraints. While we have seen an improvement of launch times, some users may still see slightly above average launch times. Engineers continue to investigate, and we will provide another update in 8 hours or less.

September 23, 2024 8:01PM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV. Mitigation efforts are continuing to decrease lab launch time. This includes adding compute and network resources to rule out any resource constraints. While we have seen an improvement of launch times, some users may still see slightly above average launch times. Engineers continue to investigate, and we will provide another update in 8 hours or less.

September 22, 2024 11:41PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 24 hours.

September 21, 2024 11:55PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 24 hours.

September 21, 2024 12:18AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 24 hours.

September 20, 2024 4:29PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.

September 20, 2024 7:56AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.

September 19, 2024 11:56PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.

September 19, 2024 4:11PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.

September 19, 2024 11:58AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.

September 19, 2024 8:11AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.

September 19, 2024 4:10AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.

September 19, 2024 12:13AM UTC
[Investigating] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.

September 18, 2024 8:03PM UTC
[Investigating] Skillable engineers have identified a network related issue and have implemented changes to mitigate any negative customer impact. We continue to research root cause. Next update within 4 hours.

September 18, 2024 4:16PM UTC
[Investigating] Monitoring indicates lab startup duration is sometimes longer than expected. Skillable engineers remain actively engaged to resolve the slow startup duration.

September 17, 2024 6:32PM UTC
[Monitoring] Ongoing monitoring indicates that lab startup times are steadily returning to normal. Our staff continues to monitor while our engineers are actively investigating the root cause.

September 17, 2024 3:51PM UTC
[Investigating] All systems are functioning normally with slower than normal lab startup times. Skillable engineers are still working on further mitigation. We'll provide the next update when new information is available.

September 17, 2024 3:27PM UTC
[Investigating] We are currently experiencing an issue impacting running labs and new lab launches in all regions. Our team is actively investigating the cause and working to resolve it as quickly as possible.
Hurricane HeleneOperational

Incident Status

Operational


Components

Skillable Orchestrator, Skillable Studio, Skillable Lab Admin, Hyper-V Fabric, ESX Fabric, Skillable TMS, Skillable Insights, Skillable.com, Security Response, 3rd Party Service


Locations

US West Datacenter, US East Datacenter, EU North Datacenter, APAC Southeast Datacenter, AWS, Azure, Docker, GCP, Security Response




October 1, 2024 5:17PM UTC
[Resolved] We are back to normal operations.

September 25, 2024 9:08PM UTC
[Monitoring] Skillable is monitoring the path of Hurricane Helene and currently coordinating with our teams to take precautions in regards to our personnel and systems. As such, we will be operating with a reduced Platform Support team so that our team members in the proximity to the storm can take appropriate precautions. We expect maintaining normal ticket resolution times but want to caution our customers that there may be a slight disruption to service between 5 AM EDT on Thursday, September 26th through 8 PM EDT on Friday, September 27th. We appreciate your understanding and patience in this matter.