Hyper-V Fabric, ESX Fabric
US West Datacenter, US East Datacenter, EU North Datacenter, APAC Southeast Datacenter
October 1, 2024 5:18PM UTC
[Resolved] All functionality has been restored.
September 27, 2024 7:51PM UTC
[Monitoring] A fix was deployed to resolve this issue resulting in improved performance. Monitoring will continue, especially during high usage times, to ensure the fix is effective. An RCA (root cause analysis) report is currently being prepared and will be distributed shortly. Thank you for your patience.
September 24, 2024 7:51PM UTC
[Monitoring] Skillable engineering has discovered a legacy component of architecture causing slowness in allowing a lab taker into a lab. We have successfully tested a workaround which requires disabling the "waiting for heartbeat" setting on a VM profile. With this setting disabled, the lab taker receives their lab within the expected timeframe. Skillable engineering is currently working towards a root cause fix and will provide an update as soon as available. Thank you for your patience.
September 24, 2024 2:45PM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV and ESX. While we have seen an improvement of launch times, some users may still see above average launch times. Engineers continue to investigate, and we will provide another update in 8 hours or less.
September 24, 2024 11:54AM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV.
Mitigation efforts are continuing to decrease lab launch time. This includes adding compute and network resources to rule out any resource constraints. While we have seen an improvement of launch times, some users may still see slightly above average launch times.
Engineers continue to investigate, and we will provide another update in 8 hours or less.
September 24, 2024 4:04AM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV.
Mitigation efforts are continuing to decrease lab launch time. This includes adding compute and network resources to rule out any resource constraints. While we have seen an improvement of launch times, some users may still see slightly above average launch times.
Engineers continue to investigate, and we will provide another update in 8 hours or less.
September 23, 2024 8:01PM UTC
[Identified] The Skillable team has been working around the clock to investigate the root cause behind the longer lab launch time for labs launched through HyperV.
Mitigation efforts are continuing to decrease lab launch time. This includes adding compute and network resources to rule out any resource constraints. While we have seen an improvement of launch times, some users may still see slightly above average launch times.
Engineers continue to investigate, and we will provide another update in 8 hours or less.
September 22, 2024 11:41PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 24 hours.
September 21, 2024 11:55PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 24 hours.
September 21, 2024 12:18AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 24 hours.
September 20, 2024 4:29PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.
September 20, 2024 7:56AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.
September 19, 2024 11:56PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.
September 19, 2024 4:11PM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 8 hours.
September 19, 2024 11:58AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.
September 19, 2024 8:11AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.
September 19, 2024 4:10AM UTC
[Identified] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.
September 19, 2024 12:13AM UTC
[Investigating] Skillable engineers continue to monitor for slow startup duration. Next update within 4 hours.
September 18, 2024 8:03PM UTC
[Investigating] Skillable engineers have identified a network related issue and have implemented changes to mitigate any negative customer impact. We continue to research root cause. Next update within 4 hours.
September 18, 2024 4:16PM UTC
[Investigating] Monitoring indicates lab startup duration is sometimes longer than expected. Skillable engineers remain actively engaged to resolve the slow startup duration.
September 17, 2024 6:32PM UTC
[Monitoring] Ongoing monitoring indicates that lab startup times are steadily returning to normal. Our staff continues to monitor while our engineers are actively investigating the root cause.
September 17, 2024 3:51PM UTC
[Investigating] All systems are functioning normally with slower than normal lab startup times. Skillable engineers are still working on further mitigation. We'll provide the next update when new information is available.
September 17, 2024 3:27PM UTC
[Investigating] We are currently experiencing an issue impacting running labs and new lab launches in all regions. Our team is actively investigating the cause and working to resolve it as quickly as possible.
