Active Incident

Updated a few seconds ago

AWS Region SwappingDegraded Performance

Incident Status

Degraded Performance

Components

AWS Lab Hosting

Locations

AWS Hosting


April 1, 2022 5:00AM UTC
[Identified] We have observed behavior within Amazon AWS where the AWS Console may change to the US-East-1 region without deliberate user action. This may cause some lab steps or activities to fail if they are region dependent. Skillable has observed this behavior outside of the Lab on Demand platform and has reached out to AWS for an investigation into root cause. Further detail: When navigating to a global AWS console resource, such as IAM, the console session is redirected to US-East-1. However, when returning to other resources or the Console home, expected behavior is to return users to their originating region. Instead, users are continuing within the US-East-1 region selection. Users may manually select the correct region if known to continue the lab steps or return to their resources. Labs that use US-East-1 as the default region are not affected. Work around: Skillable has identified that using the 'back' function of a browser instead of navigating back to the Console after selecting a globally managed resource has returned the user back to the correct originating region. If you or your users of AWS Cloud Slice labs are experiencing issues you believe may be related to this incident, please contact our support team, who are able to help you correct your environment. Skillable has received confirmation from AWS that this behavior is unexpected and is related to the new AWS console. Their teams are investigating further and will notify Skillable when corrective actions have been made.

Locations

Training Management System




Operational

Lab on Demand




Operational

Customer Portal




Operational

Azure Services




Operational

AWS Lab Hosting




Isolated Disruption

US East Datacenter




Operational

US West Datacenter




Operational

EU North Datacenter




Operational

AU East Datacenter




Operational

APAC Southeast Datacenter




Operational

Security Response




Operational

Microsoft Authentication




Operational

Skillable.com




Operational

External Services

AWS CloudFront

AWS EC2

AWS Route 53

AWS S3

Amazon Web Services

Azure

GitHub

MS Office365

Zoom

2

Upcoming Maintenances

2

Incidents Last 30 Days

0

Maintenances Last 30 Days

Scheduled Maintenance

Planned Maintenance, 7/16/22Planned Maintenance

Schedule

July 16, 2022 11:00PM - July 17, 2022 9:00AM UTC

Components

Training Management System, Lab on Demand, Customer Portal, Azure Services, AWS Lab Hosting, US East Datacenter, US West Datacenter, EU North Datacenter, AU East Datacenter

Locations

Training Management, Lab on Demand, Customer Portal, US East Hyper-V Fabric, US East ESX Fabric, US East Docker Fabric, US East Overall, EU North Hyper-V Fabric, EU North ESX Fabric, EU North Overall, US West Hyper-V Fabric, US West ESX Fabric, US West Docker Fabric, US West Overall, AU East Hyper-V Fabric, AU East ESX Fabric, AU East Overall, Azure Lab Hosting, AWS Hosting, LabOnDemand API

Description

Please note that Skillable will perform general maintenance on our datacenter infrastructure in all regions on 7/16/22, from 6:00 PM EST (23:00 UTC) to 4:00 AM EST (9:00 UTC). During this time, lab users may experience short, transient connectivity issues while infrastructure fails over to secondary resources. No data for running instances should be affected. Within the same timeframe, we will also perform maintenance on our core infrastructure for Lab on Demand. During this time, connectivity to lab instances may be impacted, and new launches may fail. This should also have no effect on current running instances data.
Planned Maintenance, 10/15/22Planned Maintenance

Schedule

October 15, 2022 11:00PM - October 16, 2022 9:00AM UTC

Components

Training Management System, Lab on Demand, Customer Portal, Azure Services, AWS Lab Hosting, US East Datacenter, US West Datacenter, EU North Datacenter, AU East Datacenter

Locations

Training Management, Lab on Demand, Customer Portal, US East Hyper-V Fabric, US East ESX Fabric, US East Docker Fabric, US East Overall, EU North Hyper-V Fabric, EU North ESX Fabric, EU North Overall, US West Hyper-V Fabric, US West ESX Fabric, US West Docker Fabric, US West Overall, AU East Hyper-V Fabric, AU East ESX Fabric, AU East Overall, Azure Lab Hosting, AWS Hosting, LabOnDemand API

Description

Please note that Skillable will perform general maintenance on our datacenter infrastructure in all regions on 10/15/22, from 6:00 PM EST (23:00 UTC) to 4:00 AM EST (09:00 UTC). During this time, lab users may experience short, transient connectivity issues while infrastructure fails over to secondary resources. No data for running instances should be affected. Within the same timeframe, we will also perform maintenance on our core infrastructure for Lab on Demand. During this time, connectivity to lab instances may be impacted, and new launches may fail. This should also have no effect on current running instances data.

History (Last 7 days)

AWS Lab Launch FailsIsolated Disruption

Incident Status

Isolated Disruption


Components

AWS Lab Hosting


Locations

AWS Hosting



May 13, 2022 6:58PM UTC
[Resolved] AWS support has confirmed that AWS experienced a services outage that is inline with the time frame we observed the launch fails. AWS is calling this issue as Resolved

May 13, 2022 6:13PM UTC
[Investigating] Skillable continues to work with AWS to investigate the cause of the issue but launches of AWS labs has successfully resumed. This issue will remain open until we have confirmation of cause with our partners at AWS.

May 13, 2022 5:35PM UTC
[Investigating] Skillable has observed a number of errors attempting to launch labs on the AWS fabric beginning at 12:21 PM EST, as a result affected users will be unable to launch AWS labs. We are working with AWS support to identify the issue and put a resolution in place as soon as possible.
Skillable.com Unresponsive Degraded Performance

Incident Status

Degraded Performance


Components

Skillable.com


Locations

Skillable.com



May 11, 2022 4:21PM UTC
[Resolved] Our edge firewalls in the detected an abnormally high session load due to a large volume of malicious traffic. Automated responses were triggered and malicious traffic was blocked while valid traffic was re-routed. All services were restored by {5/6/22 6:00 PM EST}. During the disruption period, some users were unable to connect but no lab data was lost. The issue has been resolved and we do not expect further service disruption. We apologize for any inconvenience.

May 6, 2022 10:14PM UTC
[Monitoring] At this time, Skillable.com is back online and is accessible. There should be no further performance issues with the website. We will continue monitoring this incident until further notice. We apologize for the inconvenience.

May 6, 2022 9:20PM UTC
[Investigating] An incident has occurred causing skillable.com to become unresponsive. We are unaware of the cause at this time and are actively investigating this incident. Additional information will be provided as it becomes available. We apologize for the inconvenience. LOD and TMS are fully available, so it's skilling as usual over there. (labondemand.com and lms.learnondemand.net) Need to submit a support ticket? Call 855-438-5953, submit at https://supportrequest.skillable.com/form-4500904/form or submit on LOD or TMS. We look forward to being back online soon!

May 6, 2022 9:01PM UTC
[Investigating] An incident has occurred causing skillable.com to become unresponsive. We are unaware of the cause at this time and are actively investigating this incident. Additional information will be provided as it becomes available. We apologize for the inconvenience.