Ongoing AWS UAE Outage Impacting Media, File Uploads and Reports

Resolved
Resolved

AWS services continue to improve following the recent outage. All lighthouse services have been fully restored and are now operational. We remain in close communication with AWS and are monitoring their official updates regarding the outage

Next Steps

  • Continued monitoring of AWS service status and outage reports
  • Ongoing replacement of affected S3 images across our platform
  • We will provide further updates if any new issues emerge

We appreciate your patience during this incident and thank you for your continued use of our services.

Avatar for Shuja Shabandri
Shuja Shabandri
Updated

AWS has shared that conditions in the UAE region remain mostly unchanged and they are still working on recovering S3 and other foundational services. Images are largely loading again although a few assessments and reports continue to show intermittent media related issues. Background jobs that rely on AWS Lambda such as report PDF generation and bulk download remain impacted. Imports, exports and file uploads are currently operating normally and we continue to monitor them closely.

We will provide another update as AWS progresses with their recovery efforts.

Avatar for Shuja Shabandri
Shuja Shabandri
Identified

Services are beginning to recover, but full functionality is not yet restored. AWS has confirmed that two Availability Zones in the UAE region remain significantly impaired due to physical damage from recent drone strikes. S3 availability is improving, although access is still inconsistent which affects reports, assessments that rely on media and background jobs that handle imports, exports and file uploads. AWS is applying software based mitigations to restore S3 and other core services while physical repairs continue. We are seeing gradual improvement and will keep monitoring recovery progress. Another update will be shared as service stability increases.

Avatar for Shuja Shabandri
Shuja Shabandri
Updated

AWS continues to work on resolving the ongoing issue in the UAE region. Our systems remain affected, specifically reports that rely on images, assessments that use media or file uploads and background jobs for import and export. We are tracking AWS recovery progress and will post another update once we see improvement in S3 availability.

Avatar for Shuja Shabandri
Shuja Shabandri
Investigating

We are currently experiencing an outage caused by an AWS issue in the UAE region that began at 12pm GST. Images stored in S3 are failing to load which impacts reports and assessments that rely on images, file uploads, video or audio recording. Background jobs that import or export data and all file uploads are also affected. Our team is monitoring the AWS outage and will provide updates as the situation progresses.

Avatar for Shuja Shabandri
Shuja Shabandri
Began at:

Affected components
  • Lighthouse UAE
    • Report PDF Exporter
    • Object Storage