DAT Solutions Internal

Updates

• Dec 9, 2025 5:51 PM PST

  After rolling back CAB-10575, there are some files that are stuck in processing. Need production write access to invoke the lambda and reprocess the files that are stuck in the s3 bucket The incident was resolved by successfully redeploying the bulk-ratecast-lambda and reprocessing the 107 user files, with all customer issues being fixed and no further problems reported. The team remains on alert for any related customer issues but considers the incident resolved.

  Resolved
• Dec 8, 2025 9:37 PM PST (20 hours and 14 minutes earlier)

  After rolling back CAB-10575, there are some files that are stuck in processing. Need production write access to invoke the lambda and reprocess the files that are stuck in the s3 bucket The incident was mitigated by redeploying the bulk-ratecast-lambda to process the files and successfully invoking the lambda to reprocess the 107 user files, resulting in all customer issues being fixed before they were escalated. Additionally, the team verified that five out of six lanes completed successfully, indicating the majority of files were processed without issue.

  Monitoring
• Dec 8, 2025 7:00 PM PST (2 hours and 37 minutes earlier)

  After rolling back CAB-10575, there are some files that are stuck in processing. Need production write access to invoke the lambda and reprocess the files that are stuck in the s3 bucket

  Investigating