DAT Solutions Internal

Back
Sep 1, 2025 5:06 AM PDT

BA_FILES data is not updated in BA Shipper database

Updates

  • Sep 2, 2025 7:17 PM PDT

    A job responsible for extracting and processing BA_files—customer-supplied shipment and cost data—has failed. As a direct result, the BA Shipper production database has not been updated since August 27. This failure disrupts the daily data pipeline that translates raw customer files into actionable analytics within our shipper platform. there will be 100 shipper notice this issue tomorrow as today is holiday. The incident was resolved by deploying changes to fix the infrastructure issues that disrupted the data pipeline and successfully reprocessing the missed 6,134 files. Validation of the data confirmed that everything was functioning correctly after the reprocessing, leading to the incident being officially closed.

    Resolved
  • Sep 1, 2025 11:02 PM PDT (20 hours and 15 minutes earlier)

    A job responsible for extracting and processing BA_files—customer-supplied shipment and cost data—has failed. As a direct result, the BA Shipper production database has not been updated since August 27. This failure disrupts the daily data pipeline that translates raw customer files into actionable analytics within our shipper platform. there will be 100 shipper notice this issue tomorrow as today is holiday. The incident was mitigated by deploying changes to fix the infrastructure issues that had broken the data pipeline and initiating the reprocessing of the 6,134 files that were missed during the incident. Once the changes were approved and deployed, reprocessing started, which helped ensure that the database would be updated with the necessary data.

    Monitoring
  • Sep 1, 2025 7:31 PM PDT (3 hours and 30 minutes earlier)

    We’ve identified a fix for the issue that caused the Prod Shipper pipeline to stop receiving data since August 27th. The fix is ready and will be deployed shortly. Once the change is in place, we will begin reprocessing the data that was missed during the affected period.
    We’re continuing to monitor closely and will provide another update once the reprocessing begins.

    Investigating
  • Sep 1, 2025 5:06 AM PDT (14 hours and 25 minutes earlier)

    A job responsible for extracting and processing BA_files—customer-supplied shipment and cost data—has failed. As a direct result, the BA Shipper production database has not been updated since August 27. This failure disrupts the daily data pipeline that translates raw customer files into actionable analytics within our shipper platform. there will be 100 shipper notice this issue tomorrow as today is holiday.

    Investigating