DAT Solutions Internal

Updates

• Sep 3, 2025 4:46 AM PDT

  We are experiencing network connectivity issues in Hillsboro. One of the leaf switches has gone down, impacting host hilcsbcore02-a. While other servers remain online due to redundant connections, the affected server is unreachable (no SSH access). The issue appears isolated but is affecting production connectivity. The incident was resolved by physically swapping network cables on Core02 and replacing a failed fiber cable on Core03, restoring functionality to both servers. Additionally, the leaf switch was replaced, ensuring the network was fully operational again.

  Resolved
• Aug 27, 2025 3:48 PM PDT (6 days, 12 hours, and 58 minutes earlier)

  We are experiencing network connectivity issues in Hillsboro. One of the leaf switches has gone down, impacting host hilcsbcore02-a. While other servers remain online due to redundant connections, the affected server is unreachable (no SSH access). The issue appears isolated but is affecting production connectivity. The incident was mitigated by physically swapping network interface cables on Core02, which restored its service, and replacing a failed fiber cable on Core03, bringing it back online as well. Additionally, the leaf switch was replaced, ensuring the network was fully operational again.

  Monitoring
• Aug 27, 2025 12:52 PM PDT (2 hours and 55 minutes earlier)

  We are experiencing network connectivity issues in Hillsboro. One of the leaf switches has gone down, impacting host hilcsbcore02-a. While other servers remain online due to redundant connections, the affected server is unreachable (no SSH access). The issue appears isolated but is affecting production connectivity.

  Investigating