4:08 PM PDT - Aug 1 1:02 PM PDT (2d20h54min duration)
500 errors back from the Insurance System - Loadsure
This incident has been resolved.
2:14 PM PDT - 5:07 PM PDT (2h53min duration)
Confirmation codes are not being received
Received email from AWS that they have implemented the increase. The fix was tested, no additional issues found.
4:35 PM PDT - Aug 8 9:08 PM PDT (12d4h32min duration)
Customers are getting a 'no response' error when logging in to DAT One Mobile.
Since the Incident status is resolved, changing this message status as well.
9:19 AM PDT - 10:03 AM PDT (43min duration)
FTP load posting not processing
This incident has been resolved.
8:07 AM PDT - 11:17 AM PDT (3h10min duration)
Report of problems with TE and Express searches.
This incident has been resolved.
2:07 PM PDT - Jul 26 4:18 AM PDT (4d14h11min duration)
RestAPI- Migrated logins receiving forbidden error when generating user token for CSB Login ID
Based on the confirmation in INC channel (After implementing change (CAB-3342) issue has been fixed with deleting nickname when receiving updates from CSB), marking as resolved.
8:46 AM PDT - 9:05 AM PDT (19min duration)
Some reps are unable to convert leads in Sales Force
This incident has been resolved.
7:21 AM PDT - 12:35 PM PDT (5h14min duration)
Search Service > 1000 LookbackMatchesErrors
This incident has been resolved.
2:04 PM PDT - Jul 16 3:37 PM PDT (1d1h33min duration)
DAT One is not displaying Fuel Near Me
This incident has been resolved.
11:04 AM PDT - 12:13 PM PDT (1h10min duration)
Customers unable to connect to Keypoint
This incident has been resolved.
10:30 AM PDT - 2:38 PM PDT (4h8min duration)
Sales Force problems while cleaning up accounts
This incident has been resolved.
1:58 PM PDT - Jul 14 2:36 PM PDT (1d39min duration)
DOE fuel API unable to connect to CSB
This incident has been resolved.
1:41 PM PDT - Jul 14 7:44 AM PDT (18h3min duration)
User Management is experiencing issues
This incident has been resolved.
8:45 AM PDT - Jul 21 8:50 AM PDT (10d5min duration)
Truckers Edge Dash board, the blog feed is unavailable
This incident has been resolved.
6:51 AM PDT - Jul 13 2:43 AM PDT (1d19h53min duration)
MCI and RateCast data are behind
This incident has been resolved.
6:32 AM PDT - 8:22 AM PDT (1h50min duration)
users are unable post loads that include the city Ontario CA
Based on the conclusion over meeting, issue has been fixed post restarting the pool services of Rateview and clearing cache for both Rateview and Power. Also, Service is running and has been confirmed with Incident Commander.
3:52 PM PDT - Sep 28 11:54 PM PDT (82d8h2min duration)
Firewall issue with the connection between ftp.dat.com and na-ftp.dat.com.
As per the confirmation received in the Incident slack channel, moving this incident status to resolved
1:10 PM PDT - Jul 8 4:27 PM PDT (1d3h18min duration)
Error with load posting in Power
Resolved per Jeremy Branecky
8:07 AM PDT - Jul 11 7:52 AM PDT (3d23h45min duration)
Issues generating login tokens through Connexion API for TMS Users
This incident has been resolved.
6:53 AM PDT - 8:02 AM PDT (1h9min duration)
CSR pages not removing the Auth0 Email addresses
As per the communication in incident channel, the issue has been resolved.
"CSRPages has (dir2) rest.externalAddress property, in prdb.xml, pointing to localhost:8090, so I've pointed it to hilcsbtfmi02:8090"
10:47 AM PDT - 3:24 PM PDT (4h37min duration)
Problems loading dat.com products in Google Chrome
Incident has been resolved, AAR to follow.
11:17 AM PDT - Jul 6 7:09 AM PDT (19h53min duration)
Problems loading dat.com products for a version of google chrome.
As per the communication in the incident channel, changing the status to resolved.
11:13 AM PDT - Jul 5 8:14 AM PDT (3d21h1min duration)
RateView multilane downloads Issue
This incident has been resolved.
7:24 AM PDT - 9:24 AM PDT (2h duration)
Affected Components : RESTAPI Authentication
Based on RM team, Access Token Service have issue caused by an error with a revoking/change of permissions for the pod's assumed role. post restarting the pods issue fixed.
1:21 PM PDT - Jun 30 6:18 AM PDT (16h57min duration)
Facebook login disabled for DAT One Android and iOS
This incident has been resolved.
6:39 AM PDT - 2:22 PM PDT (7h43min duration)
MCI data was not processed correctly
This incident has been resolved.
6:00 PM PDT - 9:00 PM PDT (3h duration)
The scheduled maintenance has been completed.
5:03 PM PDT - Jun 27 11:14 AM PDT (18h11min duration)
Keypoint security event reported by Crowstrike
Issue has been identified which was with Power login and has been resolved.
9:56 AM PDT - 10:27 AM PDT (31min duration)
Worklist service pods are restarting due to out of memory issues
Resolved. Additional memory configured and tested.
7:25 AM PDT - 8:25 AM PDT (1h duration)
Rateviews problems with resolutions & zoom levels
This incident has been resolved.
9:15 AM PDT - Jun 27 9:11 AM PDT (4d23h56min duration)
Error when opening details for Private Loads in One Web Production
An upcoming CSB release is needed to fix the error. A bug has been captured and the team is working on it.
5:33 AM PDT - 6:06 AM PDT (33min duration)
This incident has been resolved.
8:17 AM PDT - 11:26 AM PDT (3h9min duration)
DAT One for Android users may experience errors from session renewal failure
This incident has been resolved.
7:07 AM PDT - 1:52 PM PDT (6h45min duration)
CSB did not load new data today for RateCast
This incident has been resolved.
4:14 AM PDT - 4:21 AM PDT (7min duration)
Related to databases being patched
7:00 PM PDT - Jun 18 2:00 AM PDT (7h duration)
Scheduled maintenance - CSB release from 7:00PM - 2:00AM PST
The scheduled maintenance has been completed.
12:40 PM PDT - Jul 13 1:09 PM PDT (27d29min duration)
Outage at the Beaverton Office - Started Tuesday, June 14th @ 10:08 AM PST
This incident has been resolved.
9:09 AM PDT - 10:17 AM PDT (1h8min duration)
Reps are unable to amend contracts
This incident has been resolved.
9:27 AM PDT - Jul 6 9:39 AM PDT (21d12min duration)
Customers are being overcharged
This incident has been resolved.
4:28 AM PDT - 5:54 AM PDT (1h25min duration)
This incident has been resolved.
12:14 PM PDT - 12:40 PM PDT (25min duration)
AWS Alert - MLR Bulk Processing Error
This incident has been resolved.
10:30 AM PDT - 10:40 AM PDT (10min duration)
Alert: csb-postings-marketmaps: lambda-consumer-invocations-low
This incident has been resolved.
9:26 AM PDT - 9:45 AM PDT (19min duration)
Notification system failing to communicate to DynamoDB
This incident has been resolved.
9:48 AM PDT - Jun 8 1:17 PM PDT (1d3h29min duration)
Rate Lookup Service query result is > 3.0 for 5 minutes on 'Linehaul 500 Error'
Fix is in production and everything is functioning properly
1:56 PM PDT - 3:04 PM PDT (1h8min duration)
This incident has been resolved.
7:52 AM PDT - 9:51 AM PDT (1h59min duration)
Production Failure In Ratecsat
Some of the batch jobs have already completed successfully, and data has populated in S3. While this incident is technically open until the jobs are all finished, I believe the issue is resolved.
9:16 AM PDT - 10:06 AM PDT (51min duration)
We are getting reports of users hitting the global Auth0 limit again.
This incident has been resolved.
7:52 AM PDT - 10:21 AM PDT (2h29min duration)
Salesforce Issues: The credentials supplied in the authorization request are invalid
Notes: DAT IP address was blacklisted and was eventually white listed by Elavon. After monitoring payments continue to process with no problems.
2:04 PM PDT - May 27 2:17 PM PDT (1d13min duration)
Viewing load details in DAT One sometimes causes app to hang
This incident has been resolved.
2:03 PM PDT - 2:23 PM PDT (21min duration)
EKS Freight Prod - node out of disk space
This incident has been resolved.
7:55 AM PDT - 10:18 AM PDT (2h22min duration)
Power alarm and auto-update not working
No additional reports, queuing remains minimal.
9:24 AM PDT - May 23 3:49 PM PDT (5d6h25min duration)
Auth0 Has implemented the rate limit increase.
5:33 AM PDT - 7:26 AM PDT (1h52min duration)
Login loop on Power for recently migrated users
This incident has been resolved.
7:27 AM PDT - 7:51 AM PDT (24min duration)
Power logins are talking long than expected
This incident has been resolved.
8:13 AM PDT - 2:22 PM PDT (6h10min duration)
DAT One for Android users may experience a crash after re-opening the app from background
From Matt L:
- Fix tested
- https://transcore.jira.com/browse/CAB-3053 created
- Release candidate build in progress & will release to the Play store.
8:08 AM PDT - 9:59 AM PDT (1h52min duration)
Sales Force Is Experiencing Slowness
This incident has been resolved.
8:05 AM PDT - 11:12 AM PDT (3h6min duration)
Power Alarm and Auto Update Are Not Working
This incident has been resolved.
5:44 AM PDT - 6:20 AM PDT (36min duration)
Sales Force Congestion processing orders
This incident has been resolved.
8:48 AM PDT - 11:31 AM PDT (2h43min duration)
Power Alarm and Auto Update Are not working
This incident has been resolved.
11:30 AM PDT - May 12 2:54 PM PDT (1d3h24min duration)
Auth0 Service Accounts being blocked for consecutive failed attempts
No additional reports of service accounts being blocked today.
8:01 AM PDT - 9:51 AM PDT (1h50min duration)
Power alarm consumers have fallen behind, so users are not getting live match results
This incident has been resolved.
11:50 PM PDT - May 11 4:22 AM PDT (4h32min duration)
DAT One Web - Private Loads page is inaccessible
This incident has been resolved.
8:08 AM PDT - 11:11 AM PDT (3h3min duration)
Temporary problems logging into some of our products
FmCores are processing alarms normally.
6:30 PM PDT - 10:30 PM PDT (4h duration)
Network Devices OS Upgrades on the 2nd Floor at Beaverton Building
The scheduled maintenance has been completed.
4:11 AM PDT - 4:53 AM PDT (42min duration)
Problems while login into Power
This incident has been resolved.
9:37 AM PDT - 2:16 PM PDT (4h39min duration)
Ratecast jobs are running behind schedule
New AMI cluster was created and is running multiple jobs
10:06 AM PDT - 1:15 PM PDT (3h8min duration)
We have multiple orders stuck in Amend in SF.
This incident has been resolved.
4:22 AM PDT - 5:01 AM PDT (39min duration)
EDS rate forecasts job is running late and will miss the 4am SLA
The rate forecast jobs run at 00:00 UTC time right now, so since daylight savings is in effect, the jobs does not run until 5:00am.
So the jobs for today have not kicked off yet, and the EDS jobs have already finished