DAT Solutions Internal

Back

Incident history

Aug 2023 - Oct 2023

October 2023

Oct 30

2:59 PM PDT - 4:14 PM PDT (1h16min duration)

Error message in Rateview - database error or "We're sorry an unexpected error has occurred"

This incident has been resolved.

3 updates
Oct 30

1:07 PM PDT - 2:06 PM PDT (59min duration)

CSR is Down

This incident has been resolved.

2 updates
Oct 30

7:52 AM PDT - 3:36 PM PDT (7h44min duration)

Problems accessing DAT ONE WEB

This incident has been resolved.

3 updates
Oct 25

5:43 AM PDT - 6:03 PM PDT (12h20min duration)

Success team is having issues where OSAs are not able to be viewed internally or externally.

This incident has been resolved.

6 updates
Oct 24

1:53 PM PDT - 2:58 PM PDT (1h5min duration)

Notification system data is not currently available in Observe

This incident has been resolved.

2 updates
Oct 24

12:12 PM PDT - 5:32 PM PDT (5h20min duration)

HTTP timeouts in D1 Mobile

This incident has been resolved.

3 updates
Oct 24

4:30 AM PDT - 10:59 AM PDT (6h29min duration)

Customers experiencing slowness while logging into CarrierWatch

This incident has been resolved.

3 updates
Oct 23

12:46 PM PDT - Oct 24 1:07 PM PDT (1d20min duration)

Constant buffering/lag within Power

This incident has been resolved.

3 updates
Oct 20

6:04 PM PDT - Oct 24 12:29 PM PDT (3d18h25min duration)

Reports of Rate Lookup service, Geo service and DAT directory being degraded.

This incident has been resolved.

2 updates
Oct 20

2:26 PM PDT - Oct 24 4:54 AM PDT (3d14h27min duration)

Security Incident INC-685

This incident has been resolved.

2 updates
Oct 20

2:00 PM PDT - Oct 24 4:54 AM PDT (3d14h54min duration)

RFP Tool Margin is not appearing for customers

This incident has been resolved.

2 updates
Oct 20

12:53 PM PDT - Oct 24 4:53 AM PDT (3d16h duration)

Reports of Auth0 production login issues

This incident has been resolved.

2 updates
Oct 16

1:22 PM PDT - 4:42 PM PDT (3h20min duration)

CSB Consumer for Truck Postings not executing

This incident has been resolved.

3 updates
Oct 13

5:37 AM PDT - 11:53 AM PDT (6h17min duration)

CarrierWatch is unreachable

This incident has been resolved.

4 updates
Oct 11

1:10 PM PDT - 1:30 PM PDT (19min duration)

CSB down in Nprod

This incident has been resolved.

3 updates
Oct 11

12:32 PM PDT - 12:53 PM PDT (21min duration)

Certs not moving through to OCR from DICE

This incident has been resolved.

3 updates
Oct 10

1:11 PM PDT - Oct 13 5:10 PM PDT (3d3h59min duration)

Trucker API (Mobile) security incident

This incident has been resolved.

3 updates
Oct 09

1:33 PM PDT - Jan 8 1:21 PM PST (91d48min duration)

Security Incident

This incident has been resolved.

3 updates
Oct 09

6:24 AM PDT - 6:48 AM PDT (24min duration)

Unable to open CarrierWatch Admin

CarrierWatch was restarted and is back up. Investigation continues for root cause.

3 updates
Oct 08

8:58 PM PDT - 9:11 PM PDT (13min duration)

Factoring leads from One Mobile not being sent over to OTR Solutions

This incident has been resolved.

2 updates
Oct 05

6:33 AM PDT - 8:02 AM PDT (1h29min duration)

Partial Keypoint Outage Affecting Eastern Time Zone Customers

This incident has been resolved.

3 updates
Oct 04

8:10 AM PDT - 8:25 AM PDT (15min duration)

The assets-service in production is down

This incident has been resolved.

2 updates
Oct 04

6:36 AM PDT - Oct 5 7:48 AM PDT (1d1h13min duration)

Some customers are reporting that their payment failed when their account is current

This incident has been resolved.

3 updates
Oct 02

7:06 PM PDT - Oct 4 6:40 PM PDT (1d23h35min duration)

Missing metrics triggered alarms for live query matches

This incident has been resolved.

3 updates
Oct 02

4:25 PM PDT - Oct 3 4:59 PM PDT (1d34min duration)

IQ Market condition features are inaccurate

This incident has been resolved.

3 updates
Oct 02

8:45 AM PDT - 11:43 AM PDT (2h58min duration)

Reports of degraded performance related to the factoring-service

This incident has been resolved.

2 updates
Oct 01

5:44 AM PDT - 7:49 AM PDT (2h5min duration)

Enterprise customers reporting API outage

Team have recycled the pods and retried the jobs which has fixed the issue.

2 updates

September 2023

Sep 28

5:18 PM PDT - Jan 8 1:21 PM PST (101d21h3min duration)

Bulk patch/posting of compromsed user

This incident has been resolved.

4 updates
Sep 27

8:50 AM PDT - 9:16 AM PDT (27min duration)

Security incident inc-663

This incident has been resolved.

2 updates
Sep 27

8:46 AM PDT - 3:01 PM PDT (6h15min duration)

Notification system connection-manager pod count dropped to 0

This incident has been resolved.

2 updates
Sep 25

6:30 AM PDT - 7:52 AM PDT (1h22min duration)

Sign Up Now in our Website is not working

This incident has been resolved.

2 updates
Sep 22

8:21 PM PDT - Sep 23 9:06 AM PDT (12h44min duration)

Overnight staffing in the Phillipines - Customers unable to login to Truckers Edge

This incident has been resolved.

4 updates
Sep 21

8:18 AM PDT - Oct 3 12:31 AM PDT (11d16h13min duration)

Glauthory.com and dat.com/blog are showing bad gateway errors

This incident has been resolved.

2 updates
Sep 21

5:50 AM PDT - Sep 26 10:43 AM PDT (5d4h53min duration)

Several reports of users having problems logging in

This incident has been resolved.

6 updates
Sep 20

12:09 PM PDT - Sep 21 11:48 PM PDT (1d11h38min duration)

Security Incident 657

This incident has been resolved.

3 updates
Sep 20

9:42 AM PDT - Sep 21 12:20 AM PDT (14h38min duration)

reports of missing fields when searching on one.dat.com from mobile browser

This incident has been resolved.

2 updates
Sep 20

8:42 AM PDT - 1:42 PM PDT (5h duration)

Tableau having an outage that affect some DAT products

This incident has been resolved.

4 updates
Sep 19

3:07 PM PDT - 4:46 PM PDT (1h39min duration)

Tucker api is unable to connect to CSB

Directly related to #inc-653, closing #inc-654

2 updates
Sep 19

1:41 PM PDT - 4:45 PM PDT (3h4min duration)

CSR Pages have crashed

Incident has been resolved, NOC will continue to monitor and provide updates. AAR to follow.

3 updates
Sep 18

11:32 AM PDT - Sep 19 12:06 PM PDT (1d34min duration)

Frequent pod restarts in the notification system

Incident resolved, AAR to follow

5 updates
Sep 18

11:13 AM PDT - 3:57 PM PDT (4h44min duration)

Two trucker api pods are having trouble connecting to DocumentDb

Incident resolved, AAR to follow

2 updates
Sep 15

1:22 PM PDT - Oct 6 5:13 PM PDT (21d3h51min duration)

No matching load results from Truck postings

This incident has been resolved.

2 updates
Sep 15

4:00 AM PDT - 5:25 AM PDT (1h25min duration)

Too many errors in Trucker API Web

This incident has been resolved.

3 updates
Sep 14

2:47 PM PDT - Oct 6 5:10 PM PDT (22d2h22min duration)

Live search match results from Loadlink do not immediately appear with the contact information.

This incident has been resolved.

3 updates
Sep 14

11:22 AM PDT - 1:05 PM PDT (1h44min duration)

Notification System service entered bad state because of pod restarts

This incident has been resolved.

2 updates
Sep 14

11:01 AM PDT - Sep 18 4:34 PM PDT (4d5h33min duration)

TIA Watchdog function in CarrierWatch

This incident has been resolved.

2 updates
Sep 14

10:16 AM PDT - 11:04 AM PDT (48min duration)

Security Incident INC#645

This incident has been resolved.

3 updates
Sep 14

8:36 AM PDT - 11:04 AM PDT (2h28min duration)

Reports of problems while adding payment credit cards information.

This incident has been resolved.

4 updates
Sep 12

9:14 AM PDT - Sep 19 4:39 AM PDT (6d19h25min duration)

DAT iQ Market Conditions is currently experiencing data issues

This incident has been resolved.

2 updates
Sep 12

8:44 AM PDT - Sep 13 9:07 AM PDT (1d23min duration)

Several users are reporting issues with Max.

This incident has been resolved.

4 updates
Sep 01

11:25 AM PDT - Oct 10 12:28 PM PDT (39d1h3min duration)

Unexpected requests being made to Trucker API Mobile with truckersedge.dat.com referrer

This incident has been resolved.

3 updates

August 2023

Aug 31

3:57 PM PDT - 4:27 PM PDT (30min duration)

Geography API error

This incident has been resolved.

2 updates
Aug 30

2:45 PM PDT - Jan 8 1:20 PM PST (130d23h35min duration)

Spam issue with the Update Company Information

This incident has been resolved.

4 updates
Aug 30

10:27 AM PDT - 12:31 PM PDT (2h4min duration)

Mass posting via bulk upload

This incident has been resolved.

4 updates
Aug 29

10:50 AM PDT - 12:06 PM PDT (1h16min duration)

Security Incident INC-632

This incident has been resolved.

3 updates
Aug 29

10:00 AM PDT - Jan 8 1:18 PM PST (132d4h18min duration)

Security Incident 631

This incident has been resolved.

3 updates
Aug 28

9:25 AM PDT - Sep 6 8:08 PM PDT (9d10h43min duration)

Reports of issues with a customer postings loads no showing as posted.

This incident has been resolved.

3 updates
Aug 28

5:32 AM PDT - 6:58 AM PDT (1h26min duration)

Customers experiencing issues with FTP postings.

This incident has been resolved.

2 updates
Aug 25

12:16 PM PDT - Aug 28 7:39 AM PDT (2d19h23min duration)

Compromised user posting in excess of 8k times today.

This incident has been resolved.

3 updates
Aug 25

9:06 AM PDT - 3:28 PM PDT (6h22min duration)

NICE/MAX Outage

This incident has been resolved.

2 updates
Aug 24

1:01 PM PDT - Aug 30 2:43 PM PDT (6d1h42min duration)

Security Incident INC626

This incident has been resolved.

3 updates
Aug 24

9:39 AM PDT - 5:49 PM PDT (8h10min duration)

Reports of some customers loosing access while using Ratecast within iQ.

A fix was implemented, this incident is now resolved.

3 updates
Aug 24

7:06 AM PDT - 4:07 PM PDT (9h1min duration)

Report of REST API errors from customers

This incident has been resolved.

2 updates
Aug 23

5:55 AM PDT - 6:52 PM PDT (12h57min duration)

DAT iQ Market Conditions is currently experiencing data issues

Solution has been implemented, incident resolved.

3 updates
Aug 22

1:01 PM PDT - Aug 25 3:48 PM PDT (3d2h46min duration)

Security Inicident

This incident has been resolved.

3 updates
Aug 22

9:47 AM PDT - 6:28 PM PDT (8h42min duration)

Reports of certain Truck Searches not returning any results.

This incident has been resolved.

3 updates
Aug 18

9:24 AM PDT - Aug 21 4:11 AM PDT (2d18h47min duration)

Truck Posting Service Unable to auth with https://identity.api.prod.dat.com

This incident has been resolved.

3 updates
Aug 18

6:18 AM PDT - Aug 22 12:34 AM PDT (3d18h16min duration)

Notification system high latency and error rate

This incident has been resolved.

3 updates
Aug 17

3:18 PM PDT - Aug 18 6:01 AM PDT (14h44min duration)

Single lane maps in rateview not displaying.

After deploying hotfix in Rateview prod, google maps are working as expected hence closing the incident.

3 updates
Aug 17

11:24 AM PDT - Aug 21 9:59 AM PDT (3d22h35min duration)

Security Incident INC-615

Incident has been resolved, AAR to follow.

2 updates
Aug 16

6:09 PM PDT - Aug 21 9:58 AM PDT (4d15h49min duration)

Security Incident - IN-10193

Incident has been resolved, AAR to follow.

3 updates
Aug 16

5:07 PM PDT - Jan 8 1:17 PM PST (144d21h10min duration)

Security Incident - HELP-48036

This incident has been resolved.

3 updates
Aug 16

3:25 PM PDT - 3:40 PM PDT (15min duration)

Database error when updating passwords or creating users

Issue occured in TEST and not in PROD

2 updates
Aug 16

12:45 PM PDT - Sep 2 1:32 AM PDT (16d12h48min duration)

Reports of Live Match pods running out of memory.

This incident has been resolved.

3 updates
Aug 16

12:31 PM PDT - Aug 17 8:51 AM PDT (20h20min duration)

Reports of issue while adding cards during reactivation.

This incident has been resolved.

3 updates
Aug 15

3:05 PM PDT - Aug 21 9:56 AM PDT (5d18h51min duration)

Security Incident

Incident has been resolved, AAR to follow.

3 updates
Aug 14

9:28 AM PDT - Aug 31 4:43 PM PDT (17d7h15min duration)

Profit Estimator "All in Rate" is behaving very inconsistently

This incident has been resolved.

2 updates
Aug 14

9:07 AM PDT - Aug 31 4:35 PM PDT (17d7h28min duration)

Customers unable to post loads or trucks in DAT One when Alderwood Mnr, WA is used

This incident has been resolved.

2 updates
Aug 14

8:10 AM PDT - 8:43 AM PDT (33min duration)

An expired certificate is causing some users to have issues with posting loads

This incident has been resolved.

3 updates
Aug 14

7:55 AM PDT - 9:40 AM PDT (1h45min duration)

Reports of problems with AssureSign.

This incident has been resolved.

2 updates
Aug 14

6:25 AM PDT - 1:29 PM PDT (7h4min duration)

Salesforce issue affecting internal and external reactivations.

A fix has been implemented successfully

3 updates
Aug 11

8:44 AM PDT - Aug 14 10:24 AM PDT (3d1h40min duration)

Some One Mobile for Android users experiencing crashes from Load Details

The hotfix has been deployed, tested and after being monitored this issue has now been resolved.

3 updates
Aug 11

8:19 AM PDT - Aug 15 10:59 AM PDT (4d2h40min duration)

High latency in SSE notifications (already mitigated)

This incident has been resolved.

2 updates
Aug 10

3:06 PM PDT - Aug 12 10:56 PM PDT (2d7h50min duration)

Issues with mileage on posted loads showing as air miles

This incident has been resolved.

3 updates
Aug 10

6:35 AM PDT - 7:37 AM PDT (1h2min duration)

Unable to access Tableau

This incident has been resolved.

3 updates
Aug 09

9:15 AM PDT - 11:01 AM PDT (1h46min duration)

Report of iq.dat.com not loading

This incident has been resolved.

2 updates
Aug 09

7:24 AM PDT - 11:02 AM PDT (3h39min duration)

Reports of slowness/time out errors on the app

This incident has been resolved.

2 updates
Aug 08

12:03 PM PDT - Sep 14 6:34 AM PDT (36d18h31min duration)

Customers reporting issues with FTP postings showing date ranges

This incident has been resolved.

4 updates
Aug 07

9:04 AM PDT - 9:34 AM PDT (30min duration)

Report of OnBoard to be down

This incident has been resolved.

2 updates
Aug 03

11:27 AM PDT - Aug 14 11:02 AM PDT (10d23h35min duration)

Standard carriers are getting features that shouldn't be accessible

This incident has been resolved.

2 updates
Aug 03

10:20 AM PDT - Aug 14 10:52 AM PDT (11d32min duration)

There is an issue with resolving some zip codes when posting via the REST API

This incident has been resolved.

2 updates
Aug 03

8:08 AM PDT - Aug 14 10:47 AM PDT (11d2h40min duration)

Reports of a user and their FTP file transfer to Truckstop in the "Delayed File Transfer" in CSR

The CSB team successfully deployed the new build to the A-Stack this past Friday, August 4th, and all CSB SFTP clients are now using the updated library. Hence, The issue has now been resolved.

3 updates
Aug 02

7:32 AM PDT - Aug 3 9:23 PM PDT (1d13h51min duration)

name/mc/dot number appears different in DAT directory for Hugo Hunter INC

This incident has been resolved.

3 updates
Aug 01

7:27 AM PDT - Aug 8 3:59 AM PDT (6d20h32min duration)

There are issues when posting to location Mt. Pleasant, PA

CAB 5284 was completed successfully and tested. This incident can be marked as resolved unless someone feels differently

2 updates
Aug 01

5:44 AM PDT - 10:41 AM PDT (4h57min duration)

Reports about "MCI data seems abnormally light"

This incident has been resolved.

4 updates