AuthFront (Authentication)
Increased Error Rate for Sign Ups
Incident Resolved: CTIM-1703
No further issues have been reported. Incident is contained.
Please contact CTIM or see ticket for more details.
UPDATE:
Failed sign-ups and timeouts have dropped to normal levels for ~15min. We will monitor for another 15min before containing the incident.
UPDATE:
Progress is being made on applying the blocks needed to stop the attack. Timeouts and failed signup numbers are decreasing already. We will continue to monitor the situation and provide another update in 30min or sooner.
UPDATE:
CORRECTION: Previous block from August 8 is still in-place but the new block for the current attack is still being implemented. Next update in 30min or sooner.
UPDATE:
Auth0 has implemented a block and we should start seeing improvements within the next few minutes.
UPDATE:
Auth0 has joined and is currently investigating the issue. Next update in 30min or sooner.
UPDATE:
Support teams are currently awaiting confirmation and review of the issue from third-party provider (Auth0).
UPDATE:
Escalation sent to: Vista: PBM (IRT)
Adding Vista IRT for visibility.
UPDATE:
Support teams are currently working the issue. Auth0 has been engaged to assist. Next update in 30min or sooner once more details become available.
New Incident: CTIM-1703
Priority: Critical
Escalation sent to: Access Domain for review.
Access domain teams have identified an increased rate of sign-up failures that likely indicate a coordinated attack on the Auth0 endpoint. This could affect actual customer sign-ups if rate limiting is applied to the requests. Access domain teams are online and reviewing the issue.