Incident Resolved: CTIM-1938
No additional reports of problems regarding authentication to artwork services. Remediation is ongoing. We will follow up with support teams on the progress by EOD. Incident is contained.
Please contact CTIM or see ticket for more details.
UPDATE:
Remediation process is ongoing for the affected orders. Processes may vary for each merchant so additional time will be needed to ensure all items are resubmitted correctly. We will update again in 2 hours.
UPDATE:
Support teams have prepared the lists for remediation but the process could be affected by ongoing AWS issues in the us-east-1 region. We will continue to monitor the situation and provide another update in 1 hour.
Incident Resolved: CTIM-1938
While some remediation may still be underway, the root cause of the incident is Contained. No further updates.
Please contact CTIM or see ticket for more details.
UPDATE:
Teams continue to seem positive improvements though remediations are still underway and Resolution cannot be clearly stated. Next update in max 1 hour.
UPDATE:
Teams continue to see marked improvement with errors dissipating dramatically over the last 10 minutes. However, a thorough check is required and so we have not Resolved this incident yet. Next update in max 30 minutes or once we can consider Resolved.
UPDATE:
We are seeing some improvement after recent containment attempt but due to heavy load this could take some time to reach various customers before we can confirm. Teams are working together at highest priority to resolve this. Next update in max 30 minutes.
UPDATE:
Teams have found likely culprits for the recent failures across artwork services which is causing incidents across all business units. Team has taken mitigation steps to resolve this and we are awaiting the results of those steps. Next update in max 30 minutes.
UPDATE:
Team continues to investigate at the highest priority the authorization issues currently affecting critical artwork services including Prepress which many service rely on. Next update in max 30 minutes.
UPDATE:
Access team online and actively investigating. Next update in max 30 minutes.
New Incident: CTIM-1938
Priority: Critical
Escalation sent to: Access Domain for review.
Please investigate many Artwork services failing with token/authorization issues.