Product Configuration
Increased errors in various services
Incident Resolved: CTIM-1911
No additional problems have been reported. At this point, the incident is contained.
Please contact CTIM or see ticket for more details.
UPDATE:
CT Commerce teams indicated that order placement latencies stabilized ~20min ago. We are continuing to monitor the issue and check in with affected businesses before containment.
UPDATE:
Currently waiting for confirmation that all services have been fully restored. Teams are already discussing order remediation which will take place once the incident is contained.
UPDATE:
Errors from affected services have reduced though there still some considerable latency. Currently awaiting confirmation that order placement issues are resolved. Next update in 15 minutes.
UPDATE:
CT support and dev teams from multiple domains are actively working the issue. The service which appears to have caused the original problem should be stabilizing now, though it might take some time for downstream services to recover. Next update in 15 minutes. Upgrading to MPI for visibility.
UPDATE:
Updating issue to reflect impact to all business units as well as categorizing under Product Catalog.
New Incident: CTIM-1911
Priority: Critical
Escalation sent to: Artwork Tech: Support for review.
Various services are experiencing increased latency and error rates which is affecting incoming orders. The problem is already under investigation by Artwork and Product Catalog teams.