Stores
Issues with products loading on website and cockpit
Incident Resolved: CTIM-1252
We’ve received no further reports of problems since the initial impact. The affected services remain stable since 11:45am ET. At this point, the incident is contained.
Please contact CTIM or see ticket for more details.
UPDATE:
Ecommerce support found some of their services had degraded during the impact timeframe but have since recovered. This likely caused cascading effects to IDP and other dependent services. Normal functionality should return as calls to ecomm services are successful, though it might lag a bit. We will continue to monitor the issue before considering this issue contained. Support/dev teams plan to determine the exact cause during normal business hours and we will provide those details in our PIA summary.
UPDATE:
Fulfillers reporting some improvements after the initial impact that lasted from ~11:30am ET - 11:45am ET. Website issues from Boxup are resolved but they’re still seeing some problems within Cockpit. Printdeal reported their order intake has returned to normal.
There’s a corresponding spike in the IDP during that time but has since recovered. Teams are still investigating.
UPDATE:
Updated affected organizations.
New Incident: CTIM-1252
Priority: Critical
Escalation sent to: eCommerce Support for review.
Boxup has reported various issues with products being unable to add samples to carts as well as inability to enter orders in cockpit. There was also some severe latency and template issues on the website. Printdeal also indicated some issues with product APIs. Currently investigating in channel.