Vista

Plants experiencing large volume of work items stuck in Created status with corresponding SOGs failing

Resolved

Incident Resolved: CTIM-1744
Support Teams have contained or resolved the issue. Please contact MIS PBM or see ticket for more details.

Updated

UPDATE:

Support teams identified a degraded service that has since recovered. The quantity of failed SOGs is now decreasing. We will continue to monitor the issue.

Updated

UPDATE:

The relevant team is online and actively investigating the issue with high priority. Next update in max 30 minutes

Investigating

New Incident: CTIM-1744
Plant: WND,RNO
Priority: Critical
Escalation sent to: Fulfillment: Planning/Data Investigation for review.
Windsor and Reno are experiencing a large volume of work stuck in Created status. Gangs are not progressing further, and the plants are at risk of running out of work. Some failed SOGs are returning 504 Gateway errors. The earliest stuck job traces back to 9:32 AM EST. 952 items stuck in created so far.