Incident Resolved: CTIM-2330
Support Teams have contained or resolved the issue. Please contact MIS PBM or see ticket for more details.
UPDATE:
The majority of plants have recovered and shipments are flowing as expected. Support teams are working towards final remediation and cleanup post-recovery. Next update in 30 minutes or sooner.
UPDATE:
AWS will be in full recovery within the next 30-45 minutes. Additionally, plants are seeing success with shipping. Next update in 30 minutes or sooner.
UPDATE:
AWS is reporting initial signs of service recovery. Consequently, systems at our Vista plants are beginning to return to normal operations. Our teams remain in a high-alert monitoring phase and are evaluating remediation options to ensure stability. Next update in 30 minutes or less.
UPDATE:
Initial investigations have suggested that a potential service disruption via our upstream provider, AWS, is causing connection issues across the plants. Teams are evaluating remediation options at this time. Next update in 30 minutes or sooner.
UPDATE:
Updated impact to all Vista plants.
New Incident: CTIM-2330
Plant: WND,VEN,RNO
Priority: Critical
Escalation sent to: Fulfillment: Plant Optimizations (FPO) for review.
CTIM is investing an issue with Webshell and Viper affecting multiple plants (VEN, WND, RNO). Teams have been engaged and are already investigating at high priority. Next update in 30 minutes.