Vista

(DPK) Webshell slowness observed across multiple workflows.

Mis à jour

UPDATE:

DPK IT has raised a ticket with the ISP for investigation. Another round of slowness was identified. As DPK is currently in night shift, we will provide an update by EOD ET hours when the plant begins their day shift.

Mis à jour

UPDATE:

Deer Park has observed some intermittent ‘Transfer to RIP’ issues which require items to be re-ripped. So far 4 examples were provided. Networking and FPO teams have found no obvious reason for the strain on File Transfer Service in Deer Park. Network Engineering has seen a heightened latency with Momentum circuit and requested DPK IT to reach out to ISP provider directly. Next update in max 24 hours.

Résolu

Incident Resolved: CTIM-2142
Support Teams have contained or resolved the issue. Please contact MIS PBM or see ticket for more details.

Mis à jour

UPDATE:

Production has indicated that the amount of failed to RIP items are now zero, though they are being loaded one at a time. We will keep the incident open until we can confirm how things are progressing during the next day shift (~3 hours).

Mis à jour

UPDATE:

Some workflows have seen improvements except for digital and calendars, which are still having issues in the ‘transfer to RIP’ step. Support teams continue to work the problem. Next update in 30 minutes.

Mis à jour

UPDATE:

The situation improved for nearly 30min before the slowness reoccurred. Networking is swapping to the backup ISP at this point to see whether that helps. Next update in 30min.

Mis à jour

UPDATE:

Some significant spikes in transaction times for the affected service have been identified but don’t appear to be continuous. No packet loss has been identified on the network at this point. DPK teams are evaluating the current impact to production. Next update in 30 minutes.

Mis à jour

UPDATE:

The issue is currently being reviewing by support teams from CT and Vista. Networking team is online and checking the local network in DPK. Next update in 30 minutes.

En voie de résolution

New Incident: CTIM-2142
Plant: DPK
Priority: Critical
Escalation sent to: Vista: Networking for review.
CTIM is currently investigating, at critical priority, an incident affecting DPK where Webshell slowness is observed across multiple workflows. Next update in 30 minutes or less.