Order Management

UPDATE:

Finance team is still working on remediating the Shipped order status through the VP orders System. The process for the 88k shipments from beginning of November is well under way but will take a few more hours. Finance team will update when the remediation is complete at which time CTIM will Contain the incident.

UPDATE:

MCP Orders Management confirmed that all items have been marked as shipped since the beginning of November. We are currently waiting for all of these events to flow through the VP Orders system and be successfully processed by finance. As of now 9k DIGI shipments have been processed out of 88k. The incident will be marked as contained once the entire shipment process is completed.

UPDATE:

The issue with shipment processing was traced back to a side effect of buggy code pushed recently (related to #ctim-909). The code failure caused around 88,000 shipments to be impacted, specifically those that were created without a fulfillmentLocationId which prevented them from being marked as shipped. A fix has now been implemented and affected shipments are being replayed from November 4th onwards. While the replay is in progress, some systems may show conflicting dates (e.g., 3rd December vs. 6th November) due to differences in reporting. The situation is being actively resolved and shipments created after the fix are no longer encountering the issue.

UPDATE:

Snorlax has identified the issue and is deploying a fix to resolve it. The next update will be provided in an hour.

UPDATE:
Escalation sent to: Logistics: Snorlax

Sending escalation to Snorlax team, requesting to look into this during business hours.

UPDATE:

Downgrading to ‘High’ priority, requesting Snorlax look into this issue during next available business hour. Will update again once we have more details from them.