CimCommerce v2
Orders are not being released as quickly as usual.
Incident Resolved: CTIM-1949
Remediation continues to work through the backlog with 16k orders left in queue with an estimated ETA of 2 hours to complete. Next update in 2 hours.
Please contact CTIM or see ticket for more details.
UPDATE:
The team has taken action to quickly remediate the issue. In the last hour, approximately 12K messages have been processed and around 30K messages are still in the queue and currently being processed. The issue will be considered contained once all orders have been successfully processed. CTIM will follow up in another 1 hours to know the status and will share an update
UPDATE:
The team is investigating the root cause of the elevated message failure rate that led to DLQ entries and resolve any underlying issues to prevent further DLQ accumulation. Next update when we get more information on the investigation or max in 1 hour
UPDATE:
Dev team continues to investigate this issue with high priority. Next update in max 1 hour.
UPDATE:
Dev team is online and actively looking into the issue with high priority. Next update in max 1 hour
UPDATE:
The escalation has been redirected from the Support team to the Dev team. We are currently awaiting their response and will provide the next update once we get their response on the investigation
UPDATE:
The team is online and actively investigating this issue with high priority. Next update in max 1 hour.
UPDATE:
Escalation sent to: eCommerce: Payments Squad
Requesting team to investigate this order release issue with priority.
New Incident: CTIM-1949
Priority: High
Escalation sent to: eCommerce: Payments Squad for review.
The Payment Event Processing Service indicates that orders are not being released as quickly as usual. So far, around 19K orders have been affected. The issue started at 6:30 PM EST and is intermittent. Requesting the team to investigate this issue with high priority during business hours.