CimCommerce v2

UPDATE:

The RANCH service is still performing as expected within minimal error rates. Vista has reported another spike in service errors which are being verified and diagnosed.
Errors when adding items to cart are still elevated but unrelated and will be handled separately since it’s not currently at a critical level.
Next update in 1 hour or sooner once we confirm the issue is resolved.

UPDATE:

The RANCH service has recovered and is performing near baseline. The issues with the Selector API appear to be unrelated but have also stabilized. We will continue to monitor the issues and provide another update in 30minutes.

UPDATE:

Errors from RANCH as measured from PODS calls have reduced but not yet to baseline levels. Blocked checkouts have improved but Vista still shows elevated failures when adding items to carts. Still investigating the impact to the Selector API and whether the errors seen there are related. Next update in 30 minutes or sooner.

UPDATE:

After recycling the pods and adjusting some of the infrastructure, response times for the RANCH service have started to improve on the CT side. Teams are still monitoring to evaluate whether the changes have made an impact on the failed checkouts for Vista. Next update in 30 minutes or sooner.

UPDATE:

Product Catalog teams have found a possible cause and are currently investigating the elastic cloud deployment for the RANCH service. Vista continues to see increased rates of failures when adding items to carts. Next update in 30 minutes or sooner.

UPDATE:

Product Catalog teams are actively reviewing the issue. Next update in 30 minutes or sooner.

UPDATE:
Escalation sent to: PCD: Strandbeest

Engaging on-call for Strandbeest.

UPDATE:

Commerce teams have found that there appears to be some degradation of the RANCH service with increased response times from ~6am ET to ~8am ET. Next update in 30 minutes or sooner.