Template Management

Issue with enrichment in CAM

Resolved

Incident Resolved: CTIM-2347
The Vista Design Relevance team confirmed that the remediation is complete and the issue has been resolved. Therefore, we are moving the case status to Contained.
Please contact CTIM or see ticket for more details.

Updated

UPDATE:

As per the latest update, the ingest was completed approximately 10 hours ago. We are currently awaiting confirmation of completion from the Vista Design Relevance team. The next update will be shared within 4 hours or sooner.

Updated

UPDATE:

Re-ingestion in progress. Awaiting confirmation of 100% completion from the CT teams. Next update in max 2 hours as the team will be online in another 1 or 2 hours.

Updated

UPDATE:

CT teams continue to work towards full remediation. Next update in 4 hours or sooner.

Updated

UPDATE:

CT teams have reached 50% completion of the re-ingesting of gallery templates and have a new ETA of 3-4 hours to full remediation. Next update in 4 hours or sooner.

Updated

UPDATE:

The CT teams are in the process of finishing up the re-ingesting of all gallery templates. We expect this process to be finished by 3:00 PM EST, at which point the customer impact should be fully remediated. Next update by EoD ET business hours or sooner.

Updated

UPDATE:

Customer impact on Vista galleries has been largely mitigated following the completion of the workaround. While most products are now restored, a permanent fix by the CT Template Management team is underway to address designs created after Feb 19. Full system normalization is expected by Feb 24 at 6 PM EST.

Updated

UPDATE:

Although the workaround is successfully reprocessing products, the full restoration of all missing values is now expected to be complete by tomorrow, Feb 24, at 12:00 PM EST. The teams are continuing to monitor the automated script overnight to ensure galleries are progressively updated. Next update by 12:00pm EST tomorrow or sooner if an update becomes available.

Updated

UPDATE:

Vista teams have implemented a workaround and already reprocessed multiple products successfully and have initiated the process for all remaining designs. This is expected to take 5-6 hours to complete. CT teams continue to work on a permanent fix. Next update in 4 hours or sooner if additional details become available.

Updated

UPDATE:

Vista team is continuing to work on a mitigation plan with no current ETA. Cimpress Tech is working on a script that will fully resolve the issue and the ETA is ~20 hours. Next update in max 4 hours.

Updated

UPDATE:

Artwork will need to recompute missing values to restore all Vista website color options and functionalities. Current ETA is ~18-24 hours to complete. Teams to align on update cadence and any possible containment steps. Next update in 30 minutes.

Updated

UPDATE:

Artwork and Vista teams are online and currently working the issue. Next update in 30 minutes.

Investigating

New Incident: CTIM-2347
Priority: Low
Escalation sent to: Artwork Tech: Support for review.
The artwork team ran a re-enrichment process for the new analyzers that were introduced for the templates. Unfortunately, due to a bug, the values from other analyzers were overridden.
Currently, the team is working on a fix. Pixart team confirmed they are not seeing any issue and Since this is not impacting any customers, we will consider this a low-priority issue and provide updates every 12 hours or sooner.