Incident Resolved: CTIM-961
Studio side changes are now also complete meaning all necessary work has been completed. This incident is now considered contained. CTIM will update only if errors continue to persist.
Please contact CTIM or see ticket for more details.
UPDATE:
Changes to one branch have been pushed, but another is still required. The second is currently running. Next update when this merge has completed or in 1 hour.
UPDATE:
While the fix has been Deployed SDK side to handle timeout exceptions so that Studio can efficiently perform clean-up tasks, the next step is for the change to be deployed on Studio side. Team has requested this be done and next CTIM update will be once this deployment Studio side is completed or in 1 hour.
UPDATE:
Fix has been deployed to address low number of errors in Studio environment due to an issue with a cleanup task. Team will now monitor for these errors. Next CTIM update in 1 hour.
UPDATE:
Manual Orchestration team is in the final stage of releasing a change to address a request timeout blocking a Studio cleanup task resulting in 759 errors in studio out of 583,000 sessions in the past 24+ hours. CTIM will update when the fix is released and follow up with confirmation that these errors are no longer being seen in the service.
UPDATE:
The root cause of the issue has been identified as a request timeout that was not properly handled in the SDK, preventing the studio from performing the necessary cleanup. The Manual Orchestration team is attempting to deploy a fix that will reject the promise with a 504 status code, enabling the studio to handle the error correctly. We will closely monitor the errors after the fix is deployed.
UPDATE:
Escalation sent to: Artwork Tech: MOS & DocExt
The Manual Orchestration team is currently working to reproduce the error using the demo page. We will provide the next update as soon as we have specific findings or additional information to share.
UPDATE:
The team is still investigating the issue by trying to reproduce it. We will provide the next update once we have specific findings or information to share.
New Incident: CTIM-961
Priority: High
Escalation sent to: Artwork Tech: Artwork Processing Support for review.
Customers are receiving the error message while uploading or saving images in studio. This error has been encountered by 759 times out of 583,000 sessions in the past 24 hours. Requesting assistance during business hours to help investigate the issue.
Error Message: : “Sorry, something went wrong. Please refresh your browser. If you need assistance, give us a call. Error Code: 10-65 S:b835ea01-cc13-49a4-8486-6bb986312691” .