Asset Management

UPDATE:

Error rates are nearing pre-incident levels but haven’t completely normalized. Traffic is now being reverted back to the primary region since it’s now stable. Next update in 30 minutes.

UPDATE:

No additional details at this point, but we are continuing to monitor the problem. Next update in 30 minutes.

UPDATE:

The situation continues to improve. Failed uploads for Vista customers are still declining as more traffic is routed away from eu-west-1 by Artwork teams. Next update in 20-30min or sooner.

UPDATE:

Services in us-east-1 have stabilized while eu-west-1 is still improving with some backlogged items remaining. Vista teams confirm that they’re seeing a decrease in errors.

Some increased errors above baseline is expected for the next ~40minutes. Next update in 20 minutes as we monitor the progress.

UPDATE:

Due to the ongoing impact, this issue is being upgraded to an MPI for wider visibility. Next update in 20 minutes or sooner.

UPDATE:

Multiple teams within artwork are working the issue currently. Adjustments have been made to infrastructure and traffic routing to alleviate the symptoms. Backlogs are clearing up as well. Next update in 30 minutes.

UPDATE:

Traffic shifting is currently in progress and the team is also working on deleting stale jobs. The next update will be shared once we have more information or within the next 30 minutes.

UPDATE:

The team has scaled up the infrastructure to its maximum possible capacity at this point. They are also discussing options to clear the backlog by deleting jobs that have likely already timed out from the customer or caller’s perspective. Next update in max 30 minutes