AMV Outage

Resuelto abr 10, 2024 12:08 PM EDT

Incident Resolved: CTIM-607
AMV service is stable with limits in place for the requests that caused the initial outage. Teams are considering methods to mitigate future occurrences of traffic spikes for the previously-identified products (modifying rate limits and identifying why they caused such a spike to AMV initially). Incident is considered contained at this point.
Please contact Platform Support or see ticket for more details.

Actualizado abr 10, 2024 11:52 AM EDT

Incident Updated: AMV performance has returned to normal levels and impact to previously-affected services has already showed improvement. Teams continue to monitor the situation and verify ongoing stability of the AMV service, as well as identify future rate-limiting protocols for certain products.

Actualizado abr 10, 2024 11:38 AM EDT

Incident Updated: Support teams are currently identifying the products that seem to be causing the traffic spike to the service. The requests for these will be limited via WAF rules until we can give the service some time to recover. Impact to EDO and prepress flows ongoing.

Investigando abr 10, 2024 11:16 AM EDT

New Incident: CTIM-607
Priority: High
Escalation sent to: PCD: Falcon Squad for review.
AMV outage due to increased traffic (spiking 10x more than usual). This is currently causing issues with prepress flows and increasing the backlog. Support teams are currently online and investigating.