Depict - Partial API degradation on one serving region (resolved) – Incident details

Partial API degradation on one serving region (resolved)

Resolved
Partial outage
Started 7 days agoLasted 5 minutes

Affected

API - Shopper Facing

Partial outage from 5:45 PM to 5:50 PM

Collections / Search

Partial outage from 5:45 PM to 5:50 PM

Recommendations

Partial outage from 5:45 PM to 5:50 PM

Updates
  • Resolved
    UTC
    Resolved
    Resolved: the lock was released at 17:49 UTC and all requests had recovered by 17:50 UTC.
  • Identified
    UTC
    Identified
    For about five minutes (17:45–17:50 UTC), a subset of API requests for listings and recommendations served from one of our two regions returned errors (HTTP 500/504) while a database migration waited on a lock. The other region, search results and the merchant portal's data were not affected; no data was lost. The lock was released at 17:49 UTC and all requests recovered by 17:50 UTC. We are moving schema changes on these tables to a low-traffic window with a lock check before each step.