MaskableRepository — InnoDB row lock contention on concurrent pano updates
Service
cupixworks-api
Occurrences
229
Status
Reported
Confidence
85%
Actionability
28%
Cluster ID
94c03d26-2ad2-499e-8130-a37b054b11b3
First Seen
2026-05-27 11:44 UTC
Last Seen
2026-08-04 21:35 UTC
Datadog
SlackActions
MaskableRepository — InnoDB row lock contention on concurrent pano updates
What Happened#
2026-05-27 11:44:09 UTC에 cupixworks-api 서비스의 Api::V1::PanosController#mask_upload_url 엔드포인트에서 1815ms의 응답 지연이 발생했다. cupix-agent 클라이언트가 12개 이상의 pano mask upload URL 요청을 동시에 전송하는 burst 패턴에서, 첫 번째 배치(~11:44:10)는 정상(100-350ms)이었으나 두 번째 배치(~11:44:12)에서 1700-3200ms로 급증했다.
Quick Facts#
| Field | Value |
|---|---|
| resource_name | Api::V1::PanosController#mask_upload_url |
| top_frame | app/controllers/concerns/maskable_controller.rb:28 |
| env | production, us-west-2 |
| deploy | production-us-west-2-20260527t0524z0-650f3601-cupixworks |
Timeline#
- 2026-05-27T11:44:10Z — 첫 번째 배치 요청 도착 (7개, pano 86026458-86026469), 정상 응답 (100-350ms)
- 2026-05-27T11:44:12Z — 두 번째 배치 요청 도착 (5개), 지연 응답 (1700-3200ms)
- 2026-05-27T11:44:12.817Z — 대표 trace (ID: 1047593615445870707, pano 86026468) 1813ms 응답
- 2026-05-27T11:48:20Z — 동일 사용자의 후속 요청에서도 2065ms 지연 재현
Scoring#
Confidence 85% · Actionability 28%
Confidence#
| Dimension | Score | Detail |
|---|---|---|
| Evidence completeness | 5/5 | 12 code refs, 2 log queries |
| Code path explicitness | 3/3 | 12 file:line refs |
| Log evidence | 3/3 | section, query, pattern |
| RCA structure | 3/3 | 3/3 sections |
| Revision history | 0/3 | 0 revision(s) |
| Agent execution | 3/3 | success |
Actionability#
| Dimension | Score | Detail |
|---|---|---|
| Fix complexity | 1/5 | critical |
| Affected files | 1/5 | 13 file(s) |
| Single repo | 1/3 | 3 service(s) |
| Immediate actions | 0/3 | absent |
| Testability | 0/3 | no test info |
| External dependency | 1/3 | external deps found |
| Data migration | 3/3 | no migration |