Sidekiq job died after all retries
Service
cupixworks-migration-worker
Occurrences
7
Status
Dismissed
Confidence
85%
Actionability
24%
Cluster ID
54cf68b1-3d3c-4a4b-9325-71ce78a7072b
First Seen
2026-07-08 22:06 UTC
Last Seen
2026-07-10 05:13 UTC
Datadog
SlackActions
현재 상태 dismissed 에서는 실행할 액션이 없습니다.
Sidekiq job died after all retries
What Happened#
2026-07-09 07:06 KST에 cupixworks-migration-worker의 ImportWorker (Sidekiq, queue migration) 가 migration id 1843 처리 중 MigrationImportOperation#migrate_tile_object에서 ActiveRecord::RecordNotFound: Couldn't find Pano with 'id'=92228359 [WHERE panos.state != ?] 예외를 반복적으로 발생시켰고, MAX_RETRY_COUNT 5회 재시도가 모두 실패하여 SidekiqDeathHandler가 3건의 Sidekiq job died after all retries 에러를 기록했다. Migration 1843의 데이터 임포트가 중단되어 MigrationOperation.check_import가 result: 'error'로 마감되었다.
Quick Facts#
| Field | Value |
|---|---|
| exception.class | ActiveRecord::RecordNotFound |
| exception.message | Couldn't find Pano with 'id'=92228359 [WHERE panos.state != ?] |
| top_frame | app/operations/migration_import_operation.rb:708 |
| runtime | Ruby 3.3.0 / activerecord 7.2.2 |
| env | production, us-west-2 |
| tenant | cupix |
Affected Teams#
| Team / Domain | Error Count | Impact |
|---|---|---|
| migration (ImportWorker) | 3 | Migration id 1843 임포트 실패 (check_import result: error). 해당 마이그레이션 요청자의 데이터 복제 실패 |
Timeline#
- 2026-07-09 07:06 KST —
ImportWorker가 migration 1843의migrate_pano단계에서 첫 실패.Pano#find(92228359)→ RecordNotFound - 2026-07-09 07:07 KST — Sidekiq 재시도 실패 (07:07:13, 07:07:45 등 5회 재시도)
- 2026-07-09 07:07:45 KST —
sidekiq_retries_exhausted훅 발동,Database import retries exhausted: migration id(1843)에러 로그,MigrationOperation.check_import(result: 'error')호출.SidekiqDeathHandler가 최종 3건의 death 로그 기록
Scoring#
Confidence 85% · Actionability 24%
Confidence#
| Dimension | Score | Detail |
|---|---|---|
| Evidence completeness | 5/5 | 21 code refs, 5 log queries |
| Code path explicitness | 3/3 | 21 file:line refs |
| Log evidence | 3/3 | section, query, pattern |
| RCA structure | 3/3 | 3/3 sections |
| Revision history | 0/3 | 0 revision(s) |
| Agent execution | 3/3 | success |
Actionability#
| Dimension | Score | Detail |
|---|---|---|
| Fix complexity | 1/5 | critical |
| Affected files | 1/5 | 16 file(s) |
| Single repo | 1/3 | 2 service(s) |
| Immediate actions | 0/3 | absent |
| Testability | 0/3 | no test info |
| External dependency | 3/3 | no external deps |
| Data migration | 0/3 | migration needed |