Postprocessor triggers before S3 upload completes — race condition
Service
cupixworks-pano-postprocessor-instance
Occurrences
3,902
Status
Reported
Confidence
80%
Actionability
28%
Cluster ID
8707efbe-3fd3-4a56-8b07-f1bad0628db4
First Seen
2026-05-22 04:30 UTC
Last Seen
2026-07-13 05:36 UTC
Datadog
SlackActions
Postprocessor triggers before S3 upload completes — race condition
What Happened#
2026-05-22 04:30 UTC에 cupixworks-pano-postprocessor-instance 서비스에서 S3 파노라마 이미지 다운로드 실패 에러가 6건 발생했다. capture_72952 (4건)와 capture_72927 (2건)에 속한 pano 이미지들의 S3 object key가 존재하지 않아 다운로드에 실패했다.
Quick Facts#
| Field | Value |
|---|---|
| exception.class | AWS S3 NoSuchKey |
| exception.message | The specified key does not exist. |
| top_frame | aws-s3.manager.ts:68-76 |
| env | production, ap-southeast-2 |
Timeline#
- 2026-05-22 04:30:20 UTC — capture_72952에서 pano 다운로드 실패 4건 발생
- 2026-05-22 04:30:53 UTC — capture_72927에서 pano 다운로드 실패 2건 발생
- 2026-05-22 04:46:32 UTC — capture_72927 "Preview is ready", "refine processing done" 로그 확인 (API 정상 동작)
- 2026-05-22 05:20:28 UTC — postprocessor 완료:
dd_total:16&dd_completed:16&dd_errored:0(에러 미반영)
Scoring#
Confidence 80% · Actionability 28%
Confidence#
| Dimension | Score | Detail |
|---|---|---|
| Evidence completeness | 5/5 | 11 code refs, 4 log queries |
| Code path explicitness | 3/3 | 11 file:line refs |
| Log evidence | 2/3 | section, query |
| RCA structure | 3/3 | 3/3 sections |
| Revision history | 0/3 | 0 revision(s) |
| Agent execution | 3/3 | success |
Actionability#
| Dimension | Score | Detail |
|---|---|---|
| Fix complexity | 1/5 | critical |
| Affected files | 1/5 | 15 file(s) |
| Single repo | 1/3 | 3 service(s) |
| Immediate actions | 0/3 | absent |
| Testability | 0/3 | no test info |
| External dependency | 1/3 | external deps found |
| Data migration | 3/3 | no migration |