ES /docs

VoxelService /captured_area — API Gateway timeout exceeds Athena query duration

Service
cupixworks-worker
Occurrences
5,794
Status
Reported
Confidence
85%
Actionability
24%
Cluster ID
82b58d18-a390-446a-9420-c5c1c02acf05
First Seen
2026-04-06 08:31 UTC
Last Seen
2026-08-05 04:45 UTC
Datadog↗ Slack↗
Actions

VoxelService /captured_area — API Gateway timeout exceeds Athena query duration

What Happened#

2026-04-24 09:35 KST, cupixworks-worker의 cron job Cupix::Cron::Facility.flush_stale_captured_size가 실행되면서 다수의 Facility에 대해 voxel-service의 /captured_area Lambda 엔드포인트를 호출했다. 이 과정에서 일부 요청이 500 Internal Server Error(Athena 쿼리 실패)와 503 Service Unavailable(API Gateway 30초 타임아웃)로 실패했다.

Quick Facts#

Field Value
exception.class RestClient::Exception
exception.message failed to get captured area - error: 500 Internal Server Error
top_frame app/services/cupix/voxel_service.rb:92
env production, us-west-2

Timeline#

  1. 09:31 KST — cron job flush_stale_captured_size 실행 시작, stale 상태 Facility 최대 30건 순차 처리
  2. 09:31~09:35 KST — 다수의 Facility captured_area 계산 성공 (info 로그 확인)
  3. 09:35:09 KST — Facility 11519에 대해 500 Internal Server Error 발생 (Athena 쿼리 실패)
  4. 09:37~09:42 KST — 이후 다수 Facility에서 503 Service Unavailable 연쇄 발생 (API Gateway 타임아웃)
  5. 09:42 KST — cron batch 처리 완료

Scoring#

Confidence 85% · Actionability 24%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 17 code refs, 3 log queries
Code path explicitness 3/3 17 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 0/3 0 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 1/5 critical
Affected files 1/5 17 file(s)
Single repo 1/3 2 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 3/3 no external deps
Data migration 0/3 migration needed