ES /docs

VoxelService Lambda returns HTTP 500 on Athena failures

Service
cupixworks-api
Occurrences
45
Status
Reported
Confidence
85%
Actionability
36%
Cluster ID
29acb2e1-8e37-4d54-93dc-9411a86f30b1
First Seen
2023-10-05 02:06 UTC
Last Seen
2026-08-05 04:49 UTC
Datadog↗ Slack↗
Actions

VoxelService Lambda returns HTTP 500 on Athena failures

What Happened#

GET /api/v1/levels/{id}/voxels (Api::V1::LevelsController#merged_voxels) 요청이 downstream voxel service ($CUPIX_VOXEL_SERVICE_URL/merge, data-pipeline-functions Lambda) 를 호출한다. Lambda 가 500 을 반환하면 tesla 의 Cupix::VoxelService.merge_voxel 이 RestClient::Exception 을 잡아 Cupix::Errors::System (code SYS20000) 로 재발생시키고, 사용자에게는 500 응답이 나간다. 2026-07-14 부터 2026-08-01 까지 여러 tenant 와 level 에 걸쳐 374건 발생했다.

Quick Facts#

Field Value
exception.class Cupix::Errors::System
exception.message failed to merge voxels - error: 500 Internal Server Error
exception.code SYS20000
top_frame app/services/cupix/voxel_service.rb:68
downstream voxel service PUT $CUPIX_VOXEL_SERVICE_URL/merge (data-pipeline-functions merge_voxel.py)
runtime Rails (tesla), Ruby
deploy production-us-west-2-20260731T0510Z0-5d9c7658-cupixworks
env production, us-west-2

Affected Teams#

@http.status_code:500 인 merged_voxels 요청 로그 (최근 14일, 100건 샘플) 의 team.domain 분포다. 특정 tenant 하나가 아니라 여러 tenant 에 걸쳐 발생한다.

Team / Domain Error Count (sample) Impact
southlandind 71 특정 level (66844, 66884) 에서 merge 반복 실패
whitingturner 6 merged voxel 다운로드 실패
realitysa 4 merged voxel 다운로드 실패
cmdintl 4 merged voxel 다운로드 실패
clark-vdc 3 merged voxel 다운로드 실패
기타 (siteline, algtest 등) 나머지 merged voxel 다운로드 실패

Timeline#

  1. 2026-07-14 17:35 KST — 클러스터 최초 발생 (first_seen).
  2. 2026-07-23 14:43 KST — southlandind level 66844/66884 에서 대량 발생 (수초 내 수십 건, 클라이언트 재시도 폭주 추정).
  3. 2026-08-01 09:40 KST — 최근 발생 (last_seen), realitysa level 55863, 요청 duration 약 22.6초.

Scoring#

Confidence 85% · Actionability 36%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 20 code refs, 4 log queries
Code path explicitness 3/3 20 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 0/3 0 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 1/5 critical
Affected files 1/5 14 file(s)
Single repo 1/3 2 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 3/3 no external deps
Data migration 3/3 no migration