ES /docs

API Gateway — 30s integration timeout exceeded by Athena query latency

Service
cupixworks-api
Occurrences
321
Status
Reported
Confidence
90%
Actionability
28%
Cluster ID
cad1cf61-8b2c-4763-88a9-c7d159e53fdb
First Seen
2026-04-21 03:05 UTC
Last Seen
2026-07-30 08:43 UTC
Datadog↗ Slack↗
Actions

API Gateway — 30s integration timeout exceeded by Athena query latency

What Happened#

2026-04-26 22:26~23:06 UTC (약 40분간) cupixworks-api 서비스의 Cupix::SiteinsightsService#_get_element_record_counts 메서드에서 외부 AWS API Gateway Siteinsights 서비스 호출이 504 Gateway Timeout으로 실패했다. 단일 사용자(yohan.kim@cupix.com)가 3개 facility에 대해 반복 요청하면서 총 38건의 에러가 발생했으며, 클라이언트에는 HTTP 502 Bad Gateway로 응답되었다.

Quick Facts#

Field Value
exception.class RestClient::Exception (wrapped as Cupix::Errors::System)
exception.message failed to get validation data - error: 504 Gateway Timeout
top_frame app/services/cupix/siteinsights_service.rb:282
error_code SYS20000 → BG10005 (502)
env production, us-west-2
deploy 20260426T0631Z0, 20260424T1951Z0, 20260424T2039Z0

Affected Teams#

Team / Domain Error Count Impact
admin (team_id: 133) 38 Siteinsights validation 기능 사용 불가 — element record 정합성 검증 실패

Timeline#

  1. 2026-04-26T22:26:38Z — 최초 에러 발생 (facility umphr6)
  2. 2026-04-26T23:06:41Z — 마지막 에러 발생 (40분간 38건)
  3. 2026-04-27 — Error Sweeper 감지, RCA 수행

Scoring#

Confidence 90% · Actionability 28%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 24 code refs, 6 log queries
Code path explicitness 3/3 24 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 1/3 1 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 1/5 critical
Affected files 1/5 17 file(s)
Single repo 1/3 2 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 1/3 external deps found
Data migration 3/3 no migration