ES /docs

Elasticsearch connection pool exhaustion in after_commit hook

Service
cupixworks-api
Occurrences
68
Status
Reported
Confidence
85%
Actionability
28%
Cluster ID
53672178-252d-4e6d-8088-04ea34776d95
First Seen
2026-04-24 20:10 UTC
Last Seen
2026-06-23 19:03 UTC
Datadog↗ Slack↗
Actions

Elasticsearch connection pool exhaustion in after_commit hook

What Happened#

2026-04-24 20:10 UTC에 cupixworks-api의 POST /api/v1/panos/82417652/mask_upload_url 엔드포인트에서 Elasticsearch connection pool이 고갈되어 ConnectionPool::TimeoutError가 발생했다. 요청 총 소요 시간이 약 34.8분(2,087,601ms)으로 비정상적으로 길었으며, 해당 호스트의 Elasticsearch connection pool(size: 10) 전체가 소진된 상태에서 7초 대기 후 timeout이 발생했다.

Quick Facts#

Field Value
exception.class ConnectionPool::TimeoutError
exception.message Waited 7 sec, 0/10 available
top_frame app/models/concerns/searchable.rb:112
deploy production-us-west-2-20260424T0117Z0-a4578cc0-cupixworks
env production, us-west-2

Timeline#

  1. 2026-04-24 ~19:35 UTC — 동일 호스트에서 요청 시작 (추정, 총 소요시간 ~34.8분 역산)
  2. 2026-04-24 20:10:01.285Z — ConnectionPool::TimeoutError 발생, 502 응답 반환
  3. 2026-04-25 — Error Sweeper 수집 및 RCA 수행

Scoring#

Confidence 85% · Actionability 28%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 12 code refs, 6 log queries
Code path explicitness 3/3 12 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 0/3 0 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 1/5 critical
Affected files 1/5 14 file(s)
Single repo 1/3 2 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 1/3 external deps found
Data migration 3/3 no migration