ES /docs

Api::V1::JobsController#complete_action (avg 22357ms, max 22357ms)

Service
cupixworks-api
Occurrences
1,060
Status
Reported
Confidence
85%
Actionability
28%
Cluster ID
13c20707-2776-42a4-984f-bc090734484e
First Seen
2026-06-24 17:40 UTC
Last Seen
2026-08-05 01:15 UTC
Datadog↗ Slack↗
Actions

Api::V1::JobsController#complete_action (avg 22357ms, max 22357ms)

What Happened#

2026-06-25 02:40 KST(UTC 17:40:27)에 cupixworks-api의 PUT /api/v1/jobs/1149719/actions/postprocessor/complete 요청이 22.3초 만에 응답되었다(정상 평균은 1~2초). 응답 자체는 200이었지만, postprocessor complete_action 처리 과정에서 동기적으로 실행되는 JobCallbackWorker.perform_inline(stopping → stopped 콜백) 두 단계가 요청 스레드에서 함께 수행되며 latency가 누적되었다. 동일 시간대 같은 서비스에서 발생한 7개의 unknown root cause 클러스터(인시던트 2026-06-24-svc-cupixworks-api--unknown-2)와 함께 묶여 있다.

Quick Facts#

Field Value
resource_name Api::V1::JobsController#complete_action
route PUT /api/v1/jobs/:id/actions/:action_name/complete
sample_trace_id 4072316262835173070
affected_job 1149719 (postprocessor / Capture 721071)
duration 22343.71 ms (cluster avg 22357ms)
db_time 1519.89 ms (~6.8% of total)
status_code 200
env production / us-west-2
deploy production-us-west-2-20260624t0514z0-24b9962e-cupixworks

Affected Teams#

Team / Domain Error Count Impact
burkecgi (team_id 965) 1 postprocessor complete API 22초 지연 — cupix-agent가 응답 대기

Timeline#

  1. 2026-06-25 02:33:13 KST — Capture#run_postprocessor_agent invoked for capture 721071, job 1149719 (postprocessor 실행 시작)
  2. 2026-06-25 02:34:01 KST — PUT /api/v1/jobs/1149719/actions/postprocessor/running 200 OK (running 전이)
  3. 2026-06-25 02:40:27 KST — PUT /api/v1/jobs/1149719/actions/postprocessor/complete 요청 도착 (first_seen)
  4. 2026-06-25 02:40:30 KST — [Job] state changed from running to stopping on Job 1149719
  5. 2026-06-25 02:40:32 KST — JobCallbackWorker#perform job_stopping_callback 시작 (inline)
  6. 2026-06-25 02:40:42 KST — [Job] state changed from stopping to stopped + job_stopped_callback 시작 (inline)
  7. 2026-06-25 02:40:46 KST — job_stopping_callback done, job_stopped_callback done
  8. 2026-06-25 02:40:50 KST — HTTP 200 응답 — 총 22343.71 ms

Scoring#

Confidence 85% · Actionability 28%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 19 code refs, 6 log queries
Code path explicitness 3/3 19 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 0/3 0 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 1/5 critical
Affected files 1/5 25 file(s)
Single repo 1/3 5 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 1/3 external deps found
Data migration 3/3 no migration