ES /docs

PixGenieProcess | process error: The operation was aborted

Service
cupixworks-pix-genie-preprocessor-instance
Occurrences
32
Status
Reported
Confidence
85%
Actionability
28%
Cluster ID
1c0c903a-36ec-4f99-b276-9b72b1493dfd
First Seen
2026-06-11 13:23 UTC
Last Seen
2026-08-01 09:52 UTC
Datadog↗ Slack↗
Actions

PixGenieProcess | process error: The operation was aborted

What Happened#

2026-06-11 22:23 KST에 cupixworks-pix-genie-preprocessor-instance agent가 captureId 709953에 대한 PixGenie 전처리 작업을 수행하던 중, 자식 Python 프로세스(docker_entrypoint.py → lift2dsegmentations_cli)가 2시간 hard timeout (TIMEOUT_MS = 2 * 60 * 60 * 1000)에 도달하여 AbortController가 발동되었다. Node가 자식 프로세스를 강제 종료하면서 'error' 이벤트로 AbortError: The operation was aborted를 emit, agent가 실패 종료했다. us-west-2 / cupix tenant / production 환경에서 1건 발생.

Quick Facts#

Field Value
exception.class AbortError
exception.code ABORT_ERR
exception.message The operation was aborted (cause: Error: Process timeout)
top_frame pixgenie.process.ts:60 (this._abortController!.abort(new Error('Process timeout')))
runtime Node.js child_process (spawned python3 docker_entrypoint.py)
env production, region us-west-2, tenant cupix
captureId 709953

Affected Teams#

Team / Domain Error Count Impact
cana / pix-genie preprocessor 1 단일 capture(709953)의 PixGenie 전처리 실패. PixGenieState.Error로 마킹되고 job이 Stopped로 전환됨 — 사용자 대시보드에서 해당 capture의 PixGenie 결과 미생성

Timeline#

  1. 2026-06-11 20:23:17 KST — PixGenieProcess::execute | begin - captureId: 709953 (Python 자식 프로세스 spawn)
  2. 2026-06-11 20:32:42 KST — ExtractSegments 단계 (706 frames decode 완료, MobileSAMv2 + DINOv3 inference)
  3. 2026-06-11 20:43:59 KST — ExtractFeatures (DINOv3 vitl16_lvd1689m, image_size 1536) 단계 진행
  4. 2026-06-11 21:38:07 KST — Lift2DSegmentationsCli 시작 (lift2dsegmentations_cli --input … --db pixgenie.sqlite)
  5. 2026-06-11 21:38:26~28 KST — Lift2dSegmentations::execute() start, 14M vertices에 대해 computeVisibilityByReprojectionForRange 실행. 이 시점부터 stdout 로그에 [TRACE TIMEOUT] detectAndFixVideoFrameTimestampCorruption, #391 마커가 반복 출력
  6. 2026-06-11 21:48:30 KST — Refine / MaskCoverage 로그 일부 출력 (마지막으로 관측된 정상 진행)
  7. 2026-06-11 22:23:17 KST — PixGenieProcess | process timeout, aborting... (warn) → PixGenieProcess | process error: The operation was aborted (error). begin으로부터 정확히 2시간 경과 — 코드 상의 TIMEOUT_MS 도달
  8. 2026-06-11 22:23:18 KST — PreprocessorService::run | end 에 AbortError full stack 기록 (cause: Error: Process timeout), workspace cleanup

Scoring#

Confidence 85% · Actionability 28%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 16 code refs, 9 log queries
Code path explicitness 3/3 16 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 0/3 0 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 1/5 critical
Affected files 1/5 13 file(s)
Single repo 1/3 4 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 1/3 external deps found
Data migration 3/3 no migration