job 10455 job_stopped_callback error - /var/app/current/vendor/bundle/ruby/3.3.0/gems/logger-1.6.6/l

Service

cupixworks-worker

Occurrences

Status

Abandoned

Confidence

90%

Actionability

24%

Cluster ID

d971e389-a359-4d46-9e42-7fb1e3c90ef6

First Seen

2026-07-06 00:35 UTC

Last Seen

2026-07-06 00:35 UTC

Actions

현재 상태 abandoned 에서는 실행할 액션이 없습니다.

job 10455 job_stopped_callback error - /var/app/current/vendor/bundle/ruby/3.3.0/gems/logger-1.6.6/l

What Happened#

2026-07-06 09:35 KST에 production cupixworks-worker (ap-southeast-1)에서 Cupix::Cron::Job.clean_running_jobs cron 실행 중 3건의 에러가 발생했다. Job 10455/10456/10457을 stopped 상태로 전이하는 과정에서 Cupix::Event singleton logger가 #{Rails.root}/log/tesla_production-event.log 파일을 열려다 실패했다. 동일 패턴이 지난 14일간 4개 프로덕션 리전 전체에서 총 17회 관측된다.

Quick Facts#

Field	Value
exception.class	`Errno::*` (uncertain — needs verification, `e.message` 필드가 로그에 비어 있음)
top_frame	`logger-1.6.6/lib/logger/log_device.rb:114:in initialize` (실제 `File.open` C-frame)
triggered_from	`lib/cupix/event.rb:8` (Cupix::Event Singleton `initialize`)
runtime	Ruby 3.3.0, logger 1.6.6, activesupport 7.2.2
deploy	`production-ap-southeast-1-20260706T0035Z0-13e7c827-cupixworks`
env	production, region ap-southeast-1
cron	`every '5,15,25,35,45,55 * * * *'` (`config/schedule.rb:67`)

Affected Teams#

Team / Domain	Error Count	Impact
cupixworks-worker (Job / Capture state machine)	17건 / 14일 (본 클러스터 3건)	Capture `job_stopped_callback` 이 예외로 종료 → `event_reason_processing_finalized` 이후 로직(예: `Cupix::EventService.publish_event`, `event_created!`, `Analytics.track`)이 트랜잭션 내에서 실행되지 못하고 rescue 되어 `Cupix::Logger.error` 만 남는다. state machine 트랜지션(:stopped)은 `after_transition` 콜백에서 예외가 삼켜지므로 job 상태 자체는 stopped로 커밋된다.

이벤트 publish 실패로 Segment/Analytics 이벤트 유실 및 이벤트 스토어의 Event 레코드 미생성 가능성이 있다 — uncertain, needs verification via Cupix::EventService.publish_event 성공 여부 로그.

Timeline#

2026-07-06 09:35:34 KST — ap-southeast-1의 rails runner Cupix::Cron::Job.clean_running_jobs 실행 (cron */10 @ :35)
2026-07-06 09:35:34 KST — Job 10455/10456/10457 (state=running, state_updated_at < 3.days.ago)가 stopped_state_with_error('TES10003', ...) 로 전이됨
2026-07-06 09:35:34 KST — 각 Job의 after_transition to: :stopped → JobCallbackWorker.perform_inline → job.jobable.job_stopped_callback → event_reason_processing_finalized → Cupix::Event.publish → Singleton initialize 진입
2026-07-06 09:35:34 KST — Logger::LogDevice#open_logfile 의 File.open 이 Errno::* raise, JobCallbackWorker#perform (rescue StandardError) 가 캐치하여 Datadog에 error 로그로 기록 (log_device.rb:114)

Scoring#

Confidence 90% · Actionability 24%

Confidence#

Dimension	Score	Detail
Evidence completeness	5/5	78 code refs, 3 log queries
Code path explicitness	3/3	78 file:line refs
Log evidence	2/3	section, query
RCA structure	3/3	3/3 sections
Revision history	2/3	2 revision(s)
Agent execution	3/3	success

Actionability#

Dimension	Score	Detail
Fix complexity	3/5	standard
Affected files	1/5	65 file(s)
Single repo	1/3	2 service(s)
Immediate actions	0/3	absent
Testability	0/3	no test info
External dependency	1/3	external deps found
Data migration	0/3	migration needed