job 1035726 job_stopped_callback error - /var/app/current/vendor/bundle/ruby/3.3.0/gems/mysql2-0.5.4
Service
cupixworks-api
Occurrences
2
Status
Pr_created
Confidence
80%
Actionability
52%
Cluster ID
78dd34b4-d9d4-4310-bf76-c37485b98b86
First Seen
2026-04-24 19:58 UTC
Last Seen
2026-07-13 06:22 UTC
Datadog
Slack
TSLA-12567
PR · teslaActions
현재 상태 pr_created 에서는 실행할 액션이 없습니다.
job 1035726 job_stopped_callback error - /var/app/current/vendor/bundle/ruby/3.3.0/gems/mysql2-0.5.4
What Happened#
2026-04-24 19:58:40 UTC에 cupixworks-api (us-west-2)에서 job 1035726의 job_stopped_callback 처리 중 MySQL2 쿼리 에러가 발생했다. Refinement 작업 완료 후 상태 전이 과정에서 깊게 중첩된 state machine 트랜잭션이 동일 레코드에 대한 lock 경합을 일으켜 MySQL innodb_lock_wait_timeout에 도달한 것으로 추정된다.
Quick Facts#
| Field | Value |
|---|---|
| exception.class | Mysql2::Error (ActiveRecord를 통해 전파) |
| exception.message | 로그에 exception message가 누락됨 — backtrace만 기록 |
| top_frame | mysql2/client.rb:148:in '_query' |
| runtime | Ruby 3.3.0, Rails 7.2.2, mysql2 0.5.4, Sidekiq 7.3.9 |
| deploy | production-us-west-2-20260424T1951Z0-a4578cc0-cupixworks |
| env | production, us-west-2 |
Timeline#
- 19:56:28 UTC — Capture 687538에 대한 refinement job 1035726 생성 및 SQS 메시지 전송
- 19:56:38 UTC — ECS task stopped 이벤트 수신,
PUT /api/v1/jobs/1035726호출 - 19:57:50 UTC — Job 1035726 state
created → stopped전이,job_stopped_callback시작 - 19:58:40 UTC —
touch_reviews_after_save내 MySQL UPDATE 쿼리 실패 (콜백 시작 후 ~50초) - 19:58:40 UTC — 에러가
JobCallbackWorker의 rescue 블록에서 잡히고 로깅됨, HTTP 200 반환
Scoring#
Confidence 80% · Actionability 52%
Confidence#
| Dimension | Score | Detail |
|---|---|---|
| Evidence completeness | 5/5 | 22 code refs, 6 log queries |
| Code path explicitness | 3/3 | 22 file:line refs |
| Log evidence | 2/3 | section, query |
| RCA structure | 3/3 | 3/3 sections |
| Revision history | 0/3 | 0 revision(s) |
| Agent execution | 3/3 | success |
Actionability#
| Dimension | Score | Detail |
|---|---|---|
| Fix complexity | 5/5 | trivial |
| Affected files | 1/5 | 35 file(s) |
| Single repo | 1/3 | 2 service(s) |
| Immediate actions | 0/3 | absent |
| Testability | 0/3 | no test info |
| External dependency | 3/3 | no external deps |
| Data migration | 3/3 | no migration |