ES /docs

Forbidden

Service
cupixworks-migration-worker
Occurrences
73
Status
Reported
Confidence
85%
Actionability
40%
Cluster ID
de99ff2b-391b-427c-9f98-b74c24133593
First Seen
2026-07-18 01:00 UTC
Last Seen
2026-07-18 01:02 UTC
Datadog↗ Slack↗
Actions

Forbidden

What Happened#

2026-07-18 10:00~10:02 KST, cupixworks-migration-worker (tesla Sidekiq migration role) 인스턴스에서 Cupix::NotificationService#delete_user_recipe 와 #unsubscribe 호출이 downstream notification-service API Gateway 로부터 HTTP 403 Forbidden 을 반환받아 73건의 error 로그가 발생했다. 트리거는 동시에 실행된 만료 편집자 권한 정리 cron (Cupix::Cron::EditingPermission.revoke_expired_editor_permissions) 이 대량의 FacilityPermission 을 destroy 하면서 이어진 pub-sub 정리 흐름이다.

Quick Facts#

Field Value
exception.class RestClient::ExceptionWithResponse (rescued, not raised)
exception.message Forbidden / recipe deletion failed: {"message":"Forbidden"}
top_frame lib/cupix/notification_service.rb:65 (delete_user_recipe rescue) / lib/cupix/notification_service.rb:110 (unsubscribe rescue)
runtime Rails / Sidekiq (tesla)
deploy production-us-west-2-20260718T0100Z0-f2b18e95-cupixworks
env production, us-west-2

Affected Teams#

Team / Domain Error Count Impact
tesla cupixworks-migration-worker (notification cleanup) 73 만료 편집자에 대한 email recipe 삭제 및 facility 알림 unsubscribe 가 downstream 에서 거부됨. 사용자 대면 요청은 실패하지 않고, 알림 side effect 만 정리 누락

Timeline#

  1. 2026-07-18 10:00 KST — Cupix::Cron::EditingPermission.revoke_expired_editor_permissions 실행 시작, 만료된 편집자 FacilityPermission 대량 destroy 개시
  2. 2026-07-18 10:00:49 KST (first_seen) — 첫 Forbidden 로그 발생 (Cupix::NotificationService)
  3. 2026-07-18 10:02:45~10:02:47 KST — [Permission][Cleanup] FacilityPermission destroyed. Checking parent permissions for accessor User(...) 대량 info 로그, 이어서 unsubscribe / delete_user_recipe 실패 로그가 연속 발생
  4. 2026-07-18 10:02:47 KST (last_seen) — 마지막 Forbidden 로그, 총 73건

Scoring#

Confidence 85% · Actionability 40%

Confidence#

Dimension Score Detail
Evidence completeness 5/5 18 code refs, 5 log queries
Code path explicitness 3/3 18 file:line refs
Log evidence 3/3 section, query, pattern
RCA structure 3/3 3/3 sections
Revision history 0/3 0 revision(s)
Agent execution 3/3 success

Actionability#

Dimension Score Detail
Fix complexity 5/5 trivial
Affected files 1/5 21 file(s)
Single repo 1/3 3 service(s)
Immediate actions 0/3 absent
Testability 0/3 no test info
External dependency 3/3 no external deps
Data migration 0/3 migration needed