failed to generate thumbnail - error: Timed out connecting to server
failed to get captured area - error: Timed out reading data from server
CreateCaptureIntelligenceJob#run | error: Mysql2::Error::TimeoutError: Lock wait timeout exceeded; t
AwsTask#fetch! — cross-region IAM permission denied
BIM360 Authentication failed: Connection reset by peer
failed to sync line item opportunities from Salesforce - line_item_id: 1290, error: Validation faile
failed to generate thumbnail - error: 503 Service Unavailable
Elasticsearch connection pool exhaustion — concurrent bulk indexing
BulkableRepository missing .compact on nil IDs
BulkPartialIndexWorker — partial update before full document indexed
Elasticsearch mapping schema drift — immutable field type mismatch
Backfill facility defaults: failed
Failed to save partial JSON Element 15382518
Bulk operation failed
Editing split failed: Couldn't find Editing with 'id'=1204740
AnalyzePanoWorker::perform | error on 40003 - The bucket you are attempting to access must be addres
job 10455 job_stopped_callback error - /var/app/current/vendor/bundle/ruby/3.3.0/gems/logger-1.6.6/l
Phase 4 reconcile: orphan ET without template
ProgressSerializer attribute block arity mismatch with fast_jsonapi
Timeout while getting cupix-trace-id
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
StandardError - wrong number of arguments (given 1, expected 0)
ThumbnailService HTTP 500 — AWS API Gateway timeout
AnalyzePanoWorker::perform | error on 737963 - Mysql2::Error::TimeoutError: Lock wait timeout exceed
[Cupix::Cron::Integration] failed to renew integration: BIM360 Authentication failed:
PullTaskWorker::perform | error on 9680 - Rate exceeded
SavePartialJsonToFileWorker logs normal race condition as error
Forbidden
flush_geo_coordinate - error - message: Mysql2::Error: The MySQL server is running with the --read-o
Missing trashed filter in facility refresh query
Fail to create salesforce Facility resource. reason: INVALID_CROSS_REFERENCE_KEY: invalid cross refe
Failed to create event: Permission denied @ rb_sysopen - /var/app/current/log/tesla_production-event
Editing split failed: Couldn't find Editing with 'id'=5549
[post_pointcloud_state_change_worker] Retrying 1 times, error: 429 Too Many Requests
flush_geo_coordinate - error - message: Mysql2::Error::TimeoutError: Lock wait timeout exceeded; try
FacilityType with id 298 not found after 6 retries
BIM360 refresh_token failed: - error: 500 Internal Server Error
[CustomerIo] track failed - event: BE_MAIL_CAPTURE_PROCESSING_COMPLETE
ReviewPermission with id 131231 not found after 6 retries
Category with ids [nil] does not match after 6 retries
Bulk index partial failure
[SalesforceWebToCaseWorker] fail to send web to case. reason: 'RestClient error' case_type: 'floorpl
Directory not writable before file write attempt
PullTaskWorker::perform | error on 771599 - Mysql2::Error::TimeoutError: Lock wait timeout exceeded;
[fail to translation bim. BimRevision: 5194 Status: failed, Messages: {"type"=>"error", "code"=>"Rev
VoxelService captured_area API returns 503 Service Unavailable
VoxelService /captured_area — API Gateway timeout exceeds Athena query duration
batch_pull! error on batch arn:aws:ecs:us-west-2:002596530511:task/cupix-tesla-ece/f08cf04288c144f38
StandardError - Waited 7 sec, 0/10 available
error occurred while reprocess. capture_id: 2356, reason:Capture is not invokable status
FacilityPermission with id 571060 not found after 6 retries
error on sitetrack_id: 21354 - undefined method `untrashed?' for nil
Fail to create salesforce Facility resource. reason: STRING_TOO_LONG: Project Name: data value too l
Elasticsearch dynamic mapping type mismatch — boolean vs integer
Editing with id 1204740 not found after 6 retries
Failed to save partial JSON ElementTrace 102272260
TSLA-12839 D1 recurrence detected
error occurred while reprocess. capture_id: 30152, reason:Model has invalid state to reprocess, user
[Integration] failed to refresh token for bim360 integration(239) - state: failed, error_message: BI
UploadCpcLogWorker::perform | error on job 88615 - Function not found: arn:aws:lambda:eu-central-1:0
recipe deletion failed: {"message":"Forbidden"}
ConnectionPool exhaustion during ES latency spike
VoxelService 503 — downstream throttling/concurrency limit
invoke postprocessor failed on Capture 47027
CopyRequest async worker race — enqueue before transaction commit
AwsTask#stop! missing error handling for removed tasks
WorkspacePermission with id 114366 not found after 6 retries
[Inotify] job: 1018639, task not found
failed to calculate voxels for Capture ID: 745783, error: error state model cannot calculate voxel
AnalysisTimeoutWorker::perform | timeout on 686589
Sidekiq job died after all retries
error on sitetrack_id: 21336 - Mysql2::Error::TimeoutError: Lock wait timeout exceeded; try restarti
Editing split failed: Mysql2::Error::TimeoutError: Lock wait timeout exceeded; try restarting transa
ES bulk partial index failed (non-recoverable items)
Cupix::Event logger init fails — permission denied on log file
error occurred while reprocess. capture_id: 30152, reason:Permission denied, user_id: 3615
Post-split cap still exceeded after max re-split retries, giving up
batch_pull! error on batch arn:aws:ecs:us-west-2:002596530511:task/cupix-tesla-ece/ab866da276af40d4b
Missing Lambda function in eu-central-1 region — config mismatch
Failed to save Partial JSON Capture 701882 to file /var/data_changes/captures/partial/2026-05-22/usw
Fail to create salesforce Facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
S3 bucket not found — nonexistent hosting bucket reference
CopyRequest enqueues Sidekiq job inside transaction — visibility race
Failed to refresh average cadence on gh7xhe: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on d5fhi3: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on oix034: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on 9kcvz7: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on g7voz4: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on tk5pez: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on dgspfe: Calculating average cadence is not supported for trashe
Failed to refresh average cadence on xmmxpf: Calculating average cadence is not supported for trashe
Category with ids [2292] does not match after 6 retries
FacilityPermission with id 599043 not found after 6 retries
flush_geo_coordinate - error - message: Mysql2::Error::TimeoutError: Lock wait timeout exceeded; try
job 216996 job_stopped_callback error - /var/app/current/vendor/bundle/ruby/3.3.0/gems/logger-1.6.6/
failed to sync line item opportunities from Salesforce - line_item_id: 13696, error: Couldn't find L
AnalysisTimeoutWorker::perform | timeout on 79017
TSLA-12839 D1 recurrence detected
AnalysisTimeoutWorker::perform | timeout on 721010
failed to generate thumbnail - error: 500 Internal Server Error
[[400] {"error":{"root_cause":{"type":"illegal_argument_exception","reason":"mapper [error_code] can
flush_geo_coordinate - error - message: The specified bucket does not exist
Failed to save Partial JSON EntityParameterGroup 1193 to file /var/data_changes/entity_parameter_gro
Failed to save Partial JSON Deviation 1825 to file /var/data_changes/deviations/partial/2026-06-24/a
failed to sync line item opportunities from Salesforce - line_item_id: 13604, error: Couldn't find L
flush_geo_coordinate - error - message: Waited 7 sec, 0/10 available
StandardError - Waited 7 sec, 0/10 available
Failed to get records - Waited 7 sec, 0/10 available
Bulk operation failed
Failed to create event: Permission denied @ rb_sysopen - /var/app/current/log/tesla_production-event
Bookmark with id 4550 not found after 6 retries
failed to get captured area - error: 500 Internal Server Error
error on sitetrack_id: 19563 - Waited 7 sec, 0/10 available
Index error - Waited 7 sec, 0/10 available
PullTaskWorker::perform | error on 9402 - Rate exceeded
ES doc_missing after max retries
ES bulk partial index dead
StandardError - wrong number of arguments (given 1, expected 0)
Index error - wrong number of arguments (given 1, expected 0)
Sidekiq job died after all retries
PullTaskWorker::perform | error on 9384 - User: arn:aws:iam::002596530511:user/system/tesla-api-prod
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
flush_geo_coordinate - error - message: The specified bucket does not exist
Failed to save Partial JSON ElementTrace 121549555 to file /var/data_changes/element_traces/partial/
Failed to save Partial JSON Element 15615729 to file /var/data_changes/elements/partial/2026-06-13/u
Failed to save Partial JSON Bim 18234 to file /var/data_changes/bims/partial/2026-06-13/uswe2/178133
Failed to save Partial JSON EditingEntity 1721164 to file /var/data_changes/editing_entities/partial
Failed to save Partial JSON Record 130784 to file /var/data_changes/records/partial/2026-06-12/uswe2
Failed to save Partial JSON Cluster 1380988 to file /var/data_changes/clusters/partial/2026-06-12/us
Failed to save Partial JSON Editing 1161729 to file /var/data_changes/editings/partial/2026-06-12/us
Failed to save Partial JSON Capture 713499 to file /var/data_changes/captures/partial/2026-06-12/usw
failed to generate thumbnail - error: Timed out connecting to server
ES search failed: Resolving timed out after 23622 milliseconds
Bookmark with id 4527 not found after 6 retries
StorageTeam with id 4285 not found after 6 retries
ReviewPermission with id 128315 not found after 6 retries
TSLA-12839 D1 recurrence detected
recipe deletion failed: {"message":"Forbidden"}
Forbidden
[Index error - [429] {"error":{"root_cause":{"type":"circuit_breaking_exception","reason":"[parent]
failed to sync line item opportunities from Salesforce - line_item_id: 1325, error: Couldn't find Li
[Cupix::Cron::Integration] failed to renew integration: Connection reset by peer
[post_pointcloud_state_change_worker] Retrying 1 times, error: SSL_connect returned=1 errno=0 peerad
Sidekiq job died after all retries
Failed to get records - Waited 7 sec, 0/10 available
flush_geo_coordinate - error - message: Aws::S3::Errors::Http502Error
failed to generate thumbnail - error: 404 Not Found
flush_geo_coordinate - error - message: Net::ReadTimeout with #<TCPSocket:(closed)>
Index error - Operation timed out after 10002 milliseconds with 0 bytes received
WorkspacePermission with id 122974 not found after 6 retries
FacilityPermission with id 582481 not found after 6 retries
Failed to save Partial JSON Deviation 1791 to file /var/data_changes/deviations/partial/2026-06-03/a
Index error - Waited 7 sec, 0/10 available
Failed to refresh average cadence on irt3yg: Calculating average cadence is not supported for trashe
[[400] {"error":{"root_cause":{"type":"illegal_argument_exception","reason":"mapper [priority] canno
Association with id 71497 not found after 6 retries
flush_geo_coordinate - error - message: Mysql2::Error::TimeoutError: Lock wait timeout exceeded; try
Sidekiq job died after all retries
BulkableRepository#bulk! — nil array passed without .compact
Association with id 66194 not found after 6 retries
Fail to update salesforce facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
[Inotify] job: 1046543, task not found
[fail to translation bim. BimRevision: 4600 Status: failed, Messages: {"type"=>"error", "message"=>"
Failed to save Partial JSON AppliedProduct 5 to file /var/data_changes/applied_products/partial/2026
ReviewPermission with id 124802 not found after 6 retries
Failed to save Partial JSON Sitetrack 18168 to file /var/data_changes/sitetracks/partial/2026-05-22/
ES bulk partial index dead
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
AnalysisTimeoutWorker::perform | timeout on 702401
Failed to save Partial JSON Deviation 1790 to file /var/data_changes/deviations/partial/2026-05-25/a
Failed to save Partial JSON Facility 17 to file /var/data_changes/facilities/partial/2026-05-11/cace
Failed to save Partial JSON Record 128537 to file /var/data_changes/records/partial/2026-05-22/uswe2
SavePartialJsonToFileWorker — deleted record race condition
Failed to save Partial JSON Reviewer 808437 to file /var/data_changes/reviewers/partial/2026-05-22/u
failed to generate thumbnail - error: 503 Service Unavailable
AnalysisTimeoutWorker::perform | timeout on 69765
Failed to save Partial JSON Cupix::Cron::Integration 6090 to file /var/data_changes/cupix/cron/integ
Failed to save Partial JSON Level 55 to file /var/data_changes/levels/partial/2026-04-20/cace1/17767
PullTaskWorker::perform | error on 8365 - User: arn:aws:iam::002596530511:user/system/tesla-api-prod
[Index error - [429] {"error":{"root_cause":{"type":"circuit_breaking_exception","reason":"[parent]
error on sitetrack_id: 18289 - Waited 7 sec, 0/10 available
Failed to save Partial JSON BimRevision 23688 to file /var/data_changes/bim_revisions/partial/2026-0
Failed to save Partial JSON Asset 91660 to file /var/data_changes/assets/partial/2026-05-22/uswe2/17
error on sitetrack_id: 956 - Waited 7 sec, 0/10 available
flush_geo_coordinate - error - message: The specified bucket does not exist
Failed to save Partial JSON EntityParameter 6980 to file /var/data_changes/entity_parameters/partial
flush_geo_coordinate - error - message: We encountered an internal error. Please try again.
UploadCpcLogWorker::perform | error on job 90507 - Function not found: arn:aws:lambda:eu-central-1:0
Failed to save Partial JSON Task 14864 to file /var/data_changes/tasks/partial/2026-04-23/apse2/1776
Failed to save Partial JSON Association 71035 to file /var/data_changes/associations/partial/2026-05
ES bulk partial index dead
Failed to save Partial JSON TeamPermission 74603 to file /var/data_changes/team_permissions/partial/
Fail to create salesforce Facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
Failed to save Partial JSON AnnotationLayer 44514 to file /var/data_changes/annotation_layers/partia
Failed to save Partial JSON FacilityPermission 577546 to file /var/data_changes/facility_permissions
StandardError - Waited 7 sec, 0/10 available
flush_geo_coordinate - error - message: Waited 7 sec, 0/10 available
Fail to create salesforce Facility resource. reason: STRING_TOO_LONG: Project Name: data value too l
Failed to save Partial JSON AerialMap 443 to file /var/data_changes/aerial_maps/partial/2026-05-22/u
Failed to save Partial JSON Cluster 1344003 to file /var/data_changes/clusters/partial/2026-05-22/us
ElementTrace with ids [nil] does not match after 6 retries
Failed to save Partial JSON GroupedUser 64115 to file /var/data_changes/grouped_users/partial/2026-0
Failed to get records - Waited 7 sec, 0/10 available
AnalysisTimeoutWorker::perform | timeout on 72812
Failed to save Partial JSON FloorplanSource 35319 to file /var/data_changes/floorplan_sources/partia
failed to get captured area - error: 503 Service Unavailable
Failed to save Partial JSON Floorplan 69389 to file /var/data_changes/floorplans/partial/2026-05-22/
Failed to save Partial JSON FacilityType 19 to file /var/data_changes/facility_types/partial/2026-04
Failed to save Partial JSON Team 1169 to file /var/data_changes/teams/partial/2026-05-23/uswe2/17794
Failed to save Partial JSON Bookmark 4360 to file /var/data_changes/bookmarks/partial/2026-05-22/usw
Failed to save Partial JSON EntityParameterGroup 1056 to file /var/data_changes/entity_parameter_gro
ES doc_missing after max retries
PullTaskWorker::perform | error on 6701 - Rate exceeded
ES search failed: Operation timed out after 10002 milliseconds with 0 bytes received
failed to get captured area - error: 503 Service Unavailable
Failed to save Partial JSON Workspace 45 to file /var/data_changes/workspaces/partial/2026-04-27/aps
Failed to save Partial JSON Capture 66 to file /var/data_changes/captures/partial/2026-05-08/cace1/1
failed to generate thumbnail - error: 404 Not Found
Failed to save Partial JSON EntityParameterGroup 756 to file /var/data_changes/entity_parameter_grou
Failed to save Partial JSON RecordPermission 167968 to file /var/data_changes/record_permissions/par
Failed to save Partial JSON Element 14935389 to file /var/data_changes/elements/partial/2026-05-23/u
Failed to refresh average cadence on sp8b91: Calculating average cadence is not supported for trashe
PullTaskWorker::perform | error on 8401 - Rate exceeded
[post_pointcloud_state_change_worker] Retrying 1 times, error: SSL_read: unexpected eof while readin
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
Failed to save Partial JSON Integration 4803 to file /var/data_changes/integrations/partial/2026-05-
Failed to save Partial JSON Review 60378 to file /var/data_changes/reviews/partial/2026-05-22/uswe2/
Editing split failed: Waited 7 sec, 0/10 available
Failed to save Partial JSON EntityParameter 5963 to file /var/data_changes/entity_parameters/partial
failed to generate thumbnail - error: 504 Gateway Timeout
Failed to save Partial JSON Level 82956 to file /var/data_changes/levels/partial/2026-05-22/uswe2/17
[Element with ids nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, ni
Association with id 69650 not found after 6 retries
failed to generate thumbnail - error: 500 Internal Server Error
Category with ids [nil] does not match after 6 retries
WorkspacePermission with id 111780 not found after 6 retries
Failed to save Partial JSON Facility 17 to file /var/data_changes/facilities/partial/2026-04-20/cace
Sidekiq job died after all retries
FacilityPermission with id 177830 not found after 6 retries
Fail to create salesforce Facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
AnalysisTimeoutWorker::perform | timeout on 68408
failed to generate thumbnail - error: 503 Service Unavailable
ReviewPermission with id 122781 not found after 6 retries
Failed to save Partial JSON EntityParameter 553 to file /var/data_changes/entity_parameters/partial/
PullTaskWorker::perform | error on 6518 - User: arn:aws:iam::002596530511:user/system/tesla-api-prod
flush_geo_coordinate - error - message: The specified bucket does not exist
fail to post to issue service. reason: 'RestClient error' message: {"result":{"code":"ARG10002","mes
Failed to save Partial JSON Workspace 46 to file /var/data_changes/workspaces/partial/2026-04-16/aps
Elasticsearch mapping type mismatch — field type change rejected
failed to sync line item opportunities from Salesforce - line_item_id: 97, error: Couldn't find Line
PullTaskWorker::perform | error on 5686 - Rate exceeded
AnalysisTimeoutWorker::perform | timeout on 674893
Failed to save Partial JSON EntityParameterGroup 719 to file /var/data_changes/entity_parameter_grou
failed to get captured area - error: 503 Service Unavailable
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
failed to generate thumbnail - error: 500 Internal Server Error
Fail to create salesforce Facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
PullTaskWorker::perform | error on 6276 - User: arn:aws:iam::002596530511:user/system/tesla-api-prod
Failed to save Partial JSON EntityParameterGroup 737 to file /var/data_changes/entity_parameter_grou
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
PullTaskWorker::perform | error on 6154 - Rate exceeded
Failed to save Partial JSON EntityParameterGroup 113 to file /var/data_changes/entity_parameter_grou
[fail to translation bim. BimRevision: 22477 Status: failed, Messages: {"type"=>"error", "message"=>
flush_geo_coordinate - error - message: The specified bucket does not exist
Fail to create salesforce Facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
failed to calculate captured size for Facility ID: 10149, error: failed to get captured area - error
BulkableRepository bulk path missing .compact on failed IDs
Failed to save Partial JSON EntityParameter 5912 to file /var/data_changes/entity_parameters/partial
Category with ids [nil] does not match after 6 retries
fail to post to issue service. reason: 'RestClient error' message: {"result":{"code":"ARG10002","mes
[Element with ids nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, ni
Failed to save Partial JSON EntityParameter 5741 to file /var/data_changes/entity_parameters/partial
PullTaskWorker::perform | error on 5941 - User: arn:aws:iam::002596530511:user/system/tesla-api-prod
Sidekiq job died after all retries
fail to post to issue service. reason: 'RestClient error' message: {"result":{"code":"ARG10002","mes
AnalysisTimeoutWorker::perform | timeout on 679776
flush_geo_coordinate - error - message: The specified bucket does not exist
failed to get captured area - error: 503 Service Unavailable
Fail to update salesforce facility resource. reason: FIELD_CUSTOM_VALIDATION_EXCEPTION: The Account
AnalysisTimeoutWorker::perform | timeout on 684497
InvalidParameterException on task_id: arn:aws:ecs:us-west-2:002596530511:task/cupix-tesla-ece/325901
failed to generate thumbnail - error: 503 Service Unavailable
failed to get captured area - error: 503 Service Unavailable
flush_geo_coordinate - error - message: Failed to open TCP connection to s3.me-south-1.amazonaws.com
[fail to translation bim. BimRevision: 22868 Status: failed, Messages: {"type"=>"error", "message"=>
failed to calculate captured size for Facility ID: 77, error: failed to get captured area - error: 5
Workarea with ids [nil, nil] does not match after 6 retries
[[400] {"error":{"root_cause":{"type":"illegal_argument_exception","reason":"mapper [priority] canno
Association with id 65881 not found after 6 retries
Bookmark with id 3899 not found after 6 retries
failed to generate thumbnail - error: 500 Internal Server Error
fail to translation bim. BimRevision: 22797 Status: failed, Messages:
Sidekiq job died after all retries
Workarea with ids [nil, nil, nil, nil, nil, nil, nil, nil] does not match after 6 retries
failed to generate thumbnail - error: 503 Service Unavailable
Workarea with ids [nil, nil, nil, nil, nil, nil, nil] does not match after 6 retries
Category with ids [nil] does not match after 6 retries
Workarea with ids [nil, nil] does not match after 6 retries
Workarea with ids [nil, 105897] does not match after 6 retries