Open thumbnail logs in Grafana ↗ (internal; via the SSH SOCKS tunnel to hal49)

Showing detail for thumbnail request 20461:118699

Failed thumbnail 20461:118699 2026-07-20 15:40:38 worker thumbnails-68db494c78-gr657

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=648,294,4170,2276&endDwell=0&endTime=145755&format=mp4&fps=6&height=720&labelsFromDataset&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2022-05-10.timemachine/&startDwell=0&startTime=145055&tileFormat=mp4&width=1280

Fatal error

404 Not Found
/usr/lib/ruby/3.2.0/open-uri.rb:369:in `open_http'
/usr/lib/ruby/3.2.0/open-uri.rb:760:in `buffer_open'
/usr/lib/ruby/3.2.0/open-uri.rb:214:in `block in open_loop'
/usr/lib/ruby/3.2.0/open-uri.rb:212:in `catch'
/usr/lib/ruby/3.2.0/open-uri.rb:212:in `open_loop'
/usr/lib/ruby/3.2.0/open-uri.rb:153:in `open_uri'
/usr/lib/ruby/3.2.0/open-uri.rb:740:in `open'
/usr/lib/ruby/3.2.0/open-uri.rb:29:in `open'
/app/timemachine-thumbnail-server/thumbnail-server.rb:429:in `start_thumbnail_not_screenshot'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1182:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1624:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1749:in `<main>'

Last checkpoint

2026-07-20 15:40:38.769 THUMB 20461:118699:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.100.5","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"404 Not Found\n/usr/lib/ruby/3.2.0/open-uri.rb:369:in `open_http'\n/usr/lib/ruby/3.2.0/open-uri.rb:760:in `buffer_open'\n/usr/lib/ruby/3.2.0/open-uri.rb:214:in `block

Last line

2026-07-20 15:40:38.808 THUMB 20461:118699:0 request.body {"service":"Thumbnails","datetime":"2026-07-20T15:40:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.100.5 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2022-05-10.timemachine/

Worker

thumbnails-68db494c78-gr657

Raw stats

{"REMOTE_ADDR": "10.1.100.5", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "404 Not Found\n/usr/lib/ruby/3.2.0/open-uri.rb:369:in `open_http'\n/usr/lib/ruby/3.2.0/open-uri.rb:760:in `buffer_open'\n/usr/lib/ruby/3.2.0/open-uri.rb:214:in `block in open_loop'\n/usr/lib/ruby/3.2.0/open-uri.rb:212:in `catch'\n/usr/lib/ruby/3.2.0/open-uri.rb:212:in `open_loop'\n/usr/lib/ruby/3.2.0/open-uri.rb:153:in `open_uri'\n/usr/lib/ruby/3.2.0/open-uri.rb:740:in `open'\n/usr/lib/ruby/3.2.0/open-uri.rb:29:in `open'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:429:in `start_thumbnail_not_screenshot'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1182:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1624:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1749:in `<main>'"}
logs in Grafana ↗

Full log

2026-07-20 15:40:38.678 THUMB 20461:118699:0 Not found in cache; computing
2026-07-20 15:40:38.683 THUMB 20461:118699:0 STARTTHUMBNAIL http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=648,294,4170,2276&endDwell=0&endTime=145755&format=mp4&fps=6&height=720&labelsFromDataset&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2022-05-10.timemachine/&startDwell=0&startTime=145055&tileFormat=mp4&width=1280
2026-07-20 15:40:38.683 THUMB 20461:118699:0 CHECKPOINTTHUMBNAIL START {"REMOTE_ADDR":"10.1.100.5","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export"}
2026-07-20 15:40:38.769 THUMB 20461:118699:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.100.5","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"404 Not Found\n/usr/lib/ruby/3.2.0/open-uri.rb:369:in `open_http'\n/usr/lib/ruby/3.2.0/open-uri.rb:760:in `buffer_open'\n/usr/lib/ruby/3.2.0/open-uri.rb:214:in `block in open_loop'\n/usr/lib/ruby/3.2.0/open-uri.rb:212:in `catch'\n/usr/lib/ruby/3.2.0/open-uri.rb:212:in `open_loop'\n/usr/lib/ruby/3.2.0/open-uri.rb:153:in `open_uri'\n/usr/lib/ruby/3.2.0/open-uri.rb:740:in `open'\n/usr/lib/ruby/3.2.0/open-uri.rb:29:in `open'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:429:in `start_thumbnail_not_screenshot'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1182:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1624:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1749:in `<main>'"}
2026-07-20 15:40:38.769 THUMB 20461:118699:0 url is https://stat.createlab.org/api/log host stat.createlab.org port 443
2026-07-20 15:40:38.770 THUMB 20461:118699:0 request.body {"service":"Thumbnails","datetime":"2026-07-20T15:40:38+00:00","host":"-","level":"info","summary":"Thumbnail failed 20461:118699 on thumbnails-v2.createlab.org in 0.2 seconds","details":"<a href=\"http://thumbnails-v2.createlab.org/status?id=20461:118699\">More info</a>","payload":{},"valid_for_secs":null}
2026-07-20 15:40:38.808 THUMB 20461:118699:0 url is https://stat.createlab.org/api/log host stat.createlab.org port 443
2026-07-20 15:40:38.808 THUMB 20461:118699:0 request.body {"service":"Thumbnails","datetime":"2026-07-20T15:40:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}