Open thumbnail logs in Grafana ↗ (internal; via the SSH SOCKS tunnel to hal49)

Showing most recent 50 thumbnails. show twice as many

Finished thumbnail 4053850:903932 2026-11-08 08:08:18 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 x 394 frames

Finished

394 frames in 8.5 seconds (46.3 frames per second)

link

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2021-09-11.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 7301391, "videoFrameCount": 394, "totalTimeSecs": 8.502101779, "cpuTime": 48.542790000000004}
logs in Grafana ↗

Failed thumbnail 4171904:316128 2026-11-08 08:08:14 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1678.8031631378585&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-09.timemachine/&startDwell=0&startFrame=2254&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:14.189 THUMB 4171904:316128:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:08:14.229 THUMB 4171904:316128:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-09.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053846:074812 2026-11-08 08:08:10 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3253,879,4247,1438&endDwell=0&endTime=071010&format=png&fps=12&height=720&labelsFromDataset&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/&startDwell=0&startTime=071010&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4/9.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=993:559:49.055558660952556:78.96875174678587,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2022-04-24 07\:10\:10'" -threads 8 "/app/tmp/4053846.1794125290.3269722.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:09:13.796 THUMB 4053846:074812:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4

Last line

2026-11-08 08:09:13.829 THUMB 4053846:074812:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:09:13+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4/9.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=993:559:49.055558660952556:78.96875174678587,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2022-04-24 07\\:10\\:10'\" -threads 8 \"/app/tmp/4053846.1794125290.3269722.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182091:889320 2026-11-08 08:08:06 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1751.7508296805395&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/&startDwell=0&startFrame=5611&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:06.528 THUMB 182091:889320:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:08:06.565 THUMB 182091:889320:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182089:824516 2026-11-08 08:08:02 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=923.7117206433137&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/heinz/2018-09-06.timemachine/&startDwell=0&startFrame=306&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:02.157 THUMB 182089:824516:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:08:02.187 THUMB 182089:824516:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/heinz/2018-09-06.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053844:156848 2026-11-08 08:07:58 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=183.95530206381886&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-07-28.timemachine/&startDwell=0&startFrame=478&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:58.324 THUMB 4053844:156848:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:58.357 THUMB 4053844:156848:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-07-28.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053842:589099 2026-11-08 08:07:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2549.6490793953963&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-27.timemachine/&startDwell=0&startFrame=5919&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:54.587 THUMB 4053842:589099:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:54.615 THUMB 4053842:589099:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-27.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4083545:923642 2026-11-08 08:07:50 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1511.2209966024911&endDwell=0&format=mp4&fps=48&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-21.timemachine/&startDwell=0&startFrame=652&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:50.466 THUMB 4083545:923642:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:52.504 THUMB 4083545:923642:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:52+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-21.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053840:909410 2026-11-08 08:07:38 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1782.3029006417873&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-02.timemachine/&startDwell=0&startFrame=2615&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:38.714 THUMB 4053840:909410:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:38.751 THUMB 4053840:909410:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-02.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182087:790745 2026-11-08 08:07:34 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3396.517006802721&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=1918&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:34.694 THUMB 182087:790745:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:34.733 THUMB 182087:790745:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171902:276896 2026-11-08 08:07:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1657.1280948678761&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=9333&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:31.154 THUMB 4171902:276896:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:31.187 THUMB 4171902:276896:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538674:004760 2026-11-08 08:07:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1035.641288632676&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-27.timemachine/&startDwell=0&startFrame=5479&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:26.958 THUMB 3538674:004760:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:27.000 THUMB 3538674:004760:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-27.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182085:282758 2026-11-08 08:07:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2185.3103057757644&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/&startDwell=0&startFrame=11452&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:23.209 THUMB 182085:282758:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:23.250 THUMB 182085:282758:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053838:953594 2026-11-08 08:07:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2493.2524660732997&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/&startDwell=0&startFrame=4652&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:19.164 THUMB 4053838:953594:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:19.202 THUMB 4053838:953594:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538672:978956 2026-11-08 08:07:15 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4154.1950649577175&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/&startDwell=0&startFrame=7698&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:15.136 THUMB 3538672:978956:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:15.170 THUMB 3538672:978956:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171900:411052 2026-11-08 08:07:11 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2340.440646010263&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/&startDwell=0&startFrame=6280&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:11.404 THUMB 4171900:411052:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:11.433 THUMB 4171900:411052:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182083:797606 2026-11-08 08:07:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2800.7763923928464&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5578&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:07.554 THUMB 182083:797606:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:07.591 THUMB 182083:797606:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171898:720322 2026-11-08 08:07:03 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3594.5758626245747&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/&startDwell=0&startFrame=4921&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:03.770 THUMB 4171898:720322:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:03.807 THUMB 4171898:720322:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053836:228466 2026-11-08 08:06:59 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3789.5114073748523&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2040&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:59.376 THUMB 4053836:228466:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:59.408 THUMB 4053836:228466:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171896:243759 2026-11-08 08:06:55 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=402.702604756512&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-08-13.timemachine/&startDwell=0&startFrame=2986&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:55.714 THUMB 4171896:243759:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:55.747 THUMB 4171896:243759:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-08-13.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Finished thumbnail 4053774:644178 2026-11-08 08:06:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1920 x 1080 x 382 frames

Finished

382 frames in 24.1 seconds (15.8 frames per second)

link

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 29292965, "videoFrameCount": 382, "totalTimeSecs": 24.145752705, "cpuTime": 164.25210299999998}
logs in Grafana ↗

Failed thumbnail 182081:929896 2026-11-08 08:06:47 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3877.523612285187&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-01-31.timemachine/&startDwell=0&startFrame=2051&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:47.551 THUMB 182081:929896:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:47.583 THUMB 182081:929896:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-01-31.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538670:901044 2026-11-08 08:06:43 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1832.9216702000274&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-29.timemachine/&startDwell=0&startFrame=7279&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:43.792 THUMB 3538670:901044:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:43.822 THUMB 3538670:901044:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-29.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4083543:458968 2026-11-08 08:06:39 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2752.610838491452&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5419&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:39.405 THUMB 4083543:458968:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:39.443 THUMB 4083543:458968:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171894:888897 2026-11-08 08:06:32 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=400.65272319066185&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-09-05.timemachine/&startDwell=0&startFrame=5&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:32.076 THUMB 4171894:888897:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:32.110 THUMB 4171894:888897:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:32+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-09-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538668:702017 2026-11-08 08:06:28 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1165.9596825396807&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-04-08.timemachine/&startDwell=0&startFrame=5983&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:28.708 THUMB 3538668:702017:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:28.744 THUMB 3538668:702017:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:28+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182079:710062 2026-11-08 08:06:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=118.95953737150649&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-08.timemachine/&startDwell=0&startFrame=10474&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:23.543 THUMB 182079:710062:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:23.583 THUMB 182079:710062:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-08.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053772:267688 2026-11-08 08:06:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2769.6506707578515&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5820&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:19.530 THUMB 4053772:267688:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:19.567 THUMB 4053772:267688:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538666:802987 2026-11-08 08:06:15 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=846.2711111111116&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=6488&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:15.719 THUMB 3538666:802987:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:15.755 THUMB 3538666:802987:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4083541:840890 2026-11-08 08:06:12 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2204.321393387519&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-18.timemachine/&startDwell=0&startFrame=7262&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:12.037 THUMB 4083541:840890:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:12.073 THUMB 4083541:840890:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:12+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-18.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182077:503465 2026-11-08 08:06:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2816.6949952785644&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-27.timemachine/&startDwell=0&startFrame=1775&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:07.766 THUMB 182077:503465:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:07.802 THUMB 182077:503465:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-27.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171892:717662 2026-11-08 08:06:03 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2022.2967576844005&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-17.timemachine/&startDwell=0&startFrame=4920&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:03.760 THUMB 4171892:717662:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:03.791 THUMB 4171892:717662:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-17.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538664:753813 2026-11-08 08:05:59 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2093.5373771037484&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11305&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:59.850 THUMB 3538664:753813:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:59.885 THUMB 3538664:753813:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171890:339744 2026-11-08 08:05:55 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=53.62087354363558&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/&startDwell=0&startFrame=7974&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:55.604 THUMB 4171890:339744:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:55.642 THUMB 4171890:339744:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053770:546247 2026-11-08 08:05:51 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2084.46770614237&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-21.timemachine/&startDwell=0&startFrame=7298&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:51.579 THUMB 4053770:546247:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:51.610 THUMB 4053770:546247:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-21.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4171888:565122 2026-11-08 08:05:47 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=351.4441999142041&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/&startDwell=0&startFrame=5304&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:47.926 THUMB 4171888:565122:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:47.961 THUMB 4171888:565122:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182075:570689 2026-11-08 08:05:43 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4265.508544542633&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=4153&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:43.635 THUMB 182075:570689:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:43.673 THUMB 182075:570689:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538662:301727 2026-11-08 08:05:39 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=374.5846041839652&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-28.timemachine/&startDwell=0&startFrame=4374&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:39.630 THUMB 3538662:301727:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:39.663 THUMB 3538662:301727:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-28.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182073:160004 2026-11-08 08:05:35 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 2200 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=591.050007052193&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-26.timemachine/&startDwell=0&startFrame=5263&tileFormat=mp4&width=2200

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:35.710 THUMB 182073:160004:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:35.747 THUMB 182073:160004:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:35+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4083539:757023 2026-11-08 08:05:31 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=59.58620689655173&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-02.timemachine/&startDwell=0&startFrame=9323&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:31.362 THUMB 4083539:757023:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:31.390 THUMB 4083539:757023:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538660:278803 2026-11-08 08:05:27 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3742.416542409199&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/&startDwell=0&startFrame=6670&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:27.846 THUMB 3538660:278803:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:27.881 THUMB 3538660:278803:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182071:670254 2026-11-08 08:05:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2152.1752290548247&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11289&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:23.609 THUMB 182071:670254:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:23.648 THUMB 182071:670254:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4083537:789962 2026-11-08 08:05:19 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1642.938775510205&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/irvin1/2018-12-24.timemachine/&startDwell=0&startFrame=961&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:19.328 THUMB 4083537:789962:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:19.358 THUMB 4083537:789962:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/irvin1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053768:013244 2026-11-08 08:05:16 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2188.881503755552&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-12-17.timemachine/&startDwell=0&startFrame=5990&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:16.104 THUMB 4053768:013244:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:16.136 THUMB 4053768:013244:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:16+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-12-17.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Finished thumbnail 4053706:096613 2026-11-08 08:05:11 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 x 310 frames

Finished

310 frames in 7.0 seconds (44.3 frames per second)

link

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2021-09-17.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 5701210, "videoFrameCount": 310, "totalTimeSecs": 6.99920634, "cpuTime": 37.373419}
logs in Grafana ↗

Failed thumbnail 4171886:574349 2026-11-08 08:05:07 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3902.214506873142&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2138&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:07.784 THUMB 4171886:574349:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:07.816 THUMB 4171886:574349:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 182069:170598 2026-11-08 08:05:03 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3827.365938800248&endDwell=0&format=gif&fps=16&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=10904&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:03.338 THUMB 182069:170598:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:03.372 THUMB 182069:170598:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4083535:740227 2026-11-08 08:05:00 worker thumbnails-76f5488df6-8fmtd

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=7093.752537119913&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/&startDwell=0&startFrame=6592&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:00.213 THUMB 4083535:740227:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:00.242 THUMB 4083535:740227:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:00+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 4053704:532975 2026-11-08 08:04:56 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1174.8432653061222&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-10-30.timemachine/&startDwell=0&startFrame=10439&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:56.928 THUMB 4053704:532975:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:56.963 THUMB 4053704:532975:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:56+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-10-30.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Failed thumbnail 3538658:547831 2026-11-08 08:04:51 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 2200 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2101.5906633876257&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-05-23.timemachine/&startDwell=0&startFrame=5265&tileFormat=mp4&width=2200

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:51.857 THUMB 3538658:547831:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:51.888 THUMB 3538658:547831:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-05-23.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}
logs in Grafana ↗

Showing most recent 50 thumbnails. show twice as many