Open thumbnail logs in Grafana ↗ (internal; via the SSH SOCKS tunnel to hal49)

Showing most recent 100 thumbnails. show twice as many

Failed thumbnail 4172051:390208 2026-11-08 08:52:49 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2026.7055123771306&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/&startDwell=0&startFrame=6358&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:49.507 THUMB 4172051:390208:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:49.542 THUMB 4172051:390208:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:49+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053930:339052 2026-11-08 08:52:45 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3625.8955096132267&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-07-01.timemachine/&startDwell=0&startFrame=5391&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:45.438 THUMB 4053930:339052:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:45.475 THUMB 4053930:339052:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:45+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-07-01.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172049:128599 2026-11-08 08:52:41 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=68.67022136654697&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-17.timemachine/&startDwell=0&startFrame=5451&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:41.692 THUMB 4172049:128599:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:41.731 THUMB 4172049:128599:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:41+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-17.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182115:601220 2026-11-08 08:52:37 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3040.1351034973386&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=5402&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:37.296 THUMB 182115:601220:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:52:37.330 THUMB 182115:601220:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:37+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053928:737688 2026-11-08 08:52:33 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2317.443947102676&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=5259&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:33.315 THUMB 4053928:737688:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:33.350 THUMB 4053928:737688:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:33+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172047:955495 2026-11-08 08:52:29 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2541.3560221435464&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-02.timemachine/&startDwell=0&startFrame=6927&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:29.191 THUMB 4172047:955495:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:29.233 THUMB 4172047:955495:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:29+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-02.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053926:301991 2026-11-08 08:52:25 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3864.055511624231&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2143&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:25.122 THUMB 4053926:301991:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:25.163 THUMB 4053926:301991:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:25+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172045:804128 2026-11-08 08:52:21 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5530.078806720972&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/&startDwell=0&startFrame=6358&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:21.717 THUMB 4172045:804128:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:21.758 THUMB 4172045:804128:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:21+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4083571:316149 2026-11-08 08:52:17 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 x 277 frames

Finished

277 frames in 5.8 seconds (47.9 frames per second)

link
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2023-03-03.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 4196858, "videoFrameCount": 277, "totalTimeSecs": 5.781635056, "cpuTime": 35.20189}

logs in Grafana ↗

Failed thumbnail 3538694:539257 2026-11-08 08:52:13 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=739.3076417233567&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-12.timemachine/&startDwell=0&startFrame=9457&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:13.533 THUMB 3538694:539257:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:13.574 THUMB 3538694:539257:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:13+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-12.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083567:742989 2026-11-08 08:52:09 worker thumbnails-76f5488df6-8fmtd

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2501,385,4425,1466&endDwell=0&endTime=025710&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/&startDwell=0&startTime=025710&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/2/0/3.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=961:540:182.77785803254528:192.34379514330664,scale=1280:720:flags=bicubic" -threads 8 "/app/tmp/4083567.1794127929.3423035.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:53:12.915 THUMB 4083567:742989:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/2/0/

Last line

2026-11-08 08:53:12.950 THUMB 4083567:742989:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:53:12+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/2/0/3.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=961:540:182.77785803254528:192.34379514330664,scale=1280:720:flags=bicubic\" -threads 8 \"/app/tmp/4083567.1794127929.3423035.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172043:567890 2026-11-08 08:52:05 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1135.5622792391994&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-05-25.timemachine/&startDwell=0&startFrame=4381&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:05.723 THUMB 4172043:567890:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:05.761 THUMB 4172043:567890:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:05+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-05-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083565:770544 2026-11-08 08:52:02 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3366.389209241366&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/&startDwell=0&startFrame=1122&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:02.170 THUMB 4083565:770544:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:02.196 THUMB 4083565:770544:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182113:059861 2026-11-08 08:51:58 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3638.073784653191&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-08-05.timemachine/&startDwell=0&startFrame=11049&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:58.638 THUMB 182113:059861:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:51:58.678 THUMB 182113:059861:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-08-05.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053924:909047 2026-11-08 08:51:53 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=863.8889980569586&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-09-14.timemachine/&startDwell=0&startFrame=10289&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:53.634 THUMB 4053924:909047:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:53.672 THUMB 4053924:909047:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:53+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538692:064841 2026-11-08 08:51:49 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5838.6264727626985&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/&startDwell=0&startFrame=6592&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:49.746 THUMB 3538692:064841:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:49.781 THUMB 3538692:064841:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:49+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172041:469117 2026-11-08 08:51:45 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2073.2135689131615&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/&startDwell=0&startFrame=2398&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:45.924 THUMB 4172041:469117:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:45.967 THUMB 4172041:469117:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:45+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182111:634146 2026-11-08 08:51:41 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3598.2807094553573&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-09-09.timemachine/&startDwell=0&startFrame=6443&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:41.601 THUMB 182111:634146:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:51:41.638 THUMB 182111:634146:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:41+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-09-09.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083563:691649 2026-11-08 08:51:38 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3787.936916002098&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=3074&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:38.194 THUMB 4083563:691649:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:38.231 THUMB 4083563:691649:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053922:576703 2026-11-08 08:51:34 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3850.536456896641&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/&startDwell=0&startFrame=1122&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:34.359 THUMB 4053922:576703:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:34.391 THUMB 4053922:576703:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083561:327758 2026-11-08 08:51:30 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=172.5263705968515&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-24.timemachine/&startDwell=0&startFrame=1215&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:30.684 THUMB 4083561:327758:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:30.717 THUMB 4083561:327758:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:30+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-24.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182109:726575 2026-11-08 08:51:25 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1627.2811601776848&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-06-02.timemachine/&startDwell=0&startFrame=0&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:25.734 THUMB 182109:726575:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:51:25.772 THUMB 182109:726575:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:25+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-06-02.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172039:760936 2026-11-08 08:51:22 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=560.5948713032855&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-07-22.timemachine/&startDwell=0&startFrame=3383&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:22.323 THUMB 4172039:760936:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:22.364 THUMB 4172039:760936:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:22+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-07-22.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083559:969170 2026-11-08 08:51:18 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1874.272850772977&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-04-22.timemachine/&startDwell=0&startFrame=4825&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:18.105 THUMB 4083559:969170:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:18.134 THUMB 4083559:969170:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:18+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-04-22.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538690:447307 2026-11-08 08:51:13 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3352.4817413439073&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-28.timemachine/&startDwell=0&startFrame=5615&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:13.962 THUMB 3538690:447307:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:14.001 THUMB 3538690:447307:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-28.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172037:161714 2026-11-08 08:51:10 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1483.4306913996631&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-04-15.timemachine/&startDwell=0&startFrame=6291&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:10.009 THUMB 4172037:161714:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:10.045 THUMB 4172037:161714:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:10+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-04-15.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083557:338390 2026-11-08 08:51:06 worker thumbnails-76f5488df6-8fmtd

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5674.986123186355&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-26.timemachine/&startDwell=0&startFrame=4532&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:06.167 THUMB 4083557:338390:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:06.204 THUMB 4083557:338390:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-26.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053920:725117 2026-11-08 08:51:02 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2218.3081447469635&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-07-17.timemachine/&startDwell=0&startFrame=7075&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:02.456 THUMB 4053920:725117:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:02.482 THUMB 4053920:725117:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-07-17.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538688:396500 2026-11-08 08:50:58 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3518.367346938772&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2005&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:58.527 THUMB 3538688:396500:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:58.560 THUMB 3538688:396500:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172035:102792 2026-11-08 08:50:54 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2113.666320743373&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-25.timemachine/&startDwell=0&startFrame=5061&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:54.748 THUMB 4172035:102792:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:54.780 THUMB 4172035:102792:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182107:649591 2026-11-08 08:50:50 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2063.885848255349&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-10.timemachine/&startDwell=0&startFrame=9349&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:50.617 THUMB 182107:649591:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:50.653 THUMB 182107:649591:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:50+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083555:654412 2026-11-08 08:50:46 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=489.0429140242725&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-01.timemachine/&startDwell=0&startFrame=6451&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:46.736 THUMB 4083555:654412:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:46.768 THUMB 4083555:654412:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:46+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-01.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538686:384691 2026-11-08 08:50:43 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-03-07.timemachine/&startDwell=0&startFrame=2826&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:43.476 THUMB 3538686:384691:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:43.512 THUMB 3538686:384691:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182105:265046 2026-11-08 08:50:38 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2175.2929211945593&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-24.timemachine/&startDwell=0&startFrame=7926&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:38.873 THUMB 182105:265046:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:38.907 THUMB 182105:265046:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-24.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053918:801130 2026-11-08 08:50:34 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2632.4762009089163&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/&startDwell=0&startFrame=3937&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:34.517 THUMB 4053918:801130:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:34.547 THUMB 4053918:801130:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083553:147416 2026-11-08 08:50:30 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1807.0915569583065&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/&startDwell=0&startFrame=11398&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:30.713 THUMB 4083553:147416:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:30.746 THUMB 4083553:147416:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:30+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538684:886700 2026-11-08 08:50:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2232.745114677911&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11273&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:26.836 THUMB 3538684:886700:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:26.870 THUMB 3538684:886700:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:26+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182103:646670 2026-11-08 08:50:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5431.776430544938&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/&startDwell=0&startFrame=9715&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:23.053 THUMB 182103:646670:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:23.086 THUMB 182103:646670:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172033:629706 2026-11-08 08:50:18 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2437.0151247724725&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-02-26.timemachine/&startDwell=0&startFrame=6300&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:18.907 THUMB 4172033:629706:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:18.943 THUMB 4172033:629706:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:18+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053916:847213 2026-11-08 08:50:15 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1494.1309537088596&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-09.timemachine/&startDwell=0&startFrame=2593&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:15.299 THUMB 4053916:847213:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:15.331 THUMB 4053916:847213:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-09.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182101:687120 2026-11-08 08:50:11 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=582.4257999496114&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-04-04.timemachine/&startDwell=0&startFrame=461&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:11.532 THUMB 182101:687120:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:11.571 THUMB 182101:687120:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-04-04.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053914:688916 2026-11-08 08:50:07 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-30.timemachine/&startDwell=0&startFrame=1129&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:07.254 THUMB 4053914:688916:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:07.288 THUMB 4053914:688916:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-30.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538682:719257 2026-11-08 08:50:03 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=452.6146081993538&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-08-12.timemachine/&startDwell=0&startFrame=3265&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:03.391 THUMB 3538682:719257:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:03.425 THUMB 3538682:719257:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-08-12.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172031:852711 2026-11-08 08:49:58 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=6190.418196898179&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/&startDwell=0&startFrame=9715&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:58.955 THUMB 4172031:852711:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:58.991 THUMB 4172031:852711:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083551:286215 2026-11-08 08:49:55 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1687.1579262791622&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-04.timemachine/&startDwell=0&startFrame=3126&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:55.158 THUMB 4083551:286215:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:55.194 THUMB 4083551:286215:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-04.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182099:357843 2026-11-08 08:49:52 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1578.897028947481&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-08.timemachine/&startDwell=0&startFrame=8520&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:52.152 THUMB 182099:357843:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:52.189 THUMB 182099:357843:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:52+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-08.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172029:349606 2026-11-08 08:49:47 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=539.5694770147359&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-21.timemachine/&startDwell=0&startFrame=7635&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:47.168 THUMB 4172029:349606:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:47.207 THUMB 4172029:349606:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-21.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538680:632868 2026-11-08 08:49:42 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=-30.826876123781712&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-01.timemachine/&startDwell=0&startFrame=11777&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:42.923 THUMB 3538680:632868:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:42.954 THUMB 3538680:632868:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:42+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-01.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182097:055034 2026-11-08 08:49:39 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2019-09-30.timemachine/&startDwell=0&startFrame=3705&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:39.105 THUMB 182097:055034:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:39.146 THUMB 182097:055034:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2019-09-30.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083549:709805 2026-11-08 08:49:34 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1573.8916034280753&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-05.timemachine/&startDwell=0&startFrame=10131&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:34.962 THUMB 4083549:709805:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:34.996 THUMB 4083549:709805:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-05.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172027:075805 2026-11-08 08:49:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2271.08305217365&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/&startDwell=0&startFrame=3911&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:31.549 THUMB 4172027:075805:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:31.588 THUMB 4172027:075805:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538678:269055 2026-11-08 08:49:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5363.890243639308&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/&startDwell=0&startFrame=5043&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:26.988 THUMB 3538678:269055:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:27.025 THUMB 3538678:269055:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083547:641454 2026-11-08 08:49:23 worker thumbnails-76f5488df6-8fmtd

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2141.732798352631&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-02.timemachine/&startDwell=0&startFrame=7592&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:23.323 THUMB 4083547:641454:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:23.359 THUMB 4083547:641454:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182095:028157 2026-11-08 08:49:18 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2018.0562685859782&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-04.timemachine/&startDwell=0&startFrame=7846&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:19.025 THUMB 182095:028157:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:19.062 THUMB 182095:028157:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-04.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053912:463431 2026-11-08 08:49:15 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5641.48115594957&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/&startDwell=0&startFrame=2667&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:15.333 THUMB 4053912:463431:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:15.371 THUMB 4053912:463431:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538676:562711 2026-11-08 08:49:11 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2112.924666116504&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-04.timemachine/&startDwell=0&startFrame=9175&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:11.100 THUMB 3538676:562711:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:11.128 THUMB 3538676:562711:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-04.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182093:318169 2026-11-08 08:49:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=523.979665940451&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-30.timemachine/&startDwell=0&startFrame=9737&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:07.086 THUMB 182093:318169:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:07.126 THUMB 182093:318169:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-30.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4053850:903932 2026-11-08 08:08:18 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 x 394 frames

Finished

394 frames in 8.5 seconds (46.3 frames per second)

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2021-09-11.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 7301391, "videoFrameCount": 394, "totalTimeSecs": 8.502101779, "cpuTime": 48.542790000000004}

logs in Grafana ↗

Failed thumbnail 4171904:316128 2026-11-08 08:08:14 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1678.8031631378585&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-09.timemachine/&startDwell=0&startFrame=2254&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:14.189 THUMB 4171904:316128:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:08:14.229 THUMB 4171904:316128:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-09.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053846:074812 2026-11-08 08:08:10 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3253,879,4247,1438&endDwell=0&endTime=071010&format=png&fps=12&height=720&labelsFromDataset&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/&startDwell=0&startTime=071010&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4/9.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=993:559:49.055558660952556:78.96875174678587,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2022-04-24 07\:10\:10'" -threads 8 "/app/tmp/4053846.1794125290.3269722.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:09:13.796 THUMB 4053846:074812:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4

Last line

2026-11-08 08:09:13.829 THUMB 4053846:074812:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:09:13+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4/9.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=993:559:49.055558660952556:78.96875174678587,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2022-04-24 07\\:10\\:10'\" -threads 8 \"/app/tmp/4053846.1794125290.3269722.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182091:889320 2026-11-08 08:08:06 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1751.7508296805395&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/&startDwell=0&startFrame=5611&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:06.528 THUMB 182091:889320:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:08:06.565 THUMB 182091:889320:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182089:824516 2026-11-08 08:08:02 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=923.7117206433137&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/heinz/2018-09-06.timemachine/&startDwell=0&startFrame=306&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:02.157 THUMB 182089:824516:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:08:02.187 THUMB 182089:824516:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/heinz/2018-09-06.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053844:156848 2026-11-08 08:07:58 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=183.95530206381886&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-07-28.timemachine/&startDwell=0&startFrame=478&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:58.324 THUMB 4053844:156848:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:58.357 THUMB 4053844:156848:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-07-28.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053842:589099 2026-11-08 08:07:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2549.6490793953963&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-27.timemachine/&startDwell=0&startFrame=5919&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:54.587 THUMB 4053842:589099:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:54.615 THUMB 4053842:589099:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-27.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083545:923642 2026-11-08 08:07:50 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1511.2209966024911&endDwell=0&format=mp4&fps=48&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-21.timemachine/&startDwell=0&startFrame=652&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:50.466 THUMB 4083545:923642:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:52.504 THUMB 4083545:923642:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:52+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-21.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053840:909410 2026-11-08 08:07:38 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1782.3029006417873&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-02.timemachine/&startDwell=0&startFrame=2615&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:38.714 THUMB 4053840:909410:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:38.751 THUMB 4053840:909410:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-02.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182087:790745 2026-11-08 08:07:34 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3396.517006802721&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=1918&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:34.694 THUMB 182087:790745:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:34.733 THUMB 182087:790745:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171902:276896 2026-11-08 08:07:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1657.1280948678761&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=9333&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:31.154 THUMB 4171902:276896:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:31.187 THUMB 4171902:276896:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538674:004760 2026-11-08 08:07:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1035.641288632676&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-27.timemachine/&startDwell=0&startFrame=5479&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:26.958 THUMB 3538674:004760:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:27.000 THUMB 3538674:004760:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-27.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182085:282758 2026-11-08 08:07:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2185.3103057757644&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/&startDwell=0&startFrame=11452&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:23.209 THUMB 182085:282758:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:23.250 THUMB 182085:282758:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053838:953594 2026-11-08 08:07:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2493.2524660732997&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/&startDwell=0&startFrame=4652&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:19.164 THUMB 4053838:953594:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:19.202 THUMB 4053838:953594:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538672:978956 2026-11-08 08:07:15 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4154.1950649577175&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/&startDwell=0&startFrame=7698&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:15.136 THUMB 3538672:978956:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:15.170 THUMB 3538672:978956:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171900:411052 2026-11-08 08:07:11 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2340.440646010263&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/&startDwell=0&startFrame=6280&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:11.404 THUMB 4171900:411052:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:11.433 THUMB 4171900:411052:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182083:797606 2026-11-08 08:07:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2800.7763923928464&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5578&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:07.554 THUMB 182083:797606:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:07.591 THUMB 182083:797606:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171898:720322 2026-11-08 08:07:03 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3594.5758626245747&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/&startDwell=0&startFrame=4921&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:03.770 THUMB 4171898:720322:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:03.807 THUMB 4171898:720322:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053836:228466 2026-11-08 08:06:59 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3789.5114073748523&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2040&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:59.376 THUMB 4053836:228466:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:59.408 THUMB 4053836:228466:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171896:243759 2026-11-08 08:06:55 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=402.702604756512&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-08-13.timemachine/&startDwell=0&startFrame=2986&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:55.714 THUMB 4171896:243759:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:55.747 THUMB 4171896:243759:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-08-13.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4053774:644178 2026-11-08 08:06:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1920 x 1080 x 382 frames

Finished

382 frames in 24.1 seconds (15.8 frames per second)

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 29292965, "videoFrameCount": 382, "totalTimeSecs": 24.145752705, "cpuTime": 164.25210299999998}

logs in Grafana ↗

Failed thumbnail 182081:929896 2026-11-08 08:06:47 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3877.523612285187&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-01-31.timemachine/&startDwell=0&startFrame=2051&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:47.551 THUMB 182081:929896:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:47.583 THUMB 182081:929896:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-01-31.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538670:901044 2026-11-08 08:06:43 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1832.9216702000274&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-29.timemachine/&startDwell=0&startFrame=7279&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:43.792 THUMB 3538670:901044:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:43.822 THUMB 3538670:901044:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-29.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083543:458968 2026-11-08 08:06:39 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2752.610838491452&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5419&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:39.405 THUMB 4083543:458968:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:39.443 THUMB 4083543:458968:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171894:888897 2026-11-08 08:06:32 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=400.65272319066185&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-09-05.timemachine/&startDwell=0&startFrame=5&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:32.076 THUMB 4171894:888897:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:32.110 THUMB 4171894:888897:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:32+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-09-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538668:702017 2026-11-08 08:06:28 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1165.9596825396807&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-04-08.timemachine/&startDwell=0&startFrame=5983&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:28.708 THUMB 3538668:702017:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:28.744 THUMB 3538668:702017:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:28+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182079:710062 2026-11-08 08:06:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=118.95953737150649&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-08.timemachine/&startDwell=0&startFrame=10474&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:23.543 THUMB 182079:710062:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:23.583 THUMB 182079:710062:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-08.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053772:267688 2026-11-08 08:06:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2769.6506707578515&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5820&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:19.530 THUMB 4053772:267688:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:19.567 THUMB 4053772:267688:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538666:802987 2026-11-08 08:06:15 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=846.2711111111116&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=6488&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:15.719 THUMB 3538666:802987:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:15.755 THUMB 3538666:802987:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083541:840890 2026-11-08 08:06:12 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2204.321393387519&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-18.timemachine/&startDwell=0&startFrame=7262&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:12.037 THUMB 4083541:840890:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:12.073 THUMB 4083541:840890:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:12+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-18.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182077:503465 2026-11-08 08:06:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2816.6949952785644&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-27.timemachine/&startDwell=0&startFrame=1775&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:07.766 THUMB 182077:503465:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:07.802 THUMB 182077:503465:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-27.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171892:717662 2026-11-08 08:06:03 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2022.2967576844005&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-17.timemachine/&startDwell=0&startFrame=4920&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:03.760 THUMB 4171892:717662:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:03.791 THUMB 4171892:717662:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-17.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538664:753813 2026-11-08 08:05:59 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2093.5373771037484&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11305&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:59.850 THUMB 3538664:753813:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:59.885 THUMB 3538664:753813:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171890:339744 2026-11-08 08:05:55 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=53.62087354363558&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/&startDwell=0&startFrame=7974&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:55.604 THUMB 4171890:339744:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:55.642 THUMB 4171890:339744:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053770:546247 2026-11-08 08:05:51 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2084.46770614237&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-21.timemachine/&startDwell=0&startFrame=7298&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:51.579 THUMB 4053770:546247:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:51.610 THUMB 4053770:546247:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-21.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171888:565122 2026-11-08 08:05:47 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=351.4441999142041&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/&startDwell=0&startFrame=5304&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:47.926 THUMB 4171888:565122:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:47.961 THUMB 4171888:565122:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182075:570689 2026-11-08 08:05:43 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4265.508544542633&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=4153&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:43.635 THUMB 182075:570689:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:43.673 THUMB 182075:570689:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538662:301727 2026-11-08 08:05:39 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=374.5846041839652&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-28.timemachine/&startDwell=0&startFrame=4374&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:39.630 THUMB 3538662:301727:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:39.663 THUMB 3538662:301727:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-28.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182073:160004 2026-11-08 08:05:35 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 2200 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=591.050007052193&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-26.timemachine/&startDwell=0&startFrame=5263&tileFormat=mp4&width=2200

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:35.710 THUMB 182073:160004:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:35.747 THUMB 182073:160004:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:35+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083539:757023 2026-11-08 08:05:31 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=59.58620689655173&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-02.timemachine/&startDwell=0&startFrame=9323&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:31.362 THUMB 4083539:757023:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:31.390 THUMB 4083539:757023:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538660:278803 2026-11-08 08:05:27 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3742.416542409199&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/&startDwell=0&startFrame=6670&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:27.846 THUMB 3538660:278803:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:27.881 THUMB 3538660:278803:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182071:670254 2026-11-08 08:05:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2152.1752290548247&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11289&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:23.609 THUMB 182071:670254:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:23.648 THUMB 182071:670254:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083537:789962 2026-11-08 08:05:19 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1642.938775510205&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/irvin1/2018-12-24.timemachine/&startDwell=0&startFrame=961&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:19.328 THUMB 4083537:789962:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:19.358 THUMB 4083537:789962:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/irvin1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗