Open thumbnail logs in Grafana ↗ (internal; via the SSH SOCKS tunnel to hal49)

Failed thumbnail 4172051:390208 2026-11-08 08:52:49 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2026.7055123771306&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/&startDwell=0&startFrame=6358&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:49.507 THUMB 4172051:390208:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:49.542 THUMB 4172051:390208:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:49+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053930:339052 2026-11-08 08:52:45 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3625.8955096132267&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-07-01.timemachine/&startDwell=0&startFrame=5391&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:45.438 THUMB 4053930:339052:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:45.475 THUMB 4053930:339052:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:45+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-07-01.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172049:128599 2026-11-08 08:52:41 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=68.67022136654697&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-17.timemachine/&startDwell=0&startFrame=5451&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:41.692 THUMB 4172049:128599:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:41.731 THUMB 4172049:128599:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:41+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-17.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182115:601220 2026-11-08 08:52:37 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3040.1351034973386&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=5402&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:37.296 THUMB 182115:601220:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:52:37.330 THUMB 182115:601220:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:37+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053928:737688 2026-11-08 08:52:33 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2317.443947102676&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=5259&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:33.315 THUMB 4053928:737688:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:33.350 THUMB 4053928:737688:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:33+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172047:955495 2026-11-08 08:52:29 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2541.3560221435464&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-02.timemachine/&startDwell=0&startFrame=6927&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:29.191 THUMB 4172047:955495:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:29.233 THUMB 4172047:955495:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:29+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-02.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053926:301991 2026-11-08 08:52:25 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3864.055511624231&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2143&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:25.122 THUMB 4053926:301991:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:25.163 THUMB 4053926:301991:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:25+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172045:804128 2026-11-08 08:52:21 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5530.078806720972&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/&startDwell=0&startFrame=6358&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:21.717 THUMB 4172045:804128:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:21.758 THUMB 4172045:804128:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:21+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-11-03.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4083571:316149 2026-11-08 08:52:17 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 x 277 frames

Finished

277 frames in 5.8 seconds (47.9 frames per second)

link
IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2023-03-03.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 4196858, "videoFrameCount": 277, "totalTimeSecs": 5.781635056, "cpuTime": 35.20189}

logs in Grafana ↗

Failed thumbnail 3538694:539257 2026-11-08 08:52:13 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=739.3076417233567&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-12.timemachine/&startDwell=0&startFrame=9457&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:13.533 THUMB 3538694:539257:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:13.574 THUMB 3538694:539257:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:13+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-12.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083567:742989 2026-11-08 08:52:09 worker thumbnails-76f5488df6-8fmtd

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2501,385,4425,1466&endDwell=0&endTime=025710&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/&startDwell=0&startTime=025710&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/2/0/3.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=961:540:182.77785803254528:192.34379514330664,scale=1280:720:flags=bicubic" -threads 8 "/app/tmp/4083567.1794127929.3423035.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:53:12.915 THUMB 4083567:742989:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/2/0/

Last line

2026-11-08 08:53:12.950 THUMB 4083567:742989:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:53:12+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/2/0/3.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=961:540:182.77785803254528:192.34379514330664,scale=1280:720:flags=bicubic\" -threads 8 \"/app/tmp/4083567.1794127929.3423035.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172043:567890 2026-11-08 08:52:05 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1135.5622792391994&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-05-25.timemachine/&startDwell=0&startFrame=4381&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:05.723 THUMB 4172043:567890:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:05.761 THUMB 4172043:567890:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:05+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-05-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083565:770544 2026-11-08 08:52:02 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3366.389209241366&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/&startDwell=0&startFrame=1122&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:52:02.170 THUMB 4083565:770544:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:52:02.196 THUMB 4083565:770544:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:52:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182113:059861 2026-11-08 08:51:58 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3638.073784653191&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-08-05.timemachine/&startDwell=0&startFrame=11049&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:58.638 THUMB 182113:059861:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:51:58.678 THUMB 182113:059861:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-08-05.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053924:909047 2026-11-08 08:51:53 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=863.8889980569586&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-09-14.timemachine/&startDwell=0&startFrame=10289&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:53.634 THUMB 4053924:909047:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:53.672 THUMB 4053924:909047:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:53+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538692:064841 2026-11-08 08:51:49 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5838.6264727626985&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/&startDwell=0&startFrame=6592&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:49.746 THUMB 3538692:064841:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:49.781 THUMB 3538692:064841:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:49+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172041:469117 2026-11-08 08:51:45 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2073.2135689131615&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/&startDwell=0&startFrame=2398&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:45.924 THUMB 4172041:469117:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:45.967 THUMB 4172041:469117:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:45+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182111:634146 2026-11-08 08:51:41 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3598.2807094553573&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-09-09.timemachine/&startDwell=0&startFrame=6443&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:41.601 THUMB 182111:634146:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:51:41.638 THUMB 182111:634146:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:41+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-09-09.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083563:691649 2026-11-08 08:51:38 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3787.936916002098&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=3074&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:38.194 THUMB 4083563:691649:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:38.231 THUMB 4083563:691649:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053922:576703 2026-11-08 08:51:34 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3850.536456896641&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/&startDwell=0&startFrame=1122&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:34.359 THUMB 4053922:576703:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:34.391 THUMB 4053922:576703:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/pitt1/2019-07-02.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083561:327758 2026-11-08 08:51:30 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=172.5263705968515&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-24.timemachine/&startDwell=0&startFrame=1215&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:30.684 THUMB 4083561:327758:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:30.717 THUMB 4083561:327758:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:30+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-24.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182109:726575 2026-11-08 08:51:25 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1627.2811601776848&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-06-02.timemachine/&startDwell=0&startFrame=0&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:25.734 THUMB 182109:726575:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:51:25.772 THUMB 182109:726575:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:25+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-06-02.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172039:760936 2026-11-08 08:51:22 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=560.5948713032855&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-07-22.timemachine/&startDwell=0&startFrame=3383&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:22.323 THUMB 4172039:760936:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:22.364 THUMB 4172039:760936:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:22+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-07-22.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083559:969170 2026-11-08 08:51:18 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1874.272850772977&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-04-22.timemachine/&startDwell=0&startFrame=4825&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:18.105 THUMB 4083559:969170:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:18.134 THUMB 4083559:969170:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:18+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-04-22.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538690:447307 2026-11-08 08:51:13 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3352.4817413439073&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-28.timemachine/&startDwell=0&startFrame=5615&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:13.962 THUMB 3538690:447307:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:14.001 THUMB 3538690:447307:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-28.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172037:161714 2026-11-08 08:51:10 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1483.4306913996631&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-04-15.timemachine/&startDwell=0&startFrame=6291&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:10.009 THUMB 4172037:161714:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:10.045 THUMB 4172037:161714:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:10+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-04-15.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083557:338390 2026-11-08 08:51:06 worker thumbnails-76f5488df6-8fmtd

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5674.986123186355&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-26.timemachine/&startDwell=0&startFrame=4532&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:06.167 THUMB 4083557:338390:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:06.204 THUMB 4083557:338390:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-26.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053920:725117 2026-11-08 08:51:02 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2218.3081447469635&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-07-17.timemachine/&startDwell=0&startFrame=7075&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:51:02.456 THUMB 4053920:725117:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:51:02.482 THUMB 4053920:725117:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:51:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-07-17.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538688:396500 2026-11-08 08:50:58 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3518.367346938772&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2005&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:58.527 THUMB 3538688:396500:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:58.560 THUMB 3538688:396500:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172035:102792 2026-11-08 08:50:54 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2113.666320743373&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-25.timemachine/&startDwell=0&startFrame=5061&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:54.748 THUMB 4172035:102792:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:54.780 THUMB 4172035:102792:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182107:649591 2026-11-08 08:50:50 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2063.885848255349&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-10.timemachine/&startDwell=0&startFrame=9349&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:50.617 THUMB 182107:649591:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:50.653 THUMB 182107:649591:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:50+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083555:654412 2026-11-08 08:50:46 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=489.0429140242725&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-01.timemachine/&startDwell=0&startFrame=6451&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:46.736 THUMB 4083555:654412:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:46.768 THUMB 4083555:654412:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:46+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-08-01.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538686:384691 2026-11-08 08:50:43 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-03-07.timemachine/&startDwell=0&startFrame=2826&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:43.476 THUMB 3538686:384691:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:43.512 THUMB 3538686:384691:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182105:265046 2026-11-08 08:50:38 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2175.2929211945593&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-24.timemachine/&startDwell=0&startFrame=7926&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:38.873 THUMB 182105:265046:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:38.907 THUMB 182105:265046:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-24.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053918:801130 2026-11-08 08:50:34 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2632.4762009089163&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/&startDwell=0&startFrame=3937&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:34.517 THUMB 4053918:801130:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:34.547 THUMB 4053918:801130:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083553:147416 2026-11-08 08:50:30 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1807.0915569583065&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/&startDwell=0&startFrame=11398&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:30.713 THUMB 4083553:147416:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:30.746 THUMB 4083553:147416:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:30+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538684:886700 2026-11-08 08:50:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2232.745114677911&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11273&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:26.836 THUMB 3538684:886700:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:26.870 THUMB 3538684:886700:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:26+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182103:646670 2026-11-08 08:50:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5431.776430544938&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/&startDwell=0&startFrame=9715&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:23.053 THUMB 182103:646670:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:23.086 THUMB 182103:646670:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172033:629706 2026-11-08 08:50:18 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2437.0151247724725&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-02-26.timemachine/&startDwell=0&startFrame=6300&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:18.907 THUMB 4172033:629706:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:18.943 THUMB 4172033:629706:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:18+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053916:847213 2026-11-08 08:50:15 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1494.1309537088596&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-09.timemachine/&startDwell=0&startFrame=2593&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:15.299 THUMB 4053916:847213:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:15.331 THUMB 4053916:847213:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-10-09.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182101:687120 2026-11-08 08:50:11 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=582.4257999496114&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-04-04.timemachine/&startDwell=0&startFrame=461&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:11.532 THUMB 182101:687120:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:50:11.571 THUMB 182101:687120:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-04-04.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053914:688916 2026-11-08 08:50:07 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-30.timemachine/&startDwell=0&startFrame=1129&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:07.254 THUMB 4053914:688916:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:07.288 THUMB 4053914:688916:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-30.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538682:719257 2026-11-08 08:50:03 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=452.6146081993538&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-08-12.timemachine/&startDwell=0&startFrame=3265&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:50:03.391 THUMB 3538682:719257:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:50:03.425 THUMB 3538682:719257:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:50:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-08-12.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172031:852711 2026-11-08 08:49:58 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=6190.418196898179&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/&startDwell=0&startFrame=9715&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:58.955 THUMB 4172031:852711:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:58.991 THUMB 4172031:852711:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-01.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083551:286215 2026-11-08 08:49:55 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1687.1579262791622&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-04.timemachine/&startDwell=0&startFrame=3126&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:55.158 THUMB 4083551:286215:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:55.194 THUMB 4083551:286215:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-04.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182099:357843 2026-11-08 08:49:52 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1578.897028947481&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-08.timemachine/&startDwell=0&startFrame=8520&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:52.152 THUMB 182099:357843:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:52.189 THUMB 182099:357843:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:52+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-08.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172029:349606 2026-11-08 08:49:47 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=539.5694770147359&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-21.timemachine/&startDwell=0&startFrame=7635&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:47.168 THUMB 4172029:349606:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:47.207 THUMB 4172029:349606:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-21.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538680:632868 2026-11-08 08:49:42 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=-30.826876123781712&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-01.timemachine/&startDwell=0&startFrame=11777&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:42.923 THUMB 3538680:632868:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:42.954 THUMB 3538680:632868:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:42+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-01.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182097:055034 2026-11-08 08:49:39 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2019-09-30.timemachine/&startDwell=0&startFrame=3705&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:39.105 THUMB 182097:055034:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:39.146 THUMB 182097:055034:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2019-09-30.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083549:709805 2026-11-08 08:49:34 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1573.8916034280753&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-05.timemachine/&startDwell=0&startFrame=10131&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:34.962 THUMB 4083549:709805:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:34.996 THUMB 4083549:709805:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-05.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4172027:075805 2026-11-08 08:49:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2271.08305217365&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/&startDwell=0&startFrame=3911&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:31.549 THUMB 4172027:075805:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:31.588 THUMB 4172027:075805:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538678:269055 2026-11-08 08:49:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5363.890243639308&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/&startDwell=0&startFrame=5043&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:26.988 THUMB 3538678:269055:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:27.025 THUMB 3538678:269055:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083547:641454 2026-11-08 08:49:23 worker thumbnails-76f5488df6-8fmtd

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2141.732798352631&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-02.timemachine/&startDwell=0&startFrame=7592&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:23.323 THUMB 4083547:641454:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:23.359 THUMB 4083547:641454:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182095:028157 2026-11-08 08:49:18 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2018.0562685859782&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-04.timemachine/&startDwell=0&startFrame=7846&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:19.025 THUMB 182095:028157:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:19.062 THUMB 182095:028157:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-10-04.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053912:463431 2026-11-08 08:49:15 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5641.48115594957&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/&startDwell=0&startFrame=2667&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:15.333 THUMB 4053912:463431:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:15.371 THUMB 4053912:463431:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538676:562711 2026-11-08 08:49:11 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2112.924666116504&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-04.timemachine/&startDwell=0&startFrame=9175&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:11.100 THUMB 3538676:562711:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:49:11.128 THUMB 3538676:562711:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-04.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182093:318169 2026-11-08 08:49:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=523.979665940451&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-30.timemachine/&startDwell=0&startFrame=9737&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:49:07.086 THUMB 182093:318169:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:49:07.126 THUMB 182093:318169:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:49:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-30.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4053850:903932 2026-11-08 08:08:18 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 x 394 frames

Finished

394 frames in 8.5 seconds (46.3 frames per second)

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2021-09-11.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 7301391, "videoFrameCount": 394, "totalTimeSecs": 8.502101779, "cpuTime": 48.542790000000004}

logs in Grafana ↗

Failed thumbnail 4171904:316128 2026-11-08 08:08:14 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1678.8031631378585&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-09.timemachine/&startDwell=0&startFrame=2254&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:14.189 THUMB 4171904:316128:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:08:14.229 THUMB 4171904:316128:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-09.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053846:074812 2026-11-08 08:08:10 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3253,879,4247,1438&endDwell=0&endTime=071010&format=png&fps=12&height=720&labelsFromDataset&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/&startDwell=0&startTime=071010&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4/9.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=993:559:49.055558660952556:78.96875174678587,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2022-04-24 07\:10\:10'" -threads 8 "/app/tmp/4053846.1794125290.3269722.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:09:13.796 THUMB 4053846:074812:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4

Last line

2026-11-08 08:09:13.829 THUMB 4053846:074812:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:09:13+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y  -ss 200.583 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-04-24.timemachine/crf26-12fps-1424x800/3/4/9.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=993:559:49.055558660952556:78.96875174678587,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2022-04-24 07\\:10\\:10'\" -threads 8 \"/app/tmp/4053846.1794125290.3269722.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182091:889320 2026-11-08 08:08:06 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1751.7508296805395&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/&startDwell=0&startFrame=5611&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:06.528 THUMB 182091:889320:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:08:06.565 THUMB 182091:889320:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182089:824516 2026-11-08 08:08:02 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=923.7117206433137&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/breathecam/timemachines/heinz/2018-09-06.timemachine/&startDwell=0&startFrame=306&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:08:02.157 THUMB 182089:824516:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:08:02.187 THUMB 182089:824516:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:08:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/breathecam/timemachines/heinz/2018-09-06.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053844:156848 2026-11-08 08:07:58 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=183.95530206381886&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-07-28.timemachine/&startDwell=0&startFrame=478&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:58.324 THUMB 4053844:156848:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:58.357 THUMB 4053844:156848:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-07-28.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053842:589099 2026-11-08 08:07:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2549.6490793953963&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-27.timemachine/&startDwell=0&startFrame=5919&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:54.587 THUMB 4053842:589099:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:54.615 THUMB 4053842:589099:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-27.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083545:923642 2026-11-08 08:07:50 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1511.2209966024911&endDwell=0&format=mp4&fps=48&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-21.timemachine/&startDwell=0&startFrame=652&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:50.466 THUMB 4083545:923642:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:52.504 THUMB 4083545:923642:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:52+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-21.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053840:909410 2026-11-08 08:07:38 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1782.3029006417873&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-02.timemachine/&startDwell=0&startFrame=2615&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:38.714 THUMB 4053840:909410:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:38.751 THUMB 4053840:909410:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-02.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182087:790745 2026-11-08 08:07:34 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3396.517006802721&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=1918&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:34.694 THUMB 182087:790745:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:34.733 THUMB 182087:790745:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171902:276896 2026-11-08 08:07:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1657.1280948678761&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=9333&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:31.154 THUMB 4171902:276896:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:31.187 THUMB 4171902:276896:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538674:004760 2026-11-08 08:07:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1035.641288632676&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-27.timemachine/&startDwell=0&startFrame=5479&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:26.958 THUMB 3538674:004760:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:27.000 THUMB 3538674:004760:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-27.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182085:282758 2026-11-08 08:07:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2185.3103057757644&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/&startDwell=0&startFrame=11452&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:23.209 THUMB 182085:282758:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:23.250 THUMB 182085:282758:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-06-17.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053838:953594 2026-11-08 08:07:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2493.2524660732997&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/&startDwell=0&startFrame=4652&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:19.164 THUMB 4053838:953594:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:19.202 THUMB 4053838:953594:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538672:978956 2026-11-08 08:07:15 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4154.1950649577175&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/&startDwell=0&startFrame=7698&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:15.136 THUMB 3538672:978956:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:15.170 THUMB 3538672:978956:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171900:411052 2026-11-08 08:07:11 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2340.440646010263&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/&startDwell=0&startFrame=6280&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:11.404 THUMB 4171900:411052:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:11.433 THUMB 4171900:411052:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-23.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182083:797606 2026-11-08 08:07:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2800.7763923928464&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5578&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:07.554 THUMB 182083:797606:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:07:07.591 THUMB 182083:797606:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171898:720322 2026-11-08 08:07:03 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3594.5758626245747&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/&startDwell=0&startFrame=4921&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:07:03.770 THUMB 4171898:720322:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:07:03.807 THUMB 4171898:720322:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:07:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053836:228466 2026-11-08 08:06:59 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3789.5114073748523&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2040&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:59.376 THUMB 4053836:228466:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:59.408 THUMB 4053836:228466:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171896:243759 2026-11-08 08:06:55 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=402.702604756512&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-08-13.timemachine/&startDwell=0&startFrame=2986&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:55.714 THUMB 4171896:243759:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:55.747 THUMB 4171896:243759:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-08-13.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4053774:644178 2026-11-08 08:06:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1920 x 1080 x 382 frames

Finished

382 frames in 24.1 seconds (15.8 frames per second)

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 29292965, "videoFrameCount": 382, "totalTimeSecs": 24.145752705, "cpuTime": 164.25210299999998}

logs in Grafana ↗

Failed thumbnail 182081:929896 2026-11-08 08:06:47 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3877.523612285187&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-01-31.timemachine/&startDwell=0&startFrame=2051&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:47.551 THUMB 182081:929896:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:47.583 THUMB 182081:929896:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-01-31.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538670:901044 2026-11-08 08:06:43 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1832.9216702000274&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-29.timemachine/&startDwell=0&startFrame=7279&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:43.792 THUMB 3538670:901044:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:43.822 THUMB 3538670:901044:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-29.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083543:458968 2026-11-08 08:06:39 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2752.610838491452&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5419&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:39.405 THUMB 4083543:458968:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:39.443 THUMB 4083543:458968:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171894:888897 2026-11-08 08:06:32 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=400.65272319066185&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-09-05.timemachine/&startDwell=0&startFrame=5&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:32.076 THUMB 4171894:888897:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:32.110 THUMB 4171894:888897:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:32+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-09-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538668:702017 2026-11-08 08:06:28 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1165.9596825396807&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-04-08.timemachine/&startDwell=0&startFrame=5983&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:28.708 THUMB 3538668:702017:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:28.744 THUMB 3538668:702017:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:28+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-04-08.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182079:710062 2026-11-08 08:06:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=118.95953737150649&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-08.timemachine/&startDwell=0&startFrame=10474&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:23.543 THUMB 182079:710062:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:23.583 THUMB 182079:710062:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-08.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053772:267688 2026-11-08 08:06:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2769.6506707578515&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=5820&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:19.530 THUMB 4053772:267688:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:19.567 THUMB 4053772:267688:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538666:802987 2026-11-08 08:06:15 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=846.2711111111116&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=6488&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:15.719 THUMB 3538666:802987:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:15.755 THUMB 3538666:802987:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083541:840890 2026-11-08 08:06:12 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2204.321393387519&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-18.timemachine/&startDwell=0&startFrame=7262&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:12.037 THUMB 4083541:840890:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:12.073 THUMB 4083541:840890:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:12+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-18.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182077:503465 2026-11-08 08:06:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2816.6949952785644&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-27.timemachine/&startDwell=0&startFrame=1775&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:07.766 THUMB 182077:503465:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:06:07.802 THUMB 182077:503465:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-27.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171892:717662 2026-11-08 08:06:03 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2022.2967576844005&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-17.timemachine/&startDwell=0&startFrame=4920&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:06:03.760 THUMB 4171892:717662:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:06:03.791 THUMB 4171892:717662:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:06:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-04-17.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538664:753813 2026-11-08 08:05:59 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2093.5373771037484&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11305&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:59.850 THUMB 3538664:753813:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:59.885 THUMB 3538664:753813:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171890:339744 2026-11-08 08:05:55 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=53.62087354363558&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/&startDwell=0&startFrame=7974&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:55.604 THUMB 4171890:339744:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:55.642 THUMB 4171890:339744:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053770:546247 2026-11-08 08:05:51 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2084.46770614237&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-21.timemachine/&startDwell=0&startFrame=7298&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:51.579 THUMB 4053770:546247:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:51.610 THUMB 4053770:546247:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-02-21.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171888:565122 2026-11-08 08:05:47 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=351.4441999142041&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/&startDwell=0&startFrame=5304&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:47.926 THUMB 4171888:565122:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:47.961 THUMB 4171888:565122:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182075:570689 2026-11-08 08:05:43 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4265.508544542633&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/&startDwell=0&startFrame=4153&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:43.635 THUMB 182075:570689:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:43.673 THUMB 182075:570689:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538662:301727 2026-11-08 08:05:39 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=374.5846041839652&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-28.timemachine/&startDwell=0&startFrame=4374&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:39.630 THUMB 3538662:301727:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:39.663 THUMB 3538662:301727:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-06-28.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182073:160004 2026-11-08 08:05:35 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 2200 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=591.050007052193&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-26.timemachine/&startDwell=0&startFrame=5263&tileFormat=mp4&width=2200

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:35.710 THUMB 182073:160004:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:35.747 THUMB 182073:160004:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:35+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-10-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083539:757023 2026-11-08 08:05:31 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=59.58620689655173&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-02.timemachine/&startDwell=0&startFrame=9323&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:31.362 THUMB 4083539:757023:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:31.390 THUMB 4083539:757023:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-06-02.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538660:278803 2026-11-08 08:05:27 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3742.416542409199&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/&startDwell=0&startFrame=6670&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:27.846 THUMB 3538660:278803:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:27.881 THUMB 3538660:278803:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182071:670254 2026-11-08 08:05:23 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2152.1752290548247&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=11289&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:23.609 THUMB 182071:670254:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:23.648 THUMB 182071:670254:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083537:789962 2026-11-08 08:05:19 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1642.938775510205&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/irvin1/2018-12-24.timemachine/&startDwell=0&startFrame=961&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:19.328 THUMB 4083537:789962:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:19.358 THUMB 4083537:789962:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/irvin1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053768:013244 2026-11-08 08:05:16 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2188.881503755552&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-12-17.timemachine/&startDwell=0&startFrame=5990&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:16.104 THUMB 4053768:013244:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:16.136 THUMB 4053768:013244:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:16+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-12-17.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4053706:096613 2026-11-08 08:05:11 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 x 310 frames

Finished

310 frames in 7.0 seconds (44.3 frames per second)

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton4/2021-09-17.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 5701210, "videoFrameCount": 310, "totalTimeSecs": 6.99920634, "cpuTime": 37.373419}

logs in Grafana ↗

Failed thumbnail 4171886:574349 2026-11-08 08:05:07 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3902.214506873142&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=2138&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:07.784 THUMB 4171886:574349:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:07.816 THUMB 4171886:574349:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182069:170598 2026-11-08 08:05:03 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3827.365938800248&endDwell=0&format=gif&fps=16&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=10904&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:03.338 THUMB 182069:170598:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:05:03.372 THUMB 182069:170598:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083535:740227 2026-11-08 08:05:00 worker thumbnails-76f5488df6-8fmtd

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=7093.752537119913&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/&startDwell=0&startFrame=6592&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:05:00.213 THUMB 4083535:740227:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:05:00.242 THUMB 4083535:740227:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:05:00+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-02-18.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053704:532975 2026-11-08 08:04:56 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1174.8432653061222&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-10-30.timemachine/&startDwell=0&startFrame=10439&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:56.928 THUMB 4053704:532975:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:56.963 THUMB 4053704:532975:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:56+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-10-30.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538658:547831 2026-11-08 08:04:51 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 2200 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2101.5906633876257&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-05-23.timemachine/&startDwell=0&startFrame=5265&tileFormat=mp4&width=2200

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:51.857 THUMB 3538658:547831:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:51.888 THUMB 3538658:547831:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-05-23.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182067:806058 2026-11-08 08:04:47 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=410.5103105590065&endDwell=0&format=png&fps=6&height=720&root=http://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-08-10.timemachine/&startDwell=0&startFrame=0&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:47.759 THUMB 182067:806058:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:04:47.802 THUMB 182067:806058:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

http://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-08-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053702:323705 2026-11-08 08:04:43 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2155.0261667357913&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-12-10.timemachine/&startDwell=0&startFrame=6057&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:43.454 THUMB 4053702:323705:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:43.486 THUMB 4053702:323705:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-12-10.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171884:650254 2026-11-08 08:04:40 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2045.2109432420366&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-30.timemachine/&startDwell=0&startFrame=3573&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:40.940 THUMB 4171884:650254:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:40.975 THUMB 4171884:650254:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:40+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-30.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182065:676117 2026-11-08 08:04:35 worker thumbnails-76f5488df6-4qsht

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=994.3098570922081&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-21.timemachine/&startDwell=0&startFrame=6982&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:35.199 THUMB 182065:676117:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:04:35.237 THUMB 182065:676117:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:35+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-21.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083533:406643 2026-11-08 08:04:31 worker thumbnails-76f5488df6-8fmtd

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2391.697577879339&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/&startDwell=0&startFrame=5277&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:31.341 THUMB 4083533:406643:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:31.379 THUMB 4083533:406643:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-09-25.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538656:096424 2026-11-08 08:04:29 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1595.2801691690415&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-05-27.timemachine/&startDwell=0&startFrame=1820&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:29.036 THUMB 3538656:096424:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:29.077 THUMB 3538656:096424:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:29+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-05-27.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171882:318745 2026-11-08 08:04:23 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1000 x 1000 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5647.753179683383&endDwell=0&format=mp4&fps=12&height=1000&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/&startDwell=0&startFrame=11542&tileFormat=mp4&width=1000

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:23.546 THUMB 4171882:318745:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:23.582 THUMB 4171882:318745:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053700:100299 2026-11-08 08:04:19 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=186.36145419160266&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-22.timemachine/&startDwell=0&startFrame=24&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:19.398 THUMB 4053700:100299:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:19.435 THUMB 4053700:100299:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:19+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2018-09-22.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182063:467055 2026-11-08 08:04:15 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=-64.66763619910449&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-08-13.timemachine/&startDwell=0&startFrame=4755&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:15.296 THUMB 182063:467055:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:04:15.338 THUMB 182063:467055:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-08-13.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053698:045041 2026-11-08 08:04:11 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2932.396155368689&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-06.timemachine/&startDwell=0&startFrame=2609&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:11.427 THUMB 4053698:045041:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:11.458 THUMB 4053698:045041:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:11+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-06.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538654:121221 2026-11-08 08:04:07 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=492.6497688945206&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-29.timemachine/&startDwell=0&startFrame=4929&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:07.335 THUMB 3538654:121221:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:04:07.372 THUMB 3538654:121221:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-29.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182061:853636 2026-11-08 08:04:03 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2324.1706381545227&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-05-12.timemachine/&startDwell=0&startFrame=6020&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:04:03.293 THUMB 182061:853636:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 08:04:03.327 THUMB 182061:853636:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:04:03+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-05-12.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171880:883555 2026-11-08 08:03:59 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1957.651919887066&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-06.timemachine/&startDwell=0&startFrame=1713&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:03:59.407 THUMB 4171880:883555:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:03:59.442 THUMB 4171880:883555:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:03:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-09-06.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053696:403326 2026-11-08 08:03:55 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1400 x 1000 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=57.34355873056188&endDwell=0&format=mp4&fps=24&height=1000&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-09-13.timemachine/&startDwell=0&startFrame=4535&tileFormat=mp4&width=1400

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:03:55.229 THUMB 4053696:403326:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:03:55.261 THUMB 4053696:403326:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:03:55+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2018-09-13.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538652:751301 2026-11-08 08:03:51 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1000 x 1000 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1626.5862649944734&endDwell=0&format=mp4&fps=12&height=1000&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/&startDwell=0&startFrame=4675&tileFormat=mp4&width=1000

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:03:51.205 THUMB 3538652:751301:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:03:51.237 THUMB 3538652:751301:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:03:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-11.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4083531:406637 2026-11-08 08:03:47 worker thumbnails-76f5488df6-8fmtd

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3086.518349128169&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-03-09.timemachine/&startDwell=0&startFrame=0&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:03:47.548 THUMB 4083531:406637:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:03:47.581 THUMB 4083531:406637:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:03:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-03-09.timemachine/

Worker

thumbnails-76f5488df6-8fmtd

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053694:833097 2026-11-08 08:03:43 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=258.5359267241349&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2020-07-03.timemachine/&startDwell=0&startFrame=0&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 08:03:43.073 THUMB 4053694:833097:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 08:03:43.106 THUMB 4053694:833097:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T08:03:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2020-07-03.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538650:375240 2026-11-08 07:51:32 worker thumbnails-76f5488df6-xfczl

timemachine_export · jpg 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?bt=19800101&endDwell=2&et=20190101&format=jpg&fps=30&height=720&l=bdrk_detailed%2Callegheny_county_vacant_dates&ps=0&root=https%3A%2F%2Fheadless.earthtime.org%23v=40.44577%2C-79.91242%2C11.193%2ClatLng&t=11.80&tileFormat=mp4&timestampOnlyUI=true&width=1280

Fatal error

Must specify boundsNWSE or boundsLTRB, unless fromScreenshot
/app/timemachine-thumbnail-server/thumbnail-server.rb:1186:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:51:32.339 THUMB 3538650:375240:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36","HTTP_REFERER":"https://earthtime.org/m/stories/chr","codepath":"timemachine_export","FATALERROR":"Must specify boundsNWSE or boundsLTRB, unless fromScreenshot\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1186:in `compute_thumbnail'\n/app/timema

Last line

2026-11-08 07:51:32.384 THUMB 3538650:375240:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:51:32+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

Referer: https://earthtime.org/m/stories/chr IP: 10.1.160.33 Browser: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36

Root

https://headless.earthtime.org#v=40.44577,-79.91242,11.193,latLng

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/m/stories/chr", "codepath": "timemachine_export", "FATALERROR": "Must specify boundsNWSE or boundsLTRB, unless fromScreenshot\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1186:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171878:293686 2026-11-08 07:20:29 worker thumbnails-76f5488df6-qdq98

timemachine_export · jpg 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?bt=20100101&et=20100101&format=jpg&fps=30&height=720&l=bdrk%2Cbdrk_detailed%2Ctotal_race_2010%2Callegheny_county_zips&ps=0&root=https%3A%2F%2Fheadless.earthtime.org%23v=40.45683%2C-79.97422%2C9.029%2ClatLng&t=3.16&tileFormat=mp4&timestampOnlyUI=true&width=1280

Fatal error

Must specify boundsNWSE or boundsLTRB, unless fromScreenshot
/app/timemachine-thumbnail-server/thumbnail-server.rb:1186:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:20:29.894 THUMB 4171878:293686:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36","HTTP_REFERER":"https://earthtime.org/m/stories/chr","codepath":"timemachine_export","FATALERROR":"Must specify boundsNWSE or boundsLTRB, unless fromScreenshot\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1186:in `compute_thumbnail'\n/app/timema

Last line

2026-11-08 07:20:29.935 THUMB 4171878:293686:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:20:29+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

Referer: https://earthtime.org/m/stories/chr IP: 10.1.160.33 Browser: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36

Root

https://headless.earthtime.org#v=40.45683,-79.97422,9.029,latLng

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/m/stories/chr", "codepath": "timemachine_export", "FATALERROR": "Must specify boundsNWSE or boundsLTRB, unless fromScreenshot\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1186:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538628:605703 2026-11-08 07:19:47 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2174.3638694410324&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-23.timemachine/&startDwell=0&startFrame=5807&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:47.168 THUMB 3538628:605703:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:19:47.205 THUMB 3538628:605703:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-23.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053690:504169 2026-11-08 07:19:43 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1659,1092,3538,2149&endDwell=0&endTime=113905&format=png&fps=12&height=720&labelsFromDataset&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-10-03.timemachine/&startDwell=0&startTime=113905&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 552.417 -i https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-10-03.timemachine/crf26-12fps-1424x800/1/2/2.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=939:528:117.48611131642838:146.00781261549093,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2021-10-03 11\:39\:05'" -threads 8 "/app/tmp/4053690.1794122383.3637187.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:20:46.911 THUMB 4053690:504169:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y  -ss 552.417 -i https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-10-03.timemachine/crf26-12fps-1424x800/

Last line

2026-11-08 07:20:46.939 THUMB 4053690:504169:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:20:46+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-10-03.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y  -ss 552.417 -i https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-10-03.timemachine/crf26-12fps-1424x800/1/2/2.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=939:528:117.48611131642838:146.00781261549093,scale=1280:720:flags=bicubic,drawtext=fontfile=./fonts/DroidSans.ttf:fontsize=20:fontcolor=yellow:x=9:y=12:text='2021-10-03 11\\:39\\:05'\" -threads 8 \"/app/tmp/4053690.1794122383.3637187.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538626:185673 2026-11-08 07:19:38 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1903.7715517241363&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=5273&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:39.023 THUMB 3538626:185673:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:19:39.058 THUMB 3538626:185673:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:39+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182058:988049 2026-11-08 07:19:35 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=-17.106451749793024&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/&startDwell=0&startFrame=6835&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:35.096 THUMB 182058:988049:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:19:35.126 THUMB 182058:988049:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:35+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-05.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171876:430650 2026-11-08 07:19:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3391.3425769629257&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=1848&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:31.141 THUMB 4171876:430650:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:19:31.174 THUMB 4171876:430650:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171872:072783 2026-11-08 07:19:27 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3936,1104,4677,1522&endDwell=0&endTime=025710&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/&startDwell=0&startTime=025710&tileFormat=mp4&width=1280

Fatal error

Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/3/5/11.mp4 -vframes 1 -filter_complex "pad=1424:800:0:0,crop=742:417:19.472597597787626:104.2970861487554,scale=1280:720:flags=bicubic" -threads 8 "/app/tmp/4171872.1794122367.506258.png"'
/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:20:30.971 THUMB 4171872:072783:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/3/5/

Last line

2026-11-08 07:20:31.008 THUMB 4171872:072783:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:20:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y  -ss 51.000 -i https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-10-29.timemachine/crf26-12fps-1424x800/3/5/11.mp4 -vframes 1 -filter_complex \"pad=1424:800:0:0,crop=742:417:19.472597597787626:104.2970861487554,scale=1280:720:flags=bicubic\" -threads 8 \"/app/tmp/4171872.1794122367.506258.png\"'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:946:in `encode_frames'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1403:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053688:225840 2026-11-08 07:19:23 worker thumbnails-76f5488df6-4fxmx

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2607.7148335129536&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/&startDwell=0&startFrame=8224&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:23.240 THUMB 4053688:225840:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:19:23.273 THUMB 4053688:225840:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538624:884911 2026-11-08 07:19:18 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=531.031869273465&endDwell=0&format=mp4&fps=48&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-10-30.timemachine/&startDwell=0&startFrame=3606&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:18.927 THUMB 3538624:884911:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:19:18.957 THUMB 3538624:884911:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:18+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-10-30.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182056:210171 2026-11-08 07:19:14 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=685.8029163741795&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-13.timemachine/&startDwell=0&startFrame=236&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:15.040 THUMB 182056:210171:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:19:15.076 THUMB 182056:210171:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:15+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2021-04-13.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182054:479575 2026-11-08 07:19:07 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2125.3196460190606&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=3627&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:19:07.196 THUMB 182054:479575:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:19:07.229 THUMB 182054:479575:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:19:07+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538622:354422 2026-11-08 07:18:59 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=6231.905667167246&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-04-12.timemachine/&startDwell=0&startFrame=7806&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:59.146 THUMB 3538622:354422:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:59.183 THUMB 3538622:354422:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:59+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-04-12.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053686:386814 2026-11-08 07:18:54 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2332.354088116292&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-04-05.timemachine/&startDwell=0&startFrame=5365&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:54.913 THUMB 4053686:386814:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:54.945 THUMB 4053686:386814:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2021-04-05.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538620:215659 2026-11-08 07:18:50 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2721.468668673947&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-07-04.timemachine/&startDwell=0&startFrame=6043&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:51.011 THUMB 3538620:215659:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:51.043 THUMB 3538620:215659:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-07-04.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538618:814312 2026-11-08 07:18:46 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3427.226002207548&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/&startDwell=0&startFrame=7263&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:47.021 THUMB 3538618:814312:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:47.054 THUMB 3538618:814312:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:47+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182052:846732 2026-11-08 07:18:43 worker thumbnails-76f5488df6-4qsht

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:43.300 THUMB 182052:846732:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:18:43.336 THUMB 182052:846732:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Finished thumbnail 4053624:950818 2026-11-08 07:18:39 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 x 37 frames

Finished

37 frames in 1.6 seconds (23.0 frames per second)

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2022-11-22.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "sizeBytes": 655302, "videoFrameCount": 37, "totalTimeSecs": 1.607522249, "cpuTime": 5.242903}

logs in Grafana ↗

Failed thumbnail 182050:262104 2026-11-08 07:18:31 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=8.23825302490036&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-10-31.timemachine/&startDwell=0&startFrame=7834&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:31.103 THUMB 182050:262104:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:18:31.143 THUMB 182050:262104:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-10-31.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538616:688534 2026-11-08 07:18:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2711.348206487524&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-07.timemachine/&startDwell=0&startFrame=5989&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:26.988 THUMB 3538616:688534:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:27.022 THUMB 3538616:688534:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-07.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053622:804978 2026-11-08 07:18:23 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1885.8399596682889&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/&startDwell=0&startFrame=2643&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:23.171 THUMB 4053622:804978:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:23.207 THUMB 4053622:804978:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:23+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171870:234617 2026-11-08 07:18:14 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2751.9310770503907&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-05.timemachine/&startDwell=0&startFrame=11010&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:14.869 THUMB 4171870:234617:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:14.906 THUMB 4171870:234617:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-07-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053620:041724 2026-11-08 07:18:06 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1838.9966217789158&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-25.timemachine/&startDwell=0&startFrame=7694&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:06.926 THUMB 4053620:041724:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:06.953 THUMB 4053620:041724:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-07-25.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171868:816815 2026-11-08 07:18:02 worker thumbnails-76f5488df6-qdq98

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=615.4674190599465&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-04-05.timemachine/&startDwell=0&startFrame=460&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:18:02.846 THUMB 4171868:816815:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:18:02.879 THUMB 4171868:816815:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:18:02+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-04-05.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182048:549563 2026-11-08 07:17:56 worker thumbnails-76f5488df6-4qsht

timemachine_export · png 720 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=785.6924923052306&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/&startDwell=0&startFrame=4921&tileFormat=mp4&width=720

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:56.092 THUMB 182048:549563:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:17:56.128 THUMB 182048:549563:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:56+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-12-25.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538614:478034 2026-11-08 07:17:51 worker thumbnails-76f5488df6-xfczl

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2149.0206993332176&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=9323&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:51.017 THUMB 3538614:478034:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:51.048 THUMB 3538614:478034:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053618:930807 2026-11-08 07:17:46 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2941.603754368859&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/&startDwell=0&startFrame=7787&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:46.822 THUMB 4053618:930807:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:46.861 THUMB 4053618:930807:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:46+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-10.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538612:993482 2026-11-08 07:17:38 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-02-16.timemachine/&startDwell=0&startFrame=8477&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:38.896 THUMB 3538612:993482:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:38.930 THUMB 3538612:993482:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-02-16.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171866:577425 2026-11-08 07:17:31 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1731.9853038451724&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-03-31.timemachine/&startDwell=0&startFrame=3910&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:31.468 THUMB 4171866:577425:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:31.495 THUMB 4171866:577425:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:31+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2020-03-31.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182046:910423 2026-11-08 07:17:27 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=848.1885317560271&endDwell=0&format=mp4&fps=48&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-10.timemachine/&startDwell=0&startFrame=0&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:27.155 THUMB 182046:910423:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:17:27.192 THUMB 182046:910423:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:27+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-10.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538610:203323 2026-11-08 07:17:22 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1892.4931473515348&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-21.timemachine/&startDwell=0&startFrame=8033&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:22.329 THUMB 3538610:203323:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:22.369 THUMB 3538610:203323:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:22+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2018-08-21.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171864:953830 2026-11-08 07:17:14 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=64.82629605150919&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-02-03.timemachine/&startDwell=0&startFrame=9703&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:14.518 THUMB 4171864:953830:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:14.552 THUMB 4171864:953830:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2019-02-03.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538608:325514 2026-11-08 07:17:10 worker thumbnails-76f5488df6-xfczl

timemachine_export · png 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2808.1013367452256&endDwell=0&format=png&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-03.timemachine/&startDwell=0&startFrame=5522&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:10.711 THUMB 3538608:325514:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:10.745 THUMB 3538608:325514:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:10+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2019-01-03.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053616:234866 2026-11-08 07:17:06 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 600 x 400 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1425.7555753791255&endDwell=0&format=gif&fps=16&height=400&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-05.timemachine/&startDwell=0&startFrame=2692&tileFormat=mp4&width=600

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:17:06.571 THUMB 4053616:234866:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:17:06.601 THUMB 4053616:234866:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:17:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-05.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182044:538464 2026-11-08 07:16:58 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=3972.7736959136187&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/&startDwell=0&startFrame=9719&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:58.612 THUMB 182044:538464:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:16:58.647 THUMB 182044:538464:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-06-09.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171862:874099 2026-11-08 07:16:54 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=4327.384498773695&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/&startDwell=0&startFrame=411&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:54.747 THUMB 4171862:874099:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:54.783 THUMB 4171862:874099:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-12-24.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053614:347517 2026-11-08 07:16:51 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=NaN&endDwell=0&format=gif&fps=16&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-03-07.timemachine/&startDwell=0&startFrame=2845&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:51.092 THUMB 4053614:347517:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:51.120 THUMB 4053614:347517:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:51+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538606:650382 2026-11-08 07:16:46 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=183.04003388888046&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-12-18.timemachine/&startDwell=0&startFrame=7176&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:46.514 THUMB 3538606:650382:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:46.550 THUMB 3538606:650382:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:46+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-12-18.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053612:294511 2026-11-08 07:16:38 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1351.1344167815641&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/&startDwell=0&startFrame=5466&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:38.599 THUMB 4053612:294511:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:38.635 THUMB 4053612:294511:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-07.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171860:879948 2026-11-08 07:16:34 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5213.867719653137&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/&startDwell=0&startFrame=86&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:34.647 THUMB 4171860:879948:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:34.681 THUMB 4171860:879948:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2020-12-12.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538604:624860 2026-11-08 07:16:26 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1313.9384048946772&endDwell=0&format=mp4&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2021-03-10.timemachine/&startDwell=0&startFrame=8250&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:26.415 THUMB 3538604:624860:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:26.454 THUMB 3538604:624860:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:26+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2021-03-10.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171858:639244 2026-11-08 07:16:22 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=525.7057496148245&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-08.timemachine/&startDwell=0&startFrame=1589&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:22.702 THUMB 4171858:639244:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:22.736 THUMB 4171858:639244:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:22+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-03-08.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182042:065844 2026-11-08 07:16:18 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=630.5374727651678&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-09-12.timemachine/&startDwell=0&startFrame=4581&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:18.351 THUMB 182042:065844:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:16:18.384 THUMB 182042:065844:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:18+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/walnuttowers2/2020-09-12.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538602:653023 2026-11-08 07:16:14 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2005.785655491809&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=9829&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:14.225 THUMB 3538602:653023:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:14.259 THUMB 3538602:653023:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:14+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171856:623691 2026-11-08 07:16:06 worker thumbnails-76f5488df6-qdq98

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2438.1243112021502&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-10-11.timemachine/&startDwell=0&startFrame=3935&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:16:06.723 THUMB 4171856:623691:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:16:06.761 THUMB 4171856:623691:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:16:06+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/braddock1/2018-10-11.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053610:747258 2026-11-08 07:15:58 worker thumbnails-76f5488df6-4fxmx

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2108.5203908275844&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=10809&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:15:58.283 THUMB 4053610:747258:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:15:58.319 THUMB 4053610:747258:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:15:58+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182040:287441 2026-11-08 07:15:54 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 700 x 500 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=5427.441721741088&endDwell=0&format=mp4&fps=12&height=500&root=https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-11-12.timemachine/&startDwell=0&startFrame=5837&tileFormat=mp4&width=700

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:15:54.408 THUMB 182040:287441:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:15:54.447 THUMB 182040:287441:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:15:54+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/clairton1/2018-11-12.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 3538600:046182 2026-11-08 07:15:50 worker thumbnails-76f5488df6-xfczl

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2212.357250081713&endDwell=0&format=mp4&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/&startDwell=0&startFrame=12818&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:15:50.621 THUMB 3538600:046182:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:15:50.656 THUMB 3538600:046182:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:15:50+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-09-14.timemachine/

Worker

thumbnails-76f5488df6-xfczl

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4171854:211049 2026-11-08 07:15:43 worker thumbnails-76f5488df6-qdq98

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=2137.893475635131&endDwell=0&format=gif&fps=6&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-01-23.timemachine/&startDwell=0&startFrame=4101&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:15:43.285 THUMB 4171854:211049:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:15:43.321 THUMB 4171854:211049:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:15:43+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/accan1/2019-01-23.timemachine/

Worker

thumbnails-76f5488df6-qdq98

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 4053608:088765 2026-11-08 07:15:38 worker thumbnails-76f5488df6-4fxmx

timemachine_export · gif 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=-874.4657327586226&endDwell=0&format=gif&fps=12&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-08-13.timemachine/&startDwell=0&startFrame=4720&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:15:38.215 THUMB 4053608:088765:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemac

Last line

2026-11-08 07:15:38.245 THUMB 4053608:088765:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:15:38+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2020-08-13.timemachine/

Worker

thumbnails-76f5488df6-4fxmx

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗

Failed thumbnail 182038:719572 2026-11-08 07:15:34 worker thumbnails-76f5488df6-4qsht

timemachine_export · mp4 1280 x 720 http://thumbnails-v2.createlab.org/thumbnail?boundsLTRB=1243.7281002476345&endDwell=0&format=mp4&fps=24&height=720&root=https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/&startDwell=0&startFrame=13492&tileFormat=mp4&width=1280

Fatal error

boundsLTRB was specified without the required 4 coords separated by commas
/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'
/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'

Last checkpoint

2026-11-08 07:15:34.325 THUMB 182038:719572:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.160.33","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"timemachine_export","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemach

Last line

2026-11-08 07:15:34.356 THUMB 182038:719572:0 request.body {"service":"Thumbnails","datetime":"2026-11-08T07:15:34+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}

IP: 10.1.160.33 Browser: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36

Root

https://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2021-02-26.timemachine/

Worker

thumbnails-76f5488df6-4qsht

Raw stats

{"REMOTE_ADDR": "10.1.160.33", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "timemachine_export", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/app/timemachine-thumbnail-server/thumbnail-server.rb:91:in `parse_bounds'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1181:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1659:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1784:in `<main>'"}

logs in Grafana ↗