Showing detail for thumbnail request 3458045:058452

Logfile is 27156.4 MB, only reading last 1000.0 MB

Failed thumbnail 3458045:058452 2025-12-02 20:57:25

zip 540 x 540 https://thumbnails-earthtime.cmucreatelab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18

Fatal error

SIGTERM
/usr/local/lib/ruby/2.4.0/net/protocol.rb:176:in `wait_readable'
/usr/local/lib/ruby/2.4.0/net/protocol.rb:176:in `rbuf_fill'
/usr/local/lib/ruby/2.4.0/net/protocol.rb:154:in `readuntil'
/usr/local/lib/ruby/2.4.0/net/protocol.rb:164:in `readline'
/usr/local/lib/ruby/2.4.0/net/http/response.rb:40:in `read_status_line'
/usr/local/lib/ruby/2.4.0/net/http/response.rb:29:in `read_new'
/usr/local/lib/ruby/2.4.0/net/http.rb:1446:in `block in transport_request'
/usr/local/lib/ruby/2.4.0/net/http.rb:1443:in `catch'
/usr/local/lib/ruby/2.4.0/net/http.rb:1443:in `transport_request'
/usr/local/lib/ruby/2.4.0/net/http.rb:1416:in `request'
/usr/local/lib/ruby/2.4.0/net/http.rb:1409:in `block in request'
/usr/local/lib/ruby/2.4.0/net/http.rb:877:in `start'
/usr/local/lib/ruby/2.4.0/net/http.rb:1407:in `request'
/usr/local/lib/ruby/2.4.0/net/http.rb:1165:in `get'
/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1082:in `delegate_thumbnail'
/t/thumbnails-v2.create

Last checkpoint

2025-12-02 20:58:21.297 THUMB 3458045:058452:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"128.237.152.6","HTTP_USER_AGENT":"Python-urllib/3.7","delegatedTo":"https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&h

Last line

2025-12-02 20:58:21.325 THUMB 3458045:058452:0 request.body {"service":"Thumbnails","datetime":"2025-12-02T20:58:21-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
IP: 128.237.152.6 Browser: Python-urllib/3.7

Root

https://headless.earthtime.org/#l=mb_labeled,smell_my_city_pgh_reports_top2,plume_nowcast_18_202512020500_202512030500&bt=20251202170000&et=20251202230000&v=40.42532,-79.91643,9.233,latLng&ps=2400&startDwell=0&endDwell=0

Delegated to

https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1764727045767

Raw stats

{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1764727045767", "FATALERROR": "SIGTERM\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:176:in `wait_readable'\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:176:in `rbuf_fill'\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:154:in `readuntil'\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:164:in `readline'\n/usr/local/lib/ruby/2.4.0/net/http/response.rb:40:in `read_status_line'\n/usr/local/lib/ruby/2.4.0/net/http/response.rb:29:in `read_new'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1446:in `block in transport_request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1443:in `catch'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1443:in `transport_request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1416:in `request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1409:in `block in request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:877:in `start'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1407:in `request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1165:in `get'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1082:in `delegate_thumbnail'\n/t/thumbnails-v2.create"}
More: grep 3458045:058452 /t/thumbnails-v2.createlab.org/log.txt

Full log

2025-12-02 20:57:25.766 THUMB 3458045:058452:0 Not found in cache; computing
2025-12-02 20:57:25.767 THUMB 3458045:058452:0 STARTTHUMBNAIL https://thumbnails-earthtime.cmucreatelab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18
2025-12-02 20:57:25.767 THUMB 3458045:058452:0 CHECKPOINTTHUMBNAIL START {"REMOTE_ADDR":"128.237.152.6","HTTP_USER_AGENT":"Python-urllib/3.7"}
2025-12-02 20:57:25.767 THUMB 3458045:058452:0 Captured resource lock /t/thumbnails-v2.createlab.org/locks/0154+hal20-thumbnailworker.createlab.org from /t/thumbnails-v2.createlab.org/locks
2025-12-02 20:57:25.767 THUMB 3458045:058452:0 Thumbnail worker hal20-thumbnailworker.createlab.org
2025-12-02 20:57:25.767 THUMB 3458045:058452:0 CHECKPOINTTHUMBNAIL DELEGATION_START {"REMOTE_ADDR":"128.237.152.6","HTTP_USER_AGENT":"Python-urllib/3.7","delegatedTo":"https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1764727045767"}
2025-12-02 20:57:25.767 THUMB 3458045:058452:0 Delegating thumbnail to hal20-thumbnailworker.createlab.org
2025-12-02 20:58:21.297 THUMB 3458045:058452:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"128.237.152.6","HTTP_USER_AGENT":"Python-urllib/3.7","delegatedTo":"https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512020500_202512030500%26bt%3D20251202170000%26et%3D20251202230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1764727045767","FATALERROR":"SIGTERM\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:176:in `wait_readable'\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:176:in `rbuf_fill'\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:154:in `readuntil'\n/usr/local/lib/ruby/2.4.0/net/protocol.rb:164:in `readline'\n/usr/local/lib/ruby/2.4.0/net/http/response.rb:40:in `read_status_line'\n/usr/local/lib/ruby/2.4.0/net/http/response.rb:29:in `read_new'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1446:in `block in transport_request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1443:in `catch'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1443:in `transport_request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1416:in `request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1409:in `block in request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:877:in `start'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1407:in `request'\n/usr/local/lib/ruby/2.4.0/net/http.rb:1165:in `get'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1082:in `delegate_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1235:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}
2025-12-02 20:58:21.298 THUMB 3458045:058452:0 url is https://stat.createlab.org/api/log host stat.createlab.org port 443
2025-12-02 20:58:21.298 THUMB 3458045:058452:0 request.body {"service":"Thumbnails","datetime":"2025-12-02T20:58:21-05:00","host":"-","level":"info","summary":"Thumbnail failed 3458045:058452 on thumbnails-earthtime.cmucreatelab.org in 55.5 seconds","details":"<a href=\"https://hal20-thumbnailworker.createlab.org/status?id=3458045:058452\">More info</a>","payload":{},"valid_for_secs":null}
2025-12-02 20:58:21.325 THUMB 3458045:058452:0 url is https://stat.createlab.org/api/log host stat.createlab.org port 443
2025-12-02 20:58:21.325 THUMB 3458045:058452:0 request.body {"service":"Thumbnails","datetime":"2025-12-02T20:58:21-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}