Logfile is 27156.3 MB, only reading last 100.0 MB
{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512250500_202512260500%26bt%3D20251225230000%26et%3D20251226050000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1766704737725", "sizeBytes": 20779623, "totalTimeSecs": 406.558279394, "cpuTime": 0.6}More: grep 571502:414866 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512250500_202512260500%26bt%3D20251225170000%26et%3D20251225230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1766704737698", "sizeBytes": 20117116, "totalTimeSecs": 336.984960671, "cpuTime": 0.55}More: grep 571505:588056 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512250500_202512260500%26bt%3D20251225110000%26et%3D20251225170000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1766704737697", "sizeBytes": 25349436, "totalTimeSecs": 390.439542242, "cpuTime": 0.59}More: grep 571504:103259 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_18_202512250500_202512260500%26bt%3D20251225050000%26et%3D20251225110000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=18&workerepoch=1766704737696", "sizeBytes": 27411427, "totalTimeSecs": 319.258588002, "cpuTime": 0.72}More: grep 571503:680553 /t/thumbnails-v2.createlab.org/log.txt2025-12-25 17:58:03.902 THUMB 561363:334676:0 CHECKPOINTTHUMBNAIL DELEGATION_START {"REMOTE_ADDR":"188.146.144.7","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.0.0 Safari/537.36 OPR/124.0.0.0","HTTP_REFERER":"https://villars-institute.earthtime.org/","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fvillars-institute.earthtime.org%23v%3D46.61737%2C8.37562%2C5.85%2ClatLng%26t%3D11.13%26p2025-12-25 17:58:03.902 THUMB 561363:334676:0 Delegating thumbnail to hal40-thumbnailworker.createlab.org
{"REMOTE_ADDR": "188.146.144.7", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.0.0 Safari/537.36 OPR/124.0.0.0", "HTTP_REFERER": "https://villars-institute.earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fvillars-institute.earthtime.org%23v%3D46.61737%2C8.37562%2C5.85%2ClatLng%26t%3D11.13%26ps%3D0%26l%3Dvillars_institute_electricity_production_plants%2Cmb_monochrome_light%2Cvillars_institute_power_plants_maincategory_totalpower_graph%26bt%3D19000101%26et%3D19000101%26startDwell%3D0%26endDwell%3D0%26fps%3D10&width=128&height=74&format=png&fps=10&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&baseMapsNoLabels&workerepoch=1766703483902"}More: grep 561363:334676 /t/thumbnails-v2.createlab.org/log.txtThumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 500 and response body <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>500 Internal Server Error</title> </head><body> <h1>Internal Server Error</h1> <p>The server encountered an internal error or misconfiguration and was unable to complete your request.</p> <p>Please contact the server administrator at [no address given] to inform them of the time this error occurred, and the actions you performed just before this error.</p> <p>More information about this error may be available in the server error log.</p> <hr> <address>Apache/2.4.41 (Ubuntu) Server at hal40-thumbnailworker.createlab.org Port 443</address> </body></html> /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1095:in `delegate_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1235:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-th
2025-12-25 17:58:03.208 THUMB 558932:850266:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"188.146.144.7","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.0.0 Safari/537.36 OPR/124.0.0.0","HTTP_REFERER":"https://villars-institute.earthtime.org/","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fvillars-institute.earthtime.org%23v%3D46.61737%2C8.37562%2C5.85%2ClatLng%26t%3D11.13%26ps%3D0%2025-12-25 17:58:03.208 THUMB 558932:850266:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T17:58:03-05:00","host":"-","level":"info","summary":"Thumbnail failed 558932:850266 on thumbnails-earthtime.cmucreatelab.org in 1251.3 seconds","details":"<a href=\"https://hal40-thumbnailworker.createlab.org/status?id=558932:850266\">More info</a>","payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "188.146.144.7", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.0.0 Safari/537.36 OPR/124.0.0.0", "HTTP_REFERER": "https://villars-institute.earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fvillars-institute.earthtime.org%23v%3D46.61737%2C8.37562%2C5.85%2ClatLng%26t%3D11.13%26ps%3D0%26l%3Dvillars_institute_electricity_production_plants%2Cmb_monochrome_light%2Cvillars_institute_power_plants_maincategory_totalpower_graph%26bt%3D19000101%26et%3D19000101%26startDwell%3D0%26endDwell%3D0%26fps%3D10&width=128&height=74&format=png&fps=10&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&baseMapsNoLabels&workerepoch=1766702231943", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 500 and response body <!DOCTYPE HTML PUBLIC \"-//IETF//DTD HTML 2.0//EN\">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n [no address given] to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n<hr>\n<address>Apache/2.4.41 (Ubuntu) Server at hal40-thumbnailworker.createlab.org Port 443</address>\n</body></html>\n\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1095:in `delegate_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1235:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-th"}More: grep 558932:850266 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "186.179.163.81", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36", "HTTP_REFERER": "https://explorables.cmucreatelab.org/", "sizeBytes": 17925, "totalTimeSecs": 0.895109744, "cpuTime": 1.2200000000000002}More: grep 519061:921454 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "186.179.163.81", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36", "HTTP_REFERER": "https://explorables.cmucreatelab.org/", "sizeBytes": 16948, "totalTimeSecs": 0.894477903, "cpuTime": 0.86}More: grep 519060:494521 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_12_202512250500_202512260500%26bt%3D20251225110000%26et%3D20251225170000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=12&workerepoch=1766685305106", "sizeBytes": 25302183, "totalTimeSecs": 415.947636095, "cpuTime": 0.61}More: grep 473980:310944 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_12_202512250500_202512260500%26bt%3D20251225170000%26et%3D20251225230000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=12&workerepoch=1766685305074", "sizeBytes": 20115268, "totalTimeSecs": 334.609834921, "cpuTime": 0.5700000000000001}More: grep 473982:680318 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_12_202512250500_202512260500%26bt%3D20251225050000%26et%3D20251225110000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=12&workerepoch=1766685305072", "sizeBytes": 27427411, "totalTimeSecs": 409.980883218, "cpuTime": 0.61}More: grep 473983:108850 /t/thumbnails-v2.createlab.org/log.txt{"REMOTE_ADDR": "128.237.152.6", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2%2Cplume_nowcast_12_202512250500_202512260500%26bt%3D20251225230000%26et%3D20251226050000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=12&workerepoch=1766685305070", "sizeBytes": 20771614, "totalTimeSecs": 328.533779818, "cpuTime": 0.58}More: grep 473981:857637 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/445757.1766679574.796895.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:19:34.852 THUMB 445757:883988:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"13.89.243.47","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=229:2292025-12-25 11:19:34.930 THUMB 445757:883988:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:19:34-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "13.89.243.47", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/445757.1766679574.796895.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 445757:883988 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444467.1766679320.2278697.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:20.280 THUMB 444467:186519:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.75.98","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \2025-12-25 11:15:20.337 THUMB 444467:186519:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:20-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.75.98", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444467.1766679320.2278697.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444467:186519 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 0.083 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444464.1766679320.1505299.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:20.276 THUMB 444464:792179:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.77.10.140","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.6 Safari/605.1.15","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 0.083 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=229:229:242025-12-25 11:15:20.359 THUMB 444464:792179:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:20-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.77.10.140", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.6 Safari/605.1.15", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 0.083 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444464.1766679320.1505299.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444464:792179 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444463.1766679320.150523.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:20.276 THUMB 444463:191999:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"135.119.82.168","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.9 Chrome/132.0.6834.210 Electron/34.3.0 Safari/537.36","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex2025-12-25 11:15:20.329 THUMB 444463:191999:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:20-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "135.119.82.168", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.9 Chrome/132.0.6834.210 Electron/34.3.0 Safari/537.36", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1292.729 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-05-06.timemachine/crf26-12fps-1424x800/2/1/0.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=229:229:249.0391370944007:166.0391370944007,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444463.1766679320.150523.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444463:191999 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:13.425 THUMB 444442:434480:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.146.113","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/2025-12-25 11:15:13.448 THUMB 444442:434480:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:13-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.146.113", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444442:434480 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:13.399 THUMB 444440:525692:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.74.90","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.4 Chrome/130.0.6723.191 Electron/33.3.2 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/2025-12-25 11:15:13.423 THUMB 444440:525692:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:13-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.74.90", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.4 Chrome/130.0.6723.191 Electron/33.3.2 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444440:525692 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:13.393 THUMB 444437:075031:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.35.211","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.4 Chrome/130.0.6723.191 Electron/33.3.2 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local2025-12-25 11:15:13.412 THUMB 444437:075031:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:13-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.35.211", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.4 Chrome/130.0.6723.191 Electron/33.3.2 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444437:075031 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:13.395 THUMB 444436:094773:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.215.180","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in 2025-12-25 11:15:13.418 THUMB 444436:094773:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:13-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.215.180", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444436:094773 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:06.553 THUMB 444356:699974:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.43.174.255","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:22025-12-25 11:15:06.578 THUMB 444356:699974:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:06-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.43.174.255", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444356:699974 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:06.538 THUMB 444351:450570:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.113.247.56","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `2025-12-25 11:15:06.559 THUMB 444351:450570:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:06-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.113.247.56", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444351:450570 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:06.538 THUMB 444353:479714:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.78.130.72","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.36 OPR/117.0.0.0","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-ur2025-12-25 11:15:06.565 THUMB 444353:479714:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:06-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.78.130.72", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.36 OPR/117.0.0.0", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444353:479714 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:15:06.538 THUMB 444350:366485:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"168.61.148.193","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in 2025-12-25 11:15:06.553 THUMB 444350:366485:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:15:06-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "168.61.148.193", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444350:366485 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:59.898 THUMB 444325:932800:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"13.67.236.20","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:2102025-12-25 11:14:59.918 THUMB 444325:932800:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:59-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "13.67.236.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444325:932800 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:59.739 THUMB 444321:096967:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"132.196.9.68","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/us2025-12-25 11:14:59.756 THUMB 444321:096967:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:59-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "132.196.9.68", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444321:096967 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:59.732 THUMB 444320:705103:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.158.227","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/2025-12-25 11:14:59.746 THUMB 444320:705103:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:59-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.158.227", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444320:705103 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:59.732 THUMB 444319:979789:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.43.163.224","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/us2025-12-25 11:14:59.751 THUMB 444319:979789:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:59-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.43.163.224", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444319:979789 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:53.751 THUMB 444312:598833:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.83.38.223","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:2102025-12-25 11:14:53.769 THUMB 444312:598833:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:53-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.83.38.223", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444312:598833 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:53.310 THUMB 444237:217772:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.83.17.249","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `c2025-12-25 11:14:53.328 THUMB 444237:217772:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:53-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.83.17.249", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444237:217772 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:53.138 THUMB 444234:261028:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.43.227.37","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Safari/605.1.15","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212025-12-25 11:14:53.151 THUMB 444234:261028:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:53-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.43.227.37", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Safari/605.1.15", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444234:261028 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:53.126 THUMB 444233:972198:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.83.38.42","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `ca2025-12-25 11:14:53.146 THUMB 444233:972198:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:53-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.83.38.42", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444233:972198 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:46.435 THUMB 444212:278176:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.158.227","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:2025-12-25 11:14:46.447 THUMB 444212:278176:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:46-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.158.227", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444212:278176 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:46.392 THUMB 444210:032160:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.86.112.216","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/u2025-12-25 11:14:46.414 THUMB 444210:032160:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:46-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.86.112.216", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444210:032160 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:46.369 THUMB 444208:241409:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.43.206.136","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/2025-12-25 11:14:46.387 THUMB 444208:241409:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:46-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.43.206.136", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444208:241409 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:46.367 THUMB 444206:503034:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"172.171.8.40","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/us2025-12-25 11:14:46.393 THUMB 444206:503034:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:46-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "172.171.8.40", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444206:503034 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444174.1766679279.452391.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:39.513 THUMB 444174:773994:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.229.36","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.5 Safari/605.1.15","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:202025-12-25 11:14:39.564 THUMB 444174:773994:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:39-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.229.36", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.5 Safari/605.1.15", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444174.1766679279.452391.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444174:773994 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 0.083 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444176.1766679279.4326258.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:39.513 THUMB 444176:372144:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"168.61.174.233","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 0.083 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"2025-12-25 11:14:39.608 THUMB 444176:372144:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:39-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "168.61.174.233", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 0.083 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444176.1766679279.4326258.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444176:372144 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444171.1766679279.3931065.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:39.513 THUMB 444171:555334:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"172.202.36.169","HTTP_USER_AGENT":"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:138.0) Gecko/20100101 Firefox/138.0","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicu2025-12-25 11:14:39.618 THUMB 444171:555334:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:39-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "172.202.36.169", "HTTP_USER_AGENT": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:138.0) Gecko/20100101 Firefox/138.0", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444171.1766679279.3931065.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444171:555334 /t/thumbnails-v2.createlab.org/log.txtError executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex "pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart "/usr2/thumbnails-v2.createlab.org/tmp/444170.1766679279.3929026.mp4"' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:39.513 THUMB 444170:805167:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.43.150","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36","FATALERROR":"Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:200:288.2025-12-25 11:14:39.613 THUMB 444170:805167:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:39-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.43.150", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36", "FATALERROR": "Error executing '/usr/local/bin/ffmpeg -y -r 12.0 -ss 1351.312 -i http://tiles.cmucreatelab.org/ecam/timemachines/westmifflin1/2022-02-03.timemachine/crf26-12fps-1424x800/2/5/2.mp4 -vframes 360 -filter_complex \"pad=1424:800:0:0,crop=200:200:288.0:100.0,scale=180:180:flags=bicubic\" -threads 8 -vcodec libx264 -preset slow -pix_fmt yuv420p -crf 20 -g 10 -bf 0 -movflags faststart \"/usr2/thumbnails-v2.createlab.org/tmp/444170.1766679279.3929026.mp4\"'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:802:in `encode_frames'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1066:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444170:805167 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:32.837 THUMB 444090:976652:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.208.31.184","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.6 Safari/605.1.15","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:22025-12-25 11:14:32.852 THUMB 444090:976652:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:32-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.208.31.184", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.6 Safari/605.1.15", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444090:976652 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:32.800 THUMB 444088:270844:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.225.200","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.5938.132 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212025-12-25 11:14:32.816 THUMB 444088:270844:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:32-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.225.200", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.5938.132 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444088:270844 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:32.763 THUMB 444085:089314:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.78.155.196","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36 Edg/135.0.0.0","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/2025-12-25 11:14:32.779 THUMB 444085:089314:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:32-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.78.155.196", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36 Edg/135.0.0.0", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444085:089314 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:32.758 THUMB 444084:197757:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.152.45","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local2025-12-25 11:14:32.774 THUMB 444084:197757:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:32-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.152.45", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.6.5 Chrome/124.0.6367.243 Electron/30.1.2 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444084:197757 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:26.057 THUMB 444067:716895:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.35.6","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:2025-12-25 11:14:26.073 THUMB 444067:716895:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:26-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.35.6", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444067:716895 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:26.054 THUMB 444065:085063:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.149.124","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:2102025-12-25 11:14:26.069 THUMB 444065:085063:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:26-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.149.124", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444065:085063 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:25.972 THUMB 444063:342522:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"40.122.158.227","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Safari/605.1.15","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:22025-12-25 11:14:25.987 THUMB 444063:342522:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:25-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "40.122.158.227", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.6 Safari/605.1.15", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444063:342522 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:25.954 THUMB 444061:786271:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.43.165.228","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:2025-12-25 11:14:25.970 THUMB 444061:786271:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:25-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.43.165.228", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 444061:786271 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:19.368 THUMB 443973:048806:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"4.242.222.222","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:i2025-12-25 11:14:19.386 THUMB 443973:048806:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:19-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "4.242.222.222", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 443973:048806 /t/thumbnails-v2.createlab.org/log.txt404 Not Found /usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http' /usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' /usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch' /usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' /usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' /usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open' /usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-12-25 11:14:19.365 THUMB 443972:883780:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"104.43.204.162","HTTP_USER_AGENT":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.36","FATALERROR":"404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:22025-12-25 11:14:19.381 THUMB 443972:883780:0 request.body {"service":"Thumbnails","datetime":"2025-12-25T11:14:19-05:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "104.43.204.162", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.36", "FATALERROR": "404 Not Found\n/usr/local/lib/ruby/2.4.0/open-uri.rb:363:in `open_http'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `catch'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:721:in `open'\n/usr/local/lib/ruby/2.4.0/open-uri.rb:35:in `open'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:341:in `start_thumbnail_not_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:860:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}More: grep 443972:883780 /t/thumbnails-v2.createlab.org/log.txt