Logfile is 27095.1 MB, only reading last 100.0 MB
boundsLTRB was specified without the required 4 coords separated by commas /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:85:in `parse_bounds' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:844:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-10-21 07:56:28.607 THUMB 2457881:118762:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"66.249.64.14","HTTP_USER_AGENT":"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.7339.207 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)","FATALERROR":"boundsLTRB was specified without the required 4 coords separated by commas\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:8
2025-10-21 07:56:28.631 THUMB 2457881:118762:0 request.body {"service":"Thumbnails","datetime":"2025-10-21T07:56:28-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "66.249.64.14", "HTTP_USER_AGENT": "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.7339.207 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)", "FATALERROR": "boundsLTRB was specified without the required 4 coords separated by commas\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:85:in `parse_bounds'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:844:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}
More: grep 2457881:118762 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "57.141.0.44", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%23v%3D1033%2C273%2C2469%2C1080%2Cpts%26t%3D1898.36%26ps%3D50%26bt%3D20240621102021%26et%3D20240621102201%26startDwell%3D0%26endDwell%3D0%26d%3D2024-06-21%26s%3Dcementcam%26fps%3D6&width=1280&height=720&format=mp4&fps=6&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&workerepoch=1761033338562", "sizeBytes": 2151196, "totalTimeSecs": 15.709782924, "cpuTime": 0.34}
More: grep 2387342:651915 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-20 21:45:44.089 THUMB 2281129:829850:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.35","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2896%2C-436%2C8071%2C2475%2Cpts%26t%3D114.94%26ps%3D1500%26bt%3D20231229060903%26et%3D20231229070903%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-29%26s%3Dclairton3%26fps
2025-10-20 21:45:44.110 THUMB 2281129:829850:0 request.body {"service":"Thumbnails","datetime":"2025-10-20T21:45:44-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.35", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2896%2C-436%2C8071%2C2475%2Cpts%26t%3D114.94%26ps%3D1500%26bt%3D20231229060903%26et%3D20231229070903%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-29%26s%3Dclairton3%26fps%3D180&width=1280&height=720&format=mp4&fps=180&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1761010628833", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 2281129:829850 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-20 19:01:40.172 THUMB 2233797:519889:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.57","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=http%3A%2F%2Flocalhost%2Fbreathecam%2Fbreathecam.org%2Fwww%2F%23v%3D3103%2C1460%2C4899%2C2470%2Cpts%26t%3D1372.44%26ps%3D0%26bt%3D20241101174403%26et%3D20241101174403%26startDwell%3D0%26endDwell%3D0%26d%3D2024
2025-10-20 19:01:40.193 THUMB 2233797:519889:0 request.body {"service":"Thumbnails","datetime":"2025-10-20T19:01:40-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.57", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=http%3A%2F%2Flocalhost%2Fbreathecam%2Fbreathecam.org%2Fwww%2F%23v%3D3103%2C1460%2C4899%2C2470%2Cpts%26t%3D1372.44%26ps%3D0%26bt%3D20241101174403%26et%3D20241101174403%26startDwell%3D0%26endDwell%3D0%26d%3D2024-11-01%26s%3Dclairton4%26fps%3D9&width=1280&height=720&format=png&fps=9&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1761000787457", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 2233797:519889 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-20 12:38:17.121 THUMB 2123312:807967:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.67","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2377%2C-31%2C6317%2C2186%2Cpts%26t%3D90.02%26ps%3D1500%26bt%3D20231230055403%26et%3D20231230175403%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-30%26s%3Dclairton3%26fps%3
2025-10-20 12:38:17.141 THUMB 2123312:807967:0 request.body {"service":"Thumbnails","datetime":"2025-10-20T12:38:17-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.67", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2377%2C-31%2C6317%2C2186%2Cpts%26t%3D90.02%26ps%3D1500%26bt%3D20231230055403%26et%3D20231230175403%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-30%26s%3Dclairton3%26fps%3D180&width=1920&height=1080&format=mp4&fps=180&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760977774804", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 2123312:807967 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-20 12:13:47.337 THUMB 2115784:215945:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.71","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D5220%2C15%2C8917%2C2094%2Cpts%26t%3D1206.11%26ps%3D50%26bt%3D20240108170421%26et%3D20240108173757%26startDwell%3D0%26endDwell%3D0%26d%3D2024-01-08%26s%3Dclairton3%26fps%3D
2025-10-20 12:13:47.359 THUMB 2115784:215945:0 request.body {"service":"Thumbnails","datetime":"2025-10-20T12:13:47-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.71", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D5220%2C15%2C8917%2C2094%2Cpts%26t%3D1206.11%26ps%3D50%26bt%3D20240108170421%26et%3D20240108173757%26startDwell%3D0%26endDwell%3D0%26d%3D2024-01-08%26s%3Dclairton3%26fps%3D9&width=3840&height=2160&format=mp4&fps=9&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760976258624", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 2115784:215945 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>javascript error: Cannot read properties of null (reading 'bbox') (Session info: chrome-headless-shell=127.0.6533.119) #0 0x564b84bd86ca <unknown> #1 0x564b848a9600 <unknown> #2 0x564b848af48f <unknown> #3 0x564b848b13a3 <unknown> #4 0x564b8493af6e <unknown> #5 0x564b8491b8a2 <unknown> #6 0x564b8493a04a <unknown> #7 0x564b8491b643 <unknown> #8 0x564b848ebd31 <unknown> #9 0x564b848ec79e <unknown> #10 0x564b84ba025b <unknown> #11 0x564b84ba41f2 <unknown> #12 0x564b84b8d615 <unknown> #13 0x564b84ba4d82 <unknown> #14 0x564b84b7225f <unknown> #15 0x564b84bc7e68 <unknown> #16 0x564b84bc8040 <unknown> #17 0x564b84bd749c <unknown> #18 0x7f6d9786c609 start_thread /var/lib/gems/2.7.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/response.rb:72:in `assert_ok' /var/lib/gems/2.7.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remot
2025-10-20 09:12:36.877 THUMB 2066314:837591:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"161.9.44.180","HTTP_USER_AGENT":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36","HTTP_REFERER":"https://earthtime.org/","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D305630%2C356938%2C1881580%2C1320019%2Cpts%26t%3D1.01%26ps%3D0%26l%3Dblsat%2Ctop1_bot50_1970%26bt%3D1990
2025-10-20 09:12:36.893 THUMB 2066314:837591:0 request.body {"service":"Thumbnails","datetime":"2025-10-20T09:12:36-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "161.9.44.180", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D305630%2C356938%2C1881580%2C1320019%2Cpts%26t%3D1.01%26ps%3D0%26l%3Dblsat%2Ctop1_bot50_1970%26bt%3D19900101%26et%3D19900101%26startDwell%3D0%26endDwell%3D0%26fps%3D10&width=131&height=75&format=png&fps=10&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&baseMapsNoLabels&workerepoch=1760965952249", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>javascript error: Cannot read properties of null (reading 'bbox')\n (Session info: chrome-headless-shell=127.0.6533.119)\n#0 0x564b84bd86ca <unknown>\n#1 0x564b848a9600 <unknown>\n#2 0x564b848af48f <unknown>\n#3 0x564b848b13a3 <unknown>\n#4 0x564b8493af6e <unknown>\n#5 0x564b8491b8a2 <unknown>\n#6 0x564b8493a04a <unknown>\n#7 0x564b8491b643 <unknown>\n#8 0x564b848ebd31 <unknown>\n#9 0x564b848ec79e <unknown>\n#10 0x564b84ba025b <unknown>\n#11 0x564b84ba41f2 <unknown>\n#12 0x564b84b8d615 <unknown>\n#13 0x564b84ba4d82 <unknown>\n#14 0x564b84b7225f <unknown>\n#15 0x564b84bc7e68 <unknown>\n#16 0x564b84bc8040 <unknown>\n#17 0x564b84bd749c <unknown>\n#18 0x7f6d9786c609 start_thread\n/var/lib/gems/2.7.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/response.rb:72:in `assert_ok'\n/var/lib/gems/2.7.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remot"}
More: grep 2066314:837591 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510190400_202510200400%26bt%3D20251019120000%26et%3D20251019200000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760961174321", "sizeBytes": 28724942, "totalTimeSecs": 254.220899371, "cpuTime": 0.6499999999999999}
More: grep 2043206:463244 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510190400_202510200400%26bt%3D20251019200000%26et%3D20251020040000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760961174311", "sizeBytes": 27541648, "totalTimeSecs": 191.584634913, "cpuTime": 0.63}
More: grep 2043207:794461 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510190400_202510200400%26bt%3D20251019040000%26et%3D20251019120000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760961174308", "sizeBytes": 31982264, "totalTimeSecs": 250.736462066, "cpuTime": 0.64}
More: grep 2043205:086758 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-19 14:20:26.842 THUMB 1738421:381310:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.52","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2896%2C-436%2C8071%2C2475%2Cpts%26t%3D214.86%26ps%3D600%26bt%3D20231229070903%26et%3D20231229080903%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-29%26s%3Dclairton3%26fps%
2025-10-19 14:20:26.861 THUMB 1738421:381310:0 request.body {"service":"Thumbnails","datetime":"2025-10-19T14:20:26-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.52", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2896%2C-436%2C8071%2C2475%2Cpts%26t%3D214.86%26ps%3D600%26bt%3D20231229070903%26et%3D20231229080903%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-29%26s%3Dclairton3%26fps%3D72&width=1280&height=720&format=mp4&fps=72&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760897511650", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 1738421:381310 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "84.127.157.74", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D195748%2C408534%2C1996377%2C1421388%2Cpts%26t%3D52.8%26ps%3D50%26l%3Dbdrk%2Cviirs%26bt%3D20160228%26et%3D20160309%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=1280&height=720&format=mp4&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&workerepoch=1760890563365", "sizeBytes": 183498, "totalTimeSecs": 38.339309399, "cpuTime": 0.3}
More: grep 1704729:831641 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "148.227.95.207", "HTTP_USER_AGENT": "Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Mobile Safari/537.36", "HTTP_REFERER": "https://explorables.cmucreatelab.org/", "sizeBytes": 25654, "totalTimeSecs": 0.850645518, "cpuTime": 1.22}
More: grep 1659293:347867 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "148.227.95.207", "HTTP_USER_AGENT": "Mozilla/5.0 (Linux; Android 10; K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Mobile Safari/537.36", "HTTP_REFERER": "https://explorables.cmucreatelab.org/", "sizeBytes": 23770, "totalTimeSecs": 0.824493033, "cpuTime": 0.64}
More: grep 1659294:616528 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510180400_202510190400%26bt%3D20251018120000%26et%3D20251018200000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760874921118", "sizeBytes": 32825866, "totalTimeSecs": 265.499220522, "cpuTime": 0.71}
More: grep 1628638:988577 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510180400_202510190400%26bt%3D20251018040000%26et%3D20251018120000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760874921113", "sizeBytes": 34687592, "totalTimeSecs": 262.352788965, "cpuTime": 0.72}
More: grep 1628639:722351 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510180400_202510190400%26bt%3D20251018200000%26et%3D20251019040000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760874921113", "sizeBytes": 30357805, "totalTimeSecs": 198.312460725, "cpuTime": 0.6799999999999999}
More: grep 1628640:429912 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "74.98.211.177", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://accancamera.com/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%23v%3D1366%2C1429%2C4699%2C3303%2Cpts%26t%3D1006.02%26ps%3D50%26bt%3D20251017140406%26et%3D20251017141603%26startDwell%3D0%26endDwell%3D0%26d%3D2025-10-17%26s%3Daccan2%26fps%3D6&width=1280&height=720&format=mp4&fps=6&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&workerepoch=1760802192882", "sizeBytes": 5346677, "totalTimeSecs": 27.461360292, "cpuTime": 0.36}
More: grep 1286363:894373 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510170400_202510180400%26bt%3D20251017040000%26et%3D20251017120000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760787981767", "sizeBytes": 31239699, "totalTimeSecs": 261.058430129, "cpuTime": 0.65}
More: grep 1217301:720659 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510170400_202510180400%26bt%3D20251017200000%26et%3D20251018040000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760787981752", "sizeBytes": 39670226, "totalTimeSecs": 189.821339359, "cpuTime": 0.8}
More: grep 1217303:114720 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510170400_202510180400%26bt%3D20251017120000%26et%3D20251017200000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760787981748", "sizeBytes": 36659094, "totalTimeSecs": 264.726583058, "cpuTime": 0.76}
More: grep 1217302:845380 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D373217%2C731930%2C544062%2C828030%2Cpts%26t%3D0.33%26ps%3D0%26l%3Dblsat%26bt%3D19871231%26et%3D19871231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760786144073", "sizeBytes": 11893, "totalTimeSecs": 4.533952733, "cpuTime": 0.29}
More: grep 1208363:512934 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D371955%2C731220%2C545324%2C828740%2Cpts%26t%3D0.03%26ps%3D0%26l%3Dblsat%26bt%3D19841231%26et%3D19841231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760786110075", "sizeBytes": 12008, "totalTimeSecs": 6.434356293, "cpuTime": 0.3}
More: grep 1208208:444249 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D370674%2C730499%2C546605%2C829461%2Cpts%26t%3D0.03%26ps%3D0%26l%3Dblsat%26bt%3D20001231%26et%3D20001231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760786097736", "sizeBytes": 12358, "totalTimeSecs": 4.909134283, "cpuTime": 0.29000000000000004}
More: grep 1208105:026965 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D409159%2C692015%2C508121%2C867946%2Cpts%26t%3D0.03%26ps%3D0%26l%3Dblsat%26bt%3D20001231%26et%3D20001231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=180&height=320&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760786097718", "sizeBytes": 10669, "totalTimeSecs": 4.339290223, "cpuTime": 0.28}
More: grep 1208104:357512 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D371955%2C731220%2C545324%2C828740%2Cpts%26t%3D0.33%26ps%3D0%26l%3Dblsat%26bt%3D19871231%26et%3D19871231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785845899", "sizeBytes": 12014, "totalTimeSecs": 5.260672446, "cpuTime": 0.3}
More: grep 1206832:625289 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D409880%2C693296%2C507400%2C866665%2Cpts%26t%3D0.33%26ps%3D0%26l%3Dblsat%26bt%3D19871231%26et%3D19871231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=180&height=320&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785845889", "sizeBytes": 10225, "totalTimeSecs": 4.541767519, "cpuTime": 0.29}
More: grep 1206831:705820 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D371955%2C731220%2C545324%2C828740%2Cpts%26t%3D0.13%26ps%3D0%26l%3Dblsat%26bt%3D19851231%26et%3D19851231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785806708", "sizeBytes": 12032, "totalTimeSecs": 4.407571184, "cpuTime": 0.28}
More: grep 1206610:220210 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D370674%2C730499%2C546605%2C829461%2Cpts%26t%3D0.13%26ps%3D0%26l%3Dblsat%26bt%3D19851231%26et%3D19851231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785799039", "sizeBytes": 12110, "totalTimeSecs": 5.615332594, "cpuTime": 0.30000000000000004}
More: grep 1206579:125333 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D409159%2C692015%2C508121%2C867946%2Cpts%26t%3D0.13%26ps%3D0%26l%3Dblsat%26bt%3D19851231%26et%3D19851231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=180&height=320&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785798999", "sizeBytes": 10520, "totalTimeSecs": 4.770052883, "cpuTime": 0.26}
More: grep 1206580:653980 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D409159%2C692015%2C508121%2C867946%2Cpts%26t%3D0.03%26ps%3D0%26l%3Dblsat%26bt%3D19841231%26et%3D19841231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=180&height=320&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785723355", "sizeBytes": 10434, "totalTimeSecs": 29.705878774, "cpuTime": 0.27}
More: grep 1206191:023074 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D370674%2C730499%2C546605%2C829461%2Cpts%26t%3D0.03%26ps%3D0%26l%3Dblsat%26bt%3D19841231%26et%3D19841231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785723355", "sizeBytes": 12067, "totalTimeSecs": 30.047452145, "cpuTime": 0.27}
More: grep 1206190:339071 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D564243%2C823400%2C802956%2C1247780%2Cpts%26t%3D0%26ps%3D0%26l%3Dflg%2Cunu_moder_slavery_brazil_bubble_map%2Cunu_modern_slavery_call_to_action_dashboard%26bt%3D20181231%26et%3D20181231%26startDwell%3D0%26endDwell%3D1%26fps%3D30&width=180&height=320&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=1&fromScreenshot&workerepoch=1760785293216", "sizeBytes": 35965, "totalTimeSecs": 23.762070181, "cpuTime": 0.29}
More: grep 1204041:112815 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D-242518%2C36629%2C2316955%2C1476333%2Cpts%26t%3D0%26ps%3D0%26l%3Dflg%2Cunu_moder_slavery_brazil_bubble_map%2Cunu_modern_slavery_call_to_action_dashboard%26bt%3D20181231%26et%3D20181231%26startDwell%3D0%26endDwell%3D1%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=1&fromScreenshot&workerepoch=1760785293186", "sizeBytes": 27943, "totalTimeSecs": 24.178355413, "cpuTime": 0.24000000000000002}
More: grep 1204043:203038 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D564243%2C823400%2C802956%2C1247780%2Cpts%26t%3D0%26ps%3D0%26l%3Dflg%2Cunu_moder_slavery_brazil_bubble_map%2Cunu_modern_slavery_call_to_action_dashboard%26bt%3D20181231%26et%3D20181231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=180&height=320&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785286364", "sizeBytes": 35965, "totalTimeSecs": 30.832232978, "cpuTime": 0.31000000000000005}
More: grep 1204022:653410 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "107.120.36.20", "HTTP_USER_AGENT": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://earthtime.org/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%23v%3D-242518%2C36629%2C2316955%2C1476333%2Cpts%26t%3D0%26ps%3D0%26l%3Dflg%2Cunu_moder_slavery_brazil_bubble_map%2Cunu_modern_slavery_call_to_action_dashboard%26bt%3D20181231%26et%3D20181231%26startDwell%3D0%26endDwell%3D0%26fps%3D30&width=320&height=180&format=jpg&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&workerepoch=1760785286362", "sizeBytes": 27943, "totalTimeSecs": 30.453480137, "cpuTime": 0.28}
More: grep 1204024:640651 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "74.98.211.177", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://accancamera.com/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%23v%3D399%2C1642%2C3396%2C3328%2Cpts%26t%3D1303.61%26ps%3D50%26bt%3D20251016170221%26et%3D20251016171106%26startDwell%3D0%26endDwell%3D0%26d%3D2025-10-16%26s%3Daccan2%26fps%3D6&width=1280&height=720&format=mp4&fps=6&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&workerepoch=1760720078427", "sizeBytes": 6315017, "totalTimeSecs": 25.681953316, "cpuTime": 0.38}
More: grep 892109:953119 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "74.98.211.177", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://accancamera.com/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%23v%3D2130%2C1814%2C4853%2C3346%2Cpts%26t%3D1255.44%26ps%3D50%26bt%3D20251016163327%26et%3D20251016163703%26startDwell%3D0%26endDwell%3D0%26d%3D2025-10-16%26s%3Daccan2%26fps%3D6&width=1280&height=720&format=mp4&fps=6&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&workerepoch=1760719771105", "sizeBytes": 2009051, "totalTimeSecs": 14.201261468, "cpuTime": 0.31}
More: grep 890631:811825 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "74.98.211.177", "HTTP_USER_AGENT": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36", "HTTP_REFERER": "https://accancamera.com/", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%23v%3D684%2C1345%2C4557%2C3524%2Cpts%26t%3D1080.86%26ps%3D50%26bt%3D20251016144839%26et%3D20251016145642%26startDwell%3D0%26endDwell%3D0%26d%3D2025-10-16%26s%3Daccan2%26fps%3D6&width=1280&height=720&format=mp4&fps=6&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&workerepoch=1760719221454", "sizeBytes": 7718572, "totalTimeSecs": 24.628638957, "cpuTime": 0.39}
More: grep 887982:401543 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-17 09:49:11.675 THUMB 835787:057064:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.28","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2504%2C-784%2C8523%2C2602%2Cpts%26t%3D133.19%26ps%3D2500%26bt%3D20231225062003%26et%3D20231225172003%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-25%26s%3Dclairton3%26fps%
2025-10-17 09:49:11.693 THUMB 835787:057064:0 request.body {"service":"Thumbnails","datetime":"2025-10-17T09:49:11-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.28", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2504%2C-784%2C8523%2C2602%2Cpts%26t%3D133.19%26ps%3D2500%26bt%3D20231225062003%26et%3D20231225172003%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-25%26s%3Dclairton3%26fps%3D300&width=1920&height=1080&format=mp4&fps=300&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760708434891", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 835787:057064 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510160400_202510170400%26bt%3D20251016120000%26et%3D20251016200000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760702036957", "sizeBytes": 26704504, "totalTimeSecs": 266.331520478, "cpuTime": 0.66}
More: grep 804938:826536 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal20-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510160400_202510170400%26bt%3D20251016040000%26et%3D20251016120000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760702036929", "sizeBytes": 27018257, "totalTimeSecs": 192.068790448, "cpuTime": 0.61}
More: grep 804940:912833 /t/thumbnails-v2.createlab.org/log.txt
{"REMOTE_ADDR": "128.2.218.94", "HTTP_USER_AGENT": "Python-urllib/3.7", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fheadless.earthtime.org%2F%23l%3Dmb_labeled%2Csmell_my_city_pgh_reports_top2025%2Cplume_202510160400_202510170400%26bt%3D20251016200000%26et%3D20251017040000%26v%3D40.42532%2C-79.91643%2C9.233%2ClatLng%26ps%3D2400%26startDwell%3D0%26endDwell%3D0&&width=540&height=540&format=zip&fps=30&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&disableUI&redo=0&workerepoch=1760702036928", "sizeBytes": 27081725, "totalTimeSecs": 267.378435512, "cpuTime": 0.62}
More: grep 804939:234408 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-17 07:16:55.073 THUMB 791801:667945:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.52","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2896%2C-436%2C8071%2C2475%2Cpts%26t%3D214.86%26ps%3D0%26bt%3D20231229070903%26et%3D20231229070903%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-29%26s%3Dclairton3%26fps%3D1
2025-10-17 07:16:55.094 THUMB 791801:667945:0 request.body {"service":"Thumbnails","datetime":"2025-10-17T07:16:55-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.52", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2896%2C-436%2C8071%2C2475%2Cpts%26t%3D214.86%26ps%3D0%26bt%3D20231229070903%26et%3D20231229070903%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-29%26s%3Dclairton3%26fps%3D1&width=1280&height=720&format=mp4&fps=1&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760699299074", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 791801:667945 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Too many frames to compute 11793 /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:417:in `capture_frames_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1057:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.org", "HTTP_ACCEPT_ENCODING": "gzip;q=1.0,deflate;q=0.6,identity;q=0.3", "HTTP_ACCEPT": "*/*", "HTTP_USER_AGENT": "Ruby", "HTTP_HOST":
2025-10-17 05:14:25.697 THUMB 760269:082778:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.52","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D378%2C205%2C5555%2C3541%2Cpts%26t%3D50.36%26ps%3D100%26bt%3D20231023043021%26et%3D20231023143021%26startDwell%3D0%26endDwell%3D0%26d%3D2023-10-23%26s%3Dwestmifflin2%26fps%3
2025-10-17 05:14:25.715 THUMB 760269:082778:0 request.body {"service":"Thumbnails","datetime":"2025-10-17T05:14:25-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.52", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D378%2C205%2C5555%2C3541%2Cpts%26t%3D50.36%26ps%3D100%26bt%3D20231023043021%26et%3D20231023143021%26startDwell%3D0%26endDwell%3D0%26d%3D2023-10-23%26s%3Dwestmifflin2%26fps%3D18&width=180&height=696&format=mp4&fps=18&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760692463491", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Too many frames to compute 11793\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:417:in `capture_frames_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1057:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.org\",\n \"HTTP_ACCEPT_ENCODING\": \"gzip;q=1.0,deflate;q=0.6,identity;q=0.3\",\n \"HTTP_ACCEPT\": \"*/*\",\n \"HTTP_USER_AGENT\": \"Ruby\",\n \"HTTP_HOST\": "}
More: grep 760269:082778 /t/thumbnails-v2.createlab.org/log.txt
comparison of Float with NaN failed /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:558:in `find_tile_for_non_screenshot' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1059:in `compute_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail' /t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'
2025-10-17 04:57:43.839 THUMB 755834:160532:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.20","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","FATALERROR":"comparison of Float with NaN failed\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:558:in `find_tile_for_non_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1059:in `compute_thumbnail'\n/t/th
2025-10-17 04:57:43.886 THUMB 755834:160532:0 request.body {"service":"Thumbnails","datetime":"2025-10-17T04:57:43-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.20", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "FATALERROR": "comparison of Float with NaN failed\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:558:in `find_tile_for_non_screenshot'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1059:in `compute_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1239:in `serve_thumbnail'\n/t/thumbnails-v2.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1360:in `<main>'"}
More: grep 755834:160532 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-17 01:50:25.867 THUMB 703886:109332:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.48","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2504%2C-784%2C8523%2C2602%2Cpts%26t%3D133.19%26ps%3D5000%26bt%3D20231225062003%26et%3D20231225173003%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-25%26s%3Dclairton3%26fps%
2025-10-17 01:50:25.883 THUMB 703886:109332:0 request.body {"service":"Thumbnails","datetime":"2025-10-17T01:50:25-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.48", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D2504%2C-784%2C8523%2C2602%2Cpts%26t%3D133.19%26ps%3D5000%26bt%3D20231225062003%26et%3D20231225173003%26startDwell%3D0%26endDwell%3D0%26d%3D2023-12-25%26s%3Dclairton3%26fps%3D600&width=1920&height=1080&format=mp4&fps=600&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760679706041", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 703886:109332 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.o
2025-10-16 23:11:14.287 THUMB 654820:166458:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.6","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=http%3A%2F%2Flocalhost%2Fbreathecam%2Fbreathecam.org%2Fwww%2F%23v%3D1473%2C-128%2C6457%2C2676%2Cpts%26t%3D1571.69%26ps%3D0%26bt%3D20241202204403%26et%3D20241202204403%26startDwell%3D0%26endDwell%3D0%26d%3D2024-1
2025-10-16 23:11:14.306 THUMB 654820:166458:0 request.body {"service":"Thumbnails","datetime":"2025-10-16T23:11:14-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.6", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=http%3A%2F%2Flocalhost%2Fbreathecam%2Fbreathecam.org%2Fwww%2F%23v%3D1473%2C-128%2C6457%2C2676%2Cpts%26t%3D1571.69%26ps%3D0%26bt%3D20241202204403%26et%3D20241202204403%26startDwell%3D0%26endDwell%3D0%26d%3D2024-12-02%26s%3Dclairton4%26fps%3D9&width=1280&height=720&format=png&fps=9&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760670161379", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Oh gosh, failed many times to initialize chrome, aborting\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:155:in `make_chrome'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:283:in `start_thumbnail_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:858:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.o"}
More: grep 654820:166458 /t/thumbnails-v2.createlab.org/log.txt
Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Too many frames to compute 11997 /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:417:in `capture_frames_from_screenshot' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1057:in `compute_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail' /thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{ "SCRIPT_URL": "/thumbnail", "SCRIPT_URI": "https://hal40-thumbnailworker.createlab.org/thumbnail", "HTTPS": "on", "SSL_TLS_SNI": "hal40-thumbnailworker.createlab.org", "HTTP_ACCEPT_ENCODING": "gzip;q=1.0,deflate;q=0.6,identity;q=0.3", "HTTP_ACCEPT": "*/*", "HTTP_USER_AGENT": "Ruby", "HTTP_HOST":
2025-10-16 21:39:28.709 THUMB 630736:816458:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"57.141.0.31","HTTP_USER_AGENT":"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)","delegatedTo":"https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D215%2C-785%2C7899%2C3537%2Cpts%26t%3D355.61%26ps%3D500%26bt%3D20240314073342%26et%3D20240314223342%26startDwell%3D0%26endDwell%3D0%26d%3D2024-03-14%26s%3Dclairton4%26fps%3D
2025-10-16 21:39:28.729 THUMB 630736:816458:0 request.body {"service":"Thumbnails","datetime":"2025-10-16T21:39:28-04:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "57.141.0.31", "HTTP_USER_AGENT": "meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)", "delegatedTo": "https://hal40-thumbnailworker.createlab.org/thumbnail?root=https%3A%2F%2Fbreathecam.org%2F%23v%3D215%2C-785%2C7899%2C3537%2Cpts%26t%3D355.61%26ps%3D500%26bt%3D20240314073342%26et%3D20240314223342%26startDwell%3D0%26endDwell%3D0%26d%3D2024-03-14%26s%3Dclairton4%26fps%3D60&width=1280&height=720&format=mp4&fps=60&tileFormat=mp4&startDwell=0&endDwell=0&fromScreenshot&minimalUI&watermark=Breathe%20Project%7CCREATE%20Lab&workerepoch=1760665166634", "FATALERROR": "Thumbnail delegation to hal40-thumbnailworker.createlab.org failed with status code 400 and response body 400: Bad Request<br><html><body><pre>Too many frames to compute 11997\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:417:in `capture_frames_from_screenshot'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1057:in `compute_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1240:in `serve_thumbnail'\n/thumbnailworker/thumbnailworker.createlab.org/timemachine-thumbnail-server/thumbnail-server.rb:1340:in `<main>'</pre><hr><pre>{\n \"SCRIPT_URL\": \"/thumbnail\",\n \"SCRIPT_URI\": \"https://hal40-thumbnailworker.createlab.org/thumbnail\",\n \"HTTPS\": \"on\",\n \"SSL_TLS_SNI\": \"hal40-thumbnailworker.createlab.org\",\n \"HTTP_ACCEPT_ENCODING\": \"gzip;q=1.0,deflate;q=0.6,identity;q=0.3\",\n \"HTTP_ACCEPT\": \"*/*\",\n \"HTTP_USER_AGENT\": \"Ruby\",\n \"HTTP_HOST\": "}
More: grep 630736:816458 /t/thumbnails-v2.createlab.org/log.txt