Open thumbnail logs in Grafana ↗ (internal; via the SSH SOCKS tunnel to hal49)
exporter exited (1) before emitting header: Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/tm.json
Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/crf26-12fps-1424x800/r.json
TimeMachine has 4 levels and 28680 frames
Traceback (most recent call last):
File "/app/timemachine-thumbnail-server/venv/bin/breathecam-thumbnail-export", line 6, in <module>
sys.exit(main())
^^^^^^
File "/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/breathecam_export_cli.py", line 109, in main
start_frame = tm.frameno_from_date_after_or_equal(begin)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/timemachine.py", line 119, in frameno_from_date_after_or_equal
for i, t in enumerate(self.capture_datetimes()):
^^^^^^^^^^^^^^
2026-07-20 15:37:29.745 THUMB 10044:975672:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.100.5","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"breathecam_export","FATALERROR":"exporter exited (1) before emitting header: Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/tm.json\nFetching https://tiles.cmuc2026-07-20 15:37:29.782 THUMB 10044:975672:0 request.body {"service":"Thumbnails","datetime":"2026-07-20T15:37:29+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}
{"REMOTE_ADDR": "10.1.100.5", "HTTP_USER_AGENT": "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36", "codepath": "breathecam_export", "FATALERROR": "exporter exited (1) before emitting header: Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/tm.json\nFetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/crf26-12fps-1424x800/r.json\nTimeMachine has 4 levels and 28680 frames\nTraceback (most recent call last):\n File \"/app/timemachine-thumbnail-server/venv/bin/breathecam-thumbnail-export\", line 6, in <module>\n sys.exit(main())\n ^^^^^^\n File \"/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/breathecam_export_cli.py\", line 109, in main\n start_frame = tm.frameno_from_date_after_or_equal(begin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/timemachine.py\", line 119, in frameno_from_date_after_or_equal\n for i, t in enumerate(self.capture_datetimes()):\n ^^^^^^^^^^^^^^"}2026-07-20 15:37:28.729 THUMB 10044:975672:0 Ignoring fromScreenshot for breathecam.org root; using export path
2026-07-20 15:37:28.729 THUMB 10044:975672:0 Auto-detected breathecam.org root; routing to fromExport path
2026-07-20 15:37:28.802 THUMB 10044:975672:0 Not found in cache; computing
2026-07-20 15:37:28.806 THUMB 10044:975672:0 STARTTHUMBNAIL http://thumbnails-v2.createlab.org/thumbnail?endDwell=0&format=mp4&fps=6&fromScreenshot&height=720&minimalUI&root=https://breathecam.org%23v%3D483,892,4692,3259,pts%26t%3D1360.44%26ps%3D50%26bt%3D20260715174154%26et%3D20260715174445%26startDwell%3D0%26endDwell%3D0%26d%3D2026-07-15%26s%3Daccan2%26fps%3D6&startDwell=0&tileFormat=mp4&width=1280
2026-07-20 15:37:28.807 THUMB 10044:975672:0 CHECKPOINTTHUMBNAIL START {"REMOTE_ADDR":"10.1.100.5","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"breathecam_export"}
2026-07-20 15:37:28.807 THUMB 10044:975672:0 fromExport root https://breathecam.org#v=483,892,4692,3259,pts&t=1360.44&ps=50&bt=20260715174154&et=20260715174445&startDwell=0&endDwell=0&d=2026-07-15&s=accan2&fps=6
2026-07-20 15:37:28.807 THUMB 10044:975672:0 Spawning exporter: ["/app/timemachine-thumbnail-server/venv/bin/breathecam-thumbnail-export", "https://breathecam.org#v=483,892,4692,3259,pts&t=1360.44&ps=50&bt=20260715174154&et=20260715174445&startDwell=0&endDwell=0&d=2026-07-15&s=accan2&fps=6", "--size", "1280x720", "-o", "-"]
2026-07-20 15:37:29.390 THUMB 10044:975672:0 exporter: Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/tm.json
2026-07-20 15:37:29.574 THUMB 10044:975672:0 exporter: Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/crf26-12fps-1424x800/r.json
2026-07-20 15:37:29.636 THUMB 10044:975672:0 exporter: TimeMachine has 4 levels and 28680 frames
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: Traceback (most recent call last):
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: File "/app/timemachine-thumbnail-server/venv/bin/breathecam-thumbnail-export", line 6, in <module>
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: sys.exit(main())
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: ^^^^^^
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: File "/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/breathecam_export_cli.py", line 109, in main
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: start_frame = tm.frameno_from_date_after_or_equal(begin)
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: File "/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/timemachine.py", line 119, in frameno_from_date_after_or_equal
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: for i, t in enumerate(self.capture_datetimes()):
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: ^^^^^^^^^^^^^^^^^^^^^^^^
2026-07-20 15:37:29.638 THUMB 10044:975672:0 exporter: File "/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/timemachine.py", line 107, in capture_datetimes
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: return [self.timezone.localize(datetime.datetime.strptime(t, "%Y-%m-%d %H:%M:%S")) for t in self.capture_times()]
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: File "/usr/lib/python3.12/_strptime.py", line 554, in _strptime_datetime
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: tt, fraction, gmtoff_fraction = _strptime(data_string, format)
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: File "/usr/lib/python3.12/_strptime.py", line 336, in _strptime
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: raise ValueError("unconverted data remains: %s" %
2026-07-20 15:37:29.639 THUMB 10044:975672:0 exporter: ValueError: unconverted data remains: EDT
2026-07-20 15:37:29.745 THUMB 10044:975672:0 CHECKPOINTTHUMBNAIL FATALERROR {"REMOTE_ADDR":"10.1.100.5","HTTP_USER_AGENT":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36","codepath":"breathecam_export","FATALERROR":"exporter exited (1) before emitting header: Fetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/tm.json\nFetching https://tiles.cmucreatelab.org/ecam/timemachines/accan2/2026-07-15.timemachine/crf26-12fps-1424x800/r.json\nTimeMachine has 4 levels and 28680 frames\nTraceback (most recent call last):\n File \"/app/timemachine-thumbnail-server/venv/bin/breathecam-thumbnail-export\", line 6, in <module>\n sys.exit(main())\n ^^^^^^\n File \"/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/breathecam_export_cli.py\", line 109, in main\n start_frame = tm.frameno_from_date_after_or_equal(begin)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/timemachine.py\", line 119, in frameno_from_date_after_or_equal\n for i, t in enumerate(self.capture_datetimes()):\n ^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/app/timemachine-thumbnail-server/venv/lib/python3.12/site-packages/timemachine_video_export/timemachine.py\", line 107, in capture_datetimes\n return [self.timezone.localize(datetime.datetime.strptime(t, \"%Y-%m-%d %H:%M:%S\")) for t in self.capture_times()]\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/usr/lib/python3.12/_strptime.py\", line 554, in _strptime_datetime\n tt, fraction, gmtoff_fraction = _strptime(data_string, format)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/usr/lib/python3.12/_strptime.py\", line 336, in _strptime\n raise ValueError(\"unconverted data remains: %s\" %\nValueError: unconverted data remains: EDT\n\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1020:in `compute_thumbnail_from_export'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1161:in `compute_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1624:in `serve_thumbnail'\n/app/timemachine-thumbnail-server/thumbnail-server.rb:1749:in `<main>'"}
2026-07-20 15:37:29.745 THUMB 10044:975672:0 url is https://stat.createlab.org/api/log host stat.createlab.org port 443
2026-07-20 15:37:29.745 THUMB 10044:975672:0 request.body {"service":"Thumbnails","datetime":"2026-07-20T15:37:29+00:00","host":"-","level":"info","summary":"Thumbnail failed 10044:975672 on thumbnails-v2.createlab.org in 1.0 seconds","details":"<a href=\"http://thumbnails-v2.createlab.org/status?id=10044:975672\">More info</a>","payload":{},"valid_for_secs":null}
2026-07-20 15:37:29.782 THUMB 10044:975672:0 url is https://stat.createlab.org/api/log host stat.createlab.org port 443
2026-07-20 15:37:29.782 THUMB 10044:975672:0 request.body {"service":"Thumbnails","datetime":"2026-07-20T15:37:29+00:00","host":"-","level":"up","summary":"Last thumbnail failed","details":null,"payload":{},"valid_for_secs":null}