orcaLog in

Runs · run 3815

load_day 2025-04-22, attempt 1 succeeded

Host
73ccef5e07c2:291764
Started
2026-11-08T11:32:23Z
Ended
2026-11-08T11:34:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
776 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
213.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3815/load_day/2025-04-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:32:23Z [load_day 2025-04-22] attempt 1 started
2026-11-08T11:32:23Z [load_day 2025-04-22] 2025-04-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:32:32Z [load_day 2025-04-22] 2025-04-22 hour 0: 201667 events in 0 files, snapshot none (task 7620 ms: download 4348 ms overlapping gunzip 1231 ms, parse 5002 ms, sort 0 ms, write 0 ms, index 835 ms: 7 candidates, 94464 repo-hours, 1385 releases; waiting 199 ms; commit 0 ms)
2026-11-08T11:32:32Z [load_day 2025-04-22] 2025-04-22 hour 1: 234866 events in 0 files, snapshot none (task 8454 ms: download 5118 ms overlapping gunzip 1251 ms, parse 5504 ms, sort 0 ms, write 0 ms, index 877 ms: 10 candidates, 126603 repo-hours, 1147 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:32:41Z [load_day 2025-04-22] 2025-04-22 hour 2: 204719 events in 0 files, snapshot none (task 8426 ms: download 5194 ms overlapping gunzip 1344 ms, parse 5407 ms, sort 0 ms, write 0 ms, index 757 ms: 8 candidates, 89107 repo-hours, 1078 releases; waiting 549 ms; commit 0 ms)
2026-11-08T11:32:42Z [load_day 2025-04-22] 2025-04-22 hour 3: 224277 events in 0 files, snapshot none (task 8664 ms: download 5485 ms overlapping gunzip 1398 ms, parse 5563 ms, sort 0 ms, write 0 ms, index 760 ms: 13 candidates, 91130 repo-hours, 2986 releases; waiting 549 ms; commit 0 ms)
2026-11-08T11:32:51Z [load_day 2025-04-22] 2025-04-22 hour 4: 211606 events in 0 files, snapshot none (task 10279 ms: download 5923 ms overlapping gunzip 1715 ms, parse 7055 ms, sort 0 ms, write 0 ms, index 950 ms: 5 candidates, 81668 repo-hours, 965 releases; waiting 276 ms; commit 0 ms)
2026-11-08T11:32:52Z [load_day 2025-04-22] 2025-04-22 hour 5: 219085 events in 0 files, snapshot none (task 10313 ms: download 6369 ms overlapping gunzip 1759 ms, parse 6798 ms, sort 0 ms, write 0 ms, index 979 ms: 6 candidates, 86604 repo-hours, 1034 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:33:00Z [load_day 2025-04-22] 2025-04-22 hour 6: 245062 events in 0 files, snapshot none (task 8364 ms: download 5231 ms overlapping gunzip 1241 ms, parse 5034 ms, sort 0 ms, write 0 ms, index 912 ms: 6 candidates, 107748 repo-hours, 1243 releases; waiting 526 ms; commit 0 ms)
2026-11-08T11:33:09Z [load_day 2025-04-22] 2025-04-22 hour 7: 246720 events in 0 files, snapshot none (task 15571 ms: download 11760 ms overlapping gunzip 1886 ms, parse 7787 ms, sort 0 ms, write 0 ms, index 1050 ms: 7 candidates, 102411 repo-hours, 1197 releases; waiting 4436 ms; commit 0 ms)
2026-11-08T11:33:11Z [load_day 2025-04-22] 2025-04-22 hour 8: 252482 events in 0 files, snapshot none (task 10497 ms: download 7655 ms overlapping gunzip 1663 ms, parse 7288 ms, sort 0 ms, write 0 ms, index 770 ms: 15 candidates, 108271 repo-hours, 1489 releases; waiting 461 ms; commit 0 ms)
2026-11-08T11:33:20Z [load_day 2025-04-22] 2025-04-22 hour 9: 260613 events in 0 files, snapshot none (task 11312 ms: download 8065 ms overlapping gunzip 1711 ms, parse 7673 ms, sort 0 ms, write 0 ms, index 960 ms: 7 candidates, 111450 repo-hours, 1569 releases; waiting 642 ms; commit 0 ms)
2026-11-08T11:33:23Z [load_day 2025-04-22] 2025-04-22 hour 10: 247274 events in 0 files, snapshot none (task 10820 ms: download 8011 ms overlapping gunzip 1704 ms, parse 7489 ms, sort 0 ms, write 0 ms, index 855 ms: 10 candidates, 104393 repo-hours, 1466 releases; waiting 447 ms; commit 0 ms)
2026-11-08T11:33:31Z [load_day 2025-04-22] 2025-04-22 hour 11: 252411 events in 0 files, snapshot none (task 9567 ms: download 6298 ms overlapping gunzip 1515 ms, parse 6328 ms, sort 0 ms, write 0 ms, index 935 ms: 6 candidates, 102722 repo-hours, 1393 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:33:34Z [load_day 2025-04-22] 2025-04-22 hour 12: 283970 events in 0 files, snapshot none (task 10598 ms: download 7472 ms overlapping gunzip 1642 ms, parse 7029 ms, sort 0 ms, write 0 ms, index 1073 ms: 11 candidates, 144846 repo-hours, 1538 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:33:40Z [load_day 2025-04-22] 2025-04-22 hour 13: 273426 events in 0 files, snapshot none (task 9208 ms: download 6419 ms overlapping gunzip 1363 ms, parse 5729 ms, sort 0 ms, write 0 ms, index 994 ms: 11 candidates, 130364 repo-hours, 1393 releases; waiting 861 ms; commit 0 ms)
2026-11-08T11:33:43Z [load_day 2025-04-22] 2025-04-22 hour 14: 271838 events in 0 files, snapshot none (task 9057 ms: download 6220 ms overlapping gunzip 1401 ms, parse 5959 ms, sort 0 ms, write 0 ms, index 918 ms: 13 candidates, 116723 repo-hours, 1563 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:33:51Z [load_day 2025-04-22] 2025-04-22 hour 15: 271364 events in 0 files, snapshot none (task 10317 ms: download 5973 ms overlapping gunzip 1435 ms, parse 6060 ms, sort 0 ms, write 0 ms, index 1780 ms: 7 candidates, 119889 repo-hours, 1695 releases; waiting 723 ms; commit 0 ms)
2026-11-08T11:33:54Z [load_day 2025-04-22] 2025-04-22 hour 16: 267030 events in 0 files, snapshot none (task 10163 ms: download 6424 ms overlapping gunzip 1434 ms, parse 6448 ms, sort 0 ms, write 0 ms, index 1484 ms: 7 candidates, 114035 repo-hours, 1505 releases; waiting 524 ms; commit 0 ms)
2026-11-08T11:34:02Z [load_day 2025-04-22] 2025-04-22 hour 17: 256098 events in 0 files, snapshot none (task 10094 ms: download 5751 ms overlapping gunzip 1582 ms, parse 6628 ms, sort 0 ms, write 0 ms, index 1374 ms: 4 candidates, 107312 repo-hours, 1378 releases; waiting 196 ms; commit 0 ms)
2026-11-08T11:34:04Z [load_day 2025-04-22] 2025-04-22 hour 18: 260616 events in 0 files, snapshot none (task 9810 ms: download 6865 ms overlapping gunzip 1480 ms, parse 6571 ms, sort 0 ms, write 0 ms, index 940 ms: 13 candidates, 116685 repo-hours, 1518 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:34:12Z [load_day 2025-04-22] 2025-04-22 hour 19: 246599 events in 0 files, snapshot none (task 9862 ms: download 6894 ms overlapping gunzip 1532 ms, parse 6671 ms, sort 0 ms, write 0 ms, index 887 ms: 12 candidates, 97893 repo-hours, 1400 releases; waiting 546 ms; commit 0 ms)
2026-11-08T11:34:14Z [load_day 2025-04-22] 2025-04-22 hour 20: 233290 events in 0 files, snapshot none (task 9580 ms: download 6845 ms overlapping gunzip 1486 ms, parse 6458 ms, sort 0 ms, write 0 ms, index 877 ms: 5 candidates, 94897 repo-hours, 1295 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:34:22Z [load_day 2025-04-22] 2025-04-22 hour 21: 222643 events in 0 files, snapshot none (task 8925 ms: download 5773 ms overlapping gunzip 1413 ms, parse 5852 ms, sort 0 ms, write 0 ms, index 851 ms: 5 candidates, 88641 repo-hours, 1513 releases; waiting 531 ms; commit 0 ms)
2026-11-08T11:34:24Z [load_day 2025-04-22] 2025-04-22 hour 22: 207538 events in 0 files, snapshot none (task 8832 ms: download 6248 ms overlapping gunzip 1440 ms, parse 5920 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 76558 repo-hours, 1261 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:34:29Z [load_day 2025-04-22] 2025-04-22 hour 23: 196052 events in 0 files, snapshot none (task 6680 ms: download 4224 ms overlapping gunzip 991 ms, parse 4323 ms, sort 0 ms, write 0 ms, index 616 ms: 2 candidates, 74273 repo-hours, 1146 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:34:40Z [load_day 2025-04-22] 2025-04-22: repo_hour merged from 24 files to 1 (2488687 rows, 10670 ms)
2026-11-08T11:34:42Z [load_day 2025-04-22] 2025-04-22: index committed in 13497 ms (24 + 1 + 24 files)
2026-11-08T11:34:42Z [load_day 2025-04-22] 2025-04-22: 5791246 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:34:42Z [load_day 2025-04-22] attempt 1 succeeded