orcaLog in

Runs · run 4912

load_day 2026-02-08, attempt 1 succeeded

Host
73ccef5e07c2:440203
Started
2026-11-08T15:15:26Z
Ended
2026-11-08T15:16:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.0 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4912/load_day/2026-02-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:15:26Z [load_day 2026-02-08] attempt 1 started
2026-11-08T15:15:27Z [load_day 2026-02-08] 2026-02-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:15:31Z [load_day 2026-02-08] 2026-02-08 hour 0: 138837 events in 0 files, snapshot none (task 3629 ms: download 2299 ms overlapping gunzip 406 ms, parse 1296 ms, sort 0 ms, write 0 ms, index 666 ms: 10 candidates, 61082 repo-hours, 1202 releases; waiting 899 ms; commit 0 ms)
2026-11-08T15:15:32Z [load_day 2026-02-08] 2026-02-08 hour 1: 145195 events in 0 files, snapshot none (task 4598 ms: download 3263 ms overlapping gunzip 394 ms, parse 1271 ms, sort 0 ms, write 0 ms, index 732 ms: 9 candidates, 77068 repo-hours, 1025 releases; waiting 1903 ms; commit 0 ms)
2026-11-08T15:15:36Z [load_day 2026-02-08] 2026-02-08 hour 2: 148361 events in 0 files, snapshot none (task 4390 ms: download 2650 ms overlapping gunzip 452 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 1065 ms: 6 candidates, 84625 repo-hours, 806 releases; waiting 1125 ms; commit 0 ms)
2026-11-08T15:15:36Z [load_day 2026-02-08] 2026-02-08 hour 3: 140415 events in 0 files, snapshot none (task 3316 ms: download 1936 ms overlapping gunzip 442 ms, parse 1398 ms, sort 0 ms, write 0 ms, index 632 ms: 11 candidates, 68714 repo-hours, 828 releases; waiting 537 ms; commit 0 ms)
2026-11-08T15:15:41Z [load_day 2026-02-08] 2026-02-08 hour 4: 144352 events in 0 files, snapshot none (task 4194 ms: download 2784 ms overlapping gunzip 579 ms, parse 1838 ms, sort 0 ms, write 0 ms, index 512 ms: 9 candidates, 66198 repo-hours, 734 releases; waiting 942 ms; commit 0 ms)
2026-11-08T15:15:41Z [load_day 2026-02-08] 2026-02-08 hour 5: 142488 events in 0 files, snapshot none (task 3813 ms: download 1977 ms overlapping gunzip 499 ms, parse 1590 ms, sort 0 ms, write 0 ms, index 774 ms: 7 candidates, 66624 repo-hours, 1538 releases; waiting 621 ms; commit 0 ms)
2026-11-08T15:15:45Z [load_day 2026-02-08] 2026-02-08 hour 6: 145666 events in 0 files, snapshot none (task 3713 ms: download 1974 ms overlapping gunzip 578 ms, parse 1613 ms, sort 0 ms, write 0 ms, index 595 ms: 5 candidates, 72340 repo-hours, 783 releases; waiting 488 ms; commit 0 ms)
2026-11-08T15:15:45Z [load_day 2026-02-08] 2026-02-08 hour 7: 144260 events in 0 files, snapshot none (task 3465 ms: download 2478 ms overlapping gunzip 502 ms, parse 1484 ms, sort 0 ms, write 0 ms, index 642 ms: 12 candidates, 70087 repo-hours, 660 releases; waiting 631 ms; commit 0 ms)
2026-11-08T15:15:50Z [load_day 2026-02-08] 2026-02-08 hour 8: 144585 events in 0 files, snapshot none (task 3892 ms: download 2686 ms overlapping gunzip 456 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 517 ms: 8 candidates, 68944 repo-hours, 731 releases; waiting 1094 ms; commit 0 ms)
2026-11-08T15:15:50Z [load_day 2026-02-08] 2026-02-08 hour 9: 146189 events in 0 files, snapshot none (task 3340 ms: download 2046 ms overlapping gunzip 413 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 719 ms: 11 candidates, 71387 repo-hours, 740 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:15:54Z [load_day 2026-02-08] 2026-02-08 hour 10: 145969 events in 0 files, snapshot none (task 3660 ms: download 2247 ms overlapping gunzip 479 ms, parse 1411 ms, sort 0 ms, write 0 ms, index 604 ms: 8 candidates, 70181 repo-hours, 711 releases; waiting 899 ms; commit 0 ms)
2026-11-08T15:15:54Z [load_day 2026-02-08] 2026-02-08 hour 11: 146795 events in 0 files, snapshot none (task 2893 ms: download 1735 ms overlapping gunzip 437 ms, parse 1313 ms, sort 0 ms, write 0 ms, index 576 ms: 6 candidates, 68988 repo-hours, 787 releases; waiting 295 ms; commit 0 ms)
2026-11-08T15:15:58Z [load_day 2026-02-08] 2026-02-08 hour 12: 154676 events in 0 files, snapshot none (task 3412 ms: download 2131 ms overlapping gunzip 431 ms, parse 1334 ms, sort 0 ms, write 0 ms, index 758 ms: 6 candidates, 91065 repo-hours, 659 releases; waiting 552 ms; commit 0 ms)
2026-11-08T15:15:58Z [load_day 2026-02-08] 2026-02-08 hour 13: 153884 events in 0 files, snapshot none (task 3561 ms: download 2258 ms overlapping gunzip 512 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 88309 repo-hours, 571 releases; waiting 515 ms; commit 0 ms)
2026-11-08T15:16:03Z [load_day 2026-02-08] 2026-02-08 hour 14: 151745 events in 0 files, snapshot none (task 4184 ms: download 2285 ms overlapping gunzip 641 ms, parse 1865 ms, sort 0 ms, write 0 ms, index 842 ms: 8 candidates, 78741 repo-hours, 785 releases; waiting 564 ms; commit 0 ms)
2026-11-08T15:16:03Z [load_day 2026-02-08] 2026-02-08 hour 15: 153319 events in 0 files, snapshot none (task 4183 ms: download 2006 ms overlapping gunzip 599 ms, parse 1706 ms, sort 0 ms, write 0 ms, index 796 ms: 9 candidates, 78308 repo-hours, 811 releases; waiting 799 ms; commit 0 ms)
2026-11-08T15:16:07Z [load_day 2026-02-08] 2026-02-08 hour 16: 149503 events in 0 files, snapshot none (task 4158 ms: download 1897 ms overlapping gunzip 589 ms, parse 1921 ms, sort 0 ms, write 0 ms, index 799 ms: 4 candidates, 76735 repo-hours, 820 releases; waiting 519 ms; commit 0 ms)
2026-11-08T15:16:07Z [load_day 2026-02-08] 2026-02-08 hour 17: 155860 events in 0 files, snapshot none (task 3826 ms: download 1962 ms overlapping gunzip 554 ms, parse 1692 ms, sort 0 ms, write 0 ms, index 900 ms: 5 candidates, 80313 repo-hours, 711 releases; waiting 306 ms; commit 0 ms)
2026-11-08T15:16:12Z [load_day 2026-02-08] 2026-02-08 hour 18: 151703 events in 0 files, snapshot none (task 4456 ms: download 2583 ms overlapping gunzip 558 ms, parse 1836 ms, sort 0 ms, write 0 ms, index 942 ms: 4 candidates, 79875 repo-hours, 794 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:16:12Z [load_day 2026-02-08] 2026-02-08 hour 19: 146223 events in 0 files, snapshot none (task 4473 ms: download 2761 ms overlapping gunzip 727 ms, parse 2189 ms, sort 0 ms, write 0 ms, index 700 ms: 8 candidates, 72667 repo-hours, 839 releases; waiting 553 ms; commit 0 ms)
2026-11-08T15:16:17Z [load_day 2026-02-08] 2026-02-08 hour 20: 148222 events in 0 files, snapshot none (task 4260 ms: download 3154 ms overlapping gunzip 469 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 577 ms: 4 candidates, 71156 repo-hours, 866 releases; waiting 1191 ms; commit 0 ms)
2026-11-08T15:16:17Z [load_day 2026-02-08] 2026-02-08 hour 21: 153860 events in 0 files, snapshot none (task 3409 ms: download 2094 ms overlapping gunzip 450 ms, parse 1406 ms, sort 0 ms, write 0 ms, index 551 ms: 4 candidates, 66950 repo-hours, 913 releases; waiting 607 ms; commit 0 ms)
2026-11-08T15:16:20Z [load_day 2026-02-08] 2026-02-08 hour 22: 147848 events in 0 files, snapshot none (task 2902 ms: download 2009 ms overlapping gunzip 385 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 475 ms: 4 candidates, 65395 repo-hours, 774 releases; waiting 628 ms; commit 0 ms)
2026-11-08T15:16:21Z [load_day 2026-02-08] 2026-02-08 hour 23: 148045 events in 0 files, snapshot none (task 3112 ms: download 2360 ms overlapping gunzip 401 ms, parse 1247 ms, sort 0 ms, write 0 ms, index 474 ms: 6 candidates, 64267 repo-hours, 729 releases; waiting 771 ms; commit 0 ms)
2026-11-08T15:16:28Z [load_day 2026-02-08] 2026-02-08: repo_hour merged from 24 files to 1 (1760019 rows, 7671 ms)
2026-11-08T15:16:32Z [load_day 2026-02-08] 2026-02-08: index committed in 11438 ms (24 + 1 + 24 files)
2026-11-08T15:16:32Z [load_day 2026-02-08] 2026-02-08: 3548000 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:16:32Z [load_day 2026-02-08] attempt 1 succeeded