orcaLog in

Runs · run 4997

load_day 2026-03-03, attempt 1 succeeded

Host
73ccef5e07c2:450827
Started
2026-11-08T15:28:38Z
Ended
2026-11-08T15:29:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
730 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.7 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4997/load_day/2026-03-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:28:38Z [load_day 2026-03-03] attempt 1 started
2026-11-08T15:28:39Z [load_day 2026-03-03] 2026-03-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:28:43Z [load_day 2026-03-03] 2026-03-03 hour 0: 151236 events in 0 files, snapshot none (task 3302 ms: download 2065 ms overlapping gunzip 422 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 565 ms: 3 candidates, 72213 repo-hours, 849 releases; waiting 666 ms; commit 0 ms)
2026-11-08T15:28:43Z [load_day 2026-03-03] 2026-03-03 hour 1: 154880 events in 0 files, snapshot none (task 3686 ms: download 2294 ms overlapping gunzip 373 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 641 ms: 7 candidates, 89884 repo-hours, 598 releases; waiting 1178 ms; commit 0 ms)
2026-11-08T15:28:46Z [load_day 2026-03-03] 2026-03-03 hour 2: 155229 events in 0 files, snapshot none (task 2933 ms: download 1809 ms overlapping gunzip 350 ms, parse 1060 ms, sort 0 ms, write 0 ms, index 656 ms: 5 candidates, 90994 repo-hours, 589 releases; waiting 575 ms; commit 0 ms)
2026-11-08T15:28:47Z [load_day 2026-03-03] 2026-03-03 hour 3: 147797 events in 0 files, snapshot none (task 3214 ms: download 2168 ms overlapping gunzip 431 ms, parse 1315 ms, sort 0 ms, write 0 ms, index 620 ms: 12 candidates, 72918 repo-hours, 792 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:28:51Z [load_day 2026-03-03] 2026-03-03 hour 4: 148308 events in 0 files, snapshot none (task 4546 ms: download 2421 ms overlapping gunzip 648 ms, parse 2071 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 75053 repo-hours, 995 releases; waiting 822 ms; commit 0 ms)
2026-11-08T15:28:52Z [load_day 2026-03-03] 2026-03-03 hour 5: 147826 events in 0 files, snapshot none (task 4466 ms: download 2651 ms overlapping gunzip 707 ms, parse 2057 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 77650 repo-hours, 751 releases; waiting 766 ms; commit 0 ms)
2026-11-08T15:28:56Z [load_day 2026-03-03] 2026-03-03 hour 6: 146464 events in 0 files, snapshot none (task 4556 ms: download 2878 ms overlapping gunzip 685 ms, parse 1979 ms, sort 0 ms, write 0 ms, index 847 ms: 6 candidates, 78366 repo-hours, 839 releases; waiting 747 ms; commit 0 ms)
2026-11-08T15:28:56Z [load_day 2026-03-03] 2026-03-03 hour 7: 152878 events in 0 files, snapshot none (task 4363 ms: download 2785 ms overlapping gunzip 668 ms, parse 1971 ms, sort 0 ms, write 0 ms, index 683 ms: 7 candidates, 83393 repo-hours, 714 releases; waiting 754 ms; commit 0 ms)
2026-11-08T15:29:01Z [load_day 2026-03-03] 2026-03-03 hour 8: 151601 events in 0 files, snapshot none (task 4412 ms: download 2189 ms overlapping gunzip 659 ms, parse 1884 ms, sort 0 ms, write 0 ms, index 775 ms: 8 candidates, 85550 repo-hours, 609 releases; waiting 460 ms; commit 0 ms)
2026-11-08T15:29:01Z [load_day 2026-03-03] 2026-03-03 hour 9: 149994 events in 0 files, snapshot none (task 4061 ms: download 2474 ms overlapping gunzip 596 ms, parse 1841 ms, sort 0 ms, write 0 ms, index 761 ms: 8 candidates, 86154 repo-hours, 610 releases; waiting 569 ms; commit 0 ms)
2026-11-08T15:29:06Z [load_day 2026-03-03] 2026-03-03 hour 10: 149713 events in 0 files, snapshot none (task 4435 ms: download 2939 ms overlapping gunzip 499 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 85136 repo-hours, 493 releases; waiting 1330 ms; commit 0 ms)
2026-11-08T15:29:06Z [load_day 2026-03-03] 2026-03-03 hour 11: 150300 events in 0 files, snapshot none (task 4170 ms: download 2551 ms overlapping gunzip 519 ms, parse 1550 ms, sort 0 ms, write 0 ms, index 640 ms: 7 candidates, 82069 repo-hours, 647 releases; waiting 960 ms; commit 0 ms)
2026-11-08T15:29:10Z [load_day 2026-03-03] 2026-03-03 hour 12: 157888 events in 0 files, snapshot none (task 4215 ms: download 2931 ms overlapping gunzip 388 ms, parse 1207 ms, sort 0 ms, write 0 ms, index 869 ms: 7 candidates, 97820 repo-hours, 316 releases; waiting 1427 ms; commit 0 ms)
2026-11-08T15:29:10Z [load_day 2026-03-03] 2026-03-03 hour 13: 159362 events in 0 files, snapshot none (task 3486 ms: download 1953 ms overlapping gunzip 341 ms, parse 1101 ms, sort 0 ms, write 0 ms, index 1006 ms: 4 candidates, 100833 repo-hours, 228 releases; waiting 634 ms; commit 0 ms)
2026-11-08T15:29:15Z [load_day 2026-03-03] 2026-03-03 hour 14: 154583 events in 0 files, snapshot none (task 3787 ms: download 2008 ms overlapping gunzip 487 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 989 ms: 7 candidates, 92093 repo-hours, 314 releases; waiting 528 ms; commit 0 ms)
2026-11-08T15:29:15Z [load_day 2026-03-03] 2026-03-03 hour 15: 159571 events in 0 files, snapshot none (task 3829 ms: download 1497 ms overlapping gunzip 549 ms, parse 1541 ms, sort 0 ms, write 0 ms, index 1178 ms: 6 candidates, 93426 repo-hours, 310 releases; waiting 222 ms; commit 0 ms)
2026-11-08T15:29:19Z [load_day 2026-03-03] 2026-03-03 hour 16: 153706 events in 0 files, snapshot none (task 3818 ms: download 2335 ms overlapping gunzip 511 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 882 ms: 9 candidates, 88449 repo-hours, 407 releases; waiting 569 ms; commit 0 ms)
2026-11-08T15:29:19Z [load_day 2026-03-03] 2026-03-03 hour 17: 154792 events in 0 files, snapshot none (task 3857 ms: download 2277 ms overlapping gunzip 657 ms, parse 1691 ms, sort 0 ms, write 0 ms, index 696 ms: 12 candidates, 89360 repo-hours, 378 releases; waiting 506 ms; commit 0 ms)
2026-11-08T15:29:23Z [load_day 2026-03-03] 2026-03-03 hour 18: 147672 events in 0 files, snapshot none (task 3573 ms: download 2372 ms overlapping gunzip 477 ms, parse 1350 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 87102 repo-hours, 415 releases; waiting 666 ms; commit 0 ms)
2026-11-08T15:29:24Z [load_day 2026-03-03] 2026-03-03 hour 19: 148890 events in 0 files, snapshot none (task 4069 ms: download 2754 ms overlapping gunzip 651 ms, parse 1881 ms, sort 0 ms, write 0 ms, index 679 ms: 10 candidates, 81182 repo-hours, 739 releases; waiting 537 ms; commit 0 ms)
2026-11-08T15:29:27Z [load_day 2026-03-03] 2026-03-03 hour 20: 154122 events in 0 files, snapshot none (task 3209 ms: download 1815 ms overlapping gunzip 444 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 761 ms: 10 candidates, 82196 repo-hours, 667 releases; waiting 459 ms; commit 0 ms)
2026-11-08T15:29:28Z [load_day 2026-03-03] 2026-03-03 hour 21: 152009 events in 0 files, snapshot none (task 3919 ms: download 2792 ms overlapping gunzip 531 ms, parse 1441 ms, sort 0 ms, write 0 ms, index 596 ms: 5 candidates, 79809 repo-hours, 770 releases; waiting 1052 ms; commit 0 ms)
2026-11-08T15:29:32Z [load_day 2026-03-03] 2026-03-03 hour 22: 152077 events in 0 files, snapshot none (task 4649 ms: download 2870 ms overlapping gunzip 518 ms, parse 1612 ms, sort 0 ms, write 0 ms, index 887 ms: 6 candidates, 80686 repo-hours, 930 releases; waiting 1307 ms; commit 0 ms)
2026-11-08T15:29:33Z [load_day 2026-03-03] 2026-03-03 hour 23: 143105 events in 0 files, snapshot none (task 3689 ms: download 2462 ms overlapping gunzip 550 ms, parse 1546 ms, sort 0 ms, write 0 ms, index 603 ms: 4 candidates, 73287 repo-hours, 1065 releases; waiting 689 ms; commit 0 ms)
2026-11-08T15:29:41Z [load_day 2026-03-03] 2026-03-03: repo_hour merged from 24 files to 1 (2025623 rows, 8887 ms)
2026-11-08T15:29:44Z [load_day 2026-03-03] 2026-03-03: index committed in 11370 ms (24 + 1 + 24 files)
2026-11-08T15:29:44Z [load_day 2026-03-03] 2026-03-03: 3644003 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:29:44Z [load_day 2026-03-03] attempt 1 succeeded