orcaLog in

Runs · run 3369

load_day 2024-12-28, attempt 1 succeeded

Host
73ccef5e07c2:229085
Started
2026-11-08T09:34:15Z
Ended
2026-11-08T09:35:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
656 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.9 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3369/load_day/2024-12-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:34:15Z [load_day 2024-12-28] attempt 1 started
2026-11-08T09:34:16Z [load_day 2024-12-28] 2024-12-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:34:21Z [load_day 2024-12-28] 2024-12-28 hour 0: 153674 events in 0 files, snapshot none (task 4672 ms: download 2185 ms overlapping gunzip 636 ms, parse 2768 ms, sort 0 ms, write 0 ms, index 540 ms: 8 candidates, 76096 repo-hours, 1044 releases; waiting 431 ms; commit 0 ms)
2026-11-08T09:34:22Z [load_day 2024-12-28] 2024-12-28 hour 1: 168620 events in 0 files, snapshot none (task 4945 ms: download 2268 ms overlapping gunzip 616 ms, parse 2883 ms, sort 0 ms, write 0 ms, index 644 ms: 5 candidates, 90670 repo-hours, 769 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:34:28Z [load_day 2024-12-28] 2024-12-28 hour 2: 133732 events in 0 files, snapshot none (task 6037 ms: download 2831 ms overlapping gunzip 858 ms, parse 3694 ms, sort 0 ms, write 0 ms, index 681 ms: 5 candidates, 58866 repo-hours, 632 releases; waiting 460 ms; commit 0 ms)
2026-11-08T09:34:28Z [load_day 2024-12-28] 2024-12-28 hour 3: 155863 events in 0 files, snapshot none (task 6293 ms: download 2998 ms overlapping gunzip 914 ms, parse 4349 ms, sort 0 ms, write 0 ms, index 583 ms: 4 candidates, 59692 repo-hours, 3805 releases; waiting 180 ms; commit 0 ms)
2026-11-08T09:34:34Z [load_day 2024-12-28] 2024-12-28 hour 4: 146011 events in 0 files, snapshot none (task 5354 ms: download 2118 ms overlapping gunzip 754 ms, parse 3395 ms, sort 0 ms, write 0 ms, index 451 ms: 5 candidates, 54067 repo-hours, 525 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:34:34Z [load_day 2024-12-28] 2024-12-28 hour 5: 145729 events in 0 files, snapshot none (task 4983 ms: download 2454 ms overlapping gunzip 679 ms, parse 3036 ms, sort 0 ms, write 0 ms, index 410 ms: 0 candidates, 52234 repo-hours, 662 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:34:40Z [load_day 2024-12-28] 2024-12-28 hour 6: 171858 events in 0 files, snapshot none (task 5530 ms: download 2058 ms overlapping gunzip 698 ms, parse 3210 ms, sort 0 ms, write 0 ms, index 937 ms: 1 candidates, 72748 repo-hours, 995 releases; waiting 379 ms; commit 0 ms)
2026-11-08T09:34:40Z [load_day 2024-12-28] 2024-12-28 hour 7: 156426 events in 0 files, snapshot none (task 5489 ms: download 2390 ms overlapping gunzip 796 ms, parse 3419 ms, sort 0 ms, write 0 ms, index 462 ms: 4 candidates, 56640 repo-hours, 855 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:34:44Z [load_day 2024-12-28] 2024-12-28 hour 8: 163397 events in 0 files, snapshot none (task 4072 ms: download 1594 ms overlapping gunzip 576 ms, parse 2404 ms, sort 0 ms, write 0 ms, index 486 ms: 3 candidates, 61652 repo-hours, 820 releases; waiting 23 ms; commit 0 ms)
2026-11-08T09:34:46Z [load_day 2024-12-28] 2024-12-28 hour 9: 171669 events in 0 files, snapshot none (task 4635 ms: download 2978 ms overlapping gunzip 533 ms, parse 2410 ms, sort 0 ms, write 0 ms, index 499 ms: 4 candidates, 67875 repo-hours, 1002 releases; waiting 867 ms; commit 0 ms)
2026-11-08T09:34:49Z [load_day 2024-12-28] 2024-12-28 hour 10: 165637 events in 0 files, snapshot none (task 4323 ms: download 2714 ms overlapping gunzip 551 ms, parse 2370 ms, sort 0 ms, write 0 ms, index 461 ms: 4 candidates, 64165 repo-hours, 770 releases; waiting 617 ms; commit 0 ms)
2026-11-08T09:34:51Z [load_day 2024-12-28] 2024-12-28 hour 11: 166720 events in 0 files, snapshot none (task 4545 ms: download 2665 ms overlapping gunzip 602 ms, parse 2537 ms, sort 0 ms, write 0 ms, index 429 ms: 3 candidates, 60311 repo-hours, 702 releases; waiting 518 ms; commit 0 ms)
2026-11-08T09:34:55Z [load_day 2024-12-28] 2024-12-28 hour 12: 228237 events in 0 files, snapshot none (task 5134 ms: download 3036 ms overlapping gunzip 641 ms, parse 2931 ms, sort 0 ms, write 0 ms, index 746 ms: 5 candidates, 110677 repo-hours, 822 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:34:56Z [load_day 2024-12-28] 2024-12-28 hour 13: 193566 events in 0 files, snapshot none (task 5134 ms: download 3612 ms overlapping gunzip 599 ms, parse 2694 ms, sort 0 ms, write 0 ms, index 860 ms: 3 candidates, 88328 repo-hours, 711 releases; waiting 660 ms; commit 0 ms)
2026-11-08T09:35:02Z [load_day 2024-12-28] 2024-12-28 hour 14: 179027 events in 0 files, snapshot none (task 5491 ms: download 3017 ms overlapping gunzip 740 ms, parse 3389 ms, sort 0 ms, write 0 ms, index 597 ms: 7 candidates, 69521 repo-hours, 846 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:35:02Z [load_day 2024-12-28] 2024-12-28 hour 15: 187076 events in 0 files, snapshot none (task 5480 ms: download 2902 ms overlapping gunzip 748 ms, parse 3376 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 76949 repo-hours, 961 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:35:08Z [load_day 2024-12-28] 2024-12-28 hour 16: 180746 events in 0 files, snapshot none (task 5587 ms: download 3143 ms overlapping gunzip 786 ms, parse 3448 ms, sort 0 ms, write 0 ms, index 571 ms: 3 candidates, 70611 repo-hours, 876 releases; waiting 477 ms; commit 0 ms)
2026-11-08T09:35:08Z [load_day 2024-12-28] 2024-12-28 hour 17: 169546 events in 0 files, snapshot none (task 5456 ms: download 2975 ms overlapping gunzip 746 ms, parse 3264 ms, sort 0 ms, write 0 ms, index 500 ms: 5 candidates, 64125 repo-hours, 853 releases; waiting 629 ms; commit 0 ms)
2026-11-08T09:35:14Z [load_day 2024-12-28] 2024-12-28 hour 18: 183213 events in 0 files, snapshot none (task 5817 ms: download 3036 ms overlapping gunzip 788 ms, parse 3629 ms, sort 0 ms, write 0 ms, index 629 ms: 6 candidates, 80960 repo-hours, 996 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:35:14Z [load_day 2024-12-28] 2024-12-28 hour 19: 154661 events in 0 files, snapshot none (task 4806 ms: download 2399 ms overlapping gunzip 647 ms, parse 2909 ms, sort 0 ms, write 0 ms, index 534 ms: 6 candidates, 55597 repo-hours, 747 releases; waiting 474 ms; commit 0 ms)
2026-11-08T09:35:19Z [load_day 2024-12-28] 2024-12-28 hour 20: 154711 events in 0 files, snapshot none (task 4850 ms: download 2905 ms overlapping gunzip 713 ms, parse 2960 ms, sort 0 ms, write 0 ms, index 428 ms: 3 candidates, 57955 repo-hours, 744 releases; waiting 442 ms; commit 0 ms)
2026-11-08T09:35:19Z [load_day 2024-12-28] 2024-12-28 hour 21: 156279 events in 0 files, snapshot none (task 4245 ms: download 2433 ms overlapping gunzip 651 ms, parse 2695 ms, sort 0 ms, write 0 ms, index 424 ms: 1 candidates, 59412 repo-hours, 870 releases; waiting 207 ms; commit 0 ms)
2026-11-08T09:35:24Z [load_day 2024-12-28] 2024-12-28 hour 22: 137884 events in 0 files, snapshot none (task 4220 ms: download 2220 ms overlapping gunzip 566 ms, parse 2476 ms, sort 0 ms, write 0 ms, index 391 ms: 3 candidates, 49354 repo-hours, 1210 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:35:24Z [load_day 2024-12-28] 2024-12-28 hour 23: 129921 events in 0 files, snapshot none (task 4224 ms: download 2085 ms overlapping gunzip 557 ms, parse 2498 ms, sort 0 ms, write 0 ms, index 369 ms: 3 candidates, 46836 repo-hours, 697 releases; waiting 477 ms; commit 0 ms)
2026-11-08T09:35:31Z [load_day 2024-12-28] 2024-12-28: repo_hour merged from 24 files to 1 (1605341 rows, 6776 ms)
2026-11-08T09:35:34Z [load_day 2024-12-28] 2024-12-28: index committed in 9343 ms (23 + 1 + 24 files)
2026-11-08T09:35:34Z [load_day 2024-12-28] 2024-12-28: 3954203 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:35:34Z [load_day 2024-12-28] attempt 1 succeeded