orcaLog in

Runs · run 1926

load_day 2024-01-02, attempt 1 succeeded

Host
73ccef5e07c2:15125
Started
2026-11-08T03:58:51Z
Ended
2026-11-08T04:00:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
650 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
145.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1926/load_day/2024-01-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:58:51Z [load_day 2024-01-02] attempt 1 started
2026-11-08T03:58:53Z [load_day 2024-01-02] 2024-01-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:58:58Z [load_day 2024-01-02] 2024-01-02 hour 0: 168486 events in 0 files, snapshot none (task 4946 ms: download 2951 ms overlapping gunzip 654 ms, parse 2904 ms, sort 0 ms, write 0 ms, index 570 ms: 11 candidates, 72918 repo-hours, 909 releases; waiting 475 ms; commit 0 ms)
2026-11-08T03:58:58Z [load_day 2024-01-02] 2024-01-02 hour 1: 128788 events in 0 files, snapshot none (task 4193 ms: download 2708 ms overlapping gunzip 564 ms, parse 2407 ms, sort 0 ms, write 0 ms, index 417 ms: 5 candidates, 60769 repo-hours, 506 releases; waiting 508 ms; commit 0 ms)
2026-11-08T03:59:03Z [load_day 2024-01-02] 2024-01-02 hour 2: 147385 events in 0 files, snapshot none (task 4371 ms: download 2254 ms overlapping gunzip 665 ms, parse 2650 ms, sort 0 ms, write 0 ms, index 460 ms: 5 candidates, 51413 repo-hours, 668 releases; waiting 302 ms; commit 0 ms)
2026-11-08T03:59:04Z [load_day 2024-01-02] 2024-01-02 hour 3: 145360 events in 0 files, snapshot none (task 4904 ms: download 2788 ms overlapping gunzip 718 ms, parse 2855 ms, sort 0 ms, write 0 ms, index 358 ms: 1 candidates, 51484 repo-hours, 835 releases; waiting 674 ms; commit 0 ms)
2026-11-08T03:59:09Z [load_day 2024-01-02] 2024-01-02 hour 4: 142120 events in 0 files, snapshot none (task 5190 ms: download 2603 ms overlapping gunzip 774 ms, parse 3297 ms, sort 0 ms, write 0 ms, index 326 ms: 0 candidates, 48696 repo-hours, 581 releases; waiting 479 ms; commit 0 ms)
2026-11-08T03:59:10Z [load_day 2024-01-02] 2024-01-02 hour 5: 152134 events in 0 files, snapshot none (task 5748 ms: download 3329 ms overlapping gunzip 959 ms, parse 3662 ms, sort 0 ms, write 0 ms, index 399 ms: 3 candidates, 53496 repo-hours, 602 releases; waiting 499 ms; commit 0 ms)
2026-11-08T03:59:16Z [load_day 2024-01-02] 2024-01-02 hour 6: 170508 events in 0 files, snapshot none (task 6132 ms: download 2983 ms overlapping gunzip 919 ms, parse 3793 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 67049 repo-hours, 810 releases; waiting 515 ms; commit 0 ms)
2026-11-08T03:59:17Z [load_day 2024-01-02] 2024-01-02 hour 7: 183425 events in 0 files, snapshot none (task 6300 ms: download 3763 ms overlapping gunzip 1024 ms, parse 3992 ms, sort 0 ms, write 0 ms, index 506 ms: 4 candidates, 65109 repo-hours, 816 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:59:22Z [load_day 2024-01-02] 2024-01-02 hour 8: 191137 events in 0 files, snapshot none (task 5745 ms: download 3418 ms overlapping gunzip 875 ms, parse 3594 ms, sort 0 ms, write 0 ms, index 525 ms: 4 candidates, 71036 repo-hours, 875 releases; waiting 499 ms; commit 0 ms)
2026-11-08T03:59:23Z [load_day 2024-01-02] 2024-01-02 hour 9: 199450 events in 0 files, snapshot none (task 6434 ms: download 4215 ms overlapping gunzip 1024 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 542 ms: 2 candidates, 73908 repo-hours, 1034 releases; waiting 525 ms; commit 0 ms)
2026-11-08T03:59:29Z [load_day 2024-01-02] 2024-01-02 hour 10: 177751 events in 0 files, snapshot none (task 6357 ms: download 4045 ms overlapping gunzip 1014 ms, parse 3926 ms, sort 0 ms, write 0 ms, index 526 ms: 3 candidates, 74127 repo-hours, 982 releases; waiting 635 ms; commit 0 ms)
2026-11-08T03:59:29Z [load_day 2024-01-02] 2024-01-02 hour 11: 175673 events in 0 files, snapshot none (task 5364 ms: download 3196 ms overlapping gunzip 828 ms, parse 3289 ms, sort 0 ms, write 0 ms, index 484 ms: 2 candidates, 70297 repo-hours, 1008 releases; waiting 540 ms; commit 0 ms)
2026-11-08T03:59:37Z [load_day 2024-01-02] 2024-01-02 hour 12: 237269 events in 0 files, snapshot none (task 7964 ms: download 4837 ms overlapping gunzip 1180 ms, parse 5106 ms, sort 0 ms, write 0 ms, index 785 ms: 5 candidates, 103873 repo-hours, 1446 releases; waiting 565 ms; commit 0 ms)
2026-11-08T03:59:37Z [load_day 2024-01-02] 2024-01-02 hour 13: 207301 events in 0 files, snapshot none (task 7829 ms: download 4756 ms overlapping gunzip 1188 ms, parse 4958 ms, sort 0 ms, write 0 ms, index 709 ms: 7 candidates, 98337 repo-hours, 1213 releases; waiting 645 ms; commit 0 ms)
2026-11-08T03:59:46Z [load_day 2024-01-02] 2024-01-02 hour 14: 212581 events in 0 files, snapshot none (task 7886 ms: download 5501 ms overlapping gunzip 1264 ms, parse 5240 ms, sort 0 ms, write 0 ms, index 626 ms: 4 candidates, 85825 repo-hours, 1192 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:59:46Z [load_day 2024-01-02] 2024-01-02 hour 15: 235608 events in 0 files, snapshot none (task 8150 ms: download 5528 ms overlapping gunzip 1336 ms, parse 5373 ms, sort 0 ms, write 0 ms, index 640 ms: 6 candidates, 84069 repo-hours, 1127 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:59:55Z [load_day 2024-01-02] 2024-01-02 hour 16: 217109 events in 0 files, snapshot none (task 8449 ms: download 5791 ms overlapping gunzip 1335 ms, parse 5476 ms, sort 0 ms, write 0 ms, index 875 ms: 2 candidates, 85173 repo-hours, 1869 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:59:55Z [load_day 2024-01-02] 2024-01-02 hour 17: 195575 events in 0 files, snapshot none (task 7430 ms: download 4663 ms overlapping gunzip 1159 ms, parse 4672 ms, sort 0 ms, write 0 ms, index 907 ms: 5 candidates, 76855 repo-hours, 969 releases; waiting 370 ms; commit 0 ms)
2026-11-08T04:00:02Z [load_day 2024-01-02] 2024-01-02 hour 18: 192596 events in 0 files, snapshot none (task 6762 ms: download 4053 ms overlapping gunzip 1042 ms, parse 4228 ms, sort 0 ms, write 0 ms, index 747 ms: 6 candidates, 81505 repo-hours, 1077 releases; waiting 435 ms; commit 0 ms)
2026-11-08T04:00:02Z [load_day 2024-01-02] 2024-01-02 hour 19: 179501 events in 0 files, snapshot none (task 6765 ms: download 3975 ms overlapping gunzip 1028 ms, parse 4146 ms, sort 0 ms, write 0 ms, index 711 ms: 3 candidates, 67969 repo-hours, 1114 releases; waiting 544 ms; commit 0 ms)
2026-11-08T04:00:09Z [load_day 2024-01-02] 2024-01-02 hour 20: 169744 events in 0 files, snapshot none (task 6235 ms: download 3444 ms overlapping gunzip 932 ms, parse 3839 ms, sort 0 ms, write 0 ms, index 715 ms: 3 candidates, 66508 repo-hours, 962 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:00:09Z [load_day 2024-01-02] 2024-01-02 hour 21: 159536 events in 0 files, snapshot none (task 6249 ms: download 3398 ms overlapping gunzip 929 ms, parse 3908 ms, sort 0 ms, write 0 ms, index 608 ms: 4 candidates, 61335 repo-hours, 1004 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:00:15Z [load_day 2024-01-02] 2024-01-02 hour 22: 153674 events in 0 files, snapshot none (task 5594 ms: download 4056 ms overlapping gunzip 798 ms, parse 3226 ms, sort 0 ms, write 0 ms, index 662 ms: 6 candidates, 56888 repo-hours, 1083 releases; waiting 600 ms; commit 0 ms)
2026-11-08T04:00:15Z [load_day 2024-01-02] 2024-01-02 hour 23: 161755 events in 0 files, snapshot none (task 5396 ms: download 3895 ms overlapping gunzip 740 ms, parse 3212 ms, sort 0 ms, write 0 ms, index 533 ms: 6 candidates, 51932 repo-hours, 725 releases; waiting 665 ms; commit 0 ms)
2026-11-08T04:00:22Z [load_day 2024-01-02] 2024-01-02: repo_hour merged from 24 files to 1 (1680571 rows, 7424 ms)
2026-11-08T04:00:25Z [load_day 2024-01-02] 2024-01-02: index committed in 10159 ms (23 + 1 + 24 files)
2026-11-08T04:00:25Z [load_day 2024-01-02] 2024-01-02: 4304466 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:00:25Z [load_day 2024-01-02] attempt 1 succeeded