orcaLog in

Runs · run 2593

load_day 2024-06-15, attempt 1 succeeded

Host
73ccef5e07c2:136529
Started
2026-11-08T06:32:48Z
Ended
2026-11-08T06:34:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
641 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.4 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2593/load_day/2024-06-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:32:48Z [load_day 2024-06-15] attempt 1 started
2026-11-08T06:32:49Z [load_day 2024-06-15] 2024-06-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:32:55Z [load_day 2024-06-15] 2024-06-15 hour 0: 162338 events in 0 files, snapshot none (task 5498 ms: download 2408 ms overlapping gunzip 924 ms, parse 3646 ms, sort 0 ms, write 0 ms, index 707 ms: 10 candidates, 84971 repo-hours, 1066 releases; waiting 6 ms; commit 0 ms)
2026-11-08T06:32:55Z [load_day 2024-06-15] 2024-06-15 hour 1: 164144 events in 0 files, snapshot none (task 5993 ms: download 2782 ms overlapping gunzip 959 ms, parse 4035 ms, sort 0 ms, write 0 ms, index 782 ms: 5 candidates, 91328 repo-hours, 875 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:32:59Z [load_day 2024-06-15] 2024-06-15 hour 2: 122624 events in 0 files, snapshot none (task 3699 ms: download 769 ms overlapping gunzip 522 ms, parse 2317 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 48803 repo-hours, 772 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:33:01Z [load_day 2024-06-15] 2024-06-15 hour 3: 149029 events in 0 files, snapshot none (task 4749 ms: download 1353 ms overlapping gunzip 725 ms, parse 2945 ms, sort 0 ms, write 0 ms, index 853 ms: 7 candidates, 61810 repo-hours, 5469 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:33:05Z [load_day 2024-06-15] 2024-06-15 hour 4: 124534 events in 0 files, snapshot none (task 5397 ms: download 1407 ms overlapping gunzip 939 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 598 ms: 1 candidates, 49118 repo-hours, 549 releases; waiting 9 ms; commit 0 ms)
2026-11-08T06:33:06Z [load_day 2024-06-15] 2024-06-15 hour 5: 130570 events in 0 files, snapshot none (task 4969 ms: download 1632 ms overlapping gunzip 811 ms, parse 3379 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 52326 repo-hours, 719 releases; waiting 6 ms; commit 0 ms)
2026-11-08T06:33:10Z [load_day 2024-06-15] 2024-06-15 hour 6: 155526 events in 0 files, snapshot none (task 4454 ms: download 1340 ms overlapping gunzip 645 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 803 ms: 12 candidates, 69028 repo-hours, 1004 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:33:10Z [load_day 2024-06-15] 2024-06-15 hour 7: 148703 events in 0 files, snapshot none (task 3923 ms: download 1322 ms overlapping gunzip 597 ms, parse 2603 ms, sort 0 ms, write 0 ms, index 507 ms: 3 candidates, 56645 repo-hours, 821 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:33:15Z [load_day 2024-06-15] 2024-06-15 hour 8: 151460 events in 0 files, snapshot none (task 4938 ms: download 2113 ms overlapping gunzip 775 ms, parse 3373 ms, sort 0 ms, write 0 ms, index 547 ms: 5 candidates, 60500 repo-hours, 898 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:33:16Z [load_day 2024-06-15] 2024-06-15 hour 9: 166131 events in 0 files, snapshot none (task 5005 ms: download 2103 ms overlapping gunzip 782 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 722 ms: 13 candidates, 68313 repo-hours, 1025 releases; waiting 38 ms; commit 0 ms)
2026-11-08T06:33:21Z [load_day 2024-06-15] 2024-06-15 hour 10: 157051 events in 0 files, snapshot none (task 4666 ms: download 2042 ms overlapping gunzip 760 ms, parse 3098 ms, sort 0 ms, write 0 ms, index 614 ms: 3 candidates, 61540 repo-hours, 819 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:33:21Z [load_day 2024-06-15] 2024-06-15 hour 11: 160681 events in 0 files, snapshot none (task 5193 ms: download 2078 ms overlapping gunzip 798 ms, parse 3639 ms, sort 0 ms, write 0 ms, index 548 ms: 8 candidates, 66573 repo-hours, 757 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:33:27Z [load_day 2024-06-15] 2024-06-15 hour 12: 233373 events in 0 files, snapshot none (task 5917 ms: download 2681 ms overlapping gunzip 793 ms, parse 3968 ms, sort 0 ms, write 0 ms, index 940 ms: 10 candidates, 111509 repo-hours, 865 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:33:27Z [load_day 2024-06-15] 2024-06-15 hour 13: 189382 events in 0 files, snapshot none (task 5043 ms: download 2341 ms overlapping gunzip 753 ms, parse 3308 ms, sort 0 ms, write 0 ms, index 715 ms: 8 candidates, 84969 repo-hours, 818 releases; waiting 41 ms; commit 0 ms)
2026-11-08T06:33:33Z [load_day 2024-06-15] 2024-06-15 hour 14: 168537 events in 0 files, snapshot none (task 5011 ms: download 2514 ms overlapping gunzip 792 ms, parse 3473 ms, sort 0 ms, write 0 ms, index 546 ms: 1 candidates, 67595 repo-hours, 855 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:33:33Z [load_day 2024-06-15] 2024-06-15 hour 15: 184260 events in 0 files, snapshot none (task 4810 ms: download 2332 ms overlapping gunzip 742 ms, parse 3276 ms, sort 0 ms, write 0 ms, index 565 ms: 11 candidates, 80062 repo-hours, 1021 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:33:38Z [load_day 2024-06-15] 2024-06-15 hour 16: 170129 events in 0 files, snapshot none (task 4958 ms: download 2399 ms overlapping gunzip 760 ms, parse 3443 ms, sort 0 ms, write 0 ms, index 552 ms: 20 candidates, 70702 repo-hours, 801 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:33:38Z [load_day 2024-06-15] 2024-06-15 hour 17: 162041 events in 0 files, snapshot none (task 4376 ms: download 1580 ms overlapping gunzip 651 ms, parse 2946 ms, sort 0 ms, write 0 ms, index 576 ms: 10 candidates, 60729 repo-hours, 697 releases; waiting 30 ms; commit 0 ms)
2026-11-08T06:33:44Z [load_day 2024-06-15] 2024-06-15 hour 18: 173787 events in 0 files, snapshot none (task 5076 ms: download 2218 ms overlapping gunzip 734 ms, parse 3121 ms, sort 0 ms, write 0 ms, index 1026 ms: 14 candidates, 76706 repo-hours, 873 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:33:44Z [load_day 2024-06-15] 2024-06-15 hour 19: 145365 events in 0 files, snapshot none (task 4963 ms: download 2035 ms overlapping gunzip 780 ms, parse 3246 ms, sort 0 ms, write 0 ms, index 707 ms: 13 candidates, 54070 repo-hours, 793 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:33:48Z [load_day 2024-06-15] 2024-06-15 hour 20: 137836 events in 0 files, snapshot none (task 3739 ms: download 1541 ms overlapping gunzip 598 ms, parse 2536 ms, sort 0 ms, write 0 ms, index 391 ms: 9 candidates, 53127 repo-hours, 664 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:33:48Z [load_day 2024-06-15] 2024-06-15 hour 21: 140226 events in 0 files, snapshot none (task 3470 ms: download 1245 ms overlapping gunzip 547 ms, parse 2328 ms, sort 0 ms, write 0 ms, index 393 ms: 7 candidates, 56773 repo-hours, 825 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:33:51Z [load_day 2024-06-15] 2024-06-15 hour 22: 121458 events in 0 files, snapshot none (task 2996 ms: download 879 ms overlapping gunzip 439 ms, parse 1958 ms, sort 0 ms, write 0 ms, index 392 ms: 4 candidates, 45094 repo-hours, 764 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:33:51Z [load_day 2024-06-15] 2024-06-15 hour 23: 115260 events in 0 files, snapshot none (task 2670 ms: download 665 ms overlapping gunzip 390 ms, parse 1701 ms, sort 0 ms, write 0 ms, index 380 ms: 3 candidates, 42256 repo-hours, 522 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:33:58Z [load_day 2024-06-15] 2024-06-15: repo_hour merged from 24 files to 1 (1574547 rows, 6681 ms)
2026-11-08T06:34:00Z [load_day 2024-06-15] 2024-06-15: index committed in 8993 ms (24 + 1 + 24 files)
2026-11-08T06:34:00Z [load_day 2024-06-15] 2024-06-15: 3734445 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:34:00Z [load_day 2024-06-15] attempt 1 succeeded