orcaLog in

Runs · run 2714

load_day 2024-07-14, attempt 1 succeeded

Host
73ccef5e07c2:149731
Started
2026-11-08T06:59:14Z
Ended
2026-11-08T07:00:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
646 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
102.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2714/load_day/2024-07-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:59:14Z [load_day 2024-07-14] attempt 1 started
2026-11-08T06:59:15Z [load_day 2024-07-14] 2024-07-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:59:21Z [load_day 2024-07-14] 2024-07-14 hour 0: 134750 events in 0 files, snapshot none (task 5351 ms: download 2277 ms overlapping gunzip 736 ms, parse 3278 ms, sort 0 ms, write 0 ms, index 582 ms: 4 candidates, 72980 repo-hours, 880 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:59:21Z [load_day 2024-07-14] 2024-07-14 hour 1: 146242 events in 0 files, snapshot none (task 5156 ms: download 2321 ms overlapping gunzip 652 ms, parse 3078 ms, sort 0 ms, write 0 ms, index 709 ms: 2 candidates, 86203 repo-hours, 699 releases; waiting 475 ms; commit 0 ms)
2026-11-08T06:59:25Z [load_day 2024-07-14] 2024-07-14 hour 2: 115874 events in 0 files, snapshot none (task 4351 ms: download 2264 ms overlapping gunzip 567 ms, parse 2522 ms, sort 0 ms, write 0 ms, index 452 ms: 2 candidates, 50684 repo-hours, 567 releases; waiting 464 ms; commit 0 ms)
2026-11-08T06:59:26Z [load_day 2024-07-14] 2024-07-14 hour 3: 136577 events in 0 files, snapshot none (task 4525 ms: download 1990 ms overlapping gunzip 609 ms, parse 2824 ms, sort 0 ms, write 0 ms, index 366 ms: 4 candidates, 56734 repo-hours, 5248 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:59:30Z [load_day 2024-07-14] 2024-07-14 hour 4: 115262 events in 0 files, snapshot none (task 3883 ms: download 1998 ms overlapping gunzip 500 ms, parse 2234 ms, sort 0 ms, write 0 ms, index 385 ms: 3 candidates, 45202 repo-hours, 462 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:59:30Z [load_day 2024-07-14] 2024-07-14 hour 5: 120927 events in 0 files, snapshot none (task 4061 ms: download 1407 ms overlapping gunzip 517 ms, parse 2333 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 48196 repo-hours, 563 releases; waiting 185 ms; commit 0 ms)
2026-11-08T06:59:34Z [load_day 2024-07-14] 2024-07-14 hour 6: 146113 events in 0 files, snapshot none (task 3974 ms: download 1836 ms overlapping gunzip 489 ms, parse 2218 ms, sort 0 ms, write 0 ms, index 525 ms: 3 candidates, 68473 repo-hours, 646 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:59:34Z [load_day 2024-07-14] 2024-07-14 hour 7: 137034 events in 0 files, snapshot none (task 3731 ms: download 1995 ms overlapping gunzip 481 ms, parse 2121 ms, sort 0 ms, write 0 ms, index 391 ms: 5 candidates, 53226 repo-hours, 614 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:59:39Z [load_day 2024-07-14] 2024-07-14 hour 8: 145280 events in 0 files, snapshot none (task 3950 ms: download 2248 ms overlapping gunzip 524 ms, parse 2247 ms, sort 0 ms, write 0 ms, index 420 ms: 7 candidates, 58770 repo-hours, 678 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:59:39Z [load_day 2024-07-14] 2024-07-14 hour 9: 155377 events in 0 files, snapshot none (task 4440 ms: download 2091 ms overlapping gunzip 592 ms, parse 2594 ms, sort 0 ms, write 0 ms, index 515 ms: 3 candidates, 66016 repo-hours, 779 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:59:43Z [load_day 2024-07-14] 2024-07-14 hour 10: 151055 events in 0 files, snapshot none (task 4094 ms: download 1892 ms overlapping gunzip 541 ms, parse 2369 ms, sort 0 ms, write 0 ms, index 427 ms: 3 candidates, 60400 repo-hours, 597 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:59:44Z [load_day 2024-07-14] 2024-07-14 hour 11: 152060 events in 0 files, snapshot none (task 4405 ms: download 2642 ms overlapping gunzip 553 ms, parse 2354 ms, sort 0 ms, write 0 ms, index 422 ms: 8 candidates, 58285 repo-hours, 630 releases; waiting 731 ms; commit 0 ms)
2026-11-08T06:59:50Z [load_day 2024-07-14] 2024-07-14 hour 12: 198747 events in 0 files, snapshot none (task 6031 ms: download 3061 ms overlapping gunzip 801 ms, parse 3756 ms, sort 0 ms, write 0 ms, index 753 ms: 6 candidates, 105097 repo-hours, 817 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:59:50Z [load_day 2024-07-14] 2024-07-14 hour 13: 183147 events in 0 files, snapshot none (task 5551 ms: download 3037 ms overlapping gunzip 795 ms, parse 3594 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 93492 repo-hours, 714 releases; waiting 291 ms; commit 0 ms)
2026-11-08T06:59:56Z [load_day 2024-07-14] 2024-07-14 hour 14: 168090 events in 0 files, snapshot none (task 6235 ms: download 3231 ms overlapping gunzip 914 ms, parse 3947 ms, sort 0 ms, write 0 ms, index 579 ms: 14 candidates, 69142 repo-hours, 826 releases; waiting 554 ms; commit 0 ms)
2026-11-08T06:59:56Z [load_day 2024-07-14] 2024-07-14 hour 15: 179085 events in 0 files, snapshot none (task 5961 ms: download 3228 ms overlapping gunzip 855 ms, parse 3750 ms, sort 0 ms, write 0 ms, index 645 ms: 11 candidates, 79465 repo-hours, 879 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:00:03Z [load_day 2024-07-14] 2024-07-14 hour 16: 166775 events in 0 files, snapshot none (task 6555 ms: download 3306 ms overlapping gunzip 994 ms, parse 4159 ms, sort 0 ms, write 0 ms, index 529 ms: 5 candidates, 69979 repo-hours, 815 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:00:03Z [load_day 2024-07-14] 2024-07-14 hour 17: 160399 events in 0 files, snapshot none (task 6047 ms: download 3337 ms overlapping gunzip 818 ms, parse 3867 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 64619 repo-hours, 694 releases; waiting 543 ms; commit 0 ms)
2026-11-08T07:00:10Z [load_day 2024-07-14] 2024-07-14 hour 18: 168053 events in 0 files, snapshot none (task 5660 ms: download 2554 ms overlapping gunzip 750 ms, parse 3277 ms, sort 0 ms, write 0 ms, index 805 ms: 4 candidates, 79330 repo-hours, 859 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:00:10Z [load_day 2024-07-14] 2024-07-14 hour 19: 142975 events in 0 files, snapshot none (task 5187 ms: download 2455 ms overlapping gunzip 829 ms, parse 3146 ms, sort 0 ms, write 0 ms, index 407 ms: 5 candidates, 53044 repo-hours, 714 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:00:15Z [load_day 2024-07-14] 2024-07-14 hour 20: 138131 events in 0 files, snapshot none (task 4536 ms: download 2131 ms overlapping gunzip 592 ms, parse 2611 ms, sort 0 ms, write 0 ms, index 474 ms: 5 candidates, 52837 repo-hours, 759 releases; waiting 546 ms; commit 0 ms)
2026-11-08T07:00:15Z [load_day 2024-07-14] 2024-07-14 hour 21: 137927 events in 0 files, snapshot none (task 4279 ms: download 2157 ms overlapping gunzip 579 ms, parse 2575 ms, sort 0 ms, write 0 ms, index 413 ms: 9 candidates, 55929 repo-hours, 904 releases; waiting 466 ms; commit 0 ms)
2026-11-08T07:00:20Z [load_day 2024-07-14] 2024-07-14 hour 22: 125351 events in 0 files, snapshot none (task 4675 ms: download 2295 ms overlapping gunzip 622 ms, parse 2747 ms, sort 0 ms, write 0 ms, index 477 ms: 8 candidates, 45527 repo-hours, 746 releases; waiting 548 ms; commit 0 ms)
2026-11-08T07:00:20Z [load_day 2024-07-14] 2024-07-14 hour 23: 121963 events in 0 files, snapshot none (task 4506 ms: download 2211 ms overlapping gunzip 577 ms, parse 2680 ms, sort 0 ms, write 0 ms, index 409 ms: 5 candidates, 44930 repo-hours, 529 releases; waiting 550 ms; commit 0 ms)
2026-11-08T07:00:26Z [load_day 2024-07-14] 2024-07-14: repo_hour merged from 24 files to 1 (1538560 rows, 6564 ms)
2026-11-08T07:00:29Z [load_day 2024-07-14] 2024-07-14: index committed in 8856 ms (24 + 1 + 24 files)
2026-11-08T07:00:29Z [load_day 2024-07-14] 2024-07-14: 3547194 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:00:29Z [load_day 2024-07-14] attempt 1 succeeded