orcaLog in

Runs · run 2682

load_day 2024-07-06, attempt 1 succeeded

Host
73ccef5e07c2:145913
Started
2026-11-08T06:51:45Z
Ended
2026-11-08T06:53:06Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
631 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
108.6 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2682/load_day/2024-07-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:51:45Z [load_day 2024-07-06] attempt 1 started
2026-11-08T06:51:45Z [load_day 2024-07-06] 2024-07-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:51:52Z [load_day 2024-07-06] 2024-07-06 hour 0: 136191 events in 0 files, snapshot none (task 5556 ms: download 2860 ms overlapping gunzip 819 ms, parse 3442 ms, sort 0 ms, write 0 ms, index 536 ms: 6 candidates, 73734 repo-hours, 861 releases; waiting 482 ms; commit 0 ms)
2026-11-08T06:51:53Z [load_day 2024-07-06] 2024-07-06 hour 1: 170101 events in 0 files, snapshot none (task 6651 ms: download 4125 ms overlapping gunzip 1059 ms, parse 4254 ms, sort 0 ms, write 0 ms, index 682 ms: 5 candidates, 95587 repo-hours, 725 releases; waiting 351 ms; commit 0 ms)
2026-11-08T06:51:58Z [load_day 2024-07-06] 2024-07-06 hour 2: 134333 events in 0 files, snapshot none (task 5809 ms: download 3093 ms overlapping gunzip 935 ms, parse 3672 ms, sort 0 ms, write 0 ms, index 446 ms: 12 candidates, 55542 repo-hours, 615 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:51:59Z [load_day 2024-07-06] 2024-07-06 hour 3: 148613 events in 0 files, snapshot none (task 5173 ms: download 2293 ms overlapping gunzip 754 ms, parse 3172 ms, sort 0 ms, write 0 ms, index 493 ms: 2 candidates, 58143 repo-hours, 6431 releases; waiting 449 ms; commit 0 ms)
2026-11-08T06:52:02Z [load_day 2024-07-06] 2024-07-06 hour 4: 125065 events in 0 files, snapshot none (task 4043 ms: download 2267 ms overlapping gunzip 493 ms, parse 2179 ms, sort 0 ms, write 0 ms, index 500 ms: 4 candidates, 46903 repo-hours, 620 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:52:03Z [load_day 2024-07-06] 2024-07-06 hour 5: 135938 events in 0 files, snapshot none (task 4270 ms: download 2226 ms overlapping gunzip 634 ms, parse 2545 ms, sort 0 ms, write 0 ms, index 470 ms: 7 candidates, 49998 repo-hours, 650 releases; waiting 351 ms; commit 0 ms)
2026-11-08T06:52:08Z [load_day 2024-07-06] 2024-07-06 hour 6: 159327 events in 0 files, snapshot none (task 5179 ms: download 2325 ms overlapping gunzip 733 ms, parse 3089 ms, sort 0 ms, write 0 ms, index 584 ms: 4 candidates, 68788 repo-hours, 915 releases; waiting 471 ms; commit 0 ms)
2026-11-08T06:52:09Z [load_day 2024-07-06] 2024-07-06 hour 7: 149751 events in 0 files, snapshot none (task 5287 ms: download 4105 ms overlapping gunzip 619 ms, parse 2732 ms, sort 0 ms, write 0 ms, index 427 ms: 9 candidates, 55295 repo-hours, 792 releases; waiting 1193 ms; commit 0 ms)
2026-11-08T06:52:14Z [load_day 2024-07-06] 2024-07-06 hour 8: 160854 events in 0 files, snapshot none (task 6073 ms: download 2961 ms overlapping gunzip 867 ms, parse 3917 ms, sort 0 ms, write 0 ms, index 444 ms: 5 candidates, 65049 repo-hours, 799 releases; waiting 529 ms; commit 0 ms)
2026-11-08T06:52:15Z [load_day 2024-07-06] 2024-07-06 hour 9: 165963 events in 0 files, snapshot none (task 5161 ms: download 2558 ms overlapping gunzip 763 ms, parse 3067 ms, sort 0 ms, write 0 ms, index 549 ms: 5 candidates, 73101 repo-hours, 1050 releases; waiting 447 ms; commit 0 ms)
2026-11-08T06:52:20Z [load_day 2024-07-06] 2024-07-06 hour 10: 153138 events in 0 files, snapshot none (task 4820 ms: download 2131 ms overlapping gunzip 645 ms, parse 2828 ms, sort 0 ms, write 0 ms, index 561 ms: 6 candidates, 60916 repo-hours, 697 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:52:20Z [load_day 2024-07-06] 2024-07-06 hour 11: 149374 events in 0 files, snapshot none (task 4718 ms: download 2367 ms overlapping gunzip 652 ms, parse 2862 ms, sort 0 ms, write 0 ms, index 412 ms: 3 candidates, 57248 repo-hours, 670 releases; waiting 479 ms; commit 0 ms)
2026-11-08T06:52:25Z [load_day 2024-07-06] 2024-07-06 hour 12: 176580 events in 0 files, snapshot none (task 4914 ms: download 1547 ms overlapping gunzip 625 ms, parse 3014 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 89275 repo-hours, 616 releases; waiting 278 ms; commit 0 ms)
2026-11-08T06:52:27Z [load_day 2024-07-06] 2024-07-06 hour 13: 191767 events in 0 files, snapshot none (task 5596 ms: download 2972 ms overlapping gunzip 760 ms, parse 3454 ms, sort 0 ms, write 0 ms, index 645 ms: 8 candidates, 95304 repo-hours, 763 releases; waiting 416 ms; commit 0 ms)
2026-11-08T06:52:32Z [load_day 2024-07-06] 2024-07-06 hour 14: 177169 events in 0 files, snapshot none (task 6481 ms: download 2874 ms overlapping gunzip 848 ms, parse 3584 ms, sort 0 ms, write 0 ms, index 1175 ms: 8 candidates, 76422 repo-hours, 809 releases; waiting 551 ms; commit 0 ms)
2026-11-08T06:52:34Z [load_day 2024-07-06] 2024-07-06 hour 15: 191504 events in 0 files, snapshot none (task 6520 ms: download 3691 ms overlapping gunzip 905 ms, parse 3977 ms, sort 0 ms, write 0 ms, index 814 ms: 5 candidates, 90977 repo-hours, 893 releases; waiting 557 ms; commit 0 ms)
2026-11-08T06:52:39Z [load_day 2024-07-06] 2024-07-06 hour 16: 178279 events in 0 files, snapshot none (task 6500 ms: download 2381 ms overlapping gunzip 863 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 952 ms: 3 candidates, 84469 repo-hours, 743 releases; waiting 433 ms; commit 0 ms)
2026-11-08T06:52:41Z [load_day 2024-07-06] 2024-07-06 hour 17: 165805 events in 0 files, snapshot none (task 6196 ms: download 2945 ms overlapping gunzip 938 ms, parse 4007 ms, sort 0 ms, write 0 ms, index 458 ms: 12 candidates, 64289 repo-hours, 700 releases; waiting 516 ms; commit 0 ms)
2026-11-08T06:52:45Z [load_day 2024-07-06] 2024-07-06 hour 18: 180474 events in 0 files, snapshot none (task 5258 ms: download 2729 ms overlapping gunzip 711 ms, parse 2868 ms, sort 0 ms, write 0 ms, index 892 ms: 14 candidates, 83898 repo-hours, 896 releases; waiting 480 ms; commit 0 ms)
2026-11-08T06:52:46Z [load_day 2024-07-06] 2024-07-06 hour 19: 144201 events in 0 files, snapshot none (task 4399 ms: download 2376 ms overlapping gunzip 552 ms, parse 2405 ms, sort 0 ms, write 0 ms, index 616 ms: 5 candidates, 53770 repo-hours, 782 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:52:51Z [load_day 2024-07-06] 2024-07-06 hour 20: 150331 events in 0 files, snapshot none (task 4822 ms: download 2414 ms overlapping gunzip 691 ms, parse 2864 ms, sort 0 ms, write 0 ms, index 470 ms: 1 candidates, 64327 repo-hours, 845 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:52:51Z [load_day 2024-07-06] 2024-07-06 hour 21: 139145 events in 0 files, snapshot none (task 4132 ms: download 1974 ms overlapping gunzip 564 ms, parse 2427 ms, sort 0 ms, write 0 ms, index 381 ms: 2 candidates, 55016 repo-hours, 807 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:52:57Z [load_day 2024-07-06] 2024-07-06 hour 22: 117251 events in 0 files, snapshot none (task 4934 ms: download 2319 ms overlapping gunzip 698 ms, parse 3073 ms, sort 0 ms, write 0 ms, index 432 ms: 4 candidates, 43216 repo-hours, 865 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:52:57Z [load_day 2024-07-06] 2024-07-06 hour 23: 147621 events in 0 files, snapshot none (task 5004 ms: download 2381 ms overlapping gunzip 664 ms, parse 3072 ms, sort 0 ms, write 0 ms, index 494 ms: 6 candidates, 79028 repo-hours, 554 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:53:04Z [load_day 2024-07-06] 2024-07-06: repo_hour merged from 24 files to 1 (1640295 rows, 6662 ms)
2026-11-08T06:53:06Z [load_day 2024-07-06] 2024-07-06: index committed in 9195 ms (24 + 1 + 24 files)
2026-11-08T06:53:06Z [load_day 2024-07-06] 2024-07-06: 3748775 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:53:06Z [load_day 2024-07-06] attempt 1 succeeded