orcaLog in

Runs · run 3374

load_day 2024-12-29, attempt 1 succeeded

Host
73ccef5e07c2:229695
Started
2026-11-08T09:34:53Z
Ended
2026-11-08T09:36:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
651 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.5 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3374/load_day/2024-12-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:34:53Z [load_day 2024-12-29] attempt 1 started
2026-11-08T09:34:54Z [load_day 2024-12-29] 2024-12-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:35:01Z [load_day 2024-12-29] 2024-12-29 hour 0: 141125 events in 0 files, snapshot none (task 4917 ms: download 2378 ms overlapping gunzip 668 ms, parse 3039 ms, sort 0 ms, write 0 ms, index 493 ms: 6 candidates, 68650 repo-hours, 1150 releases; waiting 354 ms; commit 0 ms)
2026-11-08T09:35:02Z [load_day 2024-12-29] 2024-12-29 hour 1: 171198 events in 0 files, snapshot none (task 5962 ms: download 3215 ms overlapping gunzip 813 ms, parse 3629 ms, sort 0 ms, write 0 ms, index 718 ms: 6 candidates, 101264 repo-hours, 870 releases; waiting 501 ms; commit 0 ms)
2026-11-08T09:35:06Z [load_day 2024-12-29] 2024-12-29 hour 2: 132450 events in 0 files, snapshot none (task 5166 ms: download 3058 ms overlapping gunzip 647 ms, parse 2720 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 66355 repo-hours, 674 releases; waiting 872 ms; commit 0 ms)
2026-11-08T09:35:07Z [load_day 2024-12-29] 2024-12-29 hour 3: 151363 events in 0 files, snapshot none (task 5157 ms: download 2573 ms overlapping gunzip 666 ms, parse 2990 ms, sort 0 ms, write 0 ms, index 455 ms: 4 candidates, 64471 repo-hours, 3921 releases; waiting 715 ms; commit 0 ms)
2026-11-08T09:35:11Z [load_day 2024-12-29] 2024-12-29 hour 4: 136428 events in 0 files, snapshot none (task 4436 ms: download 2180 ms overlapping gunzip 573 ms, parse 2454 ms, sort 0 ms, write 0 ms, index 545 ms: 7 candidates, 49048 repo-hours, 568 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:35:13Z [load_day 2024-12-29] 2024-12-29 hour 5: 140297 events in 0 files, snapshot none (task 4614 ms: download 2060 ms overlapping gunzip 610 ms, parse 2779 ms, sort 0 ms, write 0 ms, index 424 ms: 1 candidates, 49535 repo-hours, 609 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:35:17Z [load_day 2024-12-29] 2024-12-29 hour 6: 163425 events in 0 files, snapshot none (task 5127 ms: download 3272 ms overlapping gunzip 591 ms, parse 2609 ms, sort 0 ms, write 0 ms, index 655 ms: 3 candidates, 68844 repo-hours, 770 releases; waiting 912 ms; commit 0 ms)
2026-11-08T09:35:18Z [load_day 2024-12-29] 2024-12-29 hour 7: 148127 events in 0 files, snapshot none (task 4612 ms: download 2649 ms overlapping gunzip 608 ms, parse 2700 ms, sort 0 ms, write 0 ms, index 406 ms: 3 candidates, 51852 repo-hours, 554 releases; waiting 574 ms; commit 0 ms)
2026-11-08T09:35:22Z [load_day 2024-12-29] 2024-12-29 hour 8: 149891 events in 0 files, snapshot none (task 4346 ms: download 2315 ms overlapping gunzip 503 ms, parse 2257 ms, sort 0 ms, write 0 ms, index 758 ms: 3 candidates, 56844 repo-hours, 683 releases; waiting 579 ms; commit 0 ms)
2026-11-08T09:35:23Z [load_day 2024-12-29] 2024-12-29 hour 9: 163210 events in 0 files, snapshot none (task 4715 ms: download 2485 ms overlapping gunzip 568 ms, parse 2667 ms, sort 0 ms, write 0 ms, index 542 ms: 4 candidates, 63749 repo-hours, 815 releases; waiting 581 ms; commit 0 ms)
2026-11-08T09:35:27Z [load_day 2024-12-29] 2024-12-29 hour 10: 158593 events in 0 files, snapshot none (task 3968 ms: download 1946 ms overlapping gunzip 535 ms, parse 2269 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 60647 repo-hours, 730 releases; waiting 318 ms; commit 0 ms)
2026-11-08T09:35:29Z [load_day 2024-12-29] 2024-12-29 hour 11: 164629 events in 0 files, snapshot none (task 5110 ms: download 2686 ms overlapping gunzip 612 ms, parse 2579 ms, sort 0 ms, write 0 ms, index 492 ms: 5 candidates, 58334 repo-hours, 854 releases; waiting 946 ms; commit 0 ms)
2026-11-08T09:35:33Z [load_day 2024-12-29] 2024-12-29 hour 12: 231413 events in 0 files, snapshot none (task 5202 ms: download 2397 ms overlapping gunzip 647 ms, parse 3004 ms, sort 0 ms, write 0 ms, index 766 ms: 4 candidates, 111947 repo-hours, 895 releases; waiting 493 ms; commit 0 ms)
2026-11-08T09:35:34Z [load_day 2024-12-29] 2024-12-29 hour 13: 199507 events in 0 files, snapshot none (task 4920 ms: download 2546 ms overlapping gunzip 621 ms, parse 2750 ms, sort 0 ms, write 0 ms, index 650 ms: 5 candidates, 89343 repo-hours, 846 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:35:39Z [load_day 2024-12-29] 2024-12-29 hour 14: 186620 events in 0 files, snapshot none (task 6385 ms: download 3155 ms overlapping gunzip 761 ms, parse 3158 ms, sort 0 ms, write 0 ms, index 907 ms: 3 candidates, 70692 repo-hours, 921 releases; waiting 979 ms; commit 0 ms)
2026-11-08T09:35:41Z [load_day 2024-12-29] 2024-12-29 hour 15: 195780 events in 0 files, snapshot none (task 6155 ms: download 2399 ms overlapping gunzip 854 ms, parse 3619 ms, sort 0 ms, write 0 ms, index 923 ms: 2 candidates, 78867 repo-hours, 1038 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:35:46Z [load_day 2024-12-29] 2024-12-29 hour 16: 187004 events in 0 files, snapshot none (task 6397 ms: download 3047 ms overlapping gunzip 865 ms, parse 3516 ms, sort 0 ms, write 0 ms, index 890 ms: 8 candidates, 72211 repo-hours, 930 releases; waiting 751 ms; commit 0 ms)
2026-11-08T09:35:47Z [load_day 2024-12-29] 2024-12-29 hour 17: 180707 events in 0 files, snapshot none (task 5533 ms: download 3288 ms overlapping gunzip 718 ms, parse 3116 ms, sort 0 ms, write 0 ms, index 710 ms: 3 candidates, 65913 repo-hours, 820 releases; waiting 548 ms; commit 0 ms)
2026-11-08T09:35:54Z [load_day 2024-12-29] 2024-12-29 hour 18: 188223 events in 0 files, snapshot none (task 6566 ms: download 3160 ms overlapping gunzip 838 ms, parse 3851 ms, sort 0 ms, write 0 ms, index 1041 ms: 12 candidates, 81985 repo-hours, 919 releases; waiting 503 ms; commit 0 ms)
2026-11-08T09:35:54Z [load_day 2024-12-29] 2024-12-29 hour 19: 161162 events in 0 files, snapshot none (task 5544 ms: download 3423 ms overlapping gunzip 748 ms, parse 3221 ms, sort 0 ms, write 0 ms, index 728 ms: 2 candidates, 58078 repo-hours, 843 releases; waiting 568 ms; commit 0 ms)
2026-11-08T09:36:00Z [load_day 2024-12-29] 2024-12-29 hour 20: 161406 events in 0 files, snapshot none (task 5530 ms: download 2954 ms overlapping gunzip 770 ms, parse 3339 ms, sort 0 ms, write 0 ms, index 520 ms: 8 candidates, 58466 repo-hours, 766 releases; waiting 538 ms; commit 0 ms)
2026-11-08T09:36:00Z [load_day 2024-12-29] 2024-12-29 hour 21: 159444 events in 0 files, snapshot none (task 5345 ms: download 2746 ms overlapping gunzip 751 ms, parse 3304 ms, sort 0 ms, write 0 ms, index 479 ms: 6 candidates, 60404 repo-hours, 963 releases; waiting 394 ms; commit 0 ms)
2026-11-08T09:36:05Z [load_day 2024-12-29] 2024-12-29 hour 22: 145081 events in 0 files, snapshot none (task 4955 ms: download 2338 ms overlapping gunzip 700 ms, parse 3063 ms, sort 0 ms, write 0 ms, index 425 ms: 3 candidates, 53335 repo-hours, 1114 releases; waiting 461 ms; commit 0 ms)
2026-11-08T09:36:05Z [load_day 2024-12-29] 2024-12-29 hour 23: 147231 events in 0 files, snapshot none (task 5079 ms: download 2550 ms overlapping gunzip 697 ms, parse 3203 ms, sort 0 ms, write 0 ms, index 388 ms: 2 candidates, 58325 repo-hours, 713 releases; waiting 488 ms; commit 0 ms)
2026-11-08T09:36:13Z [load_day 2024-12-29] 2024-12-29: repo_hour merged from 24 files to 1 (1619159 rows, 7281 ms)
2026-11-08T09:36:16Z [load_day 2024-12-29] 2024-12-29: index committed in 10240 ms (24 + 1 + 24 files)
2026-11-08T09:36:16Z [load_day 2024-12-29] 2024-12-29: 3964314 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:36:16Z [load_day 2024-12-29] attempt 1 succeeded