orcaLog in

Runs · run 2292

load_day 2024-04-07, attempt 1 succeeded

Host
73ccef5e07c2:106715
Started
2026-11-08T05:30:04Z
Ended
2026-11-08T05:31:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
627 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
125.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2292/load_day/2024-04-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:30:04Z [load_day 2024-04-07] attempt 1 started
2026-11-08T05:30:05Z [load_day 2024-04-07] 2024-04-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:30:11Z [load_day 2024-04-07] 2024-04-07 hour 0: 204223 events in 0 files, snapshot none (task 5004 ms: download 2689 ms overlapping gunzip 652 ms, parse 2980 ms, sort 0 ms, write 0 ms, index 569 ms: 13 candidates, 77467 repo-hours, 1018 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:30:11Z [load_day 2024-04-07] 2024-04-07 hour 1: 215913 events in 0 files, snapshot none (task 4832 ms: download 2536 ms overlapping gunzip 589 ms, parse 2878 ms, sort 0 ms, write 0 ms, index 620 ms: 4 candidates, 89763 repo-hours, 824 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:30:16Z [load_day 2024-04-07] 2024-04-07 hour 2: 190400 events in 0 files, snapshot none (task 5044 ms: download 2940 ms overlapping gunzip 653 ms, parse 2709 ms, sort 0 ms, write 0 ms, index 509 ms: 6 candidates, 56942 repo-hours, 689 releases; waiting 859 ms; commit 0 ms)
2026-11-08T05:30:16Z [load_day 2024-04-07] 2024-04-07 hour 3: 191562 events in 0 files, snapshot none (task 4336 ms: download 2109 ms overlapping gunzip 570 ms, parse 2511 ms, sort 0 ms, write 0 ms, index 548 ms: 6 candidates, 56196 repo-hours, 779 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:30:22Z [load_day 2024-04-07] 2024-04-07 hour 4: 182147 events in 0 files, snapshot none (task 4923 ms: download 2516 ms overlapping gunzip 674 ms, parse 3065 ms, sort 0 ms, write 0 ms, index 410 ms: 6 candidates, 50200 repo-hours, 644 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:30:22Z [load_day 2024-04-07] 2024-04-07 hour 5: 196472 events in 0 files, snapshot none (task 5578 ms: download 3280 ms overlapping gunzip 864 ms, parse 3524 ms, sort 0 ms, write 0 ms, index 396 ms: 6 candidates, 56334 repo-hours, 607 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:30:28Z [load_day 2024-04-07] 2024-04-07 hour 6: 209367 events in 0 files, snapshot none (task 5680 ms: download 2989 ms overlapping gunzip 808 ms, parse 3528 ms, sort 0 ms, write 0 ms, index 528 ms: 7 candidates, 66886 repo-hours, 738 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:30:28Z [load_day 2024-04-07] 2024-04-07 hour 7: 202346 events in 0 files, snapshot none (task 5322 ms: download 2673 ms overlapping gunzip 763 ms, parse 3499 ms, sort 0 ms, write 0 ms, index 475 ms: 11 candidates, 61147 repo-hours, 617 releases; waiting 297 ms; commit 0 ms)
2026-11-08T05:30:35Z [load_day 2024-04-07] 2024-04-07 hour 8: 214821 events in 0 files, snapshot none (task 6570 ms: download 3412 ms overlapping gunzip 969 ms, parse 4162 ms, sort 0 ms, write 0 ms, index 550 ms: 15 candidates, 67369 repo-hours, 740 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:30:35Z [load_day 2024-04-07] 2024-04-07 hour 9: 213199 events in 0 files, snapshot none (task 5725 ms: download 2629 ms overlapping gunzip 820 ms, parse 3473 ms, sort 0 ms, write 0 ms, index 660 ms: 7 candidates, 67139 repo-hours, 787 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:30:41Z [load_day 2024-04-07] 2024-04-07 hour 10: 210325 events in 0 files, snapshot none (task 5425 ms: download 2476 ms overlapping gunzip 766 ms, parse 3379 ms, sort 0 ms, write 0 ms, index 547 ms: 5 candidates, 64015 repo-hours, 728 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:30:41Z [load_day 2024-04-07] 2024-04-07 hour 11: 212366 events in 0 files, snapshot none (task 5611 ms: download 3391 ms overlapping gunzip 789 ms, parse 3338 ms, sort 0 ms, write 0 ms, index 653 ms: 2 candidates, 62857 repo-hours, 641 releases; waiting 545 ms; commit 0 ms)
2026-11-08T05:30:48Z [load_day 2024-04-07] 2024-04-07 hour 12: 283050 events in 0 files, snapshot none (task 6805 ms: download 3331 ms overlapping gunzip 974 ms, parse 4646 ms, sort 0 ms, write 0 ms, index 683 ms: 10 candidates, 97158 repo-hours, 889 releases; waiting 190 ms; commit 0 ms)
2026-11-08T05:30:48Z [load_day 2024-04-07] 2024-04-07 hour 13: 238218 events in 0 files, snapshot none (task 6602 ms: download 3478 ms overlapping gunzip 891 ms, parse 4287 ms, sort 0 ms, write 0 ms, index 678 ms: 9 candidates, 86708 repo-hours, 817 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:30:56Z [load_day 2024-04-07] 2024-04-07 hour 14: 237135 events in 0 files, snapshot none (task 7987 ms: download 5060 ms overlapping gunzip 1181 ms, parse 5322 ms, sort 0 ms, write 0 ms, index 717 ms: 7 candidates, 74916 repo-hours, 850 releases; waiting 560 ms; commit 0 ms)
2026-11-08T05:30:56Z [load_day 2024-04-07] 2024-04-07 hour 15: 236437 events in 0 files, snapshot none (task 7923 ms: download 4543 ms overlapping gunzip 1178 ms, parse 5066 ms, sort 0 ms, write 0 ms, index 932 ms: 5 candidates, 75499 repo-hours, 957 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:31:03Z [load_day 2024-04-07] 2024-04-07 hour 16: 232333 events in 0 files, snapshot none (task 6298 ms: download 3001 ms overlapping gunzip 818 ms, parse 3831 ms, sort 0 ms, write 0 ms, index 795 ms: 3 candidates, 72270 repo-hours, 767 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:31:03Z [load_day 2024-04-07] 2024-04-07 hour 17: 225665 events in 0 files, snapshot none (task 6297 ms: download 2939 ms overlapping gunzip 867 ms, parse 3818 ms, sort 0 ms, write 0 ms, index 816 ms: 6 candidates, 67305 repo-hours, 721 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:31:11Z [load_day 2024-04-07] 2024-04-07 hour 18: 235871 events in 0 files, snapshot none (task 6860 ms: download 4213 ms overlapping gunzip 948 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 610 ms: 10 candidates, 76724 repo-hours, 951 releases; waiting 476 ms; commit 0 ms)
2026-11-08T05:31:11Z [load_day 2024-04-07] 2024-04-07 hour 19: 219491 events in 0 files, snapshot none (task 6171 ms: download 3489 ms overlapping gunzip 878 ms, parse 3889 ms, sort 0 ms, write 0 ms, index 448 ms: 7 candidates, 64192 repo-hours, 841 releases; waiting 576 ms; commit 0 ms)
2026-11-08T05:31:17Z [load_day 2024-04-07] 2024-04-07 hour 20: 217885 events in 0 files, snapshot none (task 5966 ms: download 3039 ms overlapping gunzip 819 ms, parse 3542 ms, sort 0 ms, write 0 ms, index 730 ms: 9 candidates, 64407 repo-hours, 810 releases; waiting 570 ms; commit 0 ms)
2026-11-08T05:31:17Z [load_day 2024-04-07] 2024-04-07 hour 21: 206499 events in 0 files, snapshot none (task 6454 ms: download 3502 ms overlapping gunzip 951 ms, parse 4277 ms, sort 0 ms, write 0 ms, index 464 ms: 12 candidates, 58281 repo-hours, 814 releases; waiting 410 ms; commit 0 ms)
2026-11-08T05:31:22Z [load_day 2024-04-07] 2024-04-07 hour 22: 193569 events in 0 files, snapshot none (task 4363 ms: download 2373 ms overlapping gunzip 605 ms, parse 2608 ms, sort 0 ms, write 0 ms, index 380 ms: 17 candidates, 52993 repo-hours, 746 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:31:23Z [load_day 2024-04-07] 2024-04-07 hour 23: 188407 events in 0 files, snapshot none (task 4721 ms: download 3581 ms overlapping gunzip 636 ms, parse 2805 ms, sort 0 ms, write 0 ms, index 430 ms: 3 candidates, 52243 repo-hours, 562 releases; waiting 467 ms; commit 0 ms)
2026-11-08T05:31:31Z [load_day 2024-04-07] 2024-04-07: repo_hour merged from 24 files to 1 (1619011 rows, 8121 ms)
2026-11-08T05:31:33Z [load_day 2024-04-07] 2024-04-07: index committed in 10756 ms (24 + 1 + 24 files)
2026-11-08T05:31:33Z [load_day 2024-04-07] 2024-04-07: 5157701 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:31:33Z [load_day 2024-04-07] attempt 1 succeeded