orcaLog in

Runs · run 2166

load_day 2024-03-06, attempt 1 succeeded

Host
73ccef5e07c2:95038
Started
2026-11-08T04:59:18Z
Ended
2026-11-08T05:01:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
818 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2166/load_day/2024-03-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:59:18Z [load_day 2024-03-06] attempt 1 started
2026-11-08T04:59:19Z [load_day 2024-03-06] 2024-03-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:59:27Z [load_day 2024-03-06] 2024-03-06 hour 0: 237066 events in 0 files, snapshot none (task 7368 ms: download 3943 ms overlapping gunzip 999 ms, parse 4551 ms, sort 0 ms, write 0 ms, index 1077 ms: 10 candidates, 102819 repo-hours, 1108 releases; waiting 466 ms; commit 0 ms)
2026-11-08T04:59:27Z [load_day 2024-03-06] 2024-03-06 hour 1: 228163 events in 0 files, snapshot none (task 7276 ms: download 3871 ms overlapping gunzip 991 ms, parse 4390 ms, sort 0 ms, write 0 ms, index 1046 ms: 6 candidates, 98948 repo-hours, 844 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:59:33Z [load_day 2024-03-06] 2024-03-06 hour 2: 200471 events in 0 files, snapshot none (task 5865 ms: download 3577 ms overlapping gunzip 868 ms, parse 3752 ms, sort 0 ms, write 0 ms, index 490 ms: 6 candidates, 66210 repo-hours, 729 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:59:33Z [load_day 2024-03-06] 2024-03-06 hour 3: 199636 events in 0 files, snapshot none (task 5823 ms: download 3571 ms overlapping gunzip 877 ms, parse 3742 ms, sort 0 ms, write 0 ms, index 452 ms: 10 candidates, 65117 repo-hours, 831 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:59:39Z [load_day 2024-03-06] 2024-03-06 hour 4: 190668 events in 0 files, snapshot none (task 5213 ms: download 3257 ms overlapping gunzip 739 ms, parse 3198 ms, sort 0 ms, write 0 ms, index 431 ms: 6 candidates, 60592 repo-hours, 595 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:59:39Z [load_day 2024-03-06] 2024-03-06 hour 5: 203095 events in 0 files, snapshot none (task 5463 ms: download 3133 ms overlapping gunzip 800 ms, parse 3351 ms, sort 0 ms, write 0 ms, index 491 ms: 4 candidates, 67754 repo-hours, 643 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:59:45Z [load_day 2024-03-06] 2024-03-06 hour 6: 229712 events in 0 files, snapshot none (task 5790 ms: download 3404 ms overlapping gunzip 868 ms, parse 3582 ms, sort 0 ms, write 0 ms, index 617 ms: 6 candidates, 82505 repo-hours, 789 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:59:46Z [load_day 2024-03-06] 2024-03-06 hour 7: 229203 events in 0 files, snapshot none (task 5972 ms: download 3929 ms overlapping gunzip 899 ms, parse 3709 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 79313 repo-hours, 819 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:59:54Z [load_day 2024-03-06] 2024-03-06 hour 8: 243405 events in 0 files, snapshot none (task 9147 ms: download 6679 ms overlapping gunzip 1365 ms, parse 6461 ms, sort 0 ms, write 0 ms, index 622 ms: 8 candidates, 88517 repo-hours, 934 releases; waiting 442 ms; commit 0 ms)
2026-11-08T04:59:55Z [load_day 2024-03-06] 2024-03-06 hour 9: 257178 events in 0 files, snapshot none (task 9553 ms: download 6939 ms overlapping gunzip 1574 ms, parse 6423 ms, sort 0 ms, write 0 ms, index 771 ms: 4 candidates, 93528 repo-hours, 1236 releases; waiting 472 ms; commit 0 ms)
2026-11-08T05:00:04Z [load_day 2024-03-06] 2024-03-06 hour 10: 255630 events in 0 files, snapshot none (task 9143 ms: download 5874 ms overlapping gunzip 1305 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 1392 ms: 13 candidates, 93351 repo-hours, 1174 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:00:04Z [load_day 2024-03-06] 2024-03-06 hour 11: 252447 events in 0 files, snapshot none (task 8303 ms: download 5364 ms overlapping gunzip 1313 ms, parse 5250 ms, sort 0 ms, write 0 ms, index 1034 ms: 8 candidates, 88706 repo-hours, 1163 releases; waiting 469 ms; commit 0 ms)
2026-11-08T05:00:15Z [load_day 2024-03-06] 2024-03-06 hour 12: 302497 events in 0 files, snapshot none (task 10212 ms: download 6178 ms overlapping gunzip 1510 ms, parse 6678 ms, sort 0 ms, write 0 ms, index 1206 ms: 14 candidates, 119401 repo-hours, 1757 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:00:16Z [load_day 2024-03-06] 2024-03-06 hour 13: 281218 events in 0 files, snapshot none (task 10861 ms: download 7851 ms overlapping gunzip 1785 ms, parse 7419 ms, sort 0 ms, write 0 ms, index 822 ms: 11 candidates, 113114 repo-hours, 1191 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:00:25Z [load_day 2024-03-06] 2024-03-06 hour 14: 280367 events in 0 files, snapshot none (task 10131 ms: download 7028 ms overlapping gunzip 1517 ms, parse 6892 ms, sort 0 ms, write 0 ms, index 833 ms: 12 candidates, 103693 repo-hours, 1211 releases; waiting 543 ms; commit 0 ms)
2026-11-08T05:00:27Z [load_day 2024-03-06] 2024-03-06 hour 15: 279775 events in 0 files, snapshot none (task 10337 ms: download 7577 ms overlapping gunzip 1694 ms, parse 7061 ms, sort 0 ms, write 0 ms, index 726 ms: 9 candidates, 105050 repo-hours, 1385 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:00:36Z [load_day 2024-03-06] 2024-03-06 hour 16: 277450 events in 0 files, snapshot none (task 10271 ms: download 7240 ms overlapping gunzip 1732 ms, parse 7163 ms, sort 0 ms, write 0 ms, index 823 ms: 13 candidates, 101649 repo-hours, 1193 releases; waiting 186 ms; commit 0 ms)
2026-11-08T05:00:37Z [load_day 2024-03-06] 2024-03-06 hour 17: 272613 events in 0 files, snapshot none (task 9449 ms: download 6837 ms overlapping gunzip 1483 ms, parse 6475 ms, sort 0 ms, write 0 ms, index 690 ms: 11 candidates, 95315 repo-hours, 1090 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:00:46Z [load_day 2024-03-06] 2024-03-06 hour 18: 275235 events in 0 files, snapshot none (task 9709 ms: download 6902 ms overlapping gunzip 1556 ms, parse 6522 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 99546 repo-hours, 1269 releases; waiting 695 ms; commit 0 ms)
2026-11-08T05:00:47Z [load_day 2024-03-06] 2024-03-06 hour 19: 260997 events in 0 files, snapshot none (task 9454 ms: download 6772 ms overlapping gunzip 1515 ms, parse 6392 ms, sort 0 ms, write 0 ms, index 702 ms: 6 candidates, 88910 repo-hours, 1113 releases; waiting 575 ms; commit 0 ms)
2026-11-08T05:00:57Z [load_day 2024-03-06] 2024-03-06 hour 20: 258400 events in 0 files, snapshot none (task 9621 ms: download 6490 ms overlapping gunzip 1603 ms, parse 6330 ms, sort 0 ms, write 0 ms, index 763 ms: 1 candidates, 87670 repo-hours, 1052 releases; waiting 593 ms; commit 0 ms)
2026-11-08T05:00:57Z [load_day 2024-03-06] 2024-03-06 hour 21: 239740 events in 0 files, snapshot none (task 9313 ms: download 6399 ms overlapping gunzip 1446 ms, parse 5982 ms, sort 0 ms, write 0 ms, index 647 ms: 18 candidates, 76326 repo-hours, 1704 releases; waiting 765 ms; commit 0 ms)
2026-11-08T05:01:05Z [load_day 2024-03-06] 2024-03-06 hour 22: 227490 events in 0 files, snapshot none (task 8477 ms: download 5595 ms overlapping gunzip 1324 ms, parse 5254 ms, sort 0 ms, write 0 ms, index 598 ms: 6 candidates, 69865 repo-hours, 1059 releases; waiting 937 ms; commit 0 ms)
2026-11-08T05:01:05Z [load_day 2024-03-06] 2024-03-06 hour 23: 217319 events in 0 files, snapshot none (task 7803 ms: download 4888 ms overlapping gunzip 1120 ms, parse 4779 ms, sort 0 ms, write 0 ms, index 657 ms: 3 candidates, 65116 repo-hours, 833 releases; waiting 827 ms; commit 0 ms)
2026-11-08T05:01:15Z [load_day 2024-03-06] 2024-03-06: repo_hour merged from 24 files to 1 (2113015 rows, 9161 ms)
2026-11-08T05:01:17Z [load_day 2024-03-06] 2024-03-06: index committed in 11986 ms (24 + 1 + 24 files)
2026-11-08T05:01:17Z [load_day 2024-03-06] 2024-03-06: 5899775 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:01:17Z [load_day 2024-03-06] attempt 1 succeeded