orcaLog in

Runs · run 2182

load_day 2024-03-10, attempt 1 succeeded

Host
73ccef5e07c2:96478
Started
2026-11-08T05:03:08Z
Ended
2026-11-08T05:04:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
632 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
121.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2182/load_day/2024-03-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:03:08Z [load_day 2024-03-10] attempt 1 started
2026-11-08T05:03:09Z [load_day 2024-03-10] 2024-03-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:03:15Z [load_day 2024-03-10] 2024-03-10 hour 0: 220106 events in 0 files, snapshot none (task 4767 ms: download 2669 ms overlapping gunzip 606 ms, parse 2785 ms, sort 0 ms, write 0 ms, index 544 ms: 5 candidates, 76497 repo-hours, 978 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:03:15Z [load_day 2024-03-10] 2024-03-10 hour 1: 222049 events in 0 files, snapshot none (task 4664 ms: download 2590 ms overlapping gunzip 579 ms, parse 2655 ms, sort 0 ms, write 0 ms, index 622 ms: 5 candidates, 79498 repo-hours, 778 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:03:20Z [load_day 2024-03-10] 2024-03-10 hour 2: 184759 events in 0 files, snapshot none (task 5419 ms: download 3118 ms overlapping gunzip 684 ms, parse 3216 ms, sort 0 ms, write 0 ms, index 419 ms: 3 candidates, 45247 repo-hours, 620 releases; waiting 777 ms; commit 0 ms)
2026-11-08T05:03:20Z [load_day 2024-03-10] 2024-03-10 hour 3: 187514 events in 0 files, snapshot none (task 5160 ms: download 2306 ms overlapping gunzip 675 ms, parse 3206 ms, sort 0 ms, write 0 ms, index 508 ms: 3 candidates, 44837 repo-hours, 719 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:03:25Z [load_day 2024-03-10] 2024-03-10 hour 4: 189850 events in 0 files, snapshot none (task 4372 ms: download 2171 ms overlapping gunzip 596 ms, parse 2551 ms, sort 0 ms, write 0 ms, index 448 ms: 5 candidates, 46392 repo-hours, 507 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:03:26Z [load_day 2024-03-10] 2024-03-10 hour 5: 196501 events in 0 files, snapshot none (task 4865 ms: download 2890 ms overlapping gunzip 658 ms, parse 2864 ms, sort 0 ms, write 0 ms, index 398 ms: 5 candidates, 49010 repo-hours, 559 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:03:30Z [load_day 2024-03-10] 2024-03-10 hour 6: 210207 events in 0 files, snapshot none (task 4676 ms: download 2231 ms overlapping gunzip 613 ms, parse 2906 ms, sort 0 ms, write 0 ms, index 411 ms: 1 candidates, 57775 repo-hours, 673 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:03:31Z [load_day 2024-03-10] 2024-03-10 hour 7: 210866 events in 0 files, snapshot none (task 4927 ms: download 2627 ms overlapping gunzip 696 ms, parse 3120 ms, sort 0 ms, write 0 ms, index 367 ms: 5 candidates, 54041 repo-hours, 541 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:03:36Z [load_day 2024-03-10] 2024-03-10 hour 8: 209964 events in 0 files, snapshot none (task 5567 ms: download 3232 ms overlapping gunzip 795 ms, parse 3490 ms, sort 0 ms, write 0 ms, index 431 ms: 6 candidates, 56664 repo-hours, 588 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:03:37Z [load_day 2024-03-10] 2024-03-10 hour 9: 201893 events in 0 files, snapshot none (task 5243 ms: download 2582 ms overlapping gunzip 757 ms, parse 3410 ms, sort 0 ms, write 0 ms, index 393 ms: 5 candidates, 54929 repo-hours, 737 releases; waiting 357 ms; commit 0 ms)
2026-11-08T05:03:43Z [load_day 2024-03-10] 2024-03-10 hour 10: 223604 events in 0 files, snapshot none (task 6324 ms: download 3234 ms overlapping gunzip 922 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 656 ms: 8 candidates, 62485 repo-hours, 613 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:03:43Z [load_day 2024-03-10] 2024-03-10 hour 11: 221686 events in 0 files, snapshot none (task 6076 ms: download 2941 ms overlapping gunzip 905 ms, parse 3905 ms, sort 0 ms, write 0 ms, index 526 ms: 25 candidates, 62256 repo-hours, 673 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:03:51Z [load_day 2024-03-10] 2024-03-10 hour 12: 280788 events in 0 files, snapshot none (task 7185 ms: download 3211 ms overlapping gunzip 874 ms, parse 4140 ms, sort 0 ms, write 0 ms, index 1346 ms: 9 candidates, 97414 repo-hours, 771 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:03:51Z [load_day 2024-03-10] 2024-03-10 hour 13: 254592 events in 0 files, snapshot none (task 6890 ms: download 3191 ms overlapping gunzip 874 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 1176 ms: 6 candidates, 86172 repo-hours, 806 releases; waiting 530 ms; commit 0 ms)
2026-11-08T05:03:59Z [load_day 2024-03-10] 2024-03-10 hour 14: 250428 events in 0 files, snapshot none (task 7436 ms: download 4803 ms overlapping gunzip 1081 ms, parse 4896 ms, sort 0 ms, write 0 ms, index 657 ms: 9 candidates, 75750 repo-hours, 892 releases; waiting 568 ms; commit 0 ms)
2026-11-08T05:03:59Z [load_day 2024-03-10] 2024-03-10 hour 15: 251205 events in 0 files, snapshot none (task 7130 ms: download 4270 ms overlapping gunzip 1028 ms, parse 4621 ms, sort 0 ms, write 0 ms, index 775 ms: 14 candidates, 76071 repo-hours, 1034 releases; waiting 458 ms; commit 0 ms)
2026-11-08T05:04:06Z [load_day 2024-03-10] 2024-03-10 hour 16: 246423 events in 0 files, snapshot none (task 7069 ms: download 4229 ms overlapping gunzip 1100 ms, parse 4843 ms, sort 0 ms, write 0 ms, index 544 ms: 10 candidates, 73353 repo-hours, 837 releases; waiting 373 ms; commit 0 ms)
2026-11-08T05:04:06Z [load_day 2024-03-10] 2024-03-10 hour 17: 234245 events in 0 files, snapshot none (task 6729 ms: download 3702 ms overlapping gunzip 1042 ms, parse 4391 ms, sort 0 ms, write 0 ms, index 561 ms: 4 candidates, 69205 repo-hours, 731 releases; waiting 442 ms; commit 0 ms)
2026-11-08T05:04:13Z [load_day 2024-03-10] 2024-03-10 hour 18: 249560 events in 0 files, snapshot none (task 6199 ms: download 3013 ms overlapping gunzip 814 ms, parse 3804 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 75969 repo-hours, 998 releases; waiting 564 ms; commit 0 ms)
2026-11-08T05:04:13Z [load_day 2024-03-10] 2024-03-10 hour 19: 228135 events in 0 files, snapshot none (task 6101 ms: download 3443 ms overlapping gunzip 924 ms, parse 3850 ms, sort 0 ms, write 0 ms, index 544 ms: 6 candidates, 63327 repo-hours, 841 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:04:19Z [load_day 2024-03-10] 2024-03-10 hour 20: 220334 events in 0 files, snapshot none (task 5445 ms: download 2948 ms overlapping gunzip 748 ms, parse 3296 ms, sort 0 ms, write 0 ms, index 577 ms: 13 candidates, 71242 repo-hours, 835 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:04:19Z [load_day 2024-03-10] 2024-03-10 hour 21: 202064 events in 0 files, snapshot none (task 5279 ms: download 3012 ms overlapping gunzip 741 ms, parse 3391 ms, sort 0 ms, write 0 ms, index 392 ms: 4 candidates, 58482 repo-hours, 1028 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:04:25Z [load_day 2024-03-10] 2024-03-10 hour 22: 200073 events in 0 files, snapshot none (task 5974 ms: download 3503 ms overlapping gunzip 890 ms, parse 3694 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 55933 repo-hours, 890 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:04:25Z [load_day 2024-03-10] 2024-03-10 hour 23: 190734 events in 0 files, snapshot none (task 6083 ms: download 2997 ms overlapping gunzip 860 ms, parse 3836 ms, sort 0 ms, write 0 ms, index 569 ms: 7 candidates, 51373 repo-hours, 648 releases; waiting 532 ms; commit 0 ms)
2026-11-08T05:04:32Z [load_day 2024-03-10] 2024-03-10: repo_hour merged from 24 files to 1 (1543922 rows, 6892 ms)
2026-11-08T05:04:35Z [load_day 2024-03-10] 2024-03-10: index committed in 9455 ms (24 + 1 + 24 files)
2026-11-08T05:04:35Z [load_day 2024-03-10] 2024-03-10: 5287580 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:04:35Z [load_day 2024-03-10] attempt 1 succeeded