orcaLog in

Runs · run 3984

load_day 2025-06-05, attempt 1 succeeded

Host
73ccef5e07c2:317167
Started
2026-11-08T12:17:38Z
Ended
2026-11-08T12:19:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
662 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
145.7 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3984/load_day/2025-06-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:17:38Z [load_day 2025-06-05] attempt 1 started
2026-11-08T12:17:39Z [load_day 2025-06-05] 2025-06-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:17:46Z [load_day 2025-06-05] 2025-06-05 hour 0: 141977 events in 0 files, snapshot none (task 6184 ms: download 3362 ms overlapping gunzip 786 ms, parse 3184 ms, sort 0 ms, write 0 ms, index 968 ms: 13 candidates, 71293 repo-hours, 977 releases; waiting 985 ms; commit 0 ms)
2026-11-08T12:17:46Z [load_day 2025-06-05] 2025-06-05 hour 1: 148554 events in 0 files, snapshot none (task 6042 ms: download 2706 ms overlapping gunzip 754 ms, parse 3089 ms, sort 0 ms, write 0 ms, index 1232 ms: 15 candidates, 88466 repo-hours, 670 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:17:54Z [load_day 2025-06-05] 2025-06-05 hour 2: 139446 events in 0 files, snapshot none (task 7397 ms: download 4652 ms overlapping gunzip 928 ms, parse 3546 ms, sort 0 ms, write 0 ms, index 784 ms: 29 candidates, 70551 repo-hours, 613 releases; waiting 1789 ms; commit 0 ms)
2026-11-08T12:17:54Z [load_day 2025-06-05] 2025-06-05 hour 3: 140957 events in 0 files, snapshot none (task 5813 ms: download 2759 ms overlapping gunzip 855 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 677 ms: 14 candidates, 68482 repo-hours, 1704 releases; waiting 522 ms; commit 0 ms)
2026-11-08T12:18:00Z [load_day 2025-06-05] 2025-06-05 hour 4: 139127 events in 0 files, snapshot none (task 5953 ms: download 2752 ms overlapping gunzip 834 ms, parse 3355 ms, sort 0 ms, write 0 ms, index 881 ms: 18 candidates, 62383 repo-hours, 771 releases; waiting 524 ms; commit 0 ms)
2026-11-08T12:18:01Z [load_day 2025-06-05] 2025-06-05 hour 5: 143055 events in 0 files, snapshot none (task 6158 ms: download 3382 ms overlapping gunzip 964 ms, parse 3660 ms, sort 0 ms, write 0 ms, index 731 ms: 14 candidates, 65468 repo-hours, 677 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:18:07Z [load_day 2025-06-05] 2025-06-05 hour 6: 148970 events in 0 files, snapshot none (task 6252 ms: download 3382 ms overlapping gunzip 899 ms, parse 3848 ms, sort 0 ms, write 0 ms, index 672 ms: 19 candidates, 78011 repo-hours, 738 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:18:08Z [load_day 2025-06-05] 2025-06-05 hour 7: 150147 events in 0 files, snapshot none (task 6264 ms: download 3703 ms overlapping gunzip 986 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 73217 repo-hours, 831 releases; waiting 431 ms; commit 0 ms)
2026-11-08T12:18:15Z [load_day 2025-06-05] 2025-06-05 hour 8: 150473 events in 0 files, snapshot none (task 7205 ms: download 4231 ms overlapping gunzip 1088 ms, parse 4327 ms, sort 0 ms, write 0 ms, index 840 ms: 13 candidates, 76576 repo-hours, 747 releases; waiting 593 ms; commit 0 ms)
2026-11-08T12:18:15Z [load_day 2025-06-05] 2025-06-05 hour 9: 150382 events in 0 files, snapshot none (task 7400 ms: download 4216 ms overlapping gunzip 1053 ms, parse 4305 ms, sort 0 ms, write 0 ms, index 828 ms: 17 candidates, 76950 repo-hours, 851 releases; waiting 539 ms; commit 0 ms)
2026-11-08T12:18:23Z [load_day 2025-06-05] 2025-06-05 hour 10: 151648 events in 0 files, snapshot none (task 7005 ms: download 5084 ms overlapping gunzip 1054 ms, parse 4434 ms, sort 0 ms, write 0 ms, index 690 ms: 11 candidates, 75772 repo-hours, 705 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:18:23Z [load_day 2025-06-05] 2025-06-05 hour 11: 151170 events in 0 files, snapshot none (task 6781 ms: download 3950 ms overlapping gunzip 1000 ms, parse 4295 ms, sort 0 ms, write 0 ms, index 649 ms: 10 candidates, 73503 repo-hours, 790 releases; waiting 201 ms; commit 0 ms)
2026-11-08T12:18:30Z [load_day 2025-06-05] 2025-06-05 hour 12: 157853 events in 0 files, snapshot none (task 6927 ms: download 4346 ms overlapping gunzip 1095 ms, parse 4569 ms, sort 0 ms, write 0 ms, index 677 ms: 14 candidates, 92528 repo-hours, 817 releases; waiting 337 ms; commit 0 ms)
2026-11-08T12:18:31Z [load_day 2025-06-05] 2025-06-05 hour 13: 154955 events in 0 files, snapshot none (task 6926 ms: download 4517 ms overlapping gunzip 1053 ms, parse 4383 ms, sort 0 ms, write 0 ms, index 597 ms: 16 candidates, 87686 repo-hours, 730 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:18:38Z [load_day 2025-06-05] 2025-06-05 hour 14: 152997 events in 0 files, snapshot none (task 7418 ms: download 4851 ms overlapping gunzip 1193 ms, parse 4826 ms, sort 0 ms, write 0 ms, index 652 ms: 13 candidates, 80790 repo-hours, 818 releases; waiting 516 ms; commit 0 ms)
2026-11-08T12:18:39Z [load_day 2025-06-05] 2025-06-05 hour 15: 158249 events in 0 files, snapshot none (task 7387 ms: download 4922 ms overlapping gunzip 1145 ms, parse 4835 ms, sort 0 ms, write 0 ms, index 618 ms: 12 candidates, 82943 repo-hours, 837 releases; waiting 475 ms; commit 0 ms)
2026-11-08T12:18:45Z [load_day 2025-06-05] 2025-06-05 hour 16: 153894 events in 0 files, snapshot none (task 6436 ms: download 3631 ms overlapping gunzip 964 ms, parse 3947 ms, sort 0 ms, write 0 ms, index 692 ms: 18 candidates, 78854 repo-hours, 765 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:18:48Z [load_day 2025-06-05] 2025-06-05 hour 17: 155413 events in 0 files, snapshot none (task 8661 ms: download 5737 ms overlapping gunzip 940 ms, parse 3887 ms, sort 0 ms, write 0 ms, index 858 ms: 15 candidates, 75716 repo-hours, 720 releases; waiting 2688 ms; commit 0 ms)
2026-11-08T12:18:52Z [load_day 2025-06-05] 2025-06-05 hour 18: 149246 events in 0 files, snapshot none (task 5888 ms: download 3262 ms overlapping gunzip 801 ms, parse 3443 ms, sort 0 ms, write 0 ms, index 898 ms: 15 candidates, 71545 repo-hours, 552 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:18:55Z [load_day 2025-06-05] 2025-06-05 hour 19: 151179 events in 0 files, snapshot none (task 6330 ms: download 3036 ms overlapping gunzip 982 ms, parse 3994 ms, sort 0 ms, write 0 ms, index 636 ms: 20 candidates, 71117 repo-hours, 855 releases; waiting 397 ms; commit 0 ms)
2026-11-08T12:18:58Z [load_day 2025-06-05] 2025-06-05 hour 20: 147870 events in 0 files, snapshot none (task 5844 ms: download 3548 ms overlapping gunzip 901 ms, parse 3700 ms, sort 0 ms, write 0 ms, index 488 ms: 14 candidates, 68897 repo-hours, 823 releases; waiting 504 ms; commit 0 ms)
2026-11-08T12:19:01Z [load_day 2025-06-05] 2025-06-05 hour 21: 143413 events in 0 files, snapshot none (task 5393 ms: download 3337 ms overlapping gunzip 773 ms, parse 3226 ms, sort 0 ms, write 0 ms, index 501 ms: 21 candidates, 65724 repo-hours, 844 releases; waiting 656 ms; commit 0 ms)
2026-11-08T12:19:04Z [load_day 2025-06-05] 2025-06-05 hour 22: 137397 events in 0 files, snapshot none (task 5573 ms: download 3104 ms overlapping gunzip 789 ms, parse 3216 ms, sort 0 ms, write 0 ms, index 480 ms: 4 candidates, 60185 repo-hours, 855 releases; waiting 846 ms; commit 0 ms)
2026-11-08T12:19:06Z [load_day 2025-06-05] 2025-06-05 hour 23: 135895 events in 0 files, snapshot none (task 4747 ms: download 2890 ms overlapping gunzip 692 ms, parse 3056 ms, sort 0 ms, write 0 ms, index 423 ms: 5 candidates, 57881 repo-hours, 964 releases; waiting 329 ms; commit 0 ms)
2026-11-08T12:19:14Z [load_day 2025-06-05] 2025-06-05: repo_hour merged from 24 files to 1 (1774538 rows, 8594 ms)
2026-11-08T12:19:18Z [load_day 2025-06-05] 2025-06-05: index committed in 11833 ms (24 + 1 + 24 files)
2026-11-08T12:19:18Z [load_day 2025-06-05] 2025-06-05: 3554267 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:19:18Z [load_day 2025-06-05] attempt 1 succeeded