orcaLog in

Runs · run 4201

load_day 2025-07-28, attempt 1 succeeded

Host
73ccef5e07c2:350388
Started
2026-11-08T13:07:26Z
Ended
2026-11-08T13:09:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
670 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
159.1 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4201/load_day/2025-07-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:07:26Z [load_day 2025-07-28] attempt 1 started
2026-11-08T13:07:27Z [load_day 2025-07-28] 2025-07-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:07:34Z [load_day 2025-07-28] 2025-07-28 hour 0: 141113 events in 0 files, snapshot none (task 6447 ms: download 3568 ms overlapping gunzip 1097 ms, parse 4225 ms, sort 0 ms, write 0 ms, index 614 ms: 8 candidates, 59756 repo-hours, 1149 releases; waiting 239 ms; commit 0 ms)
2026-11-08T13:07:34Z [load_day 2025-07-28] 2025-07-28 hour 1: 150656 events in 0 files, snapshot none (task 6419 ms: download 3480 ms overlapping gunzip 947 ms, parse 3849 ms, sort 0 ms, write 0 ms, index 813 ms: 4 candidates, 82003 repo-hours, 813 releases; waiting 506 ms; commit 0 ms)
2026-11-08T13:07:40Z [load_day 2025-07-28] 2025-07-28 hour 2: 152754 events in 0 files, snapshot none (task 5650 ms: download 3784 ms overlapping gunzip 913 ms, parse 3391 ms, sort 0 ms, write 0 ms, index 654 ms: 6 candidates, 74732 repo-hours, 900 releases; waiting 324 ms; commit 0 ms)
2026-11-08T13:07:41Z [load_day 2025-07-28] 2025-07-28 hour 3: 143771 events in 0 files, snapshot none (task 5789 ms: download 3744 ms overlapping gunzip 904 ms, parse 3579 ms, sort 0 ms, write 0 ms, index 454 ms: 3 candidates, 63476 repo-hours, 1002 releases; waiting 527 ms; commit 0 ms)
2026-11-08T13:07:48Z [load_day 2025-07-28] 2025-07-28 hour 4: 149350 events in 0 files, snapshot none (task 7134 ms: download 4184 ms overlapping gunzip 1150 ms, parse 4644 ms, sort 0 ms, write 0 ms, index 513 ms: 3 candidates, 65564 repo-hours, 2043 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:07:48Z [load_day 2025-07-28] 2025-07-28 hour 5: 149988 events in 0 files, snapshot none (task 6847 ms: download 4052 ms overlapping gunzip 1187 ms, parse 4336 ms, sort 0 ms, write 0 ms, index 494 ms: 3 candidates, 65052 repo-hours, 795 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:07:57Z [load_day 2025-07-28] 2025-07-28 hour 6: 162138 events in 0 files, snapshot none (task 8370 ms: download 6065 ms overlapping gunzip 1255 ms, parse 4815 ms, sort 0 ms, write 0 ms, index 551 ms: 4 candidates, 79692 repo-hours, 963 releases; waiting 1532 ms; commit 0 ms)
2026-11-08T13:07:57Z [load_day 2025-07-28] 2025-07-28 hour 7: 163065 events in 0 files, snapshot none (task 7082 ms: download 4333 ms overlapping gunzip 1109 ms, parse 4712 ms, sort 0 ms, write 0 ms, index 565 ms: 6 candidates, 76151 repo-hours, 884 releases; waiting 451 ms; commit 0 ms)
2026-11-08T13:08:07Z [load_day 2025-07-28] 2025-07-28 hour 8: 162540 events in 0 files, snapshot none (task 9533 ms: download 6348 ms overlapping gunzip 1559 ms, parse 6078 ms, sort 0 ms, write 0 ms, index 1070 ms: 9 candidates, 79154 repo-hours, 951 releases; waiting 548 ms; commit 0 ms)
2026-11-08T13:08:07Z [load_day 2025-07-28] 2025-07-28 hour 9: 166018 events in 0 files, snapshot none (task 9580 ms: download 5756 ms overlapping gunzip 1388 ms, parse 5669 ms, sort 0 ms, write 0 ms, index 1381 ms: 3 candidates, 80266 repo-hours, 966 releases; waiting 498 ms; commit 0 ms)
2026-11-08T13:08:16Z [load_day 2025-07-28] 2025-07-28 hour 10: 155892 events in 0 files, snapshot none (task 7982 ms: download 4744 ms overlapping gunzip 1208 ms, parse 5113 ms, sort 0 ms, write 0 ms, index 856 ms: 6 candidates, 74546 repo-hours, 888 releases; waiting 490 ms; commit 0 ms)
2026-11-08T13:08:16Z [load_day 2025-07-28] 2025-07-28 hour 11: 159592 events in 0 files, snapshot none (task 7838 ms: download 4953 ms overlapping gunzip 1268 ms, parse 5044 ms, sort 0 ms, write 0 ms, index 694 ms: 3 candidates, 73869 repo-hours, 897 releases; waiting 518 ms; commit 0 ms)
2026-11-08T13:08:23Z [load_day 2025-07-28] 2025-07-28 hour 12: 169915 events in 0 files, snapshot none (task 7139 ms: download 3956 ms overlapping gunzip 1089 ms, parse 4671 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 95287 repo-hours, 924 releases; waiting 203 ms; commit 0 ms)
2026-11-08T13:08:24Z [load_day 2025-07-28] 2025-07-28 hour 13: 170302 events in 0 files, snapshot none (task 7831 ms: download 4805 ms overlapping gunzip 1202 ms, parse 4947 ms, sort 0 ms, write 0 ms, index 753 ms: 4 candidates, 93021 repo-hours, 864 releases; waiting 566 ms; commit 0 ms)
2026-11-08T13:08:32Z [load_day 2025-07-28] 2025-07-28 hour 14: 163940 events in 0 files, snapshot none (task 8170 ms: download 5587 ms overlapping gunzip 1315 ms, parse 5280 ms, sort 0 ms, write 0 ms, index 628 ms: 10 candidates, 82980 repo-hours, 987 releases; waiting 572 ms; commit 0 ms)
2026-11-08T13:08:32Z [load_day 2025-07-28] 2025-07-28 hour 15: 167985 events in 0 files, snapshot none (task 7608 ms: download 5251 ms overlapping gunzip 1251 ms, parse 4910 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 83608 repo-hours, 1056 releases; waiting 536 ms; commit 0 ms)
2026-11-08T13:08:39Z [load_day 2025-07-28] 2025-07-28 hour 16: 164899 events in 0 files, snapshot none (task 6445 ms: download 3906 ms overlapping gunzip 1058 ms, parse 4229 ms, sort 0 ms, write 0 ms, index 663 ms: 9 candidates, 82226 repo-hours, 972 releases; waiting 172 ms; commit 0 ms)
2026-11-08T13:08:39Z [load_day 2025-07-28] 2025-07-28 hour 17: 166137 events in 0 files, snapshot none (task 6629 ms: download 4226 ms overlapping gunzip 1073 ms, parse 4038 ms, sort 0 ms, write 0 ms, index 675 ms: 11 candidates, 78287 repo-hours, 912 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:08:48Z [load_day 2025-07-28] 2025-07-28 hour 18: 164748 events in 0 files, snapshot none (task 8951 ms: download 6173 ms overlapping gunzip 1272 ms, parse 4947 ms, sort 0 ms, write 0 ms, index 871 ms: 7 candidates, 82583 repo-hours, 954 releases; waiting 1650 ms; commit 0 ms)
2026-11-08T13:08:48Z [load_day 2025-07-28] 2025-07-28 hour 19: 157880 events in 0 files, snapshot none (task 8727 ms: download 5520 ms overlapping gunzip 1312 ms, parse 4858 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 70770 repo-hours, 963 releases; waiting 1622 ms; commit 0 ms)
2026-11-08T13:08:58Z [load_day 2025-07-28] 2025-07-28 hour 20: 157802 events in 0 files, snapshot none (task 8767 ms: download 5883 ms overlapping gunzip 1358 ms, parse 5282 ms, sort 0 ms, write 0 ms, index 562 ms: 4 candidates, 70842 repo-hours, 910 releases; waiting 468 ms; commit 0 ms)
2026-11-08T13:08:58Z [load_day 2025-07-28] 2025-07-28 hour 21: 153345 events in 0 files, snapshot none (task 8770 ms: download 6269 ms overlapping gunzip 1203 ms, parse 4729 ms, sort 0 ms, write 0 ms, index 489 ms: 10 candidates, 64749 repo-hours, 1098 releases; waiting 1897 ms; commit 0 ms)
2026-11-08T13:09:05Z [load_day 2025-07-28] 2025-07-28 hour 22: 142417 events in 0 files, snapshot none (task 7013 ms: download 4866 ms overlapping gunzip 1117 ms, parse 4667 ms, sort 0 ms, write 0 ms, index 469 ms: 14 candidates, 60444 repo-hours, 909 releases; waiting 526 ms; commit 0 ms)
2026-11-08T13:09:05Z [load_day 2025-07-28] 2025-07-28 hour 23: 143554 events in 0 files, snapshot none (task 7312 ms: download 4874 ms overlapping gunzip 1208 ms, parse 4636 ms, sort 0 ms, write 0 ms, index 564 ms: 8 candidates, 58293 repo-hours, 703 releases; waiting 507 ms; commit 0 ms)
2026-11-08T13:09:15Z [load_day 2025-07-28] 2025-07-28: repo_hour merged from 24 files to 1 (1797351 rows, 9803 ms)
2026-11-08T13:09:18Z [load_day 2025-07-28] 2025-07-28: index committed in 12734 ms (24 + 1 + 24 files)
2026-11-08T13:09:18Z [load_day 2025-07-28] 2025-07-28: 3779801 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:09:18Z [load_day 2025-07-28] attempt 1 succeeded