orcaLog in

Runs · run 4845

load_day 2026-01-20, attempt 1 succeeded

Host
73ccef5e07c2:432255
Started
2026-11-08T15:05:11Z
Ended
2026-11-08T15:06:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.0 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4845/load_day/2026-01-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:05:11Z [load_day 2026-01-20] attempt 1 started
2026-11-08T15:05:12Z [load_day 2026-01-20] 2026-01-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:05:16Z [load_day 2026-01-20] 2026-01-20 hour 0: 146088 events in 0 files, snapshot none (task 3400 ms: download 2092 ms overlapping gunzip 527 ms, parse 1582 ms, sort 0 ms, write 0 ms, index 582 ms: 7 candidates, 72659 repo-hours, 816 releases; waiting 418 ms; commit 0 ms)
2026-11-08T15:05:16Z [load_day 2026-01-20] 2026-01-20 hour 1: 154153 events in 0 files, snapshot none (task 3592 ms: download 2370 ms overlapping gunzip 476 ms, parse 1489 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 90372 repo-hours, 707 releases; waiting 691 ms; commit 0 ms)
2026-11-08T15:05:20Z [load_day 2026-01-20] 2026-01-20 hour 2: 146505 events in 0 files, snapshot none (task 3765 ms: download 2618 ms overlapping gunzip 384 ms, parse 1230 ms, sort 0 ms, write 0 ms, index 548 ms: 4 candidates, 76032 repo-hours, 700 releases; waiting 1361 ms; commit 0 ms)
2026-11-08T15:05:20Z [load_day 2026-01-20] 2026-01-20 hour 3: 144183 events in 0 files, snapshot none (task 3576 ms: download 2445 ms overlapping gunzip 451 ms, parse 1279 ms, sort 0 ms, write 0 ms, index 582 ms: 6 candidates, 70056 repo-hours, 803 releases; waiting 988 ms; commit 0 ms)
2026-11-08T15:05:24Z [load_day 2026-01-20] 2026-01-20 hour 4: 146702 events in 0 files, snapshot none (task 3317 ms: download 2179 ms overlapping gunzip 469 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 579 ms: 3 candidates, 71829 repo-hours, 1445 releases; waiting 579 ms; commit 0 ms)
2026-11-08T15:05:24Z [load_day 2026-01-20] 2026-01-20 hour 5: 146764 events in 0 files, snapshot none (task 3734 ms: download 2622 ms overlapping gunzip 549 ms, parse 1569 ms, sort 0 ms, write 0 ms, index 535 ms: 8 candidates, 70027 repo-hours, 623 releases; waiting 809 ms; commit 0 ms)
2026-11-08T15:05:29Z [load_day 2026-01-20] 2026-01-20 hour 6: 149389 events in 0 files, snapshot none (task 4931 ms: download 3170 ms overlapping gunzip 441 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 591 ms: 3 candidates, 77309 repo-hours, 721 releases; waiting 2353 ms; commit 0 ms)
2026-11-08T15:05:29Z [load_day 2026-01-20] 2026-01-20 hour 7: 145818 events in 0 files, snapshot none (task 3352 ms: download 2026 ms overlapping gunzip 486 ms, parse 1302 ms, sort 0 ms, write 0 ms, index 709 ms: 0 candidates, 75333 repo-hours, 647 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:05:33Z [load_day 2026-01-20] 2026-01-20 hour 8: 148726 events in 0 files, snapshot none (task 3133 ms: download 1518 ms overlapping gunzip 491 ms, parse 1384 ms, sort 0 ms, write 0 ms, index 743 ms: 8 candidates, 79912 repo-hours, 682 releases; waiting 236 ms; commit 0 ms)
2026-11-08T15:05:33Z [load_day 2026-01-20] 2026-01-20 hour 9: 145591 events in 0 files, snapshot none (task 3308 ms: download 2088 ms overlapping gunzip 446 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 599 ms: 5 candidates, 78346 repo-hours, 604 releases; waiting 633 ms; commit 0 ms)
2026-11-08T15:05:37Z [load_day 2026-01-20] 2026-01-20 hour 10: 146883 events in 0 files, snapshot none (task 3697 ms: download 2423 ms overlapping gunzip 510 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 817 ms: 7 candidates, 78974 repo-hours, 528 releases; waiting 601 ms; commit 0 ms)
2026-11-08T15:05:37Z [load_day 2026-01-20] 2026-01-20 hour 11: 145856 events in 0 files, snapshot none (task 3576 ms: download 2325 ms overlapping gunzip 507 ms, parse 1551 ms, sort 0 ms, write 0 ms, index 597 ms: 2 candidates, 77564 repo-hours, 595 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:05:40Z [load_day 2026-01-20] 2026-01-20 hour 12: 152608 events in 0 files, snapshot none (task 3148 ms: download 1814 ms overlapping gunzip 301 ms, parse 949 ms, sort 0 ms, write 0 ms, index 906 ms: 8 candidates, 94283 repo-hours, 458 releases; waiting 673 ms; commit 0 ms)
2026-11-08T15:05:41Z [load_day 2026-01-20] 2026-01-20 hour 13: 152237 events in 0 files, snapshot none (task 3212 ms: download 1836 ms overlapping gunzip 369 ms, parse 1020 ms, sort 0 ms, write 0 ms, index 866 ms: 4 candidates, 91835 repo-hours, 391 releases; waiting 593 ms; commit 0 ms)
2026-11-08T15:05:45Z [load_day 2026-01-20] 2026-01-20 hour 14: 145453 events in 0 files, snapshot none (task 3808 ms: download 2597 ms overlapping gunzip 461 ms, parse 1325 ms, sort 0 ms, write 0 ms, index 788 ms: 2 candidates, 83192 repo-hours, 482 releases; waiting 900 ms; commit 0 ms)
2026-11-08T15:05:45Z [load_day 2026-01-20] 2026-01-20 hour 15: 145561 events in 0 files, snapshot none (task 3887 ms: download 2431 ms overlapping gunzip 405 ms, parse 1292 ms, sort 0 ms, write 0 ms, index 643 ms: 5 candidates, 84064 repo-hours, 524 releases; waiting 1077 ms; commit 0 ms)
2026-11-08T15:05:49Z [load_day 2026-01-20] 2026-01-20 hour 16: 146446 events in 0 files, snapshot none (task 3578 ms: download 2494 ms overlapping gunzip 371 ms, parse 1078 ms, sort 0 ms, write 0 ms, index 728 ms: 5 candidates, 84757 repo-hours, 512 releases; waiting 1103 ms; commit 0 ms)
2026-11-08T15:05:50Z [load_day 2026-01-20] 2026-01-20 hour 17: 143559 events in 0 files, snapshot none (task 4499 ms: download 2688 ms overlapping gunzip 390 ms, parse 1165 ms, sort 0 ms, write 0 ms, index 1059 ms: 2 candidates, 78570 repo-hours, 609 releases; waiting 1534 ms; commit 0 ms)
2026-11-08T15:05:54Z [load_day 2026-01-20] 2026-01-20 hour 18: 145030 events in 0 files, snapshot none (task 3773 ms: download 2388 ms overlapping gunzip 406 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 834 ms: 2 candidates, 81702 repo-hours, 616 releases; waiting 960 ms; commit 0 ms)
2026-11-08T15:05:54Z [load_day 2026-01-20] 2026-01-20 hour 19: 141755 events in 0 files, snapshot none (task 3451 ms: download 2050 ms overlapping gunzip 454 ms, parse 1337 ms, sort 0 ms, write 0 ms, index 675 ms: 2 candidates, 71218 repo-hours, 692 releases; waiting 696 ms; commit 0 ms)
2026-11-08T15:05:58Z [load_day 2026-01-20] 2026-01-20 hour 20: 143438 events in 0 files, snapshot none (task 4142 ms: download 2489 ms overlapping gunzip 426 ms, parse 1255 ms, sort 0 ms, write 0 ms, index 1223 ms: 8 candidates, 74851 repo-hours, 707 releases; waiting 875 ms; commit 0 ms)
2026-11-08T15:05:59Z [load_day 2026-01-20] 2026-01-20 hour 21: 142785 events in 0 files, snapshot none (task 4260 ms: download 2749 ms overlapping gunzip 517 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 667 ms: 4 candidates, 69248 repo-hours, 807 releases; waiting 1251 ms; commit 0 ms)
2026-11-08T15:06:04Z [load_day 2026-01-20] 2026-01-20 hour 22: 143789 events in 0 files, snapshot none (task 4736 ms: download 3144 ms overlapping gunzip 700 ms, parse 1895 ms, sort 0 ms, write 0 ms, index 991 ms: 4 candidates, 70145 repo-hours, 899 releases; waiting 835 ms; commit 0 ms)
2026-11-08T15:06:04Z [load_day 2026-01-20] 2026-01-20 hour 23: 143716 events in 0 files, snapshot none (task 4607 ms: download 2318 ms overlapping gunzip 704 ms, parse 2273 ms, sort 0 ms, write 0 ms, index 681 ms: 9 candidates, 66799 repo-hours, 845 releases; waiting 609 ms; commit 0 ms)
2026-11-08T15:06:13Z [load_day 2026-01-20] 2026-01-20: repo_hour merged from 24 files to 1 (1869077 rows, 9321 ms)
2026-11-08T15:06:17Z [load_day 2026-01-20] 2026-01-20: index committed in 12495 ms (23 + 1 + 24 files)
2026-11-08T15:06:17Z [load_day 2026-01-20] 2026-01-20: 3513035 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:06:17Z [load_day 2026-01-20] attempt 1 succeeded