orcaLog in

Runs · run 4901

load_day 2026-02-04, attempt 1 succeeded

Host
73ccef5e07c2:438837
Started
2026-11-08T15:13:19Z
Ended
2026-11-08T15:14:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.6 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4901/load_day/2026-02-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:13:19Z [load_day 2026-02-04] attempt 1 started
2026-11-08T15:13:20Z [load_day 2026-02-04] 2026-02-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:13:23Z [load_day 2026-02-04] 2026-02-04 hour 0: 154299 events in 0 files, snapshot none (task 3138 ms: download 1811 ms overlapping gunzip 382 ms, parse 1350 ms, sort 0 ms, write 0 ms, index 529 ms: 5 candidates, 75047 repo-hours, 574 releases; waiting 486 ms; commit 0 ms)
2026-11-08T15:13:23Z [load_day 2026-02-04] 2026-02-04 hour 1: 159407 events in 0 files, snapshot none (task 2944 ms: download 1804 ms overlapping gunzip 316 ms, parse 1141 ms, sort 0 ms, write 0 ms, index 664 ms: 12 candidates, 94882 repo-hours, 275 releases; waiting 517 ms; commit 0 ms)
2026-11-08T15:13:27Z [load_day 2026-02-04] 2026-02-04 hour 2: 159378 events in 0 files, snapshot none (task 3332 ms: download 1114 ms overlapping gunzip 369 ms, parse 1407 ms, sort 0 ms, write 0 ms, index 1036 ms: 3 candidates, 92186 repo-hours, 239 releases; waiting 183 ms; commit 0 ms)
2026-11-08T15:13:27Z [load_day 2026-02-04] 2026-02-04 hour 3: 159242 events in 0 files, snapshot none (task 3290 ms: download 1908 ms overlapping gunzip 419 ms, parse 1453 ms, sort 0 ms, write 0 ms, index 581 ms: 6 candidates, 80107 repo-hours, 382 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:13:31Z [load_day 2026-02-04] 2026-02-04 hour 4: 156546 events in 0 files, snapshot none (task 3576 ms: download 2496 ms overlapping gunzip 398 ms, parse 1388 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 80849 repo-hours, 677 releases; waiting 763 ms; commit 0 ms)
2026-11-08T15:13:31Z [load_day 2026-02-04] 2026-02-04 hour 5: 155395 events in 0 files, snapshot none (task 3676 ms: download 2030 ms overlapping gunzip 468 ms, parse 1694 ms, sort 0 ms, write 0 ms, index 669 ms: 6 candidates, 79778 repo-hours, 398 releases; waiting 560 ms; commit 0 ms)
2026-11-08T15:13:36Z [load_day 2026-02-04] 2026-02-04 hour 6: 147437 events in 0 files, snapshot none (task 3493 ms: download 2172 ms overlapping gunzip 464 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 775 ms: 9 candidates, 79538 repo-hours, 618 releases; waiting 721 ms; commit 0 ms)
2026-11-08T15:13:36Z [load_day 2026-02-04] 2026-02-04 hour 7: 148996 events in 0 files, snapshot none (task 3340 ms: download 1956 ms overlapping gunzip 499 ms, parse 1479 ms, sort 0 ms, write 0 ms, index 689 ms: 8 candidates, 78996 repo-hours, 599 releases; waiting 413 ms; commit 0 ms)
2026-11-08T15:13:40Z [load_day 2026-02-04] 2026-02-04 hour 8: 145619 events in 0 files, snapshot none (task 3618 ms: download 2145 ms overlapping gunzip 470 ms, parse 1411 ms, sort 0 ms, write 0 ms, index 815 ms: 6 candidates, 80232 repo-hours, 635 releases; waiting 593 ms; commit 0 ms)
2026-11-08T15:13:40Z [load_day 2026-02-04] 2026-02-04 hour 9: 143847 events in 0 files, snapshot none (task 3551 ms: download 2171 ms overlapping gunzip 506 ms, parse 1482 ms, sort 0 ms, write 0 ms, index 682 ms: 6 candidates, 79627 repo-hours, 772 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:13:44Z [load_day 2026-02-04] 2026-02-04 hour 10: 145993 events in 0 files, snapshot none (task 3979 ms: download 2571 ms overlapping gunzip 547 ms, parse 1653 ms, sort 0 ms, write 0 ms, index 635 ms: 13 candidates, 81567 repo-hours, 723 releases; waiting 830 ms; commit 0 ms)
2026-11-08T15:13:44Z [load_day 2026-02-04] 2026-02-04 hour 11: 146931 events in 0 files, snapshot none (task 3830 ms: download 2227 ms overlapping gunzip 512 ms, parse 1549 ms, sort 0 ms, write 0 ms, index 836 ms: 7 candidates, 81833 repo-hours, 653 releases; waiting 621 ms; commit 0 ms)
2026-11-08T15:13:48Z [load_day 2026-02-04] 2026-02-04 hour 12: 152047 events in 0 files, snapshot none (task 3221 ms: download 1998 ms overlapping gunzip 410 ms, parse 1285 ms, sort 0 ms, write 0 ms, index 708 ms: 8 candidates, 89603 repo-hours, 421 releases; waiting 601 ms; commit 0 ms)
2026-11-08T15:13:48Z [load_day 2026-02-04] 2026-02-04 hour 13: 156230 events in 0 files, snapshot none (task 3682 ms: download 2388 ms overlapping gunzip 364 ms, parse 1255 ms, sort 0 ms, write 0 ms, index 770 ms: 8 candidates, 96497 repo-hours, 257 releases; waiting 1004 ms; commit 0 ms)
2026-11-08T15:13:53Z [load_day 2026-02-04] 2026-02-04 hour 14: 148078 events in 0 files, snapshot none (task 3923 ms: download 2131 ms overlapping gunzip 487 ms, parse 1644 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 83430 repo-hours, 453 releases; waiting 849 ms; commit 0 ms)
2026-11-08T15:13:53Z [load_day 2026-02-04] 2026-02-04 hour 15: 146840 events in 0 files, snapshot none (task 3563 ms: download 1860 ms overlapping gunzip 469 ms, parse 1381 ms, sort 0 ms, write 0 ms, index 841 ms: 8 candidates, 84954 repo-hours, 464 releases; waiting 571 ms; commit 0 ms)
2026-11-08T15:13:57Z [load_day 2026-02-04] 2026-02-04 hour 16: 143724 events in 0 files, snapshot none (task 3895 ms: download 2222 ms overlapping gunzip 576 ms, parse 1697 ms, sort 0 ms, write 0 ms, index 738 ms: 5 candidates, 83172 repo-hours, 416 releases; waiting 551 ms; commit 0 ms)
2026-11-08T15:13:57Z [load_day 2026-02-04] 2026-02-04 hour 17: 141499 events in 0 files, snapshot none (task 3560 ms: download 2108 ms overlapping gunzip 575 ms, parse 1513 ms, sort 0 ms, write 0 ms, index 661 ms: 8 candidates, 80956 repo-hours, 483 releases; waiting 381 ms; commit 0 ms)
2026-11-08T15:14:01Z [load_day 2026-02-04] 2026-02-04 hour 18: 146879 events in 0 files, snapshot none (task 3661 ms: download 1658 ms overlapping gunzip 562 ms, parse 1798 ms, sort 0 ms, write 0 ms, index 742 ms: 8 candidates, 85617 repo-hours, 560 releases; waiting 212 ms; commit 0 ms)
2026-11-08T15:14:01Z [load_day 2026-02-04] 2026-02-04 hour 19: 142681 events in 0 files, snapshot none (task 3548 ms: download 2148 ms overlapping gunzip 575 ms, parse 1732 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 74917 repo-hours, 749 releases; waiting 410 ms; commit 0 ms)
2026-11-08T15:14:05Z [load_day 2026-02-04] 2026-02-04 hour 20: 145195 events in 0 files, snapshot none (task 3512 ms: download 2279 ms overlapping gunzip 497 ms, parse 1442 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 76769 repo-hours, 684 releases; waiting 618 ms; commit 0 ms)
2026-11-08T15:14:05Z [load_day 2026-02-04] 2026-02-04 hour 21: 149494 events in 0 files, snapshot none (task 3479 ms: download 1882 ms overlapping gunzip 488 ms, parse 1631 ms, sort 0 ms, write 0 ms, index 670 ms: 5 candidates, 82018 repo-hours, 450 releases; waiting 406 ms; commit 0 ms)
2026-11-08T15:14:09Z [load_day 2026-02-04] 2026-02-04 hour 22: 143949 events in 0 files, snapshot none (task 3077 ms: download 2066 ms overlapping gunzip 392 ms, parse 1191 ms, sort 0 ms, write 0 ms, index 556 ms: 8 candidates, 72491 repo-hours, 836 releases; waiting 611 ms; commit 0 ms)
2026-11-08T15:14:09Z [load_day 2026-02-04] 2026-02-04 hour 23: 146129 events in 0 files, snapshot none (task 3252 ms: download 2171 ms overlapping gunzip 395 ms, parse 1294 ms, sort 0 ms, write 0 ms, index 539 ms: 4 candidates, 72771 repo-hours, 898 releases; waiting 690 ms; commit 0 ms)
2026-11-08T15:14:18Z [load_day 2026-02-04] 2026-02-04: repo_hour merged from 24 files to 1 (1967837 rows, 8457 ms)
2026-11-08T15:14:21Z [load_day 2026-02-04] 2026-02-04: index committed in 12418 ms (24 + 1 + 24 files)
2026-11-08T15:14:21Z [load_day 2026-02-04] 2026-02-04: 3585835 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:14:21Z [load_day 2026-02-04] attempt 1 succeeded