orcaLog in

Runs · run 4872

load_day 2026-01-27, attempt 1 succeeded

Host
73ccef5e07c2:435599
Started
2026-11-08T15:09:04Z
Ended
2026-11-08T15:10:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
764 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.5 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4872/load_day/2026-01-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:09:04Z [load_day 2026-01-27] attempt 1 started
2026-11-08T15:09:05Z [load_day 2026-01-27] 2026-01-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:09:10Z [load_day 2026-01-27] 2026-01-27 hour 0: 143159 events in 0 files, snapshot none (task 3892 ms: download 2720 ms overlapping gunzip 543 ms, parse 1685 ms, sort 0 ms, write 0 ms, index 578 ms: 9 candidates, 70837 repo-hours, 826 releases; waiting 797 ms; commit 0 ms)
2026-11-08T15:09:10Z [load_day 2026-01-27] 2026-01-27 hour 1: 154244 events in 0 files, snapshot none (task 3767 ms: download 2482 ms overlapping gunzip 498 ms, parse 1667 ms, sort 0 ms, write 0 ms, index 685 ms: 10 candidates, 89478 repo-hours, 651 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:09:14Z [load_day 2026-01-27] 2026-01-27 hour 2: 149255 events in 0 files, snapshot none (task 3474 ms: download 2100 ms overlapping gunzip 464 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 594 ms: 6 candidates, 80902 repo-hours, 593 releases; waiting 720 ms; commit 0 ms)
2026-11-08T15:09:14Z [load_day 2026-01-27] 2026-01-27 hour 3: 142666 events in 0 files, snapshot none (task 4195 ms: download 3202 ms overlapping gunzip 562 ms, parse 1676 ms, sort 0 ms, write 0 ms, index 569 ms: 6 candidates, 69105 repo-hours, 744 releases; waiting 1082 ms; commit 0 ms)
2026-11-08T15:09:18Z [load_day 2026-01-27] 2026-01-27 hour 4: 144623 events in 0 files, snapshot none (task 3669 ms: download 2121 ms overlapping gunzip 537 ms, parse 1622 ms, sort 0 ms, write 0 ms, index 635 ms: 10 candidates, 73600 repo-hours, 1452 releases; waiting 546 ms; commit 0 ms)
2026-11-08T15:09:19Z [load_day 2026-01-27] 2026-01-27 hour 5: 147128 events in 0 files, snapshot none (task 3870 ms: download 2476 ms overlapping gunzip 461 ms, parse 1367 ms, sort 0 ms, write 0 ms, index 564 ms: 5 candidates, 71560 repo-hours, 707 releases; waiting 1144 ms; commit 0 ms)
2026-11-08T15:09:22Z [load_day 2026-01-27] 2026-01-27 hour 6: 144761 events in 0 files, snapshot none (task 3672 ms: download 2180 ms overlapping gunzip 505 ms, parse 1573 ms, sort 0 ms, write 0 ms, index 672 ms: 14 candidates, 77538 repo-hours, 647 releases; waiting 590 ms; commit 0 ms)
2026-11-08T15:09:22Z [load_day 2026-01-27] 2026-01-27 hour 7: 140844 events in 0 files, snapshot none (task 3437 ms: download 2262 ms overlapping gunzip 553 ms, parse 1427 ms, sort 0 ms, write 0 ms, index 542 ms: 10 candidates, 72041 repo-hours, 666 releases; waiting 558 ms; commit 0 ms)
2026-11-08T15:09:25Z [load_day 2026-01-27] 2026-01-27 hour 8: 144045 events in 0 files, snapshot none (task 3141 ms: download 2087 ms overlapping gunzip 392 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 78581 repo-hours, 635 releases; waiting 606 ms; commit 0 ms)
2026-11-08T15:09:26Z [load_day 2026-01-27] 2026-01-27 hour 9: 148517 events in 0 files, snapshot none (task 3250 ms: download 2082 ms overlapping gunzip 440 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 638 ms: 6 candidates, 80438 repo-hours, 595 releases; waiting 652 ms; commit 0 ms)
2026-11-08T15:09:30Z [load_day 2026-01-27] 2026-01-27 hour 10: 146350 events in 0 files, snapshot none (task 3673 ms: download 2632 ms overlapping gunzip 368 ms, parse 1146 ms, sort 0 ms, write 0 ms, index 706 ms: 6 candidates, 80520 repo-hours, 613 releases; waiting 1175 ms; commit 0 ms)
2026-11-08T15:09:30Z [load_day 2026-01-27] 2026-01-27 hour 11: 148590 events in 0 files, snapshot none (task 3376 ms: download 2140 ms overlapping gunzip 394 ms, parse 1148 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 77430 repo-hours, 641 releases; waiting 919 ms; commit 0 ms)
2026-11-08T15:09:33Z [load_day 2026-01-27] 2026-01-27 hour 12: 156119 events in 0 files, snapshot none (task 3322 ms: download 2154 ms overlapping gunzip 311 ms, parse 1021 ms, sort 0 ms, write 0 ms, index 739 ms: 10 candidates, 96905 repo-hours, 371 releases; waiting 949 ms; commit 0 ms)
2026-11-08T15:09:34Z [load_day 2026-01-27] 2026-01-27 hour 13: 158621 events in 0 files, snapshot none (task 3347 ms: download 2163 ms overlapping gunzip 328 ms, parse 1007 ms, sort 0 ms, write 0 ms, index 670 ms: 13 candidates, 96054 repo-hours, 367 releases; waiting 1023 ms; commit 0 ms)
2026-11-08T15:09:38Z [load_day 2026-01-27] 2026-01-27 hour 14: 149764 events in 0 files, snapshot none (task 4195 ms: download 2590 ms overlapping gunzip 511 ms, parse 1466 ms, sort 0 ms, write 0 ms, index 781 ms: 6 candidates, 84467 repo-hours, 489 releases; waiting 1119 ms; commit 0 ms)
2026-11-08T15:09:38Z [load_day 2026-01-27] 2026-01-27 hour 15: 141569 events in 0 files, snapshot none (task 3661 ms: download 1859 ms overlapping gunzip 493 ms, parse 1426 ms, sort 0 ms, write 0 ms, index 792 ms: 7 candidates, 80141 repo-hours, 489 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:09:42Z [load_day 2026-01-27] 2026-01-27 hour 16: 142141 events in 0 files, snapshot none (task 3715 ms: download 2053 ms overlapping gunzip 393 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 1010 ms: 4 candidates, 82092 repo-hours, 447 releases; waiting 786 ms; commit 0 ms)
2026-11-08T15:09:42Z [load_day 2026-01-27] 2026-01-27 hour 17: 142420 events in 0 files, snapshot none (task 3737 ms: download 2080 ms overlapping gunzip 436 ms, parse 1454 ms, sort 0 ms, write 0 ms, index 702 ms: 11 candidates, 78333 repo-hours, 422 releases; waiting 794 ms; commit 0 ms)
2026-11-08T15:09:46Z [load_day 2026-01-27] 2026-01-27 hour 18: 146880 events in 0 files, snapshot none (task 3375 ms: download 1845 ms overlapping gunzip 403 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 961 ms: 8 candidates, 84087 repo-hours, 519 releases; waiting 357 ms; commit 0 ms)
2026-11-08T15:09:46Z [load_day 2026-01-27] 2026-01-27 hour 19: 145218 events in 0 files, snapshot none (task 3571 ms: download 1719 ms overlapping gunzip 467 ms, parse 1540 ms, sort 0 ms, write 0 ms, index 897 ms: 4 candidates, 75041 repo-hours, 608 releases; waiting 374 ms; commit 0 ms)
2026-11-08T15:09:51Z [load_day 2026-01-27] 2026-01-27 hour 20: 144184 events in 0 files, snapshot none (task 4258 ms: download 2308 ms overlapping gunzip 479 ms, parse 1496 ms, sort 0 ms, write 0 ms, index 1117 ms: 8 candidates, 76422 repo-hours, 630 releases; waiting 933 ms; commit 0 ms)
2026-11-08T15:09:51Z [load_day 2026-01-27] 2026-01-27 hour 21: 148897 events in 0 files, snapshot none (task 4233 ms: download 2611 ms overlapping gunzip 574 ms, parse 1707 ms, sort 0 ms, write 0 ms, index 744 ms: 10 candidates, 76178 repo-hours, 747 releases; waiting 888 ms; commit 0 ms)
2026-11-08T15:09:56Z [load_day 2026-01-27] 2026-01-27 hour 22: 146726 events in 0 files, snapshot none (task 4373 ms: download 2263 ms overlapping gunzip 520 ms, parse 1637 ms, sort 0 ms, write 0 ms, index 988 ms: 7 candidates, 74081 repo-hours, 776 releases; waiting 877 ms; commit 0 ms)
2026-11-08T15:09:56Z [load_day 2026-01-27] 2026-01-27 hour 23: 140364 events in 0 files, snapshot none (task 4157 ms: download 2666 ms overlapping gunzip 649 ms, parse 1963 ms, sort 0 ms, write 0 ms, index 543 ms: 9 candidates, 66441 repo-hours, 990 releases; waiting 763 ms; commit 0 ms)
2026-11-08T15:10:05Z [load_day 2026-01-27] 2026-01-27: repo_hour merged from 24 files to 1 (1892272 rows, 8995 ms)
2026-11-08T15:10:08Z [load_day 2026-01-27] 2026-01-27: index committed in 11964 ms (24 + 1 + 24 files)
2026-11-08T15:10:08Z [load_day 2026-01-27] 2026-01-27: 3517085 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:10:08Z [load_day 2026-01-27] attempt 1 succeeded