orcaLog in

Runs · run 4894

load_day 2026-02-02, attempt 1 succeeded

Host
73ccef5e07c2:438185
Started
2026-11-08T15:12:15Z
Ended
2026-11-08T15:13:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
729 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.7 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4894/load_day/2026-02-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:12:15Z [load_day 2026-02-02] attempt 1 started
2026-11-08T15:12:15Z [load_day 2026-02-02] 2026-02-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:12:20Z [load_day 2026-02-02] 2026-02-02 hour 0: 141541 events in 0 files, snapshot none (task 3552 ms: download 2366 ms overlapping gunzip 513 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 556 ms: 11 candidates, 65440 repo-hours, 1015 releases; waiting 683 ms; commit 0 ms)
2026-11-08T15:12:20Z [load_day 2026-02-02] 2026-02-02 hour 1: 144665 events in 0 files, snapshot none (task 3481 ms: download 1970 ms overlapping gunzip 370 ms, parse 1241 ms, sort 0 ms, write 0 ms, index 930 ms: 18 candidates, 81586 repo-hours, 634 releases; waiting 665 ms; commit 0 ms)
2026-11-08T15:12:24Z [load_day 2026-02-02] 2026-02-02 hour 2: 149330 events in 0 files, snapshot none (task 3601 ms: download 2152 ms overlapping gunzip 508 ms, parse 1511 ms, sort 0 ms, write 0 ms, index 752 ms: 8 candidates, 84677 repo-hours, 668 releases; waiting 521 ms; commit 0 ms)
2026-11-08T15:12:24Z [load_day 2026-02-02] 2026-02-02 hour 3: 145695 events in 0 files, snapshot none (task 3631 ms: download 2309 ms overlapping gunzip 510 ms, parse 1489 ms, sort 0 ms, write 0 ms, index 686 ms: 9 candidates, 64640 repo-hours, 729 releases; waiting 619 ms; commit 0 ms)
2026-11-08T15:12:28Z [load_day 2026-02-02] 2026-02-02 hour 4: 144970 events in 0 files, snapshot none (task 3919 ms: download 2553 ms overlapping gunzip 554 ms, parse 1645 ms, sort 0 ms, write 0 ms, index 537 ms: 9 candidates, 66508 repo-hours, 756 releases; waiting 708 ms; commit 0 ms)
2026-11-08T15:12:28Z [load_day 2026-02-02] 2026-02-02 hour 5: 145160 events in 0 files, snapshot none (task 3854 ms: download 2134 ms overlapping gunzip 573 ms, parse 1660 ms, sort 0 ms, write 0 ms, index 584 ms: 7 candidates, 72904 repo-hours, 1377 releases; waiting 743 ms; commit 0 ms)
2026-11-08T15:12:32Z [load_day 2026-02-02] 2026-02-02 hour 6: 145210 events in 0 files, snapshot none (task 3731 ms: download 2532 ms overlapping gunzip 507 ms, parse 1453 ms, sort 0 ms, write 0 ms, index 828 ms: 9 candidates, 74143 repo-hours, 721 releases; waiting 641 ms; commit 0 ms)
2026-11-08T15:12:34Z [load_day 2026-02-02] 2026-02-02 hour 7: 151139 events in 0 files, snapshot none (task 5094 ms: download 3467 ms overlapping gunzip 614 ms, parse 1693 ms, sort 0 ms, write 0 ms, index 584 ms: 3 candidates, 79134 repo-hours, 616 releases; waiting 1871 ms; commit 0 ms)
2026-11-08T15:12:37Z [load_day 2026-02-02] 2026-02-02 hour 8: 148629 events in 0 files, snapshot none (task 3730 ms: download 2222 ms overlapping gunzip 466 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 972 ms: 5 candidates, 77940 repo-hours, 622 releases; waiting 620 ms; commit 0 ms)
2026-11-08T15:12:38Z [load_day 2026-02-02] 2026-02-02 hour 9: 148566 events in 0 files, snapshot none (task 3611 ms: download 2350 ms overlapping gunzip 534 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 580 ms: 7 candidates, 79134 repo-hours, 571 releases; waiting 626 ms; commit 0 ms)
2026-11-08T15:12:41Z [load_day 2026-02-02] 2026-02-02 hour 10: 146112 events in 0 files, snapshot none (task 3469 ms: download 2244 ms overlapping gunzip 448 ms, parse 1252 ms, sort 0 ms, write 0 ms, index 764 ms: 7 candidates, 80743 repo-hours, 551 releases; waiting 698 ms; commit 0 ms)
2026-11-08T15:12:42Z [load_day 2026-02-02] 2026-02-02 hour 11: 148797 events in 0 files, snapshot none (task 3927 ms: download 2687 ms overlapping gunzip 544 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 674 ms: 5 candidates, 79141 repo-hours, 538 releases; waiting 877 ms; commit 0 ms)
2026-11-08T15:12:44Z [load_day 2026-02-02] 2026-02-02 hour 12: 156785 events in 0 files, snapshot none (task 3054 ms: download 1734 ms overlapping gunzip 320 ms, parse 984 ms, sort 0 ms, write 0 ms, index 846 ms: 9 candidates, 93812 repo-hours, 362 releases; waiting 602 ms; commit 0 ms)
2026-11-08T15:12:46Z [load_day 2026-02-02] 2026-02-02 hour 13: 154884 events in 0 files, snapshot none (task 3058 ms: download 1694 ms overlapping gunzip 378 ms, parse 1214 ms, sort 0 ms, write 0 ms, index 652 ms: 3 candidates, 93956 repo-hours, 304 releases; waiting 499 ms; commit 0 ms)
2026-11-08T15:12:49Z [load_day 2026-02-02] 2026-02-02 hour 14: 152435 events in 0 files, snapshot none (task 4333 ms: download 2308 ms overlapping gunzip 434 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 1115 ms: 3 candidates, 83979 repo-hours, 407 releases; waiting 1016 ms; commit 0 ms)
2026-11-08T15:12:50Z [load_day 2026-02-02] 2026-02-02 hour 15: 151240 events in 0 files, snapshot none (task 3248 ms: download 1676 ms overlapping gunzip 415 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 826 ms: 10 candidates, 86935 repo-hours, 395 releases; waiting 482 ms; commit 0 ms)
2026-11-08T15:12:54Z [load_day 2026-02-02] 2026-02-02 hour 16: 150387 events in 0 files, snapshot none (task 3870 ms: download 2000 ms overlapping gunzip 446 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 1101 ms: 7 candidates, 85939 repo-hours, 324 releases; waiting 595 ms; commit 0 ms)
2026-11-08T15:12:54Z [load_day 2026-02-02] 2026-02-02 hour 17: 147826 events in 0 files, snapshot none (task 3688 ms: download 1996 ms overlapping gunzip 460 ms, parse 1352 ms, sort 0 ms, write 0 ms, index 997 ms: 9 candidates, 82799 repo-hours, 405 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:12:57Z [load_day 2026-02-02] 2026-02-02 hour 18: 152699 events in 0 files, snapshot none (task 3029 ms: download 1226 ms overlapping gunzip 376 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 1115 ms: 6 candidates, 84674 repo-hours, 427 releases; waiting 177 ms; commit 0 ms)
2026-11-08T15:12:58Z [load_day 2026-02-02] 2026-02-02 hour 19: 145055 events in 0 files, snapshot none (task 3517 ms: download 2184 ms overlapping gunzip 488 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 581 ms: 4 candidates, 72346 repo-hours, 540 releases; waiting 827 ms; commit 0 ms)
2026-11-08T15:13:01Z [load_day 2026-02-02] 2026-02-02 hour 20: 144880 events in 0 files, snapshot none (task 3265 ms: download 2151 ms overlapping gunzip 387 ms, parse 1145 ms, sort 0 ms, write 0 ms, index 567 ms: 7 candidates, 73725 repo-hours, 415 releases; waiting 841 ms; commit 0 ms)
2026-11-08T15:13:02Z [load_day 2026-02-02] 2026-02-02 hour 21: 142597 events in 0 files, snapshot none (task 3459 ms: download 2139 ms overlapping gunzip 385 ms, parse 1122 ms, sort 0 ms, write 0 ms, index 591 ms: 10 candidates, 69594 repo-hours, 396 releases; waiting 780 ms; commit 0 ms)
2026-11-08T15:13:05Z [load_day 2026-02-02] 2026-02-02 hour 22: 140981 events in 0 files, snapshot none (task 3735 ms: download 2487 ms overlapping gunzip 480 ms, parse 1395 ms, sort 0 ms, write 0 ms, index 643 ms: 14 candidates, 66742 repo-hours, 351 releases; waiting 881 ms; commit 0 ms)
2026-11-08T15:13:06Z [load_day 2026-02-02] 2026-02-02 hour 23: 145962 events in 0 files, snapshot none (task 3459 ms: download 2014 ms overlapping gunzip 499 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 584 ms: 6 candidates, 70352 repo-hours, 754 releases; waiting 516 ms; commit 0 ms)
2026-11-08T15:13:15Z [load_day 2026-02-02] 2026-02-02: repo_hour merged from 24 files to 1 (1870843 rows, 9285 ms)
2026-11-08T15:13:18Z [load_day 2026-02-02] 2026-02-02: index committed in 12037 ms (24 + 1 + 24 files)
2026-11-08T15:13:18Z [load_day 2026-02-02] 2026-02-02: 3545545 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:13:18Z [load_day 2026-02-02] attempt 1 succeeded