orcaLog in

Runs · run 4886

load_day 2026-01-31, attempt 1 succeeded

Host
73ccef5e07c2:437229
Started
2026-11-08T15:11:11Z
Ended
2026-11-08T15:12:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
680 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.8 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4886/load_day/2026-01-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:11:11Z [load_day 2026-01-31] attempt 1 started
2026-11-08T15:11:12Z [load_day 2026-01-31] 2026-01-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:11:17Z [load_day 2026-01-31] 2026-01-31 hour 0: 143060 events in 0 files, snapshot none (task 3581 ms: download 2336 ms overlapping gunzip 496 ms, parse 1480 ms, sort 0 ms, write 0 ms, index 691 ms: 4 candidates, 68232 repo-hours, 785 releases; waiting 551 ms; commit 0 ms)
2026-11-08T15:11:17Z [load_day 2026-01-31] 2026-01-31 hour 1: 149405 events in 0 files, snapshot none (task 3803 ms: download 2100 ms overlapping gunzip 425 ms, parse 1425 ms, sort 0 ms, write 0 ms, index 744 ms: 16 candidates, 85108 repo-hours, 776 releases; waiting 884 ms; commit 0 ms)
2026-11-08T15:11:20Z [load_day 2026-01-31] 2026-01-31 hour 2: 146392 events in 0 files, snapshot none (task 3299 ms: download 2163 ms overlapping gunzip 395 ms, parse 1225 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 78021 repo-hours, 719 releases; waiting 724 ms; commit 0 ms)
2026-11-08T15:11:20Z [load_day 2026-01-31] 2026-01-31 hour 3: 143503 events in 0 files, snapshot none (task 3274 ms: download 2394 ms overlapping gunzip 443 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 545 ms: 10 candidates, 65697 repo-hours, 654 releases; waiting 782 ms; commit 0 ms)
2026-11-08T15:11:24Z [load_day 2026-01-31] 2026-01-31 hour 4: 143600 events in 0 files, snapshot none (task 3519 ms: download 2277 ms overlapping gunzip 361 ms, parse 1143 ms, sort 0 ms, write 0 ms, index 516 ms: 7 candidates, 66684 repo-hours, 1539 releases; waiting 1079 ms; commit 0 ms)
2026-11-08T15:11:24Z [load_day 2026-01-31] 2026-01-31 hour 5: 152935 events in 0 files, snapshot none (task 2818 ms: download 1734 ms overlapping gunzip 372 ms, parse 1156 ms, sort 0 ms, write 0 ms, index 513 ms: 7 candidates, 68333 repo-hours, 637 releases; waiting 421 ms; commit 0 ms)
2026-11-08T15:11:28Z [load_day 2026-01-31] 2026-01-31 hour 6: 154500 events in 0 files, snapshot none (task 3607 ms: download 2542 ms overlapping gunzip 423 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 595 ms: 6 candidates, 71881 repo-hours, 796 releases; waiting 963 ms; commit 0 ms)
2026-11-08T15:11:28Z [load_day 2026-01-31] 2026-01-31 hour 7: 149399 events in 0 files, snapshot none (task 3668 ms: download 2477 ms overlapping gunzip 417 ms, parse 1255 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 71831 repo-hours, 690 releases; waiting 1152 ms; commit 0 ms)
2026-11-08T15:11:32Z [load_day 2026-01-31] 2026-01-31 hour 8: 141628 events in 0 files, snapshot none (task 3496 ms: download 2372 ms overlapping gunzip 524 ms, parse 1561 ms, sort 0 ms, write 0 ms, index 558 ms: 5 candidates, 66270 repo-hours, 758 releases; waiting 502 ms; commit 0 ms)
2026-11-08T15:11:32Z [load_day 2026-01-31] 2026-01-31 hour 9: 148996 events in 0 files, snapshot none (task 2925 ms: download 1515 ms overlapping gunzip 411 ms, parse 1233 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 73922 repo-hours, 831 releases; waiting 308 ms; commit 0 ms)
2026-11-08T15:11:37Z [load_day 2026-01-31] 2026-01-31 hour 10: 147085 events in 0 files, snapshot none (task 3656 ms: download 2163 ms overlapping gunzip 522 ms, parse 1662 ms, sort 0 ms, write 0 ms, index 652 ms: 5 candidates, 72635 repo-hours, 821 releases; waiting 519 ms; commit 0 ms)
2026-11-08T15:11:37Z [load_day 2026-01-31] 2026-01-31 hour 11: 151387 events in 0 files, snapshot none (task 3845 ms: download 2197 ms overlapping gunzip 614 ms, parse 1779 ms, sort 0 ms, write 0 ms, index 615 ms: 7 candidates, 72648 repo-hours, 879 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:11:41Z [load_day 2026-01-31] 2026-01-31 hour 12: 155653 events in 0 files, snapshot none (task 3572 ms: download 2131 ms overlapping gunzip 472 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 761 ms: 9 candidates, 90017 repo-hours, 686 releases; waiting 552 ms; commit 0 ms)
2026-11-08T15:11:41Z [load_day 2026-01-31] 2026-01-31 hour 13: 149389 events in 0 files, snapshot none (task 3584 ms: download 2122 ms overlapping gunzip 482 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 762 ms: 7 candidates, 84649 repo-hours, 583 releases; waiting 520 ms; commit 0 ms)
2026-11-08T15:11:45Z [load_day 2026-01-31] 2026-01-31 hour 14: 150575 events in 0 files, snapshot none (task 4248 ms: download 2266 ms overlapping gunzip 615 ms, parse 1839 ms, sort 0 ms, write 0 ms, index 940 ms: 5 candidates, 76963 repo-hours, 796 releases; waiting 546 ms; commit 0 ms)
2026-11-08T15:11:46Z [load_day 2026-01-31] 2026-01-31 hour 15: 152957 events in 0 files, snapshot none (task 4434 ms: download 2298 ms overlapping gunzip 736 ms, parse 2143 ms, sort 0 ms, write 0 ms, index 637 ms: 3 candidates, 77625 repo-hours, 785 releases; waiting 468 ms; commit 0 ms)
2026-11-08T15:11:51Z [load_day 2026-01-31] 2026-01-31 hour 16: 150658 events in 0 files, snapshot none (task 4757 ms: download 2615 ms overlapping gunzip 734 ms, parse 2287 ms, sort 0 ms, write 0 ms, index 828 ms: 5 candidates, 76890 repo-hours, 778 releases; waiting 609 ms; commit 0 ms)
2026-11-08T15:11:51Z [load_day 2026-01-31] 2026-01-31 hour 17: 148417 events in 0 files, snapshot none (task 4275 ms: download 2712 ms overlapping gunzip 650 ms, parse 1961 ms, sort 0 ms, write 0 ms, index 801 ms: 8 candidates, 70136 repo-hours, 706 releases; waiting 542 ms; commit 0 ms)
2026-11-08T15:11:56Z [load_day 2026-01-31] 2026-01-31 hour 18: 153559 events in 0 files, snapshot none (task 4296 ms: download 2098 ms overlapping gunzip 612 ms, parse 2030 ms, sort 0 ms, write 0 ms, index 1035 ms: 5 candidates, 79317 repo-hours, 772 releases; waiting 308 ms; commit 0 ms)
2026-11-08T15:11:56Z [load_day 2026-01-31] 2026-01-31 hour 19: 150464 events in 0 files, snapshot none (task 4610 ms: download 2605 ms overlapping gunzip 736 ms, parse 2235 ms, sort 0 ms, write 0 ms, index 730 ms: 7 candidates, 69541 repo-hours, 776 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:11:59Z [load_day 2026-01-31] 2026-01-31 hour 20: 150451 events in 0 files, snapshot none (task 3248 ms: download 1983 ms overlapping gunzip 405 ms, parse 1261 ms, sort 0 ms, write 0 ms, index 640 ms: 8 candidates, 70496 repo-hours, 722 releases; waiting 637 ms; commit 0 ms)
2026-11-08T15:12:00Z [load_day 2026-01-31] 2026-01-31 hour 21: 148866 events in 0 files, snapshot none (task 2973 ms: download 1889 ms overlapping gunzip 423 ms, parse 1263 ms, sort 0 ms, write 0 ms, index 565 ms: 4 candidates, 67081 repo-hours, 750 releases; waiting 445 ms; commit 0 ms)
2026-11-08T15:12:03Z [load_day 2026-01-31] 2026-01-31 hour 22: 141210 events in 0 files, snapshot none (task 3411 ms: download 2264 ms overlapping gunzip 440 ms, parse 1335 ms, sort 0 ms, write 0 ms, index 468 ms: 8 candidates, 60965 repo-hours, 853 releases; waiting 831 ms; commit 0 ms)
2026-11-08T15:12:04Z [load_day 2026-01-31] 2026-01-31 hour 23: 145123 events in 0 files, snapshot none (task 3699 ms: download 2349 ms overlapping gunzip 408 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 484 ms: 5 candidates, 65238 repo-hours, 962 releases; waiting 1105 ms; commit 0 ms)
2026-11-08T15:12:11Z [load_day 2026-01-31] 2026-01-31: repo_hour merged from 24 files to 1 (1750180 rows, 7507 ms)
2026-11-08T15:12:14Z [load_day 2026-01-31] 2026-01-31: index committed in 10750 ms (24 + 1 + 24 files)
2026-11-08T15:12:14Z [load_day 2026-01-31] 2026-01-31: 3569212 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:12:14Z [load_day 2026-01-31] attempt 1 succeeded