orcaLog in

Runs · run 4823

load_day 2026-01-14, attempt 1 succeeded

Host
73ccef5e07c2:429341
Started
2026-11-08T15:01:48Z
Ended
2026-11-08T15:02:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
734 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
76.0 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4823/load_day/2026-01-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:01:48Z [load_day 2026-01-14] attempt 1 started
2026-11-08T15:01:49Z [load_day 2026-01-14] 2026-01-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:01:53Z [load_day 2026-01-14] 2026-01-14 hour 0: 145423 events in 0 files, snapshot none (task 3487 ms: download 2244 ms overlapping gunzip 443 ms, parse 1325 ms, sort 0 ms, write 0 ms, index 623 ms: 5 candidates, 71729 repo-hours, 895 releases; waiting 786 ms; commit 0 ms)
2026-11-08T15:01:54Z [load_day 2026-01-14] 2026-01-14 hour 1: 152848 events in 0 files, snapshot none (task 4235 ms: download 2408 ms overlapping gunzip 385 ms, parse 1253 ms, sort 0 ms, write 0 ms, index 741 ms: 11 candidates, 89866 repo-hours, 756 releases; waiting 1519 ms; commit 0 ms)
2026-11-08T15:01:58Z [load_day 2026-01-14] 2026-01-14 hour 2: 149260 events in 0 files, snapshot none (task 3898 ms: download 2852 ms overlapping gunzip 455 ms, parse 1381 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 81984 repo-hours, 833 releases; waiting 1136 ms; commit 0 ms)
2026-11-08T15:01:58Z [load_day 2026-01-14] 2026-01-14 hour 3: 143132 events in 0 files, snapshot none (task 3141 ms: download 2041 ms overlapping gunzip 413 ms, parse 1262 ms, sort 0 ms, write 0 ms, index 542 ms: 8 candidates, 66327 repo-hours, 841 releases; waiting 619 ms; commit 0 ms)
2026-11-08T15:02:04Z [load_day 2026-01-14] 2026-01-14 hour 4: 145204 events in 0 files, snapshot none (task 5870 ms: download 3631 ms overlapping gunzip 478 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 1138 ms: 7 candidates, 74391 repo-hours, 1520 releases; waiting 2459 ms; commit 0 ms)
2026-11-08T15:02:04Z [load_day 2026-01-14] 2026-01-14 hour 5: 146768 events in 0 files, snapshot none (task 4006 ms: download 2523 ms overlapping gunzip 635 ms, parse 1854 ms, sort 0 ms, write 0 ms, index 682 ms: 7 candidates, 71162 repo-hours, 778 releases; waiting 489 ms; commit 0 ms)
2026-11-08T15:02:10Z [load_day 2026-01-14] 2026-01-14 hour 6: 147682 events in 0 files, snapshot none (task 4642 ms: download 2333 ms overlapping gunzip 706 ms, parse 2187 ms, sort 0 ms, write 0 ms, index 887 ms: 7 candidates, 78897 repo-hours, 799 releases; waiting 566 ms; commit 0 ms)
2026-11-08T15:02:10Z [load_day 2026-01-14] 2026-01-14 hour 7: 148488 events in 0 files, snapshot none (task 4712 ms: download 2639 ms overlapping gunzip 609 ms, parse 1935 ms, sort 0 ms, write 0 ms, index 1008 ms: 6 candidates, 77491 repo-hours, 614 releases; waiting 864 ms; commit 0 ms)
2026-11-08T15:02:15Z [load_day 2026-01-14] 2026-01-14 hour 8: 144641 events in 0 files, snapshot none (task 4504 ms: download 2589 ms overlapping gunzip 812 ms, parse 2143 ms, sort 0 ms, write 0 ms, index 742 ms: 9 candidates, 75651 repo-hours, 769 releases; waiting 554 ms; commit 0 ms)
2026-11-08T15:02:15Z [load_day 2026-01-14] 2026-01-14 hour 9: 149253 events in 0 files, snapshot none (task 4547 ms: download 2634 ms overlapping gunzip 736 ms, parse 2199 ms, sort 0 ms, write 0 ms, index 634 ms: 9 candidates, 81528 repo-hours, 821 releases; waiting 660 ms; commit 0 ms)
2026-11-08T15:02:19Z [load_day 2026-01-14] 2026-01-14 hour 10: 142489 events in 0 files, snapshot none (task 4132 ms: download 2463 ms overlapping gunzip 677 ms, parse 1953 ms, sort 0 ms, write 0 ms, index 630 ms: 8 candidates, 78501 repo-hours, 655 releases; waiting 548 ms; commit 0 ms)
2026-11-08T15:02:19Z [load_day 2026-01-14] 2026-01-14 hour 11: 146064 events in 0 files, snapshot none (task 3780 ms: download 2543 ms overlapping gunzip 544 ms, parse 1510 ms, sort 0 ms, write 0 ms, index 651 ms: 6 candidates, 73210 repo-hours, 573 releases; waiting 772 ms; commit 0 ms)
2026-11-08T15:02:24Z [load_day 2026-01-14] 2026-01-14 hour 12: 155473 events in 0 files, snapshot none (task 4248 ms: download 2463 ms overlapping gunzip 476 ms, parse 1419 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 94541 repo-hours, 402 releases; waiting 1314 ms; commit 0 ms)
2026-11-08T15:02:24Z [load_day 2026-01-14] 2026-01-14 hour 13: 152312 events in 0 files, snapshot none (task 3977 ms: download 2491 ms overlapping gunzip 422 ms, parse 1390 ms, sort 0 ms, write 0 ms, index 940 ms: 6 candidates, 90166 repo-hours, 469 releases; waiting 908 ms; commit 0 ms)
2026-11-08T15:02:28Z [load_day 2026-01-14] 2026-01-14 hour 14: 150922 events in 0 files, snapshot none (task 3478 ms: download 2261 ms overlapping gunzip 385 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 627 ms: 12 candidates, 85215 repo-hours, 607 releases; waiting 952 ms; commit 0 ms)
2026-11-08T15:02:29Z [load_day 2026-01-14] 2026-01-14 hour 15: 145914 events in 0 files, snapshot none (task 3720 ms: download 2461 ms overlapping gunzip 393 ms, parse 1241 ms, sort 0 ms, write 0 ms, index 660 ms: 7 candidates, 83186 repo-hours, 575 releases; waiting 1107 ms; commit 0 ms)
2026-11-08T15:02:32Z [load_day 2026-01-14] 2026-01-14 hour 16: 147103 events in 0 files, snapshot none (task 3281 ms: download 1900 ms overlapping gunzip 413 ms, parse 1323 ms, sort 0 ms, write 0 ms, index 692 ms: 6 candidates, 83186 repo-hours, 617 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:02:32Z [load_day 2026-01-14] 2026-01-14 hour 17: 143768 events in 0 files, snapshot none (task 3417 ms: download 2201 ms overlapping gunzip 463 ms, parse 1392 ms, sort 0 ms, write 0 ms, index 625 ms: 7 candidates, 76828 repo-hours, 708 releases; waiting 617 ms; commit 0 ms)
2026-11-08T15:02:36Z [load_day 2026-01-14] 2026-01-14 hour 18: 145644 events in 0 files, snapshot none (task 3544 ms: download 2247 ms overlapping gunzip 399 ms, parse 1217 ms, sort 0 ms, write 0 ms, index 686 ms: 8 candidates, 83377 repo-hours, 696 releases; waiting 714 ms; commit 0 ms)
2026-11-08T15:02:36Z [load_day 2026-01-14] 2026-01-14 hour 19: 142151 events in 0 files, snapshot none (task 3628 ms: download 2664 ms overlapping gunzip 472 ms, parse 1324 ms, sort 0 ms, write 0 ms, index 602 ms: 8 candidates, 72832 repo-hours, 687 releases; waiting 983 ms; commit 0 ms)
2026-11-08T15:02:40Z [load_day 2026-01-14] 2026-01-14 hour 20: 142088 events in 0 files, snapshot none (task 3805 ms: download 2659 ms overlapping gunzip 430 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 630 ms: 14 candidates, 71719 repo-hours, 731 releases; waiting 1045 ms; commit 0 ms)
2026-11-08T15:02:40Z [load_day 2026-01-14] 2026-01-14 hour 21: 148409 events in 0 files, snapshot none (task 2919 ms: download 1683 ms overlapping gunzip 401 ms, parse 1192 ms, sort 0 ms, write 0 ms, index 678 ms: 11 candidates, 71694 repo-hours, 854 releases; waiting 306 ms; commit 0 ms)
2026-11-08T15:02:45Z [load_day 2026-01-14] 2026-01-14 hour 22: 143249 events in 0 files, snapshot none (task 4094 ms: download 2589 ms overlapping gunzip 548 ms, parse 1669 ms, sort 0 ms, write 0 ms, index 555 ms: 10 candidates, 69947 repo-hours, 886 releases; waiting 1020 ms; commit 0 ms)
2026-11-08T15:02:45Z [load_day 2026-01-14] 2026-01-14 hour 23: 142299 events in 0 files, snapshot none (task 3985 ms: download 2918 ms overlapping gunzip 486 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 67738 repo-hours, 909 releases; waiting 1134 ms; commit 0 ms)
2026-11-08T15:02:53Z [load_day 2026-01-14] 2026-01-14: repo_hour merged from 24 files to 1 (1871166 rows, 8037 ms)
2026-11-08T15:02:56Z [load_day 2026-01-14] 2026-01-14: index committed in 11199 ms (24 + 1 + 24 files)
2026-11-08T15:02:56Z [load_day 2026-01-14] 2026-01-14: 3520584 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:02:56Z [load_day 2026-01-14] attempt 1 succeeded