orcaLog in

Runs · run 4979

load_day 2026-02-27, attempt 1 succeeded

Host
73ccef5e07c2:448806
Started
2026-11-08T15:26:23Z
Ended
2026-11-08T15:27:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
736 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.3 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4979/load_day/2026-02-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:26:23Z [load_day 2026-02-27] attempt 1 started
2026-11-08T15:26:24Z [load_day 2026-02-27] 2026-02-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:26:28Z [load_day 2026-02-27] 2026-02-27 hour 0: 145462 events in 0 files, snapshot none (task 3213 ms: download 2020 ms overlapping gunzip 461 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 582 ms: 6 candidates, 74114 repo-hours, 1131 releases; waiting 471 ms; commit 0 ms)
2026-11-08T15:26:28Z [load_day 2026-02-27] 2026-02-27 hour 1: 158630 events in 0 files, snapshot none (task 3973 ms: download 2337 ms overlapping gunzip 423 ms, parse 1459 ms, sort 0 ms, write 0 ms, index 699 ms: 9 candidates, 94031 repo-hours, 714 releases; waiting 1124 ms; commit 0 ms)
2026-11-08T15:26:32Z [load_day 2026-02-27] 2026-02-27 hour 2: 157589 events in 0 files, snapshot none (task 3413 ms: download 2280 ms overlapping gunzip 383 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 647 ms: 4 candidates, 89435 repo-hours, 709 releases; waiting 892 ms; commit 0 ms)
2026-11-08T15:26:33Z [load_day 2026-02-27] 2026-02-27 hour 3: 152075 events in 0 files, snapshot none (task 4051 ms: download 2742 ms overlapping gunzip 418 ms, parse 1269 ms, sort 0 ms, write 0 ms, index 574 ms: 8 candidates, 73331 repo-hours, 1021 releases; waiting 1466 ms; commit 0 ms)
2026-11-08T15:26:36Z [load_day 2026-02-27] 2026-02-27 hour 4: 152892 events in 0 files, snapshot none (task 3579 ms: download 2359 ms overlapping gunzip 441 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 656 ms: 7 candidates, 76499 repo-hours, 1892 releases; waiting 748 ms; commit 0 ms)
2026-11-08T15:26:37Z [load_day 2026-02-27] 2026-02-27 hour 5: 149294 events in 0 files, snapshot none (task 3114 ms: download 1743 ms overlapping gunzip 429 ms, parse 1279 ms, sort 0 ms, write 0 ms, index 619 ms: 8 candidates, 75937 repo-hours, 1125 releases; waiting 495 ms; commit 0 ms)
2026-11-08T15:26:40Z [load_day 2026-02-27] 2026-02-27 hour 6: 150605 events in 0 files, snapshot none (task 3842 ms: download 2319 ms overlapping gunzip 471 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 748 ms: 8 candidates, 82460 repo-hours, 992 releases; waiting 832 ms; commit 0 ms)
2026-11-08T15:26:41Z [load_day 2026-02-27] 2026-02-27 hour 7: 149808 events in 0 files, snapshot none (task 3448 ms: download 2062 ms overlapping gunzip 391 ms, parse 1237 ms, sort 0 ms, write 0 ms, index 787 ms: 6 candidates, 81930 repo-hours, 897 releases; waiting 712 ms; commit 0 ms)
2026-11-08T15:26:44Z [load_day 2026-02-27] 2026-02-27 hour 8: 151499 events in 0 files, snapshot none (task 3574 ms: download 2369 ms overlapping gunzip 450 ms, parse 1388 ms, sort 0 ms, write 0 ms, index 646 ms: 6 candidates, 83797 repo-hours, 799 releases; waiting 806 ms; commit 0 ms)
2026-11-08T15:26:44Z [load_day 2026-02-27] 2026-02-27 hour 9: 146854 events in 0 files, snapshot none (task 3356 ms: download 2208 ms overlapping gunzip 362 ms, parse 1144 ms, sort 0 ms, write 0 ms, index 672 ms: 6 candidates, 83844 repo-hours, 625 releases; waiting 779 ms; commit 0 ms)
2026-11-08T15:26:49Z [load_day 2026-02-27] 2026-02-27 hour 10: 149597 events in 0 files, snapshot none (task 3832 ms: download 2355 ms overlapping gunzip 614 ms, parse 1816 ms, sort 0 ms, write 0 ms, index 605 ms: 7 candidates, 81837 repo-hours, 747 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:26:49Z [load_day 2026-02-27] 2026-02-27 hour 11: 153726 events in 0 files, snapshot none (task 3967 ms: download 2319 ms overlapping gunzip 607 ms, parse 1792 ms, sort 0 ms, write 0 ms, index 669 ms: 6 candidates, 84171 repo-hours, 827 releases; waiting 543 ms; commit 0 ms)
2026-11-08T15:26:52Z [load_day 2026-02-27] 2026-02-27 hour 12: 159886 events in 0 files, snapshot none (task 3162 ms: download 1373 ms overlapping gunzip 410 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 917 ms: 6 candidates, 98507 repo-hours, 537 releases; waiting 271 ms; commit 0 ms)
2026-11-08T15:26:52Z [load_day 2026-02-27] 2026-02-27 hour 13: 157912 events in 0 files, snapshot none (task 2843 ms: download 1219 ms overlapping gunzip 384 ms, parse 1165 ms, sort 0 ms, write 0 ms, index 791 ms: 7 candidates, 99177 repo-hours, 355 releases; waiting 234 ms; commit 0 ms)
2026-11-08T15:26:57Z [load_day 2026-02-27] 2026-02-27 hour 14: 157925 events in 0 files, snapshot none (task 3792 ms: download 2078 ms overlapping gunzip 460 ms, parse 1417 ms, sort 0 ms, write 0 ms, index 896 ms: 3 candidates, 91744 repo-hours, 430 releases; waiting 682 ms; commit 0 ms)
2026-11-08T15:26:57Z [load_day 2026-02-27] 2026-02-27 hour 15: 153947 events in 0 files, snapshot none (task 3369 ms: download 1867 ms overlapping gunzip 407 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 918 ms: 7 candidates, 86299 repo-hours, 469 releases; waiting 575 ms; commit 0 ms)
2026-11-08T15:27:01Z [load_day 2026-02-27] 2026-02-27 hour 16: 161062 events in 0 files, snapshot none (task 3850 ms: download 2041 ms overlapping gunzip 496 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 779 ms: 10 candidates, 90335 repo-hours, 482 releases; waiting 678 ms; commit 0 ms)
2026-11-08T15:27:01Z [load_day 2026-02-27] 2026-02-27 hour 17: 159167 events in 0 files, snapshot none (task 3399 ms: download 2076 ms overlapping gunzip 403 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 87711 repo-hours, 489 releases; waiting 479 ms; commit 0 ms)
2026-11-08T15:27:05Z [load_day 2026-02-27] 2026-02-27 hour 18: 152490 events in 0 files, snapshot none (task 3337 ms: download 2111 ms overlapping gunzip 351 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 799 ms: 9 candidates, 86817 repo-hours, 492 releases; waiting 729 ms; commit 0 ms)
2026-11-08T15:27:08Z [load_day 2026-02-27] 2026-02-27 hour 19: 152442 events in 0 files, snapshot none (task 6856 ms: download 4864 ms overlapping gunzip 568 ms, parse 1741 ms, sort 0 ms, write 0 ms, index 1064 ms: 11 candidates, 81725 repo-hours, 711 releases; waiting 3127 ms; commit 0 ms)
2026-11-08T15:27:09Z [load_day 2026-02-27] 2026-02-27 hour 20: 151162 events in 0 files, snapshot none (task 3581 ms: download 2087 ms overlapping gunzip 509 ms, parse 1582 ms, sort 0 ms, write 0 ms, index 638 ms: 5 candidates, 78204 repo-hours, 819 releases; waiting 569 ms; commit 0 ms)
2026-11-08T15:27:13Z [load_day 2026-02-27] 2026-02-27 hour 21: 150545 events in 0 files, snapshot none (task 4091 ms: download 2242 ms overlapping gunzip 535 ms, parse 1534 ms, sort 0 ms, write 0 ms, index 914 ms: 6 candidates, 77155 repo-hours, 1093 releases; waiting 826 ms; commit 0 ms)
2026-11-08T15:27:14Z [load_day 2026-02-27] 2026-02-27 hour 22: 151597 events in 0 files, snapshot none (task 4023 ms: download 2677 ms overlapping gunzip 568 ms, parse 1850 ms, sort 0 ms, write 0 ms, index 707 ms: 6 candidates, 75483 repo-hours, 1185 releases; waiting 652 ms; commit 0 ms)
2026-11-08T15:27:17Z [load_day 2026-02-27] 2026-02-27 hour 23: 151620 events in 0 files, snapshot none (task 3689 ms: download 2238 ms overlapping gunzip 457 ms, parse 1459 ms, sort 0 ms, write 0 ms, index 666 ms: 5 candidates, 71874 repo-hours, 1123 releases; waiting 831 ms; commit 0 ms)
2026-11-08T15:27:27Z [load_day 2026-02-27] 2026-02-27: repo_hour merged from 24 files to 1 (2006417 rows, 9800 ms)
2026-11-08T15:27:30Z [load_day 2026-02-27] 2026-02-27: index committed in 12636 ms (24 + 1 + 24 files)
2026-11-08T15:27:30Z [load_day 2026-02-27] 2026-02-27: 3677786 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:27:30Z [load_day 2026-02-27] attempt 1 succeeded