orcaLog in

Runs · run 4773

load_day 2025-12-31, attempt 1 succeeded

Host
73ccef5e07c2:423666
Started
2026-11-08T14:54:13Z
Ended
2026-11-08T14:55:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
732 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.2 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4773/load_day/2025-12-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:54:13Z [load_day 2025-12-31] attempt 1 started
2026-11-08T14:54:14Z [load_day 2025-12-31] 2025-12-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:54:18Z [load_day 2025-12-31] 2025-12-31 hour 0: 144371 events in 0 files, snapshot none (task 3183 ms: download 1728 ms overlapping gunzip 503 ms, parse 1542 ms, sort 0 ms, write 0 ms, index 556 ms: 12 candidates, 69039 repo-hours, 894 releases; waiting 262 ms; commit 0 ms)
2026-11-08T14:54:18Z [load_day 2025-12-31] 2025-12-31 hour 1: 147952 events in 0 files, snapshot none (task 3360 ms: download 2010 ms overlapping gunzip 470 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 608 ms: 8 candidates, 87877 repo-hours, 702 releases; waiting 506 ms; commit 0 ms)
2026-11-08T14:54:22Z [load_day 2025-12-31] 2025-12-31 hour 2: 143839 events in 0 files, snapshot none (task 3194 ms: download 1693 ms overlapping gunzip 461 ms, parse 1453 ms, sort 0 ms, write 0 ms, index 653 ms: 6 candidates, 74524 repo-hours, 809 releases; waiting 332 ms; commit 0 ms)
2026-11-08T14:54:22Z [load_day 2025-12-31] 2025-12-31 hour 3: 140948 events in 0 files, snapshot none (task 3528 ms: download 2327 ms overlapping gunzip 454 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 527 ms: 10 candidates, 66218 repo-hours, 848 releases; waiting 855 ms; commit 0 ms)
2026-11-08T14:54:25Z [load_day 2025-12-31] 2025-12-31 hour 4: 141421 events in 0 files, snapshot none (task 2989 ms: download 1390 ms overlapping gunzip 366 ms, parse 1206 ms, sort 0 ms, write 0 ms, index 842 ms: 10 candidates, 69218 repo-hours, 1672 releases; waiting 249 ms; commit 0 ms)
2026-11-08T14:54:25Z [load_day 2025-12-31] 2025-12-31 hour 5: 139193 events in 0 files, snapshot none (task 2984 ms: download 1988 ms overlapping gunzip 383 ms, parse 1183 ms, sort 0 ms, write 0 ms, index 587 ms: 5 candidates, 66984 repo-hours, 735 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:54:29Z [load_day 2025-12-31] 2025-12-31 hour 6: 149213 events in 0 files, snapshot none (task 3490 ms: download 2146 ms overlapping gunzip 415 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 778 ms: 6 candidates, 77011 repo-hours, 775 releases; waiting 647 ms; commit 0 ms)
2026-11-08T14:54:30Z [load_day 2025-12-31] 2025-12-31 hour 7: 146080 events in 0 files, snapshot none (task 3897 ms: download 2442 ms overlapping gunzip 545 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 574 ms: 7 candidates, 67090 repo-hours, 665 releases; waiting 925 ms; commit 0 ms)
2026-11-08T14:54:34Z [load_day 2025-12-31] 2025-12-31 hour 8: 146561 events in 0 files, snapshot none (task 4227 ms: download 2584 ms overlapping gunzip 507 ms, parse 1536 ms, sort 0 ms, write 0 ms, index 564 ms: 11 candidates, 74325 repo-hours, 696 releases; waiting 1200 ms; commit 0 ms)
2026-11-08T14:54:34Z [load_day 2025-12-31] 2025-12-31 hour 9: 146815 events in 0 files, snapshot none (task 3464 ms: download 2124 ms overlapping gunzip 498 ms, parse 1516 ms, sort 0 ms, write 0 ms, index 592 ms: 8 candidates, 73116 repo-hours, 857 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:54:38Z [load_day 2025-12-31] 2025-12-31 hour 10: 145436 events in 0 files, snapshot none (task 3805 ms: download 2436 ms overlapping gunzip 527 ms, parse 1683 ms, sort 0 ms, write 0 ms, index 581 ms: 7 candidates, 71943 repo-hours, 667 releases; waiting 640 ms; commit 0 ms)
2026-11-08T14:54:38Z [load_day 2025-12-31] 2025-12-31 hour 11: 150145 events in 0 files, snapshot none (task 3621 ms: download 2512 ms overlapping gunzip 529 ms, parse 1521 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 68543 repo-hours, 596 releases; waiting 668 ms; commit 0 ms)
2026-11-08T14:54:42Z [load_day 2025-12-31] 2025-12-31 hour 12: 150366 events in 0 files, snapshot none (task 3396 ms: download 1833 ms overlapping gunzip 509 ms, parse 1587 ms, sort 0 ms, write 0 ms, index 748 ms: 3 candidates, 88093 repo-hours, 616 releases; waiting 250 ms; commit 0 ms)
2026-11-08T14:54:42Z [load_day 2025-12-31] 2025-12-31 hour 13: 149295 events in 0 files, snapshot none (task 3625 ms: download 2471 ms overlapping gunzip 519 ms, parse 1457 ms, sort 0 ms, write 0 ms, index 733 ms: 4 candidates, 83279 repo-hours, 554 releases; waiting 605 ms; commit 0 ms)
2026-11-08T14:54:46Z [load_day 2025-12-31] 2025-12-31 hour 14: 148186 events in 0 files, snapshot none (task 3181 ms: download 1929 ms overlapping gunzip 458 ms, parse 1388 ms, sort 0 ms, write 0 ms, index 702 ms: 8 candidates, 73575 repo-hours, 757 releases; waiting 336 ms; commit 0 ms)
2026-11-08T14:54:46Z [load_day 2025-12-31] 2025-12-31 hour 15: 149397 events in 0 files, snapshot none (task 3621 ms: download 2392 ms overlapping gunzip 538 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 621 ms: 8 candidates, 74092 repo-hours, 782 releases; waiting 619 ms; commit 0 ms)
2026-11-08T14:54:50Z [load_day 2025-12-31] 2025-12-31 hour 16: 146399 events in 0 files, snapshot none (task 3876 ms: download 2652 ms overlapping gunzip 404 ms, parse 1256 ms, sort 0 ms, write 0 ms, index 630 ms: 7 candidates, 71514 repo-hours, 775 releases; waiting 1231 ms; commit 0 ms)
2026-11-08T14:54:50Z [load_day 2025-12-31] 2025-12-31 hour 17: 149677 events in 0 files, snapshot none (task 3630 ms: download 2465 ms overlapping gunzip 410 ms, parse 1254 ms, sort 0 ms, write 0 ms, index 579 ms: 8 candidates, 69655 repo-hours, 678 releases; waiting 1052 ms; commit 0 ms)
2026-11-08T14:54:54Z [load_day 2025-12-31] 2025-12-31 hour 18: 159331 events in 0 files, snapshot none (task 3687 ms: download 2291 ms overlapping gunzip 334 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 715 ms: 7 candidates, 80825 repo-hours, 603 releases; waiting 1082 ms; commit 0 ms)
2026-11-08T14:54:54Z [load_day 2025-12-31] 2025-12-31 hour 19: 156563 events in 0 files, snapshot none (task 2911 ms: download 1839 ms overlapping gunzip 271 ms, parse 1042 ms, sort 0 ms, write 0 ms, index 564 ms: 7 candidates, 75663 repo-hours, 312 releases; waiting 704 ms; commit 0 ms)
2026-11-08T14:54:58Z [load_day 2025-12-31] 2025-12-31 hour 20: 158620 events in 0 files, snapshot none (task 3019 ms: download 1823 ms overlapping gunzip 289 ms, parse 1133 ms, sort 0 ms, write 0 ms, index 665 ms: 6 candidates, 76668 repo-hours, 318 releases; waiting 584 ms; commit 0 ms)
2026-11-08T14:54:58Z [load_day 2025-12-31] 2025-12-31 hour 21: 161046 events in 0 files, snapshot none (task 2937 ms: download 1993 ms overlapping gunzip 351 ms, parse 1176 ms, sort 0 ms, write 0 ms, index 601 ms: 4 candidates, 73889 repo-hours, 310 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:55:02Z [load_day 2025-12-31] 2025-12-31 hour 22: 141379 events in 0 files, snapshot none (task 3990 ms: download 2757 ms overlapping gunzip 481 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 513 ms: 5 candidates, 56624 repo-hours, 723 releases; waiting 1199 ms; commit 0 ms)
2026-11-08T14:55:02Z [load_day 2025-12-31] 2025-12-31 hour 23: 135562 events in 0 files, snapshot none (task 3578 ms: download 1709 ms overlapping gunzip 472 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 710 ms: 2 candidates, 56101 repo-hours, 757 releases; waiting 311 ms; commit 0 ms)
2026-11-08T14:55:10Z [load_day 2025-12-31] 2025-12-31: repo_hour merged from 24 files to 1 (1745866 rows, 8291 ms)
2026-11-08T14:55:13Z [load_day 2025-12-31] 2025-12-31: index committed in 11086 ms (24 + 1 + 24 files)
2026-11-08T14:55:13Z [load_day 2025-12-31] 2025-12-31: 3547795 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:55:13Z [load_day 2025-12-31] attempt 1 succeeded