orcaLog in

Runs · run 4568

load_day 2025-11-02, attempt 1 succeeded

Host
73ccef5e07c2:399947
Started
2026-11-08T14:22:29Z
Ended
2026-11-08T14:23:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
663 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
62.6 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4568/load_day/2025-11-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:22:29Z [load_day 2025-11-02] attempt 1 started
2026-11-08T14:22:30Z [load_day 2025-11-02] 2025-11-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:22:34Z [load_day 2025-11-02] 2025-11-02 hour 0: 137657 events in 0 files, snapshot none (task 3536 ms: download 1989 ms overlapping gunzip 538 ms, parse 1748 ms, sort 0 ms, write 0 ms, index 532 ms: 8 candidates, 66619 repo-hours, 840 releases; waiting 372 ms; commit 0 ms)
2026-11-08T14:22:34Z [load_day 2025-11-02] 2025-11-02 hour 1: 142231 events in 0 files, snapshot none (task 3792 ms: download 1928 ms overlapping gunzip 475 ms, parse 1766 ms, sort 0 ms, write 0 ms, index 660 ms: 5 candidates, 85479 repo-hours, 617 releases; waiting 446 ms; commit 0 ms)
2026-11-08T14:22:38Z [load_day 2025-11-02] 2025-11-02 hour 2: 136912 events in 0 files, snapshot none (task 3240 ms: download 2123 ms overlapping gunzip 398 ms, parse 1274 ms, sort 0 ms, write 0 ms, index 493 ms: 3 candidates, 63130 repo-hours, 713 releases; waiting 730 ms; commit 0 ms)
2026-11-08T14:22:38Z [load_day 2025-11-02] 2025-11-02 hour 3: 139381 events in 0 files, snapshot none (task 3069 ms: download 1731 ms overlapping gunzip 427 ms, parse 1311 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 58754 repo-hours, 1809 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:22:41Z [load_day 2025-11-02] 2025-11-02 hour 4: 138595 events in 0 files, snapshot none (task 2520 ms: download 1609 ms overlapping gunzip 294 ms, parse 988 ms, sort 0 ms, write 0 ms, index 398 ms: 4 candidates, 55243 repo-hours, 533 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:22:42Z [load_day 2025-11-02] 2025-11-02 hour 5: 133636 events in 0 files, snapshot none (task 3532 ms: download 2310 ms overlapping gunzip 276 ms, parse 900 ms, sort 0 ms, write 0 ms, index 410 ms: 5 candidates, 54889 repo-hours, 465 releases; waiting 1642 ms; commit 0 ms)
2026-11-08T14:22:44Z [load_day 2025-11-02] 2025-11-02 hour 6: 139399 events in 0 files, snapshot none (task 2679 ms: download 1728 ms overlapping gunzip 271 ms, parse 877 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 66255 repo-hours, 513 releases; waiting 799 ms; commit 0 ms)
2026-11-08T14:22:46Z [load_day 2025-11-02] 2025-11-02 hour 7: 133750 events in 0 files, snapshot none (task 2605 ms: download 1714 ms overlapping gunzip 268 ms, parse 876 ms, sort 0 ms, write 0 ms, index 401 ms: 1 candidates, 55322 repo-hours, 408 releases; waiting 727 ms; commit 0 ms)
2026-11-08T14:22:46Z [load_day 2025-11-02] 2025-11-02 hour 8: 12954 events in 0 files, snapshot none (task 1107 ms: download 746 ms overlapping gunzip 46 ms, parse 188 ms, sort 0 ms, write 0 ms, index 95 ms: 0 candidates, 9173 repo-hours, 493 releases; waiting 564 ms; commit 0 ms)
2026-11-08T14:22:51Z [load_day 2025-11-02] 2025-11-02 hour 9: 263182 events in 0 files, snapshot none (task 3988 ms: download 2210 ms overlapping gunzip 521 ms, parse 1697 ms, sort 0 ms, write 0 ms, index 991 ms: 5 candidates, 97001 repo-hours, 528 releases; waiting 421 ms; commit 0 ms)
2026-11-08T14:22:51Z [load_day 2025-11-02] 2025-11-02 hour 10: 144114 events in 0 files, snapshot none (task 4074 ms: download 2134 ms overlapping gunzip 336 ms, parse 1171 ms, sort 0 ms, write 0 ms, index 745 ms: 6 candidates, 64552 repo-hours, 489 releases; waiting 1234 ms; commit 0 ms)
2026-11-08T14:22:54Z [load_day 2025-11-02] 2025-11-02 hour 11: 150006 events in 0 files, snapshot none (task 2976 ms: download 1937 ms overlapping gunzip 321 ms, parse 1035 ms, sort 0 ms, write 0 ms, index 678 ms: 4 candidates, 65077 repo-hours, 462 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:22:55Z [load_day 2025-11-02] 2025-11-02 hour 12: 157420 events in 0 files, snapshot none (task 3585 ms: download 2126 ms overlapping gunzip 350 ms, parse 1119 ms, sort 0 ms, write 0 ms, index 694 ms: 8 candidates, 90961 repo-hours, 480 releases; waiting 1087 ms; commit 0 ms)
2026-11-08T14:22:58Z [load_day 2025-11-02] 2025-11-02 hour 13: 151544 events in 0 files, snapshot none (task 2832 ms: download 1725 ms overlapping gunzip 310 ms, parse 982 ms, sort 0 ms, write 0 ms, index 675 ms: 2 candidates, 79505 repo-hours, 452 releases; waiting 603 ms; commit 0 ms)
2026-11-08T14:22:58Z [load_day 2025-11-02] 2025-11-02 hour 14: 146923 events in 0 files, snapshot none (task 2960 ms: download 1780 ms overlapping gunzip 334 ms, parse 1097 ms, sort 0 ms, write 0 ms, index 622 ms: 5 candidates, 70595 repo-hours, 579 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:23:01Z [load_day 2025-11-02] 2025-11-02 hour 15: 150767 events in 0 files, snapshot none (task 3142 ms: download 1870 ms overlapping gunzip 338 ms, parse 1062 ms, sort 0 ms, write 0 ms, index 709 ms: 5 candidates, 72212 repo-hours, 604 releases; waiting 699 ms; commit 0 ms)
2026-11-08T14:23:03Z [load_day 2025-11-02] 2025-11-02 hour 16: 147237 events in 0 files, snapshot none (task 3681 ms: download 2387 ms overlapping gunzip 398 ms, parse 1216 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 71381 repo-hours, 554 releases; waiting 1026 ms; commit 0 ms)
2026-11-08T14:23:05Z [load_day 2025-11-02] 2025-11-02 hour 17: 147086 events in 0 files, snapshot none (task 3364 ms: download 2240 ms overlapping gunzip 360 ms, parse 1083 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 67503 repo-hours, 521 releases; waiting 998 ms; commit 0 ms)
2026-11-08T14:23:07Z [load_day 2025-11-02] 2025-11-02 hour 18: 151750 events in 0 files, snapshot none (task 3310 ms: download 1979 ms overlapping gunzip 362 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 592 ms: 4 candidates, 73398 repo-hours, 658 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:23:09Z [load_day 2025-11-02] 2025-11-02 hour 19: 149415 events in 0 files, snapshot none (task 2981 ms: download 1798 ms overlapping gunzip 334 ms, parse 1087 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 65593 repo-hours, 550 releases; waiting 615 ms; commit 0 ms)
2026-11-08T14:23:10Z [load_day 2025-11-02] 2025-11-02 hour 20: 147787 events in 0 files, snapshot none (task 2737 ms: download 1587 ms overlapping gunzip 325 ms, parse 1020 ms, sort 0 ms, write 0 ms, index 571 ms: 4 candidates, 65974 repo-hours, 573 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:23:12Z [load_day 2025-11-02] 2025-11-02 hour 21: 142784 events in 0 files, snapshot none (task 2830 ms: download 1849 ms overlapping gunzip 344 ms, parse 1113 ms, sort 0 ms, write 0 ms, index 462 ms: 5 candidates, 62299 repo-hours, 625 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:23:13Z [load_day 2025-11-02] 2025-11-02 hour 22: 139391 events in 0 files, snapshot none (task 2879 ms: download 1948 ms overlapping gunzip 308 ms, parse 1015 ms, sort 0 ms, write 0 ms, index 428 ms: 17 candidates, 58159 repo-hours, 600 releases; waiting 838 ms; commit 0 ms)
2026-11-08T14:23:16Z [load_day 2025-11-02] 2025-11-02 hour 23: 138921 events in 0 files, snapshot none (task 3317 ms: download 2406 ms overlapping gunzip 365 ms, parse 1123 ms, sort 0 ms, write 0 ms, index 485 ms: 11 candidates, 57800 repo-hours, 590 releases; waiting 1033 ms; commit 0 ms)
2026-11-08T14:23:23Z [load_day 2025-11-02] 2025-11-02: repo_hour merged from 24 files to 1 (1576874 rows, 7321 ms)
2026-11-08T14:23:26Z [load_day 2025-11-02] 2025-11-02: index committed in 10271 ms (23 + 1 + 24 files)
2026-11-08T14:23:26Z [load_day 2025-11-02] 2025-11-02: 3442842 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:23:26Z [load_day 2025-11-02] attempt 1 succeeded