orcaLog in

Runs · run 4668

load_day 2025-11-30, attempt 1 succeeded

Host
73ccef5e07c2:410859
Started
2026-11-08T14:37:21Z
Ended
2026-11-08T14:38:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
675 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.8 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4668/load_day/2025-11-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:37:21Z [load_day 2025-11-30] attempt 1 started
2026-11-08T14:37:22Z [load_day 2025-11-30] 2025-11-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:37:27Z [load_day 2025-11-30] 2025-11-30 hour 0: 139971 events in 0 files, snapshot none (task 3840 ms: download 2448 ms overlapping gunzip 489 ms, parse 1788 ms, sort 0 ms, write 0 ms, index 527 ms: 2 candidates, 64904 repo-hours, 831 releases; waiting 738 ms; commit 0 ms)
2026-11-08T14:37:27Z [load_day 2025-11-30] 2025-11-30 hour 1: 145079 events in 0 files, snapshot none (task 3791 ms: download 2100 ms overlapping gunzip 491 ms, parse 1852 ms, sort 0 ms, write 0 ms, index 661 ms: 5 candidates, 85464 repo-hours, 587 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:37:30Z [load_day 2025-11-30] 2025-11-30 hour 2: 142546 events in 0 files, snapshot none (task 3226 ms: download 2035 ms overlapping gunzip 339 ms, parse 1144 ms, sort 0 ms, write 0 ms, index 622 ms: 16 candidates, 70409 repo-hours, 669 releases; waiting 762 ms; commit 0 ms)
2026-11-08T14:37:31Z [load_day 2025-11-30] 2025-11-30 hour 3: 141057 events in 0 files, snapshot none (task 3427 ms: download 2303 ms overlapping gunzip 373 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 533 ms: 7 candidates, 64560 repo-hours, 728 releases; waiting 950 ms; commit 0 ms)
2026-11-08T14:37:34Z [load_day 2025-11-30] 2025-11-30 hour 4: 144384 events in 0 files, snapshot none (task 3285 ms: download 2119 ms overlapping gunzip 386 ms, parse 1170 ms, sort 0 ms, write 0 ms, index 570 ms: 9 candidates, 65767 repo-hours, 1305 releases; waiting 884 ms; commit 0 ms)
2026-11-08T14:37:34Z [load_day 2025-11-30] 2025-11-30 hour 5: 140283 events in 0 files, snapshot none (task 2963 ms: download 2057 ms overlapping gunzip 390 ms, parse 1174 ms, sort 0 ms, write 0 ms, index 453 ms: 4 candidates, 59349 repo-hours, 563 releases; waiting 646 ms; commit 0 ms)
2026-11-08T14:37:37Z [load_day 2025-11-30] 2025-11-30 hour 6: 144629 events in 0 files, snapshot none (task 2863 ms: download 1762 ms overlapping gunzip 319 ms, parse 1007 ms, sort 0 ms, write 0 ms, index 622 ms: 4 candidates, 67606 repo-hours, 625 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:37:38Z [load_day 2025-11-30] 2025-11-30 hour 7: 143785 events in 0 files, snapshot none (task 2971 ms: download 2120 ms overlapping gunzip 330 ms, parse 1025 ms, sort 0 ms, write 0 ms, index 455 ms: 7 candidates, 62800 repo-hours, 425 releases; waiting 853 ms; commit 0 ms)
2026-11-08T14:37:41Z [load_day 2025-11-30] 2025-11-30 hour 8: 144400 events in 0 files, snapshot none (task 2929 ms: download 1957 ms overlapping gunzip 333 ms, parse 1008 ms, sort 0 ms, write 0 ms, index 512 ms: 4 candidates, 67958 repo-hours, 532 releases; waiting 690 ms; commit 0 ms)
2026-11-08T14:37:41Z [load_day 2025-11-30] 2025-11-30 hour 9: 148453 events in 0 files, snapshot none (task 3249 ms: download 2340 ms overlapping gunzip 327 ms, parse 1021 ms, sort 0 ms, write 0 ms, index 559 ms: 6 candidates, 67836 repo-hours, 619 releases; waiting 1028 ms; commit 0 ms)
2026-11-08T14:37:45Z [load_day 2025-11-30] 2025-11-30 hour 10: 149021 events in 0 files, snapshot none (task 3293 ms: download 2159 ms overlapping gunzip 425 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 565 ms: 2 candidates, 67657 repo-hours, 570 releases; waiting 721 ms; commit 0 ms)
2026-11-08T14:37:45Z [load_day 2025-11-30] 2025-11-30 hour 11: 145772 events in 0 files, snapshot none (task 3100 ms: download 1887 ms overlapping gunzip 375 ms, parse 1271 ms, sort 0 ms, write 0 ms, index 503 ms: 6 candidates, 65602 repo-hours, 510 releases; waiting 622 ms; commit 0 ms)
2026-11-08T14:37:49Z [load_day 2025-11-30] 2025-11-30 hour 12: 157584 events in 0 files, snapshot none (task 3621 ms: download 2218 ms overlapping gunzip 455 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 764 ms: 6 candidates, 92839 repo-hours, 497 releases; waiting 553 ms; commit 0 ms)
2026-11-08T14:37:49Z [load_day 2025-11-30] 2025-11-30 hour 13: 156825 events in 0 files, snapshot none (task 4012 ms: download 2412 ms overlapping gunzip 601 ms, parse 1910 ms, sort 0 ms, write 0 ms, index 647 ms: 6 candidates, 84513 repo-hours, 445 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:37:53Z [load_day 2025-11-30] 2025-11-30 hour 14: 150690 events in 0 files, snapshot none (task 3415 ms: download 2169 ms overlapping gunzip 438 ms, parse 1365 ms, sort 0 ms, write 0 ms, index 608 ms: 9 candidates, 70750 repo-hours, 630 releases; waiting 680 ms; commit 0 ms)
2026-11-08T14:37:54Z [load_day 2025-11-30] 2025-11-30 hour 15: 154723 events in 0 files, snapshot none (task 3907 ms: download 2180 ms overlapping gunzip 528 ms, parse 1652 ms, sort 0 ms, write 0 ms, index 772 ms: 8 candidates, 72956 repo-hours, 685 releases; waiting 537 ms; commit 0 ms)
2026-11-08T14:37:56Z [load_day 2025-11-30] 2025-11-30 hour 16: 152848 events in 0 files, snapshot none (task 3015 ms: download 1946 ms overlapping gunzip 345 ms, parse 1059 ms, sort 0 ms, write 0 ms, index 748 ms: 3 candidates, 73424 repo-hours, 673 releases; waiting 608 ms; commit 0 ms)
2026-11-08T14:37:58Z [load_day 2025-11-30] 2025-11-30 hour 17: 149710 events in 0 files, snapshot none (task 3504 ms: download 2145 ms overlapping gunzip 425 ms, parse 1323 ms, sort 0 ms, write 0 ms, index 714 ms: 6 candidates, 71884 repo-hours, 589 releases; waiting 729 ms; commit 0 ms)
2026-11-08T14:38:04Z [load_day 2025-11-30] 2025-11-30 hour 18: 154420 events in 0 files, snapshot none (task 7190 ms: download 1729 ms overlapping gunzip 341 ms, parse 1091 ms, sort 0 ms, write 0 ms, index 4907 ms: 2 candidates, 79223 repo-hours, 710 releases; waiting 564 ms; commit 0 ms)
2026-11-08T14:38:04Z [load_day 2025-11-30] 2025-11-30 hour 19: 149430 events in 0 files, snapshot none (task 3947 ms: download 2492 ms overlapping gunzip 327 ms, parse 1027 ms, sort 0 ms, write 0 ms, index 596 ms: 4 candidates, 68447 repo-hours, 571 releases; waiting 1700 ms; commit 0 ms)
2026-11-08T14:38:10Z [load_day 2025-11-30] 2025-11-30 hour 20: 145674 events in 0 files, snapshot none (task 2854 ms: download 1599 ms overlapping gunzip 426 ms, parse 1320 ms, sort 0 ms, write 0 ms, index 545 ms: 2 candidates, 66775 repo-hours, 650 releases; waiting 240 ms; commit 0 ms)
2026-11-08T14:38:10Z [load_day 2025-11-30] 2025-11-30 hour 21: 147437 events in 0 files, snapshot none (task 2924 ms: download 1536 ms overlapping gunzip 445 ms, parse 1417 ms, sort 0 ms, write 0 ms, index 483 ms: 4 candidates, 65281 repo-hours, 669 releases; waiting 361 ms; commit 0 ms)
2026-11-08T14:38:14Z [load_day 2025-11-30] 2025-11-30 hour 22: 143261 events in 0 files, snapshot none (task 3086 ms: download 1960 ms overlapping gunzip 357 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 569 ms: 9 candidates, 65107 repo-hours, 625 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:38:14Z [load_day 2025-11-30] 2025-11-30 hour 23: 144722 events in 0 files, snapshot none (task 3383 ms: download 1645 ms overlapping gunzip 377 ms, parse 1283 ms, sort 0 ms, write 0 ms, index 812 ms: 2 candidates, 63706 repo-hours, 552 releases; waiting 589 ms; commit 0 ms)
2026-11-08T14:38:22Z [load_day 2025-11-30] 2025-11-30: repo_hour merged from 24 files to 1 (1684817 rows, 7720 ms)
2026-11-08T14:38:24Z [load_day 2025-11-30] 2025-11-30: index committed in 10413 ms (24 + 1 + 24 files)
2026-11-08T14:38:24Z [load_day 2025-11-30] 2025-11-30: 3536704 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:38:24Z [load_day 2025-11-30] attempt 1 succeeded