orcaLog in

Runs · run 4725

load_day 2025-12-17, attempt 1 succeeded

Host
73ccef5e07c2:417966
Started
2026-11-08T14:46:50Z
Ended
2026-11-08T14:47:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
727 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.6 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4725/load_day/2025-12-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:46:50Z [load_day 2025-12-17] attempt 1 started
2026-11-08T14:46:51Z [load_day 2025-12-17] 2025-12-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:46:56Z [load_day 2025-12-17] 2025-12-17 hour 0: 148352 events in 0 files, snapshot none (task 4386 ms: download 2534 ms overlapping gunzip 680 ms, parse 2057 ms, sort 0 ms, write 0 ms, index 588 ms: 10 candidates, 76810 repo-hours, 860 releases; waiting 584 ms; commit 0 ms)
2026-11-08T14:46:56Z [load_day 2025-12-17] 2025-12-17 hour 1: 146849 events in 0 files, snapshot none (task 4036 ms: download 2406 ms overlapping gunzip 549 ms, parse 1854 ms, sort 0 ms, write 0 ms, index 718 ms: 14 candidates, 86511 repo-hours, 736 releases; waiting 607 ms; commit 0 ms)
2026-11-08T14:47:00Z [load_day 2025-12-17] 2025-12-17 hour 2: 145148 events in 0 files, snapshot none (task 3789 ms: download 2024 ms overlapping gunzip 556 ms, parse 1733 ms, sort 0 ms, write 0 ms, index 625 ms: 11 candidates, 74346 repo-hours, 705 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:47:00Z [load_day 2025-12-17] 2025-12-17 hour 3: 141936 events in 0 files, snapshot none (task 3784 ms: download 2264 ms overlapping gunzip 570 ms, parse 1710 ms, sort 0 ms, write 0 ms, index 634 ms: 6 candidates, 71052 repo-hours, 1014 releases; waiting 530 ms; commit 0 ms)
2026-11-08T14:47:04Z [load_day 2025-12-17] 2025-12-17 hour 4: 147015 events in 0 files, snapshot none (task 3540 ms: download 2092 ms overlapping gunzip 482 ms, parse 1480 ms, sort 0 ms, write 0 ms, index 667 ms: 6 candidates, 72483 repo-hours, 1042 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:47:04Z [load_day 2025-12-17] 2025-12-17 hour 5: 146536 events in 0 files, snapshot none (task 3616 ms: download 2033 ms overlapping gunzip 559 ms, parse 1689 ms, sort 0 ms, write 0 ms, index 630 ms: 11 candidates, 71074 repo-hours, 514 releases; waiting 392 ms; commit 0 ms)
2026-11-08T14:47:09Z [load_day 2025-12-17] 2025-12-17 hour 6: 150404 events in 0 files, snapshot none (task 3926 ms: download 2277 ms overlapping gunzip 563 ms, parse 1735 ms, sort 0 ms, write 0 ms, index 769 ms: 5 candidates, 77959 repo-hours, 658 releases; waiting 596 ms; commit 0 ms)
2026-11-08T14:47:09Z [load_day 2025-12-17] 2025-12-17 hour 7: 149002 events in 0 files, snapshot none (task 3639 ms: download 2379 ms overlapping gunzip 528 ms, parse 1620 ms, sort 0 ms, write 0 ms, index 674 ms: 11 candidates, 75707 repo-hours, 605 releases; waiting 494 ms; commit 0 ms)
2026-11-08T14:47:13Z [load_day 2025-12-17] 2025-12-17 hour 8: 148239 events in 0 files, snapshot none (task 4117 ms: download 2586 ms overlapping gunzip 600 ms, parse 1744 ms, sort 0 ms, write 0 ms, index 817 ms: 7 candidates, 78102 repo-hours, 694 releases; waiting 632 ms; commit 0 ms)
2026-11-08T14:47:13Z [load_day 2025-12-17] 2025-12-17 hour 9: 144450 events in 0 files, snapshot none (task 3910 ms: download 2353 ms overlapping gunzip 523 ms, parse 1650 ms, sort 0 ms, write 0 ms, index 676 ms: 19 candidates, 77847 repo-hours, 634 releases; waiting 695 ms; commit 0 ms)
2026-11-08T14:47:17Z [load_day 2025-12-17] 2025-12-17 hour 10: 146126 events in 0 files, snapshot none (task 4007 ms: download 2354 ms overlapping gunzip 572 ms, parse 1791 ms, sort 0 ms, write 0 ms, index 749 ms: 11 candidates, 79052 repo-hours, 574 releases; waiting 558 ms; commit 0 ms)
2026-11-08T14:47:17Z [load_day 2025-12-17] 2025-12-17 hour 11: 144841 events in 0 files, snapshot none (task 3941 ms: download 2320 ms overlapping gunzip 589 ms, parse 1786 ms, sort 0 ms, write 0 ms, index 580 ms: 3 candidates, 74005 repo-hours, 677 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:47:22Z [load_day 2025-12-17] 2025-12-17 hour 12: 155662 events in 0 files, snapshot none (task 3636 ms: download 2308 ms overlapping gunzip 502 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 733 ms: 6 candidates, 97017 repo-hours, 438 releases; waiting 568 ms; commit 0 ms)
2026-11-08T14:47:22Z [load_day 2025-12-17] 2025-12-17 hour 13: 158984 events in 0 files, snapshot none (task 3973 ms: download 2593 ms overlapping gunzip 467 ms, parse 1430 ms, sort 0 ms, write 0 ms, index 700 ms: 5 candidates, 95055 repo-hours, 449 releases; waiting 1015 ms; commit 0 ms)
2026-11-08T14:47:26Z [load_day 2025-12-17] 2025-12-17 hour 14: 144569 events in 0 files, snapshot none (task 3793 ms: download 2745 ms overlapping gunzip 389 ms, parse 1187 ms, sort 0 ms, write 0 ms, index 649 ms: 9 candidates, 81228 repo-hours, 658 releases; waiting 1254 ms; commit 0 ms)
2026-11-08T14:47:26Z [load_day 2025-12-17] 2025-12-17 hour 15: 146970 events in 0 files, snapshot none (task 3719 ms: download 2614 ms overlapping gunzip 403 ms, parse 1214 ms, sort 0 ms, write 0 ms, index 596 ms: 8 candidates, 81650 repo-hours, 673 releases; waiting 1169 ms; commit 0 ms)
2026-11-08T14:47:30Z [load_day 2025-12-17] 2025-12-17 hour 16: 148652 events in 0 files, snapshot none (task 3652 ms: download 2612 ms overlapping gunzip 442 ms, parse 1323 ms, sort 0 ms, write 0 ms, index 604 ms: 7 candidates, 80973 repo-hours, 710 releases; waiting 1015 ms; commit 0 ms)
2026-11-08T14:47:30Z [load_day 2025-12-17] 2025-12-17 hour 17: 151022 events in 0 files, snapshot none (task 3781 ms: download 2396 ms overlapping gunzip 460 ms, parse 1338 ms, sort 0 ms, write 0 ms, index 624 ms: 8 candidates, 78997 repo-hours, 691 releases; waiting 1072 ms; commit 0 ms)
2026-11-08T14:47:34Z [load_day 2025-12-17] 2025-12-17 hour 18: 147490 events in 0 files, snapshot none (task 3717 ms: download 2459 ms overlapping gunzip 445 ms, parse 1241 ms, sort 0 ms, write 0 ms, index 660 ms: 4 candidates, 81257 repo-hours, 763 releases; waiting 1043 ms; commit 0 ms)
2026-11-08T14:47:34Z [load_day 2025-12-17] 2025-12-17 hour 19: 146384 events in 0 files, snapshot none (task 3001 ms: download 1961 ms overlapping gunzip 390 ms, parse 1130 ms, sort 0 ms, write 0 ms, index 581 ms: 10 candidates, 73119 repo-hours, 662 releases; waiting 631 ms; commit 0 ms)
2026-11-08T14:47:39Z [load_day 2025-12-17] 2025-12-17 hour 20: 144779 events in 0 files, snapshot none (task 3920 ms: download 2143 ms overlapping gunzip 589 ms, parse 1706 ms, sort 0 ms, write 0 ms, index 757 ms: 8 candidates, 69843 repo-hours, 732 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:47:39Z [load_day 2025-12-17] 2025-12-17 hour 21: 144786 events in 0 files, snapshot none (task 4011 ms: download 2415 ms overlapping gunzip 613 ms, parse 1773 ms, sort 0 ms, write 0 ms, index 598 ms: 10 candidates, 71362 repo-hours, 760 releases; waiting 717 ms; commit 0 ms)
2026-11-08T14:47:44Z [load_day 2025-12-17] 2025-12-17 hour 22: 143501 events in 0 files, snapshot none (task 4397 ms: download 2462 ms overlapping gunzip 682 ms, parse 2063 ms, sort 0 ms, write 0 ms, index 890 ms: 3 candidates, 68085 repo-hours, 765 releases; waiting 446 ms; commit 0 ms)
2026-11-08T14:47:44Z [load_day 2025-12-17] 2025-12-17 hour 23: 142381 events in 0 files, snapshot none (task 4342 ms: download 2460 ms overlapping gunzip 674 ms, parse 2040 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 65873 repo-hours, 619 releases; waiting 544 ms; commit 0 ms)
2026-11-08T14:47:53Z [load_day 2025-12-17] 2025-12-17: repo_hour merged from 24 files to 1 (1859407 rows, 9090 ms)
2026-11-08T14:47:56Z [load_day 2025-12-17] 2025-12-17: index committed in 11899 ms (24 + 1 + 24 files)
2026-11-08T14:47:56Z [load_day 2025-12-17] 2025-12-17: 3534078 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:47:56Z [load_day 2025-12-17] attempt 1 succeeded