orcaLog in

Runs · run 4628

load_day 2025-11-18, attempt 1 succeeded

Host
73ccef5e07c2:406273
Started
2026-11-08T14:30:54Z
Ended
2026-11-08T14:31:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
693 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.3 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4628/load_day/2025-11-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:30:54Z [load_day 2025-11-18] attempt 1 started
2026-11-08T14:30:55Z [load_day 2025-11-18] 2025-11-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:30:59Z [load_day 2025-11-18] 2025-11-18 hour 0: 146674 events in 0 files, snapshot none (task 4015 ms: download 2550 ms overlapping gunzip 499 ms, parse 1547 ms, sort 0 ms, write 0 ms, index 619 ms: 6 candidates, 74693 repo-hours, 695 releases; waiting 1000 ms; commit 0 ms)
2026-11-08T14:30:59Z [load_day 2025-11-18] 2025-11-18 hour 1: 152104 events in 0 files, snapshot none (task 4065 ms: download 2488 ms overlapping gunzip 370 ms, parse 1276 ms, sort 0 ms, write 0 ms, index 848 ms: 6 candidates, 91721 repo-hours, 715 releases; waiting 1258 ms; commit 0 ms)
2026-11-08T14:31:03Z [load_day 2025-11-18] 2025-11-18 hour 2: 145995 events in 0 files, snapshot none (task 3588 ms: download 2555 ms overlapping gunzip 405 ms, parse 1216 ms, sort 0 ms, write 0 ms, index 616 ms: 8 candidates, 77898 repo-hours, 549 releases; waiting 1027 ms; commit 0 ms)
2026-11-08T14:31:04Z [load_day 2025-11-18] 2025-11-18 hour 3: 150922 events in 0 files, snapshot none (task 3786 ms: download 2617 ms overlapping gunzip 454 ms, parse 1346 ms, sort 0 ms, write 0 ms, index 564 ms: 6 candidates, 75991 repo-hours, 1480 releases; waiting 1040 ms; commit 0 ms)
2026-11-08T14:31:07Z [load_day 2025-11-18] 2025-11-18 hour 4: 148638 events in 0 files, snapshot none (task 3136 ms: download 2091 ms overlapping gunzip 400 ms, parse 1257 ms, sort 0 ms, write 0 ms, index 574 ms: 5 candidates, 68633 repo-hours, 562 releases; waiting 613 ms; commit 0 ms)
2026-11-08T14:31:08Z [load_day 2025-11-18] 2025-11-18 hour 5: 146226 events in 0 files, snapshot none (task 3523 ms: download 2257 ms overlapping gunzip 390 ms, parse 1130 ms, sort 0 ms, write 0 ms, index 564 ms: 5 candidates, 71106 repo-hours, 557 releases; waiting 1137 ms; commit 0 ms)
2026-11-08T14:31:11Z [load_day 2025-11-18] 2025-11-18 hour 6: 148528 events in 0 files, snapshot none (task 3126 ms: download 1958 ms overlapping gunzip 360 ms, parse 1092 ms, sort 0 ms, write 0 ms, index 560 ms: 6 candidates, 78081 repo-hours, 514 releases; waiting 815 ms; commit 0 ms)
2026-11-08T14:31:12Z [load_day 2025-11-18] 2025-11-18 hour 7: 146008 events in 0 files, snapshot none (task 3987 ms: download 2551 ms overlapping gunzip 410 ms, parse 1282 ms, sort 0 ms, write 0 ms, index 680 ms: 10 candidates, 73762 repo-hours, 512 releases; waiting 1289 ms; commit 0 ms)
2026-11-08T14:31:15Z [load_day 2025-11-18] 2025-11-18 hour 8: 146825 events in 0 files, snapshot none (task 3610 ms: download 2455 ms overlapping gunzip 509 ms, parse 1504 ms, sort 0 ms, write 0 ms, index 579 ms: 7 candidates, 76242 repo-hours, 552 releases; waiting 716 ms; commit 0 ms)
2026-11-08T14:31:17Z [load_day 2025-11-18] 2025-11-18 hour 9: 146825 events in 0 files, snapshot none (task 3771 ms: download 2684 ms overlapping gunzip 421 ms, parse 1274 ms, sort 0 ms, write 0 ms, index 662 ms: 6 candidates, 77772 repo-hours, 629 releases; waiting 1087 ms; commit 0 ms)
2026-11-08T14:31:21Z [load_day 2025-11-18] 2025-11-18 hour 10: 149000 events in 0 files, snapshot none (task 5159 ms: download 3639 ms overlapping gunzip 494 ms, parse 1394 ms, sort 0 ms, write 0 ms, index 708 ms: 3 candidates, 79220 repo-hours, 532 releases; waiting 2171 ms; commit 0 ms)
2026-11-08T14:31:21Z [load_day 2025-11-18] 2025-11-18 hour 11: 148783 events in 0 files, snapshot none (task 3664 ms: download 2045 ms overlapping gunzip 428 ms, parse 1425 ms, sort 0 ms, write 0 ms, index 682 ms: 5 candidates, 76236 repo-hours, 469 releases; waiting 717 ms; commit 0 ms)
2026-11-08T14:31:25Z [load_day 2025-11-18] 2025-11-18 hour 12: 163542 events in 0 files, snapshot none (task 3494 ms: download 1876 ms overlapping gunzip 288 ms, parse 1033 ms, sort 0 ms, write 0 ms, index 1036 ms: 5 candidates, 102356 repo-hours, 224 releases; waiting 789 ms; commit 0 ms)
2026-11-08T14:31:25Z [load_day 2025-11-18] 2025-11-18 hour 13: 159702 events in 0 files, snapshot none (task 3252 ms: download 1818 ms overlapping gunzip 272 ms, parse 1093 ms, sort 0 ms, write 0 ms, index 887 ms: 5 candidates, 98039 repo-hours, 180 releases; waiting 694 ms; commit 0 ms)
2026-11-08T14:31:28Z [load_day 2025-11-18] 2025-11-18 hour 14: 154514 events in 0 files, snapshot none (task 2886 ms: download 1660 ms overlapping gunzip 283 ms, parse 942 ms, sort 0 ms, write 0 ms, index 774 ms: 9 candidates, 91190 repo-hours, 191 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:31:29Z [load_day 2025-11-18] 2025-11-18 hour 15: 153918 events in 0 files, snapshot none (task 3428 ms: download 2229 ms overlapping gunzip 302 ms, parse 1041 ms, sort 0 ms, write 0 ms, index 715 ms: 4 candidates, 89760 repo-hours, 226 releases; waiting 1094 ms; commit 0 ms)
2026-11-08T14:31:32Z [load_day 2025-11-18] 2025-11-18 hour 16: 147412 events in 0 files, snapshot none (task 3024 ms: download 2066 ms overlapping gunzip 285 ms, parse 889 ms, sort 0 ms, write 0 ms, index 633 ms: 9 candidates, 83694 repo-hours, 283 releases; waiting 932 ms; commit 0 ms)
2026-11-08T14:31:33Z [load_day 2025-11-18] 2025-11-18 hour 17: 147572 events in 0 files, snapshot none (task 3673 ms: download 2624 ms overlapping gunzip 413 ms, parse 1306 ms, sort 0 ms, write 0 ms, index 557 ms: 6 candidates, 77534 repo-hours, 400 releases; waiting 1074 ms; commit 0 ms)
2026-11-08T14:31:35Z [load_day 2025-11-18] 2025-11-18 hour 18: 158872 events in 0 files, snapshot none (task 2761 ms: download 1640 ms overlapping gunzip 264 ms, parse 905 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 91026 repo-hours, 281 releases; waiting 627 ms; commit 0 ms)
2026-11-08T14:31:37Z [load_day 2025-11-18] 2025-11-18 hour 19: 155069 events in 0 files, snapshot none (task 3547 ms: download 2166 ms overlapping gunzip 336 ms, parse 1121 ms, sort 0 ms, write 0 ms, index 990 ms: 12 candidates, 79689 repo-hours, 333 releases; waiting 760 ms; commit 0 ms)
2026-11-08T14:31:39Z [load_day 2025-11-18] 2025-11-18 hour 20: 134938 events in 0 files, snapshot none (task 3703 ms: download 2334 ms overlapping gunzip 380 ms, parse 1115 ms, sort 0 ms, write 0 ms, index 967 ms: 5 candidates, 64986 repo-hours, 477 releases; waiting 885 ms; commit 0 ms)
2026-11-08T14:31:43Z [load_day 2025-11-18] 2025-11-18 hour 21: 126975 events in 0 files, snapshot none (task 3576 ms: download 2295 ms overlapping gunzip 466 ms, parse 1529 ms, sort 0 ms, write 0 ms, index 588 ms: 5 candidates, 58690 repo-hours, 359 releases; waiting 744 ms; commit 0 ms)
2026-11-08T14:31:44Z [load_day 2025-11-18] 2025-11-18 hour 22: 146506 events in 0 files, snapshot none (task 4386 ms: download 3155 ms overlapping gunzip 654 ms, parse 1834 ms, sort 0 ms, write 0 ms, index 546 ms: 9 candidates, 70760 repo-hours, 727 releases; waiting 1036 ms; commit 0 ms)
2026-11-08T14:31:47Z [load_day 2025-11-18] 2025-11-18 hour 23: 142764 events in 0 files, snapshot none (task 3449 ms: download 2276 ms overlapping gunzip 440 ms, parse 1274 ms, sort 0 ms, write 0 ms, index 561 ms: 2 candidates, 65908 repo-hours, 698 releases; waiting 837 ms; commit 0 ms)
2026-11-08T14:31:55Z [load_day 2025-11-18] 2025-11-18: repo_hour merged from 24 files to 1 (1894987 rows, 8269 ms)
2026-11-08T14:31:58Z [load_day 2025-11-18] 2025-11-18: index committed in 11128 ms (24 + 1 + 24 files)
2026-11-08T14:31:58Z [load_day 2025-11-18] 2025-11-18: 3568312 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:31:58Z [load_day 2025-11-18] attempt 1 succeeded