orcaLog in

Runs · run 4689

load_day 2025-12-07, attempt 1 succeeded

Host
73ccef5e07c2:413517
Started
2026-11-08T14:41:02Z
Ended
2026-11-08T14:42:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
657 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
66.3 s, up to 1.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4689/load_day/2025-12-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:41:02Z [load_day 2025-12-07] attempt 1 started
2026-11-08T14:41:03Z [load_day 2025-12-07] 2025-12-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:41:07Z [load_day 2025-12-07] 2025-12-07 hour 0: 137140 events in 0 files, snapshot none (task 3249 ms: download 2371 ms overlapping gunzip 409 ms, parse 1344 ms, sort 0 ms, write 0 ms, index 468 ms: 6 candidates, 63663 repo-hours, 965 releases; waiting 736 ms; commit 0 ms)
2026-11-08T14:41:07Z [load_day 2025-12-07] 2025-12-07 hour 1: 145676 events in 0 files, snapshot none (task 3228 ms: download 2075 ms overlapping gunzip 391 ms, parse 1290 ms, sort 0 ms, write 0 ms, index 597 ms: 6 candidates, 82907 repo-hours, 784 releases; waiting 638 ms; commit 0 ms)
2026-11-08T14:41:11Z [load_day 2025-12-07] 2025-12-07 hour 2: 138590 events in 0 files, snapshot none (task 3767 ms: download 2226 ms overlapping gunzip 553 ms, parse 1972 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 67515 repo-hours, 746 releases; waiting 273 ms; commit 0 ms)
2026-11-08T14:41:11Z [load_day 2025-12-07] 2025-12-07 hour 3: 136700 events in 0 files, snapshot none (task 3688 ms: download 1928 ms overlapping gunzip 572 ms, parse 1719 ms, sort 0 ms, write 0 ms, index 558 ms: 8 candidates, 61058 repo-hours, 960 releases; waiting 455 ms; commit 0 ms)
2026-11-08T14:41:16Z [load_day 2025-12-07] 2025-12-07 hour 4: 142527 events in 0 files, snapshot none (task 4457 ms: download 3210 ms overlapping gunzip 497 ms, parse 1703 ms, sort 0 ms, write 0 ms, index 638 ms: 8 candidates, 62927 repo-hours, 1444 releases; waiting 1302 ms; commit 0 ms)
2026-11-08T14:41:16Z [load_day 2025-12-07] 2025-12-07 hour 5: 142133 events in 0 files, snapshot none (task 4143 ms: download 2154 ms overlapping gunzip 536 ms, parse 1705 ms, sort 0 ms, write 0 ms, index 606 ms: 5 candidates, 60096 repo-hours, 702 releases; waiting 973 ms; commit 0 ms)
2026-11-08T14:41:20Z [load_day 2025-12-07] 2025-12-07 hour 6: 143178 events in 0 files, snapshot none (task 4007 ms: download 1967 ms overlapping gunzip 572 ms, parse 1886 ms, sort 0 ms, write 0 ms, index 703 ms: 3 candidates, 66507 repo-hours, 875 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:41:20Z [load_day 2025-12-07] 2025-12-07 hour 7: 141906 events in 0 files, snapshot none (task 4101 ms: download 2127 ms overlapping gunzip 548 ms, parse 1716 ms, sort 0 ms, write 0 ms, index 698 ms: 4 candidates, 59653 repo-hours, 719 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:41:24Z [load_day 2025-12-07] 2025-12-07 hour 8: 146889 events in 0 files, snapshot none (task 2847 ms: download 1443 ms overlapping gunzip 342 ms, parse 1105 ms, sort 0 ms, write 0 ms, index 818 ms: 6 candidates, 65698 repo-hours, 1175 releases; waiting 266 ms; commit 0 ms)
2026-11-08T14:41:25Z [load_day 2025-12-07] 2025-12-07 hour 9: 145237 events in 0 files, snapshot none (task 3674 ms: download 2067 ms overlapping gunzip 543 ms, parse 1645 ms, sort 0 ms, write 0 ms, index 496 ms: 2 candidates, 65240 repo-hours, 1620 releases; waiting 652 ms; commit 0 ms)
2026-11-08T14:41:27Z [load_day 2025-12-07] 2025-12-07 hour 10: 147643 events in 0 files, snapshot none (task 3143 ms: download 1874 ms overlapping gunzip 347 ms, parse 1082 ms, sort 0 ms, write 0 ms, index 638 ms: 3 candidates, 68992 repo-hours, 1031 releases; waiting 836 ms; commit 0 ms)
2026-11-08T14:41:28Z [load_day 2025-12-07] 2025-12-07 hour 11: 141998 events in 0 files, snapshot none (task 3074 ms: download 2039 ms overlapping gunzip 399 ms, parse 1326 ms, sort 0 ms, write 0 ms, index 446 ms: 1 candidates, 62822 repo-hours, 983 releases; waiting 601 ms; commit 0 ms)
2026-11-08T14:41:31Z [load_day 2025-12-07] 2025-12-07 hour 12: 157517 events in 0 files, snapshot none (task 3220 ms: download 1955 ms overlapping gunzip 305 ms, parse 980 ms, sort 0 ms, write 0 ms, index 815 ms: 4 candidates, 91190 repo-hours, 994 releases; waiting 811 ms; commit 0 ms)
2026-11-08T14:41:33Z [load_day 2025-12-07] 2025-12-07 hour 13: 152837 events in 0 files, snapshot none (task 4139 ms: download 2867 ms overlapping gunzip 433 ms, parse 1279 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 82639 repo-hours, 1389 releases; waiting 1357 ms; commit 0 ms)
2026-11-08T14:41:35Z [load_day 2025-12-07] 2025-12-07 hour 14: 149970 events in 0 files, snapshot none (task 3245 ms: download 2085 ms overlapping gunzip 360 ms, parse 1101 ms, sort 0 ms, write 0 ms, index 566 ms: 9 candidates, 72180 repo-hours, 1344 releases; waiting 811 ms; commit 0 ms)
2026-11-08T14:41:36Z [load_day 2025-12-07] 2025-12-07 hour 15: 151902 events in 0 files, snapshot none (task 3069 ms: download 2010 ms overlapping gunzip 364 ms, parse 1173 ms, sort 0 ms, write 0 ms, index 615 ms: 2 candidates, 74342 repo-hours, 1428 releases; waiting 627 ms; commit 0 ms)
2026-11-08T14:41:38Z [load_day 2025-12-07] 2025-12-07 hour 16: 146506 events in 0 files, snapshot none (task 2942 ms: download 1968 ms overlapping gunzip 336 ms, parse 1053 ms, sort 0 ms, write 0 ms, index 533 ms: 6 candidates, 72238 repo-hours, 1482 releases; waiting 743 ms; commit 0 ms)
2026-11-08T14:41:40Z [load_day 2025-12-07] 2025-12-07 hour 17: 152454 events in 0 files, snapshot none (task 3007 ms: download 1883 ms overlapping gunzip 380 ms, parse 1287 ms, sort 0 ms, write 0 ms, index 551 ms: 7 candidates, 68802 repo-hours, 1516 releases; waiting 518 ms; commit 0 ms)
2026-11-08T14:41:42Z [load_day 2025-12-07] 2025-12-07 hour 18: 148322 events in 0 files, snapshot none (task 3063 ms: download 1845 ms overlapping gunzip 384 ms, parse 1237 ms, sort 0 ms, write 0 ms, index 616 ms: 9 candidates, 74077 repo-hours, 1426 releases; waiting 563 ms; commit 0 ms)
2026-11-08T14:41:43Z [load_day 2025-12-07] 2025-12-07 hour 19: 149592 events in 0 files, snapshot none (task 2768 ms: download 1605 ms overlapping gunzip 350 ms, parse 1136 ms, sort 0 ms, write 0 ms, index 517 ms: 7 candidates, 66239 repo-hours, 1345 releases; waiting 437 ms; commit 0 ms)
2026-11-08T14:41:45Z [load_day 2025-12-07] 2025-12-07 hour 20: 146833 events in 0 files, snapshot none (task 3036 ms: download 1766 ms overlapping gunzip 338 ms, parse 1107 ms, sort 0 ms, write 0 ms, index 654 ms: 7 candidates, 65826 repo-hours, 1360 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:41:47Z [load_day 2025-12-07] 2025-12-07 hour 21: 148379 events in 0 files, snapshot none (task 2851 ms: download 1708 ms overlapping gunzip 346 ms, parse 1150 ms, sort 0 ms, write 0 ms, index 460 ms: 10 candidates, 64828 repo-hours, 1495 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:41:48Z [load_day 2025-12-07] 2025-12-07 hour 22: 145937 events in 0 files, snapshot none (task 2592 ms: download 1770 ms overlapping gunzip 338 ms, parse 1089 ms, sort 0 ms, write 0 ms, index 500 ms: 7 candidates, 62737 repo-hours, 1496 releases; waiting 381 ms; commit 0 ms)
2026-11-08T14:41:51Z [load_day 2025-12-07] 2025-12-07 hour 23: 139960 events in 0 files, snapshot none (task 3409 ms: download 1961 ms overlapping gunzip 321 ms, parse 1074 ms, sort 0 ms, write 0 ms, index 471 ms: 7 candidates, 59620 repo-hours, 1378 releases; waiting 772 ms; commit 0 ms)
2026-11-08T14:41:58Z [load_day 2025-12-07] 2025-12-07: repo_hour merged from 24 files to 1 (1641796 rows, 7239 ms)
2026-11-08T14:42:01Z [load_day 2025-12-07] 2025-12-07: index committed in 10009 ms (24 + 1 + 24 files)
2026-11-08T14:42:01Z [load_day 2025-12-07] 2025-12-07: 3499826 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:42:01Z [load_day 2025-12-07] attempt 1 succeeded