orcaLog in

Runs · run 3580

load_day 2025-02-19, attempt 1 succeeded

Host
73ccef5e07c2:257873
Started
2026-11-08T10:25:38Z
Ended
2026-11-08T10:27:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
923 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3580/load_day/2025-02-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:25:38Z [load_day 2025-02-19] attempt 1 started
2026-11-08T10:25:39Z [load_day 2025-02-19] 2025-02-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:25:48Z [load_day 2025-02-19] 2025-02-19 hour 0: 213712 events in 0 files, snapshot none (task 8231 ms: download 5251 ms overlapping gunzip 1161 ms, parse 5227 ms, sort 0 ms, write 0 ms, index 1017 ms: 11 candidates, 102623 repo-hours, 1373 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:25:48Z [load_day 2025-02-19] 2025-02-19 hour 1: 230060 events in 0 files, snapshot none (task 7890 ms: download 4957 ms overlapping gunzip 1130 ms, parse 5027 ms, sort 0 ms, write 0 ms, index 930 ms: 9 candidates, 122221 repo-hours, 1096 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:25:56Z [load_day 2025-02-19] 2025-02-19 hour 2: 204803 events in 0 files, snapshot none (task 7763 ms: download 5043 ms overlapping gunzip 1167 ms, parse 5073 ms, sort 0 ms, write 0 ms, index 733 ms: 14 candidates, 91694 repo-hours, 956 releases; waiting 495 ms; commit 0 ms)
2026-11-08T10:25:56Z [load_day 2025-02-19] 2025-02-19 hour 3: 222658 events in 0 files, snapshot none (task 7930 ms: download 5001 ms overlapping gunzip 1161 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 881 ms: 5 candidates, 90853 repo-hours, 4136 releases; waiting 487 ms; commit 0 ms)
2026-11-08T10:26:05Z [load_day 2025-02-19] 2025-02-19 hour 4: 199550 events in 0 files, snapshot none (task 7434 ms: download 4528 ms overlapping gunzip 1136 ms, parse 4722 ms, sort 0 ms, write 0 ms, index 629 ms: 12 candidates, 75377 repo-hours, 823 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:26:05Z [load_day 2025-02-19] 2025-02-19 hour 5: 207997 events in 0 files, snapshot none (task 7354 ms: download 4668 ms overlapping gunzip 1133 ms, parse 4966 ms, sort 0 ms, write 0 ms, index 599 ms: 8 candidates, 81547 repo-hours, 884 releases; waiting 385 ms; commit 0 ms)
2026-11-08T10:26:12Z [load_day 2025-02-19] 2025-02-19 hour 6: 236302 events in 0 files, snapshot none (task 7008 ms: download 4214 ms overlapping gunzip 1003 ms, parse 4336 ms, sort 0 ms, write 0 ms, index 744 ms: 6 candidates, 102943 repo-hours, 1214 releases; waiting 557 ms; commit 0 ms)
2026-11-08T10:26:12Z [load_day 2025-02-19] 2025-02-19 hour 7: 237232 events in 0 files, snapshot none (task 7037 ms: download 4328 ms overlapping gunzip 1045 ms, parse 4415 ms, sort 0 ms, write 0 ms, index 717 ms: 14 candidates, 93079 repo-hours, 999 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:26:20Z [load_day 2025-02-19] 2025-02-19 hour 8: 252361 events in 0 files, snapshot none (task 7117 ms: download 4472 ms overlapping gunzip 1069 ms, parse 4437 ms, sort 0 ms, write 0 ms, index 763 ms: 9 candidates, 105542 repo-hours, 1110 releases; waiting 529 ms; commit 0 ms)
2026-11-08T10:26:20Z [load_day 2025-02-19] 2025-02-19 hour 9: 265391 events in 0 files, snapshot none (task 7643 ms: download 4950 ms overlapping gunzip 1204 ms, parse 5094 ms, sort 0 ms, write 0 ms, index 857 ms: 9 candidates, 111708 repo-hours, 1246 releases; waiting 185 ms; commit 0 ms)
2026-11-08T10:26:30Z [load_day 2025-02-19] 2025-02-19 hour 10: 257499 events in 0 files, snapshot none (task 10289 ms: download 7464 ms overlapping gunzip 1665 ms, parse 7039 ms, sort 0 ms, write 0 ms, index 773 ms: 6 candidates, 105824 repo-hours, 1198 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:26:31Z [load_day 2025-02-19] 2025-02-19 hour 11: 257167 events in 0 files, snapshot none (task 10275 ms: download 7613 ms overlapping gunzip 1673 ms, parse 7005 ms, sort 0 ms, write 0 ms, index 837 ms: 11 candidates, 101092 repo-hours, 1299 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:26:43Z [load_day 2025-02-19] 2025-02-19 hour 12: 284303 events in 0 files, snapshot none (task 12421 ms: download 8176 ms overlapping gunzip 1772 ms, parse 7648 ms, sort 0 ms, write 0 ms, index 2201 ms: 11 candidates, 143389 repo-hours, 1467 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:26:44Z [load_day 2025-02-19] 2025-02-19 hour 13: 277996 events in 0 files, snapshot none (task 12463 ms: download 8015 ms overlapping gunzip 1947 ms, parse 8145 ms, sort 0 ms, write 0 ms, index 1546 ms: 12 candidates, 130356 repo-hours, 1331 releases; waiting 472 ms; commit 0 ms)
2026-11-08T10:26:56Z [load_day 2025-02-19] 2025-02-19 hour 14: 262371 events in 0 files, snapshot none (task 11780 ms: download 7648 ms overlapping gunzip 1907 ms, parse 7996 ms, sort 0 ms, write 0 ms, index 1092 ms: 15 candidates, 114971 repo-hours, 1323 releases; waiting 166 ms; commit 0 ms)
2026-11-08T10:26:56Z [load_day 2025-02-19] 2025-02-19 hour 15: 263641 events in 0 files, snapshot none (task 10755 ms: download 7264 ms overlapping gunzip 1842 ms, parse 7435 ms, sort 0 ms, write 0 ms, index 979 ms: 7 candidates, 119271 repo-hours, 1510 releases; waiting 274 ms; commit 0 ms)
2026-11-08T10:27:08Z [load_day 2025-02-19] 2025-02-19 hour 16: 270961 events in 0 files, snapshot none (task 12131 ms: download 8670 ms overlapping gunzip 2112 ms, parse 8498 ms, sort 0 ms, write 0 ms, index 899 ms: 14 candidates, 117398 repo-hours, 1316 releases; waiting 326 ms; commit 0 ms)
2026-11-08T10:27:08Z [load_day 2025-02-19] 2025-02-19 hour 17: 258389 events in 0 files, snapshot none (task 11576 ms: download 8947 ms overlapping gunzip 1899 ms, parse 8015 ms, sort 0 ms, write 0 ms, index 789 ms: 8 candidates, 107492 repo-hours, 1249 releases; waiting 560 ms; commit 0 ms)
2026-11-08T10:27:20Z [load_day 2025-02-19] 2025-02-19 hour 18: 264171 events in 0 files, snapshot none (task 11491 ms: download 8849 ms overlapping gunzip 1874 ms, parse 8101 ms, sort 0 ms, write 0 ms, index 820 ms: 8 candidates, 118753 repo-hours, 1481 releases; waiting 405 ms; commit 0 ms)
2026-11-08T10:27:20Z [load_day 2025-02-19] 2025-02-19 hour 19: 250641 events in 0 files, snapshot none (task 10637 ms: download 7946 ms overlapping gunzip 1838 ms, parse 7534 ms, sort 0 ms, write 0 ms, index 720 ms: 10 candidates, 98483 repo-hours, 1142 releases; waiting 246 ms; commit 0 ms)
2026-11-08T10:27:30Z [load_day 2025-02-19] 2025-02-19 hour 20: 236801 events in 0 files, snapshot none (task 9568 ms: download 6651 ms overlapping gunzip 1609 ms, parse 6357 ms, sort 0 ms, write 0 ms, index 700 ms: 11 candidates, 94466 repo-hours, 1087 releases; waiting 491 ms; commit 0 ms)
2026-11-08T10:27:31Z [load_day 2025-02-19] 2025-02-19 hour 21: 230501 events in 0 files, snapshot none (task 9859 ms: download 7012 ms overlapping gunzip 1661 ms, parse 6954 ms, sort 0 ms, write 0 ms, index 707 ms: 12 candidates, 92528 repo-hours, 1219 releases; waiting 314 ms; commit 0 ms)
2026-11-08T10:27:38Z [load_day 2025-02-19] 2025-02-19 hour 22: 214984 events in 0 files, snapshot none (task 7209 ms: download 4759 ms overlapping gunzip 1124 ms, parse 4508 ms, sort 0 ms, write 0 ms, index 679 ms: 7 candidates, 83010 repo-hours, 1202 releases; waiting 610 ms; commit 0 ms)
2026-11-08T10:27:38Z [load_day 2025-02-19] 2025-02-19 hour 23: 200353 events in 0 files, snapshot none (task 7108 ms: download 4704 ms overlapping gunzip 1047 ms, parse 4324 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 77184 repo-hours, 1028 releases; waiting 817 ms; commit 0 ms)
2026-11-08T10:27:49Z [load_day 2025-02-19] 2025-02-19: repo_hour merged from 24 files to 1 (2481804 rows, 11104 ms)
2026-11-08T10:27:52Z [load_day 2025-02-19] 2025-02-19: index committed in 14086 ms (24 + 1 + 24 files)
2026-11-08T10:27:52Z [load_day 2025-02-19] 2025-02-19: 5799844 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:27:52Z [load_day 2025-02-19] attempt 1 succeeded