orcaLog in

Runs · run 1994

load_day 2024-01-22, attempt 1 succeeded

Host
73ccef5e07c2:57522
Started
2026-11-08T04:16:18Z
Ended
2026-11-08T04:18:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
797 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
195.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1994/load_day/2024-01-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:16:18Z [load_day 2024-01-22] attempt 1 started
2026-11-08T04:16:19Z [load_day 2024-01-22] 2024-01-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:16:28Z [load_day 2024-01-22] 2024-01-22 hour 0: 196343 events in 0 files, snapshot none (task 8258 ms: download 4907 ms overlapping gunzip 1217 ms, parse 5510 ms, sort 0 ms, write 0 ms, index 692 ms: 7 candidates, 76644 repo-hours, 881 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:16:28Z [load_day 2024-01-22] 2024-01-22 hour 1: 211261 events in 0 files, snapshot none (task 8587 ms: download 5527 ms overlapping gunzip 1349 ms, parse 5694 ms, sort 0 ms, write 0 ms, index 807 ms: 22 candidates, 90331 repo-hours, 857 releases; waiting 446 ms; commit 0 ms)
2026-11-08T04:16:36Z [load_day 2024-01-22] 2024-01-22 hour 2: 184738 events in 0 files, snapshot none (task 8255 ms: download 5799 ms overlapping gunzip 1420 ms, parse 5560 ms, sort 0 ms, write 0 ms, index 441 ms: 3 candidates, 62011 repo-hours, 728 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:16:37Z [load_day 2024-01-22] 2024-01-22 hour 3: 185776 events in 0 files, snapshot none (task 8172 ms: download 5634 ms overlapping gunzip 1419 ms, parse 5434 ms, sort 0 ms, write 0 ms, index 483 ms: 2 candidates, 58958 repo-hours, 752 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:16:44Z [load_day 2024-01-22] 2024-01-22 hour 4: 189910 events in 0 files, snapshot none (task 6807 ms: download 4545 ms overlapping gunzip 1158 ms, parse 4451 ms, sort 0 ms, write 0 ms, index 408 ms: 2 candidates, 57893 repo-hours, 648 releases; waiting 458 ms; commit 0 ms)
2026-11-08T04:16:44Z [load_day 2024-01-22] 2024-01-22 hour 5: 192011 events in 0 files, snapshot none (task 6232 ms: download 3930 ms overlapping gunzip 1054 ms, parse 3864 ms, sort 0 ms, write 0 ms, index 432 ms: 6 candidates, 61023 repo-hours, 613 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:16:50Z [load_day 2024-01-22] 2024-01-22 hour 6: 207270 events in 0 files, snapshot none (task 6057 ms: download 4614 ms overlapping gunzip 934 ms, parse 3617 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 73895 repo-hours, 708 releases; waiting 616 ms; commit 0 ms)
2026-11-08T04:16:51Z [load_day 2024-01-22] 2024-01-22 hour 7: 214358 events in 0 files, snapshot none (task 6600 ms: download 4235 ms overlapping gunzip 1064 ms, parse 4198 ms, sort 0 ms, write 0 ms, index 500 ms: 5 candidates, 71133 repo-hours, 762 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:17:01Z [load_day 2024-01-22] 2024-01-22 hour 8: 223839 events in 0 files, snapshot none (task 9748 ms: download 5629 ms overlapping gunzip 1479 ms, parse 6071 ms, sort 0 ms, write 0 ms, index 1102 ms: 9 candidates, 80812 repo-hours, 1100 releases; waiting 780 ms; commit 0 ms)
2026-11-08T04:17:02Z [load_day 2024-01-22] 2024-01-22 hour 9: 241636 events in 0 files, snapshot none (task 10433 ms: download 6568 ms overlapping gunzip 1692 ms, parse 6678 ms, sort 0 ms, write 0 ms, index 1158 ms: 4 candidates, 86811 repo-hours, 1305 releases; waiting 584 ms; commit 0 ms)
2026-11-08T04:17:13Z [load_day 2024-01-22] 2024-01-22 hour 10: 243128 events in 0 files, snapshot none (task 11468 ms: download 7642 ms overlapping gunzip 1923 ms, parse 7743 ms, sort 0 ms, write 0 ms, index 827 ms: 8 candidates, 87695 repo-hours, 1324 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:17:14Z [load_day 2024-01-22] 2024-01-22 hour 11: 238745 events in 0 files, snapshot none (task 11364 ms: download 8424 ms overlapping gunzip 1943 ms, parse 7850 ms, sort 0 ms, write 0 ms, index 737 ms: 9 candidates, 83190 repo-hours, 1066 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:17:24Z [load_day 2024-01-22] 2024-01-22 hour 12: 277327 events in 0 files, snapshot none (task 11005 ms: download 7198 ms overlapping gunzip 1796 ms, parse 7243 ms, sort 0 ms, write 0 ms, index 1385 ms: 7 candidates, 114647 repo-hours, 1265 releases; waiting 25 ms; commit 0 ms)
2026-11-08T04:17:26Z [load_day 2024-01-22] 2024-01-22 hour 13: 269131 events in 0 files, snapshot none (task 11446 ms: download 7911 ms overlapping gunzip 1963 ms, parse 7700 ms, sort 0 ms, write 0 ms, index 952 ms: 2 candidates, 112125 repo-hours, 1084 releases; waiting 542 ms; commit 0 ms)
2026-11-08T04:17:37Z [load_day 2024-01-22] 2024-01-22 hour 14: 264260 events in 0 files, snapshot none (task 12227 ms: download 8533 ms overlapping gunzip 2085 ms, parse 8299 ms, sort 0 ms, write 0 ms, index 1004 ms: 4 candidates, 98614 repo-hours, 1145 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:17:38Z [load_day 2024-01-22] 2024-01-22 hour 15: 250195 events in 0 files, snapshot none (task 11981 ms: download 8627 ms overlapping gunzip 1992 ms, parse 8383 ms, sort 0 ms, write 0 ms, index 848 ms: 8 candidates, 99758 repo-hours, 1340 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:17:49Z [load_day 2024-01-22] 2024-01-22 hour 16: 248238 events in 0 files, snapshot none (task 11342 ms: download 7893 ms overlapping gunzip 1814 ms, parse 7848 ms, sort 0 ms, write 0 ms, index 871 ms: 7 candidates, 97722 repo-hours, 1137 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:17:49Z [load_day 2024-01-22] 2024-01-22 hour 17: 247570 events in 0 files, snapshot none (task 10575 ms: download 7579 ms overlapping gunzip 1778 ms, parse 7291 ms, sort 0 ms, write 0 ms, index 699 ms: 8 candidates, 90489 repo-hours, 1241 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:18:00Z [load_day 2024-01-22] 2024-01-22 hour 18: 234976 events in 0 files, snapshot none (task 10541 ms: download 7443 ms overlapping gunzip 1751 ms, parse 7152 ms, sort 0 ms, write 0 ms, index 844 ms: 6 candidates, 95989 repo-hours, 1097 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:18:00Z [load_day 2024-01-22] 2024-01-22 hour 19: 227365 events in 0 files, snapshot none (task 9859 ms: download 6879 ms overlapping gunzip 1581 ms, parse 6676 ms, sort 0 ms, write 0 ms, index 821 ms: 10 candidates, 81865 repo-hours, 1066 releases; waiting 563 ms; commit 0 ms)
2026-11-08T04:18:11Z [load_day 2024-01-22] 2024-01-22 hour 20: 222123 events in 0 files, snapshot none (task 10620 ms: download 7353 ms overlapping gunzip 1802 ms, parse 7382 ms, sort 0 ms, write 0 ms, index 666 ms: 6 candidates, 80215 repo-hours, 975 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:18:11Z [load_day 2024-01-22] 2024-01-22 hour 21: 212780 events in 0 files, snapshot none (task 10186 ms: download 6826 ms overlapping gunzip 1704 ms, parse 6841 ms, sort 0 ms, write 0 ms, index 794 ms: 2 candidates, 74770 repo-hours, 1162 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:18:22Z [load_day 2024-01-22] 2024-01-22 hour 22: 207982 events in 0 files, snapshot none (task 10498 ms: download 7614 ms overlapping gunzip 1801 ms, parse 7368 ms, sort 0 ms, write 0 ms, index 611 ms: 8 candidates, 72553 repo-hours, 1028 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:18:22Z [load_day 2024-01-22] 2024-01-22 hour 23: 189076 events in 0 files, snapshot none (task 9395 ms: download 5856 ms overlapping gunzip 1606 ms, parse 6551 ms, sort 0 ms, write 0 ms, index 780 ms: 7 candidates, 63052 repo-hours, 764 releases; waiting 198 ms; commit 0 ms)
2026-11-08T04:18:32Z [load_day 2024-01-22] 2024-01-22: repo_hour merged from 24 files to 1 (1972195 rows, 9494 ms)
2026-11-08T04:18:34Z [load_day 2024-01-22] 2024-01-22: index committed in 11732 ms (24 + 1 + 24 files)
2026-11-08T04:18:34Z [load_day 2024-01-22] 2024-01-22: 5380038 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:18:34Z [load_day 2024-01-22] attempt 1 succeeded