orcaLog in

Runs · run 3335

load_day 2024-12-18, attempt 1 succeeded

Host
73ccef5e07c2:224636
Started
2026-11-08T09:25:54Z
Ended
2026-11-08T09:27:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
846 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
195.6 s, up to 3.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3335/load_day/2024-12-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:25:54Z [load_day 2024-12-18] attempt 1 started
2026-11-08T09:25:55Z [load_day 2024-12-18] 2024-12-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:26:04Z [load_day 2024-12-18] 2024-12-18 hour 0: 194578 events in 0 files, snapshot none (task 7822 ms: download 5136 ms overlapping gunzip 1246 ms, parse 4989 ms, sort 0 ms, write 0 ms, index 793 ms: 8 candidates, 86728 repo-hours, 1260 releases; waiting 469 ms; commit 0 ms)
2026-11-08T09:26:04Z [load_day 2024-12-18] 2024-12-18 hour 1: 205300 events in 0 files, snapshot none (task 7572 ms: download 4807 ms overlapping gunzip 1163 ms, parse 4990 ms, sort 0 ms, write 0 ms, index 760 ms: 11 candidates, 105252 repo-hours, 827 releases; waiting 279 ms; commit 0 ms)
2026-11-08T09:26:11Z [load_day 2024-12-18] 2024-12-18 hour 2: 176837 events in 0 files, snapshot none (task 7007 ms: download 4428 ms overlapping gunzip 1111 ms, parse 4488 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 74551 repo-hours, 846 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:26:11Z [load_day 2024-12-18] 2024-12-18 hour 3: 189574 events in 0 files, snapshot none (task 7025 ms: download 4348 ms overlapping gunzip 1134 ms, parse 4816 ms, sort 0 ms, write 0 ms, index 570 ms: 4 candidates, 77924 repo-hours, 3926 releases; waiting 225 ms; commit 0 ms)
2026-11-08T09:26:19Z [load_day 2024-12-18] 2024-12-18 hour 4: 172499 events in 0 files, snapshot none (task 7496 ms: download 4914 ms overlapping gunzip 1210 ms, parse 4959 ms, sort 0 ms, write 0 ms, index 447 ms: 1 candidates, 65034 repo-hours, 758 releases; waiting 537 ms; commit 0 ms)
2026-11-08T09:26:19Z [load_day 2024-12-18] 2024-12-18 hour 5: 182097 events in 0 files, snapshot none (task 7599 ms: download 4830 ms overlapping gunzip 1202 ms, parse 4895 ms, sort 0 ms, write 0 ms, index 525 ms: 1 candidates, 70507 repo-hours, 768 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:26:26Z [load_day 2024-12-18] 2024-12-18 hour 6: 209917 events in 0 files, snapshot none (task 6725 ms: download 4285 ms overlapping gunzip 1011 ms, parse 4132 ms, sort 0 ms, write 0 ms, index 624 ms: 7 candidates, 93745 repo-hours, 971 releases; waiting 600 ms; commit 0 ms)
2026-11-08T09:26:27Z [load_day 2024-12-18] 2024-12-18 hour 7: 211668 events in 0 files, snapshot none (task 7074 ms: download 4581 ms overlapping gunzip 1093 ms, parse 4505 ms, sort 0 ms, write 0 ms, index 659 ms: 8 candidates, 82276 repo-hours, 870 releases; waiting 572 ms; commit 0 ms)
2026-11-08T09:26:34Z [load_day 2024-12-18] 2024-12-18 hour 8: 225908 events in 0 files, snapshot none (task 6853 ms: download 4215 ms overlapping gunzip 1083 ms, parse 4506 ms, sort 0 ms, write 0 ms, index 681 ms: 4 candidates, 94461 repo-hours, 1103 releases; waiting 289 ms; commit 0 ms)
2026-11-08T09:26:34Z [load_day 2024-12-18] 2024-12-18 hour 9: 233932 events in 0 files, snapshot none (task 7133 ms: download 4605 ms overlapping gunzip 1130 ms, parse 4668 ms, sort 0 ms, write 0 ms, index 696 ms: 9 candidates, 99242 repo-hours, 1403 releases; waiting 362 ms; commit 0 ms)
2026-11-08T09:26:44Z [load_day 2024-12-18] 2024-12-18 hour 10: 233468 events in 0 files, snapshot none (task 10187 ms: download 7344 ms overlapping gunzip 1587 ms, parse 6841 ms, sort 0 ms, write 0 ms, index 926 ms: 9 candidates, 95088 repo-hours, 1241 releases; waiting 558 ms; commit 0 ms)
2026-11-08T09:26:44Z [load_day 2024-12-18] 2024-12-18 hour 11: 227029 events in 0 files, snapshot none (task 8697 ms: download 5934 ms overlapping gunzip 1345 ms, parse 5637 ms, sort 0 ms, write 0 ms, index 868 ms: 5 candidates, 89129 repo-hours, 1113 releases; waiting 519 ms; commit 0 ms)
2026-11-08T09:26:55Z [load_day 2024-12-18] 2024-12-18 hour 12: 265392 events in 0 files, snapshot none (task 10397 ms: download 7098 ms overlapping gunzip 1610 ms, parse 7004 ms, sort 0 ms, write 0 ms, index 990 ms: 11 candidates, 135748 repo-hours, 1332 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:26:55Z [load_day 2024-12-18] 2024-12-18 hour 13: 256644 events in 0 files, snapshot none (task 9899 ms: download 6756 ms overlapping gunzip 1568 ms, parse 6578 ms, sort 0 ms, write 0 ms, index 892 ms: 5 candidates, 118253 repo-hours, 1333 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:27:07Z [load_day 2024-12-18] 2024-12-18 hour 14: 246318 events in 0 files, snapshot none (task 11475 ms: download 8428 ms overlapping gunzip 1791 ms, parse 7651 ms, sort 0 ms, write 0 ms, index 1142 ms: 10 candidates, 103600 repo-hours, 1441 releases; waiting 606 ms; commit 0 ms)
2026-11-08T09:27:07Z [load_day 2024-12-18] 2024-12-18 hour 15: 257430 events in 0 files, snapshot none (task 11133 ms: download 8214 ms overlapping gunzip 1824 ms, parse 7809 ms, sort 0 ms, write 0 ms, index 956 ms: 15 candidates, 111310 repo-hours, 1567 releases; waiting 269 ms; commit 0 ms)
2026-11-08T09:27:18Z [load_day 2024-12-18] 2024-12-18 hour 16: 244488 events in 0 files, snapshot none (task 10144 ms: download 7188 ms overlapping gunzip 1643 ms, parse 6741 ms, sort 0 ms, write 0 ms, index 905 ms: 7 candidates, 102093 repo-hours, 1345 releases; waiting 502 ms; commit 0 ms)
2026-11-08T09:27:18Z [load_day 2024-12-18] 2024-12-18 hour 17: 233867 events in 0 files, snapshot none (task 9764 ms: download 7071 ms overlapping gunzip 1509 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 756 ms: 8 candidates, 92432 repo-hours, 1270 releases; waiting 496 ms; commit 0 ms)
2026-11-08T09:27:28Z [load_day 2024-12-18] 2024-12-18 hour 18: 241969 events in 0 files, snapshot none (task 8888 ms: download 6037 ms overlapping gunzip 1381 ms, parse 5752 ms, sort 0 ms, write 0 ms, index 928 ms: 8 candidates, 105499 repo-hours, 1332 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:27:28Z [load_day 2024-12-18] 2024-12-18 hour 19: 220361 events in 0 files, snapshot none (task 8870 ms: download 6077 ms overlapping gunzip 1365 ms, parse 5767 ms, sort 0 ms, write 0 ms, index 907 ms: 9 candidates, 82821 repo-hours, 1073 releases; waiting 469 ms; commit 0 ms)
2026-11-08T09:27:37Z [load_day 2024-12-18] 2024-12-18 hour 20: 219203 events in 0 files, snapshot none (task 8802 ms: download 6311 ms overlapping gunzip 1407 ms, parse 5974 ms, sort 0 ms, write 0 ms, index 651 ms: 6 candidates, 88833 repo-hours, 997 releases; waiting 505 ms; commit 0 ms)
2026-11-08T09:27:37Z [load_day 2024-12-18] 2024-12-18 hour 21: 209641 events in 0 files, snapshot none (task 8474 ms: download 6127 ms overlapping gunzip 1257 ms, parse 5851 ms, sort 0 ms, write 0 ms, index 573 ms: 9 candidates, 80300 repo-hours, 1203 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:27:46Z [load_day 2024-12-18] 2024-12-18 hour 22: 189263 events in 0 files, snapshot none (task 8235 ms: download 5651 ms overlapping gunzip 1413 ms, parse 5809 ms, sort 0 ms, write 0 ms, index 542 ms: 6 candidates, 68904 repo-hours, 1199 releases; waiting 183 ms; commit 0 ms)
2026-11-08T09:27:46Z [load_day 2024-12-18] 2024-12-18 hour 23: 177750 events in 0 files, snapshot none (task 7866 ms: download 5110 ms overlapping gunzip 1185 ms, parse 5235 ms, sort 0 ms, write 0 ms, index 564 ms: 6 candidates, 64115 repo-hours, 871 releases; waiting 520 ms; commit 0 ms)
2026-11-08T09:27:55Z [load_day 2024-12-18] 2024-12-18: repo_hour merged from 24 files to 1 (2187845 rows, 9599 ms)
2026-11-08T09:27:58Z [load_day 2024-12-18] 2024-12-18: index committed in 12436 ms (24 + 1 + 24 files)
2026-11-08T09:27:58Z [load_day 2024-12-18] 2024-12-18: 5225133 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:27:58Z [load_day 2024-12-18] attempt 1 succeeded