orcaLog in

Runs · run 2355

load_day 2024-04-22, attempt 1 succeeded

Host
73ccef5e07c2:112520
Started
2026-11-08T05:43:29Z
Ended
2026-11-08T05:45:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
690 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
233.6 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2355/load_day/2024-04-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:43:29Z [load_day 2024-04-22] attempt 1 started
2026-11-08T05:43:30Z [load_day 2024-04-22] 2024-04-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:43:38Z [load_day 2024-04-22] 2024-04-22 hour 0: 188056 events in 0 files, snapshot none (task 8097 ms: download 4726 ms overlapping gunzip 1302 ms, parse 5437 ms, sort 0 ms, write 0 ms, index 600 ms: 17 candidates, 86399 repo-hours, 1097 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:43:39Z [load_day 2024-04-22] 2024-04-22 hour 1: 210841 events in 0 files, snapshot none (task 8245 ms: download 5425 ms overlapping gunzip 1332 ms, parse 5497 ms, sort 0 ms, write 0 ms, index 659 ms: 14 candidates, 97539 repo-hours, 892 releases; waiting 466 ms; commit 0 ms)
2026-11-08T05:43:46Z [load_day 2024-04-22] 2024-04-22 hour 2: 188525 events in 0 files, snapshot none (task 7587 ms: download 5131 ms overlapping gunzip 1195 ms, parse 4993 ms, sort 0 ms, write 0 ms, index 451 ms: 11 candidates, 65430 repo-hours, 856 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:43:47Z [load_day 2024-04-22] 2024-04-22 hour 3: 189811 events in 0 files, snapshot none (task 8212 ms: download 5958 ms overlapping gunzip 1412 ms, parse 5196 ms, sort 0 ms, write 0 ms, index 479 ms: 18 candidates, 64327 repo-hours, 903 releases; waiting 831 ms; commit 0 ms)
2026-11-08T05:43:54Z [load_day 2024-04-22] 2024-04-22 hour 4: 186611 events in 0 files, snapshot none (task 7501 ms: download 5076 ms overlapping gunzip 1245 ms, parse 4855 ms, sort 0 ms, write 0 ms, index 466 ms: 16 candidates, 60412 repo-hours, 816 releases; waiting 544 ms; commit 0 ms)
2026-11-08T05:43:57Z [load_day 2024-04-22] 2024-04-22 hour 5: 193188 events in 0 files, snapshot none (task 8905 ms: download 5660 ms overlapping gunzip 1362 ms, parse 5656 ms, sort 0 ms, write 0 ms, index 1118 ms: 7 candidates, 67098 repo-hours, 970 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:44:05Z [load_day 2024-04-22] 2024-04-22 hour 6: 225233 events in 0 files, snapshot none (task 9920 ms: download 6235 ms overlapping gunzip 1532 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 1022 ms: 20 candidates, 86408 repo-hours, 1087 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:44:08Z [load_day 2024-04-22] 2024-04-22 hour 7: 240285 events in 0 files, snapshot none (task 11263 ms: download 7643 ms overlapping gunzip 1840 ms, parse 7574 ms, sort 0 ms, write 0 ms, index 1065 ms: 7 candidates, 85980 repo-hours, 1236 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:44:17Z [load_day 2024-04-22] 2024-04-22 hour 8: 255650 events in 0 files, snapshot none (task 11656 ms: download 8737 ms overlapping gunzip 1859 ms, parse 8244 ms, sort 0 ms, write 0 ms, index 839 ms: 16 candidates, 93751 repo-hours, 1380 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:44:23Z [load_day 2024-04-22] 2024-04-22 hour 9: 259259 events in 0 files, snapshot none (task 13596 ms: download 8895 ms overlapping gunzip 2196 ms, parse 9096 ms, sort 0 ms, write 0 ms, index 1139 ms: 10 candidates, 92864 repo-hours, 1377 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:44:28Z [load_day 2024-04-22] 2024-04-22 hour 10: 243382 events in 0 files, snapshot none (task 9828 ms: download 6795 ms overlapping gunzip 1632 ms, parse 6594 ms, sort 0 ms, write 0 ms, index 891 ms: 16 candidates, 89274 repo-hours, 1177 releases; waiting 375 ms; commit 0 ms)
2026-11-08T05:44:33Z [load_day 2024-04-22] 2024-04-22 hour 11: 245562 events in 0 files, snapshot none (task 9479 ms: download 6540 ms overlapping gunzip 1464 ms, parse 6455 ms, sort 0 ms, write 0 ms, index 1029 ms: 6 candidates, 89142 repo-hours, 1099 releases; waiting 177 ms; commit 0 ms)
2026-11-08T05:44:39Z [load_day 2024-04-22] 2024-04-22 hour 12: 299292 events in 0 files, snapshot none (task 10810 ms: download 7959 ms overlapping gunzip 1641 ms, parse 7277 ms, sort 0 ms, write 0 ms, index 882 ms: 17 candidates, 126391 repo-hours, 1371 releases; waiting 724 ms; commit 0 ms)
2026-11-08T05:44:43Z [load_day 2024-04-22] 2024-04-22 hour 13: 285277 events in 0 files, snapshot none (task 9587 ms: download 6837 ms overlapping gunzip 1537 ms, parse 6422 ms, sort 0 ms, write 0 ms, index 842 ms: 9 candidates, 114023 repo-hours, 1967 releases; waiting 430 ms; commit 0 ms)
2026-11-08T05:44:49Z [load_day 2024-04-22] 2024-04-22 hour 14: 281187 events in 0 files, snapshot none (task 9774 ms: download 6904 ms overlapping gunzip 1585 ms, parse 6510 ms, sort 0 ms, write 0 ms, index 850 ms: 16 candidates, 106369 repo-hours, 1474 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:44:55Z [load_day 2024-04-22] 2024-04-22 hour 15: 286701 events in 0 files, snapshot none (task 11571 ms: download 7866 ms overlapping gunzip 1846 ms, parse 7615 ms, sort 0 ms, write 0 ms, index 1273 ms: 11 candidates, 103647 repo-hours, 1637 releases; waiting 568 ms; commit 0 ms)
2026-11-08T05:45:02Z [load_day 2024-04-22] 2024-04-22 hour 16: 269414 events in 0 files, snapshot none (task 12722 ms: download 8496 ms overlapping gunzip 1892 ms, parse 8021 ms, sort 0 ms, write 0 ms, index 1933 ms: 12 candidates, 101528 repo-hours, 1583 releases; waiting 557 ms; commit 0 ms)
2026-11-08T05:45:08Z [load_day 2024-04-22] 2024-04-22 hour 17: 263636 events in 0 files, snapshot none (task 11964 ms: download 8686 ms overlapping gunzip 2017 ms, parse 7965 ms, sort 0 ms, write 0 ms, index 709 ms: 22 candidates, 94385 repo-hours, 1413 releases; waiting 598 ms; commit 0 ms)
2026-11-08T05:45:15Z [load_day 2024-04-22] 2024-04-22 hour 18: 268520 events in 0 files, snapshot none (task 12051 ms: download 7755 ms overlapping gunzip 1957 ms, parse 8079 ms, sort 0 ms, write 0 ms, index 1153 ms: 12 candidates, 98318 repo-hours, 1395 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:45:19Z [load_day 2024-04-22] 2024-04-22 hour 19: 251585 events in 0 files, snapshot none (task 10975 ms: download 7818 ms overlapping gunzip 1725 ms, parse 7087 ms, sort 0 ms, write 0 ms, index 1295 ms: 11 candidates, 88083 repo-hours, 1151 releases; waiting 583 ms; commit 0 ms)
2026-11-08T05:45:27Z [load_day 2024-04-22] 2024-04-22 hour 20: 246838 events in 0 files, snapshot none (task 11133 ms: download 7646 ms overlapping gunzip 1724 ms, parse 7568 ms, sort 0 ms, write 0 ms, index 987 ms: 8 candidates, 87302 repo-hours, 1035 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:45:30Z [load_day 2024-04-22] 2024-04-22 hour 21: 226524 events in 0 files, snapshot none (task 10198 ms: download 7212 ms overlapping gunzip 1663 ms, parse 6860 ms, sort 0 ms, write 0 ms, index 910 ms: 15 candidates, 75584 repo-hours, 1095 releases; waiting 459 ms; commit 0 ms)
2026-11-08T05:45:38Z [load_day 2024-04-22] 2024-04-22 hour 22: 204427 events in 0 files, snapshot none (task 10870 ms: download 7579 ms overlapping gunzip 1925 ms, parse 7355 ms, sort 0 ms, write 0 ms, index 635 ms: 12 candidates, 68079 repo-hours, 981 releases; waiting 645 ms; commit 0 ms)
2026-11-08T05:45:40Z [load_day 2024-04-22] 2024-04-22 hour 23: 185105 events in 0 files, snapshot none (task 9499 ms: download 7033 ms overlapping gunzip 1510 ms, parse 6523 ms, sort 0 ms, write 0 ms, index 536 ms: 12 candidates, 63890 repo-hours, 826 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:45:50Z [load_day 2024-04-22] 2024-04-22: repo_hour merged from 24 files to 1 (2106223 rows, 9542 ms)
2026-11-08T05:45:52Z [load_day 2024-04-22] 2024-04-22: index committed in 12076 ms (24 + 1 + 24 files)
2026-11-08T05:45:52Z [load_day 2024-04-22] 2024-04-22: 5694909 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:45:52Z [load_day 2024-04-22] attempt 1 succeeded