orcaLog in

Runs · run 2922

load_day 2024-09-04, attempt 1 succeeded

Host
73ccef5e07c2:173184
Started
2026-11-08T07:45:53Z
Ended
2026-11-08T07:47:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
797 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.2 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2922/load_day/2024-09-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:45:53Z [load_day 2024-09-04] attempt 1 started
2026-11-08T07:45:54Z [load_day 2024-09-04] 2024-09-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:46:01Z [load_day 2024-09-04] 2024-09-04 hour 0: 190721 events in 0 files, snapshot none (task 6763 ms: download 4916 ms overlapping gunzip 916 ms, parse 3578 ms, sort 0 ms, write 0 ms, index 695 ms: 12 candidates, 96595 repo-hours, 1174 releases; waiting 1234 ms; commit 0 ms)
2026-11-08T07:46:01Z [load_day 2024-09-04] 2024-09-04 hour 1: 200034 events in 0 files, snapshot none (task 5659 ms: download 3559 ms overlapping gunzip 828 ms, parse 3371 ms, sort 0 ms, write 0 ms, index 741 ms: 9 candidates, 108467 repo-hours, 853 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:46:10Z [load_day 2024-09-04] 2024-09-04 hour 2: 170959 events in 0 files, snapshot none (task 6394 ms: download 3048 ms overlapping gunzip 891 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 947 ms: 9 candidates, 76215 repo-hours, 815 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:46:10Z [load_day 2024-09-04] 2024-09-04 hour 3: 183190 events in 0 files, snapshot none (task 6318 ms: download 3049 ms overlapping gunzip 961 ms, parse 3813 ms, sort 0 ms, write 0 ms, index 650 ms: 3 candidates, 76401 repo-hours, 3971 releases; waiting 630 ms; commit 0 ms)
2026-11-08T07:46:16Z [load_day 2024-09-04] 2024-09-04 hour 4: 162906 events in 0 files, snapshot none (task 5889 ms: download 3278 ms overlapping gunzip 897 ms, parse 3645 ms, sort 0 ms, write 0 ms, index 539 ms: 4 candidates, 63863 repo-hours, 660 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:46:17Z [load_day 2024-09-04] 2024-09-04 hour 5: 180163 events in 0 files, snapshot none (task 6914 ms: download 4074 ms overlapping gunzip 1056 ms, parse 4195 ms, sort 0 ms, write 0 ms, index 926 ms: 4 candidates, 70129 repo-hours, 948 releases; waiting 455 ms; commit 0 ms)
2026-11-08T07:46:25Z [load_day 2024-09-04] 2024-09-04 hour 6: 207062 events in 0 files, snapshot none (task 8043 ms: download 4495 ms overlapping gunzip 1233 ms, parse 5038 ms, sort 0 ms, write 0 ms, index 929 ms: 11 candidates, 94750 repo-hours, 1037 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:46:26Z [load_day 2024-09-04] 2024-09-04 hour 7: 217127 events in 0 files, snapshot none (task 8356 ms: download 5321 ms overlapping gunzip 1272 ms, parse 5336 ms, sort 0 ms, write 0 ms, index 920 ms: 21 candidates, 88338 repo-hours, 1141 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:46:34Z [load_day 2024-09-04] 2024-09-04 hour 8: 226330 events in 0 files, snapshot none (task 9406 ms: download 6105 ms overlapping gunzip 1556 ms, parse 6293 ms, sort 0 ms, write 0 ms, index 827 ms: 14 candidates, 95594 repo-hours, 1235 releases; waiting 471 ms; commit 0 ms)
2026-11-08T07:46:36Z [load_day 2024-09-04] 2024-09-04 hour 9: 233501 events in 0 files, snapshot none (task 9060 ms: download 6294 ms overlapping gunzip 1472 ms, parse 5924 ms, sort 0 ms, write 0 ms, index 742 ms: 9 candidates, 100061 repo-hours, 1433 releases; waiting 541 ms; commit 0 ms)
2026-11-08T07:46:44Z [load_day 2024-09-04] 2024-09-04 hour 10: 218873 events in 0 files, snapshot none (task 8788 ms: download 5687 ms overlapping gunzip 1354 ms, parse 5791 ms, sort 0 ms, write 0 ms, index 802 ms: 8 candidates, 90876 repo-hours, 1228 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:46:45Z [load_day 2024-09-04] 2024-09-04 hour 11: 221145 events in 0 files, snapshot none (task 8671 ms: download 5644 ms overlapping gunzip 1443 ms, parse 5757 ms, sort 0 ms, write 0 ms, index 676 ms: 6 candidates, 88511 repo-hours, 1219 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:46:54Z [load_day 2024-09-04] 2024-09-04 hour 12: 266370 events in 0 files, snapshot none (task 9818 ms: download 5096 ms overlapping gunzip 1487 ms, parse 6433 ms, sort 0 ms, write 0 ms, index 1423 ms: 9 candidates, 133025 repo-hours, 1464 releases; waiting 205 ms; commit 0 ms)
2026-11-08T07:46:56Z [load_day 2024-09-04] 2024-09-04 hour 13: 243742 events in 0 files, snapshot none (task 10634 ms: download 7963 ms overlapping gunzip 1633 ms, parse 6645 ms, sort 0 ms, write 0 ms, index 794 ms: 8 candidates, 114658 repo-hours, 1251 releases; waiting 1205 ms; commit 0 ms)
2026-11-08T07:47:05Z [load_day 2024-09-04] 2024-09-04 hour 14: 242419 events in 0 files, snapshot none (task 10913 ms: download 7557 ms overlapping gunzip 1722 ms, parse 7313 ms, sort 0 ms, write 0 ms, index 909 ms: 17 candidates, 103473 repo-hours, 1378 releases; waiting 618 ms; commit 0 ms)
2026-11-08T07:47:08Z [load_day 2024-09-04] 2024-09-04 hour 15: 243444 events in 0 files, snapshot none (task 10867 ms: download 8175 ms overlapping gunzip 1781 ms, parse 7513 ms, sort 0 ms, write 0 ms, index 787 ms: 9 candidates, 107205 repo-hours, 1543 releases; waiting 441 ms; commit 0 ms)
2026-11-08T07:47:16Z [load_day 2024-09-04] 2024-09-04 hour 16: 230369 events in 0 files, snapshot none (task 9944 ms: download 6684 ms overlapping gunzip 1570 ms, parse 6512 ms, sort 0 ms, write 0 ms, index 1032 ms: 11 candidates, 98559 repo-hours, 1238 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:47:17Z [load_day 2024-09-04] 2024-09-04 hour 17: 223524 events in 0 files, snapshot none (task 9091 ms: download 6619 ms overlapping gunzip 1444 ms, parse 6212 ms, sort 0 ms, write 0 ms, index 685 ms: 5 candidates, 97228 repo-hours, 1222 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:47:26Z [load_day 2024-09-04] 2024-09-04 hour 18: 237044 events in 0 files, snapshot none (task 9672 ms: download 6307 ms overlapping gunzip 1467 ms, parse 6129 ms, sort 0 ms, write 0 ms, index 827 ms: 8 candidates, 112347 repo-hours, 1251 releases; waiting 892 ms; commit 0 ms)
2026-11-08T07:47:27Z [load_day 2024-09-04] 2024-09-04 hour 19: 214316 events in 0 files, snapshot none (task 9217 ms: download 6775 ms overlapping gunzip 1501 ms, parse 6125 ms, sort 0 ms, write 0 ms, index 615 ms: 10 candidates, 84188 repo-hours, 1172 releases; waiting 644 ms; commit 0 ms)
2026-11-08T07:47:35Z [load_day 2024-09-04] 2024-09-04 hour 20: 198447 events in 0 files, snapshot none (task 8848 ms: download 6021 ms overlapping gunzip 1354 ms, parse 5511 ms, sort 0 ms, write 0 ms, index 678 ms: 14 candidates, 81274 repo-hours, 1125 releases; waiting 970 ms; commit 0 ms)
2026-11-08T07:47:36Z [load_day 2024-09-04] 2024-09-04 hour 21: 189662 events in 0 files, snapshot none (task 8426 ms: download 5400 ms overlapping gunzip 1421 ms, parse 5770 ms, sort 0 ms, write 0 ms, index 601 ms: 19 candidates, 75792 repo-hours, 1309 releases; waiting 351 ms; commit 0 ms)
2026-11-08T07:47:42Z [load_day 2024-09-04] 2024-09-04 hour 22: 172846 events in 0 files, snapshot none (task 6189 ms: download 2972 ms overlapping gunzip 994 ms, parse 4023 ms, sort 0 ms, write 0 ms, index 749 ms: 9 candidates, 64069 repo-hours, 1074 releases; waiting 198 ms; commit 0 ms)
2026-11-08T07:47:43Z [load_day 2024-09-04] 2024-09-04 hour 23: 162733 events in 0 files, snapshot none (task 6344 ms: download 3730 ms overlapping gunzip 957 ms, parse 4078 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 60969 repo-hours, 792 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:47:53Z [load_day 2024-09-04] 2024-09-04: repo_hour merged from 24 files to 1 (2182587 rows, 10082 ms)
2026-11-08T07:47:55Z [load_day 2024-09-04] 2024-09-04: index committed in 12479 ms (24 + 1 + 24 files)
2026-11-08T07:47:55Z [load_day 2024-09-04] 2024-09-04: 5036927 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:47:55Z [load_day 2024-09-04] attempt 1 succeeded