orcaLog in

Runs · run 3031

load_day 2024-10-01, attempt 1 succeeded

Host
73ccef5e07c2:186135
Started
2026-11-08T08:09:49Z
Ended
2026-11-08T08:11:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
722 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
163.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3031/load_day/2024-10-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:09:49Z [load_day 2024-10-01] attempt 1 started
2026-11-08T08:09:51Z [load_day 2024-10-01] 2024-10-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:09:58Z [load_day 2024-10-01] 2024-10-01 hour 0: 186403 events in 0 files, snapshot none (task 6700 ms: download 3784 ms overlapping gunzip 1097 ms, parse 4037 ms, sort 0 ms, write 0 ms, index 775 ms: 11 candidates, 85434 repo-hours, 1224 releases; waiting 490 ms; commit 0 ms)
2026-11-08T08:09:59Z [load_day 2024-10-01] 2024-10-01 hour 1: 206323 events in 0 files, snapshot none (task 8003 ms: download 5305 ms overlapping gunzip 1097 ms, parse 4261 ms, sort 0 ms, write 0 ms, index 777 ms: 9 candidates, 109774 repo-hours, 909 releases; waiting 1527 ms; commit 0 ms)
2026-11-08T08:10:04Z [load_day 2024-10-01] 2024-10-01 hour 2: 169341 events in 0 files, snapshot none (task 6061 ms: download 3149 ms overlapping gunzip 957 ms, parse 3459 ms, sort 0 ms, write 0 ms, index 778 ms: 7 candidates, 71490 repo-hours, 1076 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:10:06Z [load_day 2024-10-01] 2024-10-01 hour 3: 186634 events in 0 files, snapshot none (task 6504 ms: download 3710 ms overlapping gunzip 909 ms, parse 4023 ms, sort 0 ms, write 0 ms, index 797 ms: 3 candidates, 74282 repo-hours, 3979 releases; waiting 481 ms; commit 0 ms)
2026-11-08T08:10:09Z [load_day 2024-10-01] 2024-10-01 hour 4: 169607 events in 0 files, snapshot none (task 4429 ms: download 2495 ms overlapping gunzip 692 ms, parse 2475 ms, sort 0 ms, write 0 ms, index 487 ms: 11 candidates, 64033 repo-hours, 723 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:10:15Z [load_day 2024-10-01] 2024-10-01 hour 5: 183636 events in 0 files, snapshot none (task 8379 ms: download 6105 ms overlapping gunzip 1053 ms, parse 4166 ms, sort 0 ms, write 0 ms, index 484 ms: 5 candidates, 67651 repo-hours, 878 releases; waiting 2366 ms; commit 0 ms)
2026-11-08T08:10:17Z [load_day 2024-10-01] 2024-10-01 hour 6: 215468 events in 0 files, snapshot none (task 7158 ms: download 4709 ms overlapping gunzip 1206 ms, parse 4376 ms, sort 0 ms, write 0 ms, index 791 ms: 12 candidates, 92021 repo-hours, 975 releases; waiting 481 ms; commit 0 ms)
2026-11-08T08:10:23Z [load_day 2024-10-01] 2024-10-01 hour 7: 215458 events in 0 files, snapshot none (task 7073 ms: download 4696 ms overlapping gunzip 1174 ms, parse 4365 ms, sort 0 ms, write 0 ms, index 705 ms: 8 candidates, 83313 repo-hours, 1078 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:10:25Z [load_day 2024-10-01] 2024-10-01 hour 8: 224716 events in 0 files, snapshot none (task 7211 ms: download 5784 ms overlapping gunzip 1198 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 643 ms: 9 candidates, 90459 repo-hours, 1335 releases; waiting 700 ms; commit 0 ms)
2026-11-08T08:10:30Z [load_day 2024-10-01] 2024-10-01 hour 9: 230166 events in 0 files, snapshot none (task 6709 ms: download 4231 ms overlapping gunzip 1026 ms, parse 3738 ms, sort 0 ms, write 0 ms, index 768 ms: 12 candidates, 95252 repo-hours, 1349 releases; waiting 895 ms; commit 0 ms)
2026-11-08T08:10:32Z [load_day 2024-10-01] 2024-10-01 hour 10: 218099 events in 0 files, snapshot none (task 6231 ms: download 4403 ms overlapping gunzip 985 ms, parse 3455 ms, sort 0 ms, write 0 ms, index 650 ms: 11 candidates, 89371 repo-hours, 1066 releases; waiting 741 ms; commit 0 ms)
2026-11-08T08:10:37Z [load_day 2024-10-01] 2024-10-01 hour 11: 223086 events in 0 files, snapshot none (task 5946 ms: download 3580 ms overlapping gunzip 981 ms, parse 3556 ms, sort 0 ms, write 0 ms, index 692 ms: 6 candidates, 88158 repo-hours, 1138 releases; waiting 415 ms; commit 0 ms)
2026-11-08T08:10:39Z [load_day 2024-10-01] 2024-10-01 hour 12: 272868 events in 0 files, snapshot none (task 7460 ms: download 4343 ms overlapping gunzip 1036 ms, parse 4022 ms, sort 0 ms, write 0 ms, index 1395 ms: 8 candidates, 137636 repo-hours, 1430 releases; waiting 690 ms; commit 0 ms)
2026-11-08T08:10:45Z [load_day 2024-10-01] 2024-10-01 hour 13: 254960 events in 0 files, snapshot none (task 8008 ms: download 5134 ms overlapping gunzip 1262 ms, parse 5135 ms, sort 0 ms, write 0 ms, index 901 ms: 14 candidates, 117923 repo-hours, 1360 releases; waiting 399 ms; commit 0 ms)
2026-11-08T08:10:50Z [load_day 2024-10-01] 2024-10-01 hour 14: 252436 events in 0 files, snapshot none (task 9727 ms: download 5689 ms overlapping gunzip 1622 ms, parse 5783 ms, sort 0 ms, write 0 ms, index 1464 ms: 11 candidates, 106498 repo-hours, 1529 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:10:54Z [load_day 2024-10-01] 2024-10-01 hour 15: 260103 events in 0 files, snapshot none (task 8267 ms: download 5020 ms overlapping gunzip 1303 ms, parse 4680 ms, sort 0 ms, write 0 ms, index 1404 ms: 5 candidates, 111338 repo-hours, 1451 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:10:59Z [load_day 2024-10-01] 2024-10-01 hour 16: 245005 events in 0 files, snapshot none (task 8566 ms: download 5713 ms overlapping gunzip 1345 ms, parse 5273 ms, sort 0 ms, write 0 ms, index 946 ms: 3 candidates, 101118 repo-hours, 1401 releases; waiting 649 ms; commit 0 ms)
2026-11-08T08:11:01Z [load_day 2024-10-01] 2024-10-01 hour 17: 234037 events in 0 files, snapshot none (task 6892 ms: download 3740 ms overlapping gunzip 1020 ms, parse 3817 ms, sort 0 ms, write 0 ms, index 1312 ms: 7 candidates, 92517 repo-hours, 1160 releases; waiting 493 ms; commit 0 ms)
2026-11-08T08:11:07Z [load_day 2024-10-01] 2024-10-01 hour 18: 247075 events in 0 files, snapshot none (task 8007 ms: download 4627 ms overlapping gunzip 1251 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 1307 ms: 6 candidates, 107952 repo-hours, 1304 releases; waiting 348 ms; commit 0 ms)
2026-11-08T08:11:09Z [load_day 2024-10-01] 2024-10-01 hour 19: 223632 events in 0 files, snapshot none (task 7443 ms: download 4389 ms overlapping gunzip 1227 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 734 ms: 10 candidates, 85435 repo-hours, 1208 releases; waiting 335 ms; commit 0 ms)
2026-11-08T08:11:15Z [load_day 2024-10-01] 2024-10-01 hour 20: 210957 events in 0 files, snapshot none (task 6560 ms: download 3311 ms overlapping gunzip 973 ms, parse 3787 ms, sort 0 ms, write 0 ms, index 943 ms: 19 candidates, 82293 repo-hours, 1189 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:11:16Z [load_day 2024-10-01] 2024-10-01 hour 21: 203795 events in 0 files, snapshot none (task 6529 ms: download 3878 ms overlapping gunzip 1093 ms, parse 4023 ms, sort 0 ms, write 0 ms, index 600 ms: 13 candidates, 78217 repo-hours, 1267 releases; waiting 499 ms; commit 0 ms)
2026-11-08T08:11:21Z [load_day 2024-10-01] 2024-10-01 hour 22: 179121 events in 0 files, snapshot none (task 6049 ms: download 3501 ms overlapping gunzip 891 ms, parse 3216 ms, sort 0 ms, write 0 ms, index 1065 ms: 13 candidates, 65095 repo-hours, 1074 releases; waiting 543 ms; commit 0 ms)
2026-11-08T08:11:22Z [load_day 2024-10-01] 2024-10-01 hour 23: 167836 events in 0 files, snapshot none (task 5048 ms: download 2294 ms overlapping gunzip 900 ms, parse 3127 ms, sort 0 ms, write 0 ms, index 549 ms: 10 candidates, 59772 repo-hours, 953 releases; waiting 183 ms; commit 0 ms)
2026-11-08T08:11:31Z [load_day 2024-10-01] 2024-10-01: repo_hour merged from 24 files to 1 (2157032 rows, 9445 ms)
2026-11-08T08:11:34Z [load_day 2024-10-01] 2024-10-01: index committed in 12146 ms (24 + 1 + 24 files)
2026-11-08T08:11:34Z [load_day 2024-10-01] 2024-10-01: 5180762 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:11:34Z [load_day 2024-10-01] attempt 1 succeeded