orcaLog in

Runs · run 2978

load_day 2024-09-18, attempt 1 succeeded

Host
73ccef5e07c2:179772
Started
2026-11-08T07:58:34Z
Ended
2026-11-08T08:00:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
807 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.1 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2978/load_day/2024-09-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:58:34Z [load_day 2024-09-18] attempt 1 started
2026-11-08T07:58:35Z [load_day 2024-09-18] 2024-09-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:58:43Z [load_day 2024-09-18] 2024-09-18 hour 0: 180325 events in 0 files, snapshot none (task 7938 ms: download 4953 ms overlapping gunzip 1324 ms, parse 5056 ms, sort 0 ms, write 0 ms, index 684 ms: 16 candidates, 89733 repo-hours, 1091 releases; waiting 428 ms; commit 0 ms)
2026-11-08T07:58:44Z [load_day 2024-09-18] 2024-09-18 hour 1: 196320 events in 0 files, snapshot none (task 8260 ms: download 5613 ms overlapping gunzip 1414 ms, parse 5641 ms, sort 0 ms, write 0 ms, index 726 ms: 13 candidates, 107086 repo-hours, 811 releases; waiting 201 ms; commit 0 ms)
2026-11-08T07:58:52Z [load_day 2024-09-18] 2024-09-18 hour 2: 178587 events in 0 files, snapshot none (task 8417 ms: download 5243 ms overlapping gunzip 1368 ms, parse 5325 ms, sort 0 ms, write 0 ms, index 870 ms: 5 candidates, 81548 repo-hours, 893 releases; waiting 536 ms; commit 0 ms)
2026-11-08T07:58:53Z [load_day 2024-09-18] 2024-09-18 hour 3: 188184 events in 0 files, snapshot none (task 8552 ms: download 5519 ms overlapping gunzip 1375 ms, parse 5710 ms, sort 0 ms, write 0 ms, index 651 ms: 2 candidates, 77833 repo-hours, 3959 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:59:01Z [load_day 2024-09-18] 2024-09-18 hour 4: 166780 events in 0 files, snapshot none (task 8299 ms: download 5113 ms overlapping gunzip 1209 ms, parse 4665 ms, sort 0 ms, write 0 ms, index 504 ms: 4 candidates, 65406 repo-hours, 653 releases; waiting 1563 ms; commit 0 ms)
2026-11-08T07:59:01Z [load_day 2024-09-18] 2024-09-18 hour 5: 177392 events in 0 files, snapshot none (task 7775 ms: download 5061 ms overlapping gunzip 1309 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 694 ms: 6 candidates, 70271 repo-hours, 851 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:59:09Z [load_day 2024-09-18] 2024-09-18 hour 6: 210006 events in 0 files, snapshot none (task 7414 ms: download 3875 ms overlapping gunzip 1161 ms, parse 4695 ms, sort 0 ms, write 0 ms, index 1003 ms: 11 candidates, 96327 repo-hours, 1053 releases; waiting 234 ms; commit 0 ms)
2026-11-08T07:59:10Z [load_day 2024-09-18] 2024-09-18 hour 7: 218135 events in 0 files, snapshot none (task 8350 ms: download 5663 ms overlapping gunzip 1343 ms, parse 5557 ms, sort 0 ms, write 0 ms, index 671 ms: 10 candidates, 88882 repo-hours, 1131 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:59:17Z [load_day 2024-09-18] 2024-09-18 hour 8: 236877 events in 0 files, snapshot none (task 7577 ms: download 5066 ms overlapping gunzip 1200 ms, parse 4890 ms, sort 0 ms, write 0 ms, index 683 ms: 16 candidates, 97861 repo-hours, 1567 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:59:18Z [load_day 2024-09-18] 2024-09-18 hour 9: 238707 events in 0 files, snapshot none (task 8289 ms: download 5616 ms overlapping gunzip 1263 ms, parse 5200 ms, sort 0 ms, write 0 ms, index 762 ms: 2 candidates, 100946 repo-hours, 1433 releases; waiting 710 ms; commit 0 ms)
2026-11-08T07:59:25Z [load_day 2024-09-18] 2024-09-18 hour 10: 225467 events in 0 files, snapshot none (task 7297 ms: download 4759 ms overlapping gunzip 1161 ms, parse 4624 ms, sort 0 ms, write 0 ms, index 655 ms: 5 candidates, 93473 repo-hours, 1359 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:59:26Z [load_day 2024-09-18] 2024-09-18 hour 11: 230010 events in 0 files, snapshot none (task 7117 ms: download 4696 ms overlapping gunzip 1136 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 633 ms: 6 candidates, 91862 repo-hours, 1147 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:59:36Z [load_day 2024-09-18] 2024-09-18 hour 12: 282724 events in 0 files, snapshot none (task 11191 ms: download 7754 ms overlapping gunzip 1691 ms, parse 7268 ms, sort 0 ms, write 0 ms, index 1408 ms: 12 candidates, 139952 repo-hours, 1352 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:59:37Z [load_day 2024-09-18] 2024-09-18 hour 13: 261388 events in 0 files, snapshot none (task 10840 ms: download 6959 ms overlapping gunzip 1752 ms, parse 7114 ms, sort 0 ms, write 0 ms, index 1137 ms: 10 candidates, 122765 repo-hours, 1431 releases; waiting 466 ms; commit 0 ms)
2026-11-08T07:59:47Z [load_day 2024-09-18] 2024-09-18 hour 14: 252390 events in 0 files, snapshot none (task 10628 ms: download 7225 ms overlapping gunzip 1751 ms, parse 7065 ms, sort 0 ms, write 0 ms, index 938 ms: 9 candidates, 108490 repo-hours, 1544 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:59:48Z [load_day 2024-09-18] 2024-09-18 hour 15: 254183 events in 0 files, snapshot none (task 10117 ms: download 7259 ms overlapping gunzip 1653 ms, parse 6842 ms, sort 0 ms, write 0 ms, index 782 ms: 15 candidates, 111726 repo-hours, 1489 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:59:58Z [load_day 2024-09-18] 2024-09-18 hour 16: 236321 events in 0 files, snapshot none (task 9799 ms: download 7269 ms overlapping gunzip 1576 ms, parse 6727 ms, sort 0 ms, write 0 ms, index 688 ms: 14 candidates, 97614 repo-hours, 1177 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:59:58Z [load_day 2024-09-18] 2024-09-18 hour 17: 228143 events in 0 files, snapshot none (task 9253 ms: download 6647 ms overlapping gunzip 1542 ms, parse 6238 ms, sort 0 ms, write 0 ms, index 684 ms: 6 candidates, 91892 repo-hours, 1052 releases; waiting 434 ms; commit 0 ms)
2026-11-08T08:00:07Z [load_day 2024-09-18] 2024-09-18 hour 18: 232965 events in 0 files, snapshot none (task 9174 ms: download 6643 ms overlapping gunzip 1507 ms, parse 6127 ms, sort 0 ms, write 0 ms, index 722 ms: 12 candidates, 103538 repo-hours, 1298 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:00:07Z [load_day 2024-09-18] 2024-09-18 hour 19: 212280 events in 0 files, snapshot none (task 8671 ms: download 6251 ms overlapping gunzip 1433 ms, parse 5528 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 83281 repo-hours, 1151 releases; waiting 779 ms; commit 0 ms)
2026-11-08T08:00:16Z [load_day 2024-09-18] 2024-09-18 hour 20: 203564 events in 0 files, snapshot none (task 7743 ms: download 5124 ms overlapping gunzip 1224 ms, parse 4804 ms, sort 0 ms, write 0 ms, index 639 ms: 11 candidates, 80553 repo-hours, 1081 releases; waiting 769 ms; commit 0 ms)
2026-11-08T08:00:16Z [load_day 2024-09-18] 2024-09-18 hour 21: 196831 events in 0 files, snapshot none (task 7595 ms: download 5078 ms overlapping gunzip 1166 ms, parse 4759 ms, sort 0 ms, write 0 ms, index 602 ms: 6 candidates, 75953 repo-hours, 1171 releases; waiting 671 ms; commit 0 ms)
2026-11-08T08:00:23Z [load_day 2024-09-18] 2024-09-18 hour 22: 170879 events in 0 files, snapshot none (task 6873 ms: download 4288 ms overlapping gunzip 1088 ms, parse 4475 ms, sort 0 ms, write 0 ms, index 451 ms: 6 candidates, 62989 repo-hours, 1168 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:00:23Z [load_day 2024-09-18] 2024-09-18 hour 23: 163787 events in 0 files, snapshot none (task 6429 ms: download 3928 ms overlapping gunzip 980 ms, parse 4103 ms, sort 0 ms, write 0 ms, index 549 ms: 8 candidates, 59793 repo-hours, 798 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:00:32Z [load_day 2024-09-18] 2024-09-18: repo_hour merged from 24 files to 1 (2199774 rows, 9074 ms)
2026-11-08T08:00:35Z [load_day 2024-09-18] 2024-09-18: index committed in 11684 ms (24 + 1 + 24 files)
2026-11-08T08:00:35Z [load_day 2024-09-18] 2024-09-18: 5142245 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:00:35Z [load_day 2024-09-18] attempt 1 succeeded