orcaLog in

Runs · run 2237

load_day 2024-03-25, attempt 1 succeeded

Host
73ccef5e07c2:101361
Started
2026-11-08T05:17:23Z
Ended
2026-11-08T05:19:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
720 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
197.7 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2237/load_day/2024-03-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:17:23Z [load_day 2024-03-25] attempt 1 started
2026-11-08T05:17:24Z [load_day 2024-03-25] 2024-03-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:17:31Z [load_day 2024-03-25] 2024-03-25 hour 0: 185888 events in 0 files, snapshot none (task 6825 ms: download 4221 ms overlapping gunzip 1055 ms, parse 4316 ms, sort 0 ms, write 0 ms, index 722 ms: 4 candidates, 92246 repo-hours, 1024 releases; waiting 463 ms; commit 0 ms)
2026-11-08T05:17:31Z [load_day 2024-03-25] 2024-03-25 hour 1: 201194 events in 0 files, snapshot none (task 7014 ms: download 4399 ms overlapping gunzip 1077 ms, parse 4292 ms, sort 0 ms, write 0 ms, index 804 ms: 6 candidates, 99665 repo-hours, 1479 releases; waiting 549 ms; commit 0 ms)
2026-11-08T05:17:38Z [load_day 2024-03-25] 2024-03-25 hour 2: 178567 events in 0 files, snapshot none (task 5919 ms: download 3662 ms overlapping gunzip 985 ms, parse 3709 ms, sort 0 ms, write 0 ms, index 492 ms: 7 candidates, 66494 repo-hours, 790 releases; waiting 420 ms; commit 0 ms)
2026-11-08T05:17:38Z [load_day 2024-03-25] 2024-03-25 hour 3: 175168 events in 0 files, snapshot none (task 5594 ms: download 3384 ms overlapping gunzip 870 ms, parse 3495 ms, sort 0 ms, write 0 ms, index 458 ms: 4 candidates, 64436 repo-hours, 836 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:17:45Z [load_day 2024-03-25] 2024-03-25 hour 4: 163630 events in 0 files, snapshot none (task 6372 ms: download 4003 ms overlapping gunzip 969 ms, parse 3962 ms, sort 0 ms, write 0 ms, index 609 ms: 4 candidates, 59738 repo-hours, 583 releases; waiting 596 ms; commit 0 ms)
2026-11-08T05:17:45Z [load_day 2024-03-25] 2024-03-25 hour 5: 167585 events in 0 files, snapshot none (task 6386 ms: download 3922 ms overlapping gunzip 979 ms, parse 3896 ms, sort 0 ms, write 0 ms, index 724 ms: 5 candidates, 62740 repo-hours, 713 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:17:52Z [load_day 2024-03-25] 2024-03-25 hour 6: 193867 events in 0 files, snapshot none (task 6838 ms: download 3936 ms overlapping gunzip 1081 ms, parse 4290 ms, sort 0 ms, write 0 ms, index 664 ms: 2 candidates, 77667 repo-hours, 876 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:17:52Z [load_day 2024-03-25] 2024-03-25 hour 7: 203231 events in 0 files, snapshot none (task 7518 ms: download 4980 ms overlapping gunzip 1272 ms, parse 4918 ms, sort 0 ms, write 0 ms, index 551 ms: 3 candidates, 76911 repo-hours, 806 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:18:03Z [load_day 2024-03-25] 2024-03-25 hour 8: 222322 events in 0 files, snapshot none (task 10680 ms: download 6729 ms overlapping gunzip 1690 ms, parse 7063 ms, sort 0 ms, write 0 ms, index 1063 ms: 7 candidates, 89169 repo-hours, 887 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:18:04Z [load_day 2024-03-25] 2024-03-25 hour 9: 230884 events in 0 files, snapshot none (task 10467 ms: download 6930 ms overlapping gunzip 1711 ms, parse 7249 ms, sort 0 ms, write 0 ms, index 697 ms: 6 candidates, 92390 repo-hours, 1290 releases; waiting 462 ms; commit 0 ms)
2026-11-08T05:18:14Z [load_day 2024-03-25] 2024-03-25 hour 10: 233648 events in 0 files, snapshot none (task 10297 ms: download 7417 ms overlapping gunzip 1779 ms, parse 6987 ms, sort 0 ms, write 0 ms, index 687 ms: 2 candidates, 92544 repo-hours, 1161 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:18:14Z [load_day 2024-03-25] 2024-03-25 hour 11: 230268 events in 0 files, snapshot none (task 9264 ms: download 6633 ms overlapping gunzip 1549 ms, parse 6282 ms, sort 0 ms, write 0 ms, index 729 ms: 2 candidates, 88094 repo-hours, 1169 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:18:25Z [load_day 2024-03-25] 2024-03-25 hour 12: 286826 events in 0 files, snapshot none (task 10655 ms: download 7130 ms overlapping gunzip 1644 ms, parse 7007 ms, sort 0 ms, write 0 ms, index 1124 ms: 6 candidates, 122712 repo-hours, 1179 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:18:25Z [load_day 2024-03-25] 2024-03-25 hour 13: 253710 events in 0 files, snapshot none (task 10953 ms: download 7367 ms overlapping gunzip 1711 ms, parse 7345 ms, sort 0 ms, write 0 ms, index 884 ms: 5 candidates, 112787 repo-hours, 1083 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:18:34Z [load_day 2024-03-25] 2024-03-25 hour 14: 239742 events in 0 files, snapshot none (task 9215 ms: download 6659 ms overlapping gunzip 1561 ms, parse 6109 ms, sort 0 ms, write 0 ms, index 711 ms: 3 candidates, 100510 repo-hours, 1119 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:18:35Z [load_day 2024-03-25] 2024-03-25 hour 15: 262890 events in 0 files, snapshot none (task 9955 ms: download 7319 ms overlapping gunzip 1651 ms, parse 6667 ms, sort 0 ms, write 0 ms, index 833 ms: 13 candidates, 107011 repo-hours, 1385 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:18:44Z [load_day 2024-03-25] 2024-03-25 hour 16: 251659 events in 0 files, snapshot none (task 8750 ms: download 6233 ms overlapping gunzip 1379 ms, parse 5806 ms, sort 0 ms, write 0 ms, index 706 ms: 9 candidates, 101330 repo-hours, 1252 releases; waiting 539 ms; commit 0 ms)
2026-11-08T05:18:44Z [load_day 2024-03-25] 2024-03-25 hour 17: 235149 events in 0 files, snapshot none (task 7842 ms: download 5438 ms overlapping gunzip 1311 ms, parse 5051 ms, sort 0 ms, write 0 ms, index 652 ms: 9 candidates, 92539 repo-hours, 1137 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:18:52Z [load_day 2024-03-25] 2024-03-25 hour 18: 237615 events in 0 files, snapshot none (task 7621 ms: download 5124 ms overlapping gunzip 1174 ms, parse 4896 ms, sort 0 ms, write 0 ms, index 742 ms: 4 candidates, 96645 repo-hours, 1196 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:18:52Z [load_day 2024-03-25] 2024-03-25 hour 19: 222622 events in 0 files, snapshot none (task 7416 ms: download 5058 ms overlapping gunzip 1212 ms, parse 4755 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 84143 repo-hours, 1073 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:19:03Z [load_day 2024-03-25] 2024-03-25 hour 20: 231221 events in 0 files, snapshot none (task 10866 ms: download 7755 ms overlapping gunzip 1827 ms, parse 7688 ms, sort 0 ms, write 0 ms, index 879 ms: 7 candidates, 87249 repo-hours, 991 releases; waiting 190 ms; commit 0 ms)
2026-11-08T05:19:03Z [load_day 2024-03-25] 2024-03-25 hour 21: 214572 events in 0 files, snapshot none (task 10523 ms: download 7242 ms overlapping gunzip 1768 ms, parse 6890 ms, sort 0 ms, write 0 ms, index 1040 ms: 6 candidates, 77834 repo-hours, 1057 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:19:12Z [load_day 2024-03-25] 2024-03-25 hour 22: 198605 events in 0 files, snapshot none (task 8130 ms: download 5724 ms overlapping gunzip 1358 ms, parse 5418 ms, sort 0 ms, write 0 ms, index 546 ms: 6 candidates, 70514 repo-hours, 1063 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:19:12Z [load_day 2024-03-25] 2024-03-25 hour 23: 184547 events in 0 files, snapshot none (task 7550 ms: download 4372 ms overlapping gunzip 1208 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 617 ms: 6 candidates, 65411 repo-hours, 797 releases; waiting 633 ms; commit 0 ms)
2026-11-08T05:19:21Z [load_day 2024-03-25] 2024-03-25: repo_hour merged from 24 files to 1 (2080779 rows, 8819 ms)
2026-11-08T05:19:23Z [load_day 2024-03-25] 2024-03-25: index committed in 11329 ms (24 + 1 + 24 files)
2026-11-08T05:19:23Z [load_day 2024-03-25] 2024-03-25: 5205410 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:19:23Z [load_day 2024-03-25] attempt 1 succeeded