orcaLog in

Runs · run 2744

load_day 2024-07-22, attempt 1 succeeded

Host
73ccef5e07c2:152726
Started
2026-11-08T07:05:37Z
Ended
2026-11-08T07:07:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
780 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.7 s, up to 3.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2744/load_day/2024-07-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:05:37Z [load_day 2024-07-22] attempt 1 started
2026-11-08T07:05:38Z [load_day 2024-07-22] 2024-07-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:05:45Z [load_day 2024-07-22] 2024-07-22 hour 0: 164257 events in 0 files, snapshot none (task 7250 ms: download 4188 ms overlapping gunzip 1056 ms, parse 4215 ms, sort 0 ms, write 0 ms, index 828 ms: 9 candidates, 83602 repo-hours, 1005 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:05:45Z [load_day 2024-07-22] 2024-07-22 hour 1: 184195 events in 0 files, snapshot none (task 6777 ms: download 4085 ms overlapping gunzip 1017 ms, parse 4133 ms, sort 0 ms, write 0 ms, index 918 ms: 3 candidates, 99965 repo-hours, 796 releases; waiting 468 ms; commit 0 ms)
2026-11-08T07:05:52Z [load_day 2024-07-22] 2024-07-22 hour 2: 154156 events in 0 files, snapshot none (task 5943 ms: download 2897 ms overlapping gunzip 912 ms, parse 3352 ms, sort 0 ms, write 0 ms, index 887 ms: 6 candidates, 65752 repo-hours, 901 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:05:53Z [load_day 2024-07-22] 2024-07-22 hour 3: 176198 events in 0 files, snapshot none (task 6816 ms: download 3986 ms overlapping gunzip 1030 ms, parse 3972 ms, sort 0 ms, write 0 ms, index 571 ms: 5 candidates, 74385 repo-hours, 5376 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:05:59Z [load_day 2024-07-22] 2024-07-22 hour 4: 152650 events in 0 files, snapshot none (task 6365 ms: download 3652 ms overlapping gunzip 1009 ms, parse 4004 ms, sort 0 ms, write 0 ms, index 490 ms: 5 candidates, 59131 repo-hours, 602 releases; waiting 550 ms; commit 0 ms)
2026-11-08T07:06:00Z [load_day 2024-07-22] 2024-07-22 hour 5: 164486 events in 0 files, snapshot none (task 6215 ms: download 4196 ms overlapping gunzip 1045 ms, parse 3924 ms, sort 0 ms, write 0 ms, index 486 ms: 3 candidates, 65819 repo-hours, 810 releases; waiting 540 ms; commit 0 ms)
2026-11-08T07:06:08Z [load_day 2024-07-22] 2024-07-22 hour 6: 206218 events in 0 files, snapshot none (task 8929 ms: download 6249 ms overlapping gunzip 1491 ms, parse 6069 ms, sort 0 ms, write 0 ms, index 664 ms: 9 candidates, 94144 repo-hours, 956 releases; waiting 485 ms; commit 0 ms)
2026-11-08T07:06:09Z [load_day 2024-07-22] 2024-07-22 hour 7: 206070 events in 0 files, snapshot none (task 9074 ms: download 6495 ms overlapping gunzip 1501 ms, parse 6267 ms, sort 0 ms, write 0 ms, index 599 ms: 4 candidates, 84272 repo-hours, 1017 releases; waiting 374 ms; commit 0 ms)
2026-11-08T07:06:20Z [load_day 2024-07-22] 2024-07-22 hour 8: 220436 events in 0 files, snapshot none (task 11414 ms: download 7364 ms overlapping gunzip 1846 ms, parse 7669 ms, sort 0 ms, write 0 ms, index 1011 ms: 6 candidates, 92993 repo-hours, 1185 releases; waiting 555 ms; commit 0 ms)
2026-11-08T07:06:21Z [load_day 2024-07-22] 2024-07-22 hour 9: 223944 events in 0 files, snapshot none (task 11424 ms: download 7726 ms overlapping gunzip 1952 ms, parse 7911 ms, sort 0 ms, write 0 ms, index 847 ms: 13 candidates, 97361 repo-hours, 1382 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:06:31Z [load_day 2024-07-22] 2024-07-22 hour 10: 215424 events in 0 files, snapshot none (task 9810 ms: download 6896 ms overlapping gunzip 1587 ms, parse 6405 ms, sort 0 ms, write 0 ms, index 1092 ms: 10 candidates, 89389 repo-hours, 1118 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:06:31Z [load_day 2024-07-22] 2024-07-22 hour 11: 215153 events in 0 files, snapshot none (task 9502 ms: download 6395 ms overlapping gunzip 1556 ms, parse 6091 ms, sort 0 ms, write 0 ms, index 1029 ms: 5 candidates, 86625 repo-hours, 1023 releases; waiting 540 ms; commit 0 ms)
2026-11-08T07:06:40Z [load_day 2024-07-22] 2024-07-22 hour 12: 271484 events in 0 files, snapshot none (task 9066 ms: download 6174 ms overlapping gunzip 1364 ms, parse 5816 ms, sort 0 ms, write 0 ms, index 928 ms: 15 candidates, 135105 repo-hours, 1239 releases; waiting 609 ms; commit 0 ms)
2026-11-08T07:06:40Z [load_day 2024-07-22] 2024-07-22 hour 13: 258295 events in 0 files, snapshot none (task 8903 ms: download 6295 ms overlapping gunzip 1419 ms, parse 5790 ms, sort 0 ms, write 0 ms, index 857 ms: 15 candidates, 126177 repo-hours, 1229 releases; waiting 576 ms; commit 0 ms)
2026-11-08T07:06:50Z [load_day 2024-07-22] 2024-07-22 hour 14: 241533 events in 0 files, snapshot none (task 9496 ms: download 6588 ms overlapping gunzip 1540 ms, parse 6404 ms, sort 0 ms, write 0 ms, index 729 ms: 11 candidates, 102421 repo-hours, 1363 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:06:50Z [load_day 2024-07-22] 2024-07-22 hour 15: 241920 events in 0 files, snapshot none (task 9169 ms: download 5949 ms overlapping gunzip 1481 ms, parse 5804 ms, sort 0 ms, write 0 ms, index 1070 ms: 6 candidates, 107444 repo-hours, 1465 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:07:01Z [load_day 2024-07-22] 2024-07-22 hour 16: 228352 events in 0 files, snapshot none (task 9750 ms: download 7126 ms overlapping gunzip 1613 ms, parse 6581 ms, sort 0 ms, write 0 ms, index 728 ms: 13 candidates, 96595 repo-hours, 1093 releases; waiting 548 ms; commit 0 ms)
2026-11-08T07:07:01Z [load_day 2024-07-22] 2024-07-22 hour 17: 217835 events in 0 files, snapshot none (task 9352 ms: download 6919 ms overlapping gunzip 1593 ms, parse 6464 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 87812 repo-hours, 1083 releases; waiting 333 ms; commit 0 ms)
2026-11-08T07:07:14Z [load_day 2024-07-22] 2024-07-22 hour 18: 230527 events in 0 files, snapshot none (task 12405 ms: download 9138 ms overlapping gunzip 2121 ms, parse 8520 ms, sort 0 ms, write 0 ms, index 1015 ms: 5 candidates, 102909 repo-hours, 1254 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:07:14Z [load_day 2024-07-22] 2024-07-22 hour 19: 207309 events in 0 files, snapshot none (task 13326 ms: download 10430 ms overlapping gunzip 2274 ms, parse 9383 ms, sort 0 ms, write 0 ms, index 902 ms: 9 candidates, 80222 repo-hours, 1062 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:07:24Z [load_day 2024-07-22] 2024-07-22 hour 20: 203771 events in 0 files, snapshot none (task 10220 ms: download 7359 ms overlapping gunzip 1836 ms, parse 7050 ms, sort 0 ms, write 0 ms, index 653 ms: 10 candidates, 77488 repo-hours, 1123 releases; waiting 464 ms; commit 0 ms)
2026-11-08T07:07:24Z [load_day 2024-07-22] 2024-07-22 hour 21: 192853 events in 0 files, snapshot none (task 8866 ms: download 5829 ms overlapping gunzip 1430 ms, parse 5897 ms, sort 0 ms, write 0 ms, index 723 ms: 15 candidates, 77138 repo-hours, 1078 releases; waiting 547 ms; commit 0 ms)
2026-11-08T07:07:32Z [load_day 2024-07-22] 2024-07-22 hour 22: 169381 events in 0 files, snapshot none (task 7423 ms: download 5156 ms overlapping gunzip 1211 ms, parse 5017 ms, sort 0 ms, write 0 ms, index 455 ms: 6 candidates, 62930 repo-hours, 1098 releases; waiting 472 ms; commit 0 ms)
2026-11-08T07:07:32Z [load_day 2024-07-22] 2024-07-22 hour 23: 164801 events in 0 files, snapshot none (task 7393 ms: download 4803 ms overlapping gunzip 1203 ms, parse 4841 ms, sort 0 ms, write 0 ms, index 578 ms: 2 candidates, 65536 repo-hours, 729 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:07:41Z [load_day 2024-07-22] 2024-07-22: repo_hour merged from 24 files to 1 (2115215 rows, 8841 ms)
2026-11-08T07:07:44Z [load_day 2024-07-22] 2024-07-22: index committed in 11803 ms (24 + 1 + 24 files)
2026-11-08T07:07:44Z [load_day 2024-07-22] 2024-07-22: 4911248 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:07:44Z [load_day 2024-07-22] attempt 1 succeeded