orcaLog in

Runs · run 1997

load_day 2024-01-23, attempt 1 succeeded

Host
73ccef5e07c2:60826
Started
2026-11-08T04:16:53Z
Ended
2026-11-08T04:19:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.6 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1997/load_day/2024-01-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:16:53Z [load_day 2024-01-23] attempt 1 started
2026-11-08T04:16:54Z [load_day 2024-01-23] 2024-01-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:17:04Z [load_day 2024-01-23] 2024-01-23 hour 0: 209139 events in 0 files, snapshot none (task 9554 ms: download 5435 ms overlapping gunzip 1427 ms, parse 6034 ms, sort 0 ms, write 0 ms, index 1317 ms: 13 candidates, 89623 repo-hours, 989 releases; waiting 471 ms; commit 0 ms)
2026-11-08T04:17:04Z [load_day 2024-01-23] 2024-01-23 hour 1: 211009 events in 0 files, snapshot none (task 8968 ms: download 5082 ms overlapping gunzip 1335 ms, parse 5803 ms, sort 0 ms, write 0 ms, index 1040 ms: 6 candidates, 98262 repo-hours, 944 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:17:13Z [load_day 2024-01-23] 2024-01-23 hour 2: 186550 events in 0 files, snapshot none (task 8552 ms: download 5551 ms overlapping gunzip 1369 ms, parse 5646 ms, sort 0 ms, write 0 ms, index 723 ms: 2 candidates, 66883 repo-hours, 750 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:17:13Z [load_day 2024-01-23] 2024-01-23 hour 3: 179861 events in 0 files, snapshot none (task 8304 ms: download 5123 ms overlapping gunzip 1335 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 610 ms: 6 candidates, 61275 repo-hours, 913 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:17:21Z [load_day 2024-01-23] 2024-01-23 hour 4: 174113 events in 0 files, snapshot none (task 6921 ms: download 4046 ms overlapping gunzip 1007 ms, parse 4569 ms, sort 0 ms, write 0 ms, index 594 ms: 1 candidates, 58077 repo-hours, 625 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:17:21Z [load_day 2024-01-23] 2024-01-23 hour 5: 185859 events in 0 files, snapshot none (task 7609 ms: download 4302 ms overlapping gunzip 1261 ms, parse 5179 ms, sort 0 ms, write 0 ms, index 511 ms: 4 candidates, 63500 repo-hours, 638 releases; waiting 230 ms; commit 0 ms)
2026-11-08T04:17:30Z [load_day 2024-01-23] 2024-01-23 hour 6: 201856 events in 0 files, snapshot none (task 8290 ms: download 4408 ms overlapping gunzip 1250 ms, parse 5337 ms, sort 0 ms, write 0 ms, index 899 ms: 2 candidates, 76154 repo-hours, 776 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:17:30Z [load_day 2024-01-23] 2024-01-23 hour 7: 210138 events in 0 files, snapshot none (task 8577 ms: download 4844 ms overlapping gunzip 1264 ms, parse 5330 ms, sort 0 ms, write 0 ms, index 976 ms: 7 candidates, 75629 repo-hours, 820 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:17:40Z [load_day 2024-01-23] 2024-01-23 hour 8: 215642 events in 0 files, snapshot none (task 9233 ms: download 6276 ms overlapping gunzip 1414 ms, parse 6224 ms, sort 0 ms, write 0 ms, index 833 ms: 4 candidates, 81602 repo-hours, 894 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:17:41Z [load_day 2024-01-23] 2024-01-23 hour 9: 234996 events in 0 files, snapshot none (task 9503 ms: download 6282 ms overlapping gunzip 1507 ms, parse 6371 ms, sort 0 ms, write 0 ms, index 1043 ms: 7 candidates, 89890 repo-hours, 1242 releases; waiting 282 ms; commit 0 ms)
2026-11-08T04:17:50Z [load_day 2024-01-23] 2024-01-23 hour 10: 232982 events in 0 files, snapshot none (task 10255 ms: download 7274 ms overlapping gunzip 1671 ms, parse 6975 ms, sort 0 ms, write 0 ms, index 853 ms: 4 candidates, 88272 repo-hours, 1028 releases; waiting 459 ms; commit 0 ms)
2026-11-08T04:17:50Z [load_day 2024-01-23] 2024-01-23 hour 11: 211852 events in 0 files, snapshot none (task 9163 ms: download 6367 ms overlapping gunzip 1376 ms, parse 6268 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 84665 repo-hours, 1057 releases; waiting 494 ms; commit 0 ms)
2026-11-08T04:18:01Z [load_day 2024-01-23] 2024-01-23 hour 12: 255627 events in 0 files, snapshot none (task 9923 ms: download 6896 ms overlapping gunzip 1542 ms, parse 6689 ms, sort 0 ms, write 0 ms, index 909 ms: 9 candidates, 117558 repo-hours, 1333 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:18:02Z [load_day 2024-01-23] 2024-01-23 hour 13: 255895 events in 0 files, snapshot none (task 10730 ms: download 7774 ms overlapping gunzip 1639 ms, parse 7325 ms, sort 0 ms, write 0 ms, index 1057 ms: 4 candidates, 114372 repo-hours, 1247 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:18:13Z [load_day 2024-01-23] 2024-01-23 hour 14: 263100 events in 0 files, snapshot none (task 11655 ms: download 8365 ms overlapping gunzip 1867 ms, parse 7795 ms, sort 0 ms, write 0 ms, index 1160 ms: 5 candidates, 99185 repo-hours, 1316 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:18:13Z [load_day 2024-01-23] 2024-01-23 hour 15: 262537 events in 0 files, snapshot none (task 10732 ms: download 7628 ms overlapping gunzip 1619 ms, parse 7226 ms, sort 0 ms, write 0 ms, index 1029 ms: 7 candidates, 99962 repo-hours, 1309 releases; waiting 455 ms; commit 0 ms)
2026-11-08T04:18:24Z [load_day 2024-01-23] 2024-01-23 hour 16: 256651 events in 0 files, snapshot none (task 10476 ms: download 7728 ms overlapping gunzip 1709 ms, parse 7170 ms, sort 0 ms, write 0 ms, index 753 ms: 7 candidates, 97393 repo-hours, 1187 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:18:24Z [load_day 2024-01-23] 2024-01-23 hour 17: 246888 events in 0 files, snapshot none (task 9550 ms: download 6793 ms overlapping gunzip 1443 ms, parse 6511 ms, sort 0 ms, write 0 ms, index 755 ms: 8 candidates, 89577 repo-hours, 1260 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:18:33Z [load_day 2024-01-23] 2024-01-23 hour 18: 246954 events in 0 files, snapshot none (task 8367 ms: download 5732 ms overlapping gunzip 1294 ms, parse 5561 ms, sort 0 ms, write 0 ms, index 714 ms: 4 candidates, 93536 repo-hours, 1014 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:18:33Z [load_day 2024-01-23] 2024-01-23 hour 19: 230967 events in 0 files, snapshot none (task 7939 ms: download 5157 ms overlapping gunzip 1246 ms, parse 5067 ms, sort 0 ms, write 0 ms, index 782 ms: 5 candidates, 80988 repo-hours, 1080 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:18:42Z [load_day 2024-01-23] 2024-01-23 hour 20: 220765 events in 0 files, snapshot none (task 8994 ms: download 5852 ms overlapping gunzip 1425 ms, parse 5951 ms, sort 0 ms, write 0 ms, index 785 ms: 6 candidates, 80075 repo-hours, 926 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:18:43Z [load_day 2024-01-23] 2024-01-23 hour 21: 218071 events in 0 files, snapshot none (task 9941 ms: download 6265 ms overlapping gunzip 1505 ms, parse 6722 ms, sort 0 ms, write 0 ms, index 781 ms: 5 candidates, 73189 repo-hours, 1119 releases; waiting 613 ms; commit 0 ms)
2026-11-08T04:18:51Z [load_day 2024-01-23] 2024-01-23 hour 22: 207917 events in 0 files, snapshot none (task 8063 ms: download 4981 ms overlapping gunzip 1294 ms, parse 5417 ms, sort 0 ms, write 0 ms, index 601 ms: 6 candidates, 66052 repo-hours, 999 releases; waiting 558 ms; commit 0 ms)
2026-11-08T04:18:51Z [load_day 2024-01-23] 2024-01-23 hour 23: 195294 events in 0 files, snapshot none (task 7099 ms: download 4030 ms overlapping gunzip 1078 ms, parse 4755 ms, sort 0 ms, write 0 ms, index 465 ms: 6 candidates, 59636 repo-hours, 734 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:19:00Z [load_day 2024-01-23] 2024-01-23: repo_hour merged from 24 files to 1 (2005355 rows, 9335 ms)
2026-11-08T04:19:03Z [load_day 2024-01-23] 2024-01-23: index committed in 12103 ms (24 + 1 + 24 files)
2026-11-08T04:19:03Z [load_day 2024-01-23] 2024-01-23: 5314663 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:19:03Z [load_day 2024-01-23] attempt 1 succeeded