orcaLog in

Runs · run 2360

load_day 2024-04-23, attempt 1 succeeded

Host
73ccef5e07c2:113105
Started
2026-11-08T05:44:46Z
Ended
2026-11-08T05:47:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
708 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
221.1 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2360/load_day/2024-04-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:44:46Z [load_day 2024-04-23] attempt 1 started
2026-11-08T05:44:47Z [load_day 2024-04-23] 2024-04-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:44:57Z [load_day 2024-04-23] 2024-04-23 hour 0: 221450 events in 0 files, snapshot none (task 9483 ms: download 6597 ms overlapping gunzip 1491 ms, parse 6306 ms, sort 0 ms, write 0 ms, index 867 ms: 11 candidates, 96122 repo-hours, 1157 releases; waiting 548 ms; commit 0 ms)
2026-11-08T05:44:58Z [load_day 2024-04-23] 2024-04-23 hour 1: 216798 events in 0 files, snapshot none (task 9718 ms: download 6795 ms overlapping gunzip 1462 ms, parse 6348 ms, sort 0 ms, write 0 ms, index 1063 ms: 11 candidates, 106580 repo-hours, 936 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:45:09Z [load_day 2024-04-23] 2024-04-23 hour 2: 227939 events in 0 files, snapshot none (task 11213 ms: download 8618 ms overlapping gunzip 1977 ms, parse 7737 ms, sort 0 ms, write 0 ms, index 631 ms: 8 candidates, 84978 repo-hours, 1073 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:45:09Z [load_day 2024-04-23] 2024-04-23 hour 3: 194084 events in 0 files, snapshot none (task 8089 ms: download 4549 ms overlapping gunzip 1260 ms, parse 5084 ms, sort 0 ms, write 0 ms, index 929 ms: 9 candidates, 67666 repo-hours, 1130 releases; waiting 539 ms; commit 0 ms)
2026-11-08T05:45:17Z [load_day 2024-04-23] 2024-04-23 hour 4: 187929 events in 0 files, snapshot none (task 7407 ms: download 4924 ms overlapping gunzip 1211 ms, parse 4890 ms, sort 0 ms, write 0 ms, index 512 ms: 6 candidates, 63814 repo-hours, 753 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:45:18Z [load_day 2024-04-23] 2024-04-23 hour 5: 202084 events in 0 files, snapshot none (task 8781 ms: download 6004 ms overlapping gunzip 1385 ms, parse 5866 ms, sort 0 ms, write 0 ms, index 712 ms: 10 candidates, 71320 repo-hours, 1000 releases; waiting 559 ms; commit 0 ms)
2026-11-08T05:45:26Z [load_day 2024-04-23] 2024-04-23 hour 6: 232212 events in 0 files, snapshot none (task 8749 ms: download 5507 ms overlapping gunzip 1311 ms, parse 5849 ms, sort 0 ms, write 0 ms, index 849 ms: 8 candidates, 86775 repo-hours, 1219 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:45:29Z [load_day 2024-04-23] 2024-04-23 hour 7: 237364 events in 0 files, snapshot none (task 9965 ms: download 7185 ms overlapping gunzip 1519 ms, parse 6949 ms, sort 0 ms, write 0 ms, index 759 ms: 6 candidates, 88611 repo-hours, 1451 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:45:38Z [load_day 2024-04-23] 2024-04-23 hour 8: 251875 events in 0 files, snapshot none (task 11597 ms: download 8037 ms overlapping gunzip 1843 ms, parse 7982 ms, sort 0 ms, write 0 ms, index 1002 ms: 12 candidates, 97577 repo-hours, 1655 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:45:40Z [load_day 2024-04-23] 2024-04-23 hour 9: 265668 events in 0 files, snapshot none (task 10994 ms: download 8464 ms overlapping gunzip 1695 ms, parse 7820 ms, sort 0 ms, write 0 ms, index 687 ms: 9 candidates, 94228 repo-hours, 1626 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:45:46Z [load_day 2024-04-23] 2024-04-23 hour 10: 244017 events in 0 files, snapshot none (task 7578 ms: download 5096 ms overlapping gunzip 1257 ms, parse 5246 ms, sort 0 ms, write 0 ms, index 639 ms: 7 candidates, 90332 repo-hours, 1573 releases; waiting 189 ms; commit 0 ms)
2026-11-08T05:45:50Z [load_day 2024-04-23] 2024-04-23 hour 11: 238220 events in 0 files, snapshot none (task 8986 ms: download 6300 ms overlapping gunzip 1250 ms, parse 5263 ms, sort 0 ms, write 0 ms, index 622 ms: 11 candidates, 89874 repo-hours, 1420 releases; waiting 1350 ms; commit 0 ms)
2026-11-08T05:45:55Z [load_day 2024-04-23] 2024-04-23 hour 12: 294591 events in 0 files, snapshot none (task 8029 ms: download 5236 ms overlapping gunzip 1246 ms, parse 5482 ms, sort 0 ms, write 0 ms, index 847 ms: 14 candidates, 125854 repo-hours, 1545 releases; waiting 205 ms; commit 0 ms)
2026-11-08T05:46:03Z [load_day 2024-04-23] 2024-04-23 hour 13: 279149 events in 0 files, snapshot none (task 11894 ms: download 8282 ms overlapping gunzip 1764 ms, parse 7872 ms, sort 0 ms, write 0 ms, index 1172 ms: 13 candidates, 120005 repo-hours, 1541 releases; waiting 798 ms; commit 0 ms)
2026-11-08T05:46:07Z [load_day 2024-04-23] 2024-04-23 hour 14: 270121 events in 0 files, snapshot none (task 12083 ms: download 8160 ms overlapping gunzip 1839 ms, parse 8341 ms, sort 0 ms, write 0 ms, index 1098 ms: 15 candidates, 105692 repo-hours, 1563 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:46:15Z [load_day 2024-04-23] 2024-04-23 hour 15: 273888 events in 0 files, snapshot none (task 11592 ms: download 7898 ms overlapping gunzip 1695 ms, parse 7737 ms, sort 0 ms, write 0 ms, index 1669 ms: 16 candidates, 105344 repo-hours, 1550 releases; waiting 216 ms; commit 0 ms)
2026-11-08T05:46:18Z [load_day 2024-04-23] 2024-04-23 hour 16: 265631 events in 0 files, snapshot none (task 10301 ms: download 7177 ms overlapping gunzip 1671 ms, parse 6923 ms, sort 0 ms, write 0 ms, index 812 ms: 9 candidates, 96904 repo-hours, 1254 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:46:26Z [load_day 2024-04-23] 2024-04-23 hour 17: 251003 events in 0 files, snapshot none (task 10311 ms: download 7128 ms overlapping gunzip 1646 ms, parse 6614 ms, sort 0 ms, write 0 ms, index 1009 ms: 14 candidates, 92639 repo-hours, 1419 releases; waiting 756 ms; commit 0 ms)
2026-11-08T05:46:30Z [load_day 2024-04-23] 2024-04-23 hour 18: 256059 events in 0 files, snapshot none (task 11275 ms: download 7704 ms overlapping gunzip 1657 ms, parse 7353 ms, sort 0 ms, write 0 ms, index 934 ms: 5 candidates, 98408 repo-hours, 1583 releases; waiting 814 ms; commit 0 ms)
2026-11-08T05:46:35Z [load_day 2024-04-23] 2024-04-23 hour 19: 260720 events in 0 files, snapshot none (task 8710 ms: download 4948 ms overlapping gunzip 1262 ms, parse 5661 ms, sort 0 ms, write 0 ms, index 990 ms: 15 candidates, 82643 repo-hours, 1354 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:46:41Z [load_day 2024-04-23] 2024-04-23 hour 20: 233732 events in 0 files, snapshot none (task 10498 ms: download 7057 ms overlapping gunzip 1611 ms, parse 7283 ms, sort 0 ms, write 0 ms, index 799 ms: 12 candidates, 85215 repo-hours, 1170 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:46:45Z [load_day 2024-04-23] 2024-04-23 hour 21: 212521 events in 0 files, snapshot none (task 8909 ms: download 5987 ms overlapping gunzip 1345 ms, parse 5956 ms, sort 0 ms, write 0 ms, index 712 ms: 13 candidates, 74371 repo-hours, 1155 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:46:50Z [load_day 2024-04-23] 2024-04-23 hour 22: 209144 events in 0 files, snapshot none (task 8140 ms: download 4924 ms overlapping gunzip 1208 ms, parse 5408 ms, sort 0 ms, write 0 ms, index 549 ms: 11 candidates, 63237 repo-hours, 1069 releases; waiting 590 ms; commit 0 ms)
2026-11-08T05:46:52Z [load_day 2024-04-23] 2024-04-23 hour 23: 180392 events in 0 files, snapshot none (task 6643 ms: download 3925 ms overlapping gunzip 915 ms, parse 4064 ms, sort 0 ms, write 0 ms, index 429 ms: 7 candidates, 61645 repo-hours, 918 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:47:02Z [load_day 2024-04-23] 2024-04-23: repo_hour merged from 24 files to 1 (2149834 rows, 9786 ms)
2026-11-08T05:47:04Z [load_day 2024-04-23] 2024-04-23: index committed in 11964 ms (24 + 1 + 24 files)
2026-11-08T05:47:04Z [load_day 2024-04-23] 2024-04-23: 5706591 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:47:04Z [load_day 2024-04-23] attempt 1 succeeded