orcaLog in

Runs · run 2250

load_day 2024-03-28, attempt 1 succeeded

Host
73ccef5e07c2:102751
Started
2026-11-08T05:20:48Z
Ended
2026-11-08T05:22:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
730 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.3 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2250/load_day/2024-03-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:20:48Z [load_day 2024-03-28] attempt 1 started
2026-11-08T05:20:49Z [load_day 2024-03-28] 2024-03-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:20:57Z [load_day 2024-03-28] 2024-03-28 hour 0: 216720 events in 0 files, snapshot none (task 7371 ms: download 4418 ms overlapping gunzip 1065 ms, parse 4965 ms, sort 0 ms, write 0 ms, index 753 ms: 6 candidates, 100880 repo-hours, 1165 releases; waiting 289 ms; commit 0 ms)
2026-11-08T05:20:57Z [load_day 2024-03-28] 2024-03-28 hour 1: 211511 events in 0 files, snapshot none (task 7406 ms: download 4563 ms overlapping gunzip 1086 ms, parse 4721 ms, sort 0 ms, write 0 ms, index 804 ms: 8 candidates, 101381 repo-hours, 911 releases; waiting 448 ms; commit 0 ms)
2026-11-08T05:21:06Z [load_day 2024-03-28] 2024-03-28 hour 2: 189709 events in 0 files, snapshot none (task 8349 ms: download 5522 ms overlapping gunzip 1359 ms, parse 5557 ms, sort 0 ms, write 0 ms, index 553 ms: 5 candidates, 69990 repo-hours, 842 releases; waiting 580 ms; commit 0 ms)
2026-11-08T05:21:06Z [load_day 2024-03-28] 2024-03-28 hour 3: 180287 events in 0 files, snapshot none (task 7524 ms: download 4859 ms overlapping gunzip 1239 ms, parse 5034 ms, sort 0 ms, write 0 ms, index 503 ms: 4 candidates, 65146 repo-hours, 886 releases; waiting 465 ms; commit 0 ms)
2026-11-08T05:21:17Z [load_day 2024-03-28] 2024-03-28 hour 4: 171484 events in 0 files, snapshot none (task 6468 ms: download 3821 ms overlapping gunzip 986 ms, parse 4237 ms, sort 0 ms, write 0 ms, index 454 ms: 7 candidates, 59696 repo-hours, 592 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:21:17Z [load_day 2024-03-28] 2024-03-28 hour 5: 185310 events in 0 files, snapshot none (task 7117 ms: download 4658 ms overlapping gunzip 1271 ms, parse 4552 ms, sort 0 ms, write 0 ms, index 445 ms: 3 candidates, 65337 repo-hours, 699 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:21:23Z [load_day 2024-03-28] 2024-03-28 hour 6: 202531 events in 0 files, snapshot none (task 5490 ms: download 3386 ms overlapping gunzip 794 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 550 ms: 11 candidates, 80016 repo-hours, 855 releases; waiting 615 ms; commit 0 ms)
2026-11-08T05:21:24Z [load_day 2024-03-28] 2024-03-28 hour 7: 207957 events in 0 files, snapshot none (task 5985 ms: download 3608 ms overlapping gunzip 895 ms, parse 3660 ms, sort 0 ms, write 0 ms, index 602 ms: 3 candidates, 76913 repo-hours, 890 releases; waiting 556 ms; commit 0 ms)
2026-11-08T05:21:31Z [load_day 2024-03-28] 2024-03-28 hour 8: 229794 events in 0 files, snapshot none (task 7677 ms: download 5090 ms overlapping gunzip 1040 ms, parse 4188 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 87073 repo-hours, 1032 releases; waiting 1368 ms; commit 0 ms)
2026-11-08T05:21:32Z [load_day 2024-03-28] 2024-03-28 hour 9: 235601 events in 0 files, snapshot none (task 7306 ms: download 4815 ms overlapping gunzip 1126 ms, parse 4673 ms, sort 0 ms, write 0 ms, index 658 ms: 4 candidates, 89657 repo-hours, 1177 releases; waiting 552 ms; commit 0 ms)
2026-11-08T05:21:40Z [load_day 2024-03-28] 2024-03-28 hour 10: 235800 events in 0 files, snapshot none (task 9256 ms: download 6606 ms overlapping gunzip 1492 ms, parse 6253 ms, sort 0 ms, write 0 ms, index 643 ms: 3 candidates, 89031 repo-hours, 1364 releases; waiting 532 ms; commit 0 ms)
2026-11-08T05:21:41Z [load_day 2024-03-28] 2024-03-28 hour 11: 231039 events in 0 files, snapshot none (task 8749 ms: download 6303 ms overlapping gunzip 1321 ms, parse 5966 ms, sort 0 ms, write 0 ms, index 642 ms: 5 candidates, 84325 repo-hours, 1298 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:21:51Z [load_day 2024-03-28] 2024-03-28 hour 12: 281550 events in 0 files, snapshot none (task 10191 ms: download 6677 ms overlapping gunzip 1464 ms, parse 6760 ms, sort 0 ms, write 0 ms, index 1289 ms: 5 candidates, 117951 repo-hours, 1139 releases; waiting 335 ms; commit 0 ms)
2026-11-08T05:21:51Z [load_day 2024-03-28] 2024-03-28 hour 13: 265083 events in 0 files, snapshot none (task 9809 ms: download 6702 ms overlapping gunzip 1579 ms, parse 6594 ms, sort 0 ms, write 0 ms, index 850 ms: 4 candidates, 110586 repo-hours, 1212 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:22:01Z [load_day 2024-03-28] 2024-03-28 hour 14: 265782 events in 0 files, snapshot none (task 9912 ms: download 7030 ms overlapping gunzip 1604 ms, parse 6699 ms, sort 0 ms, write 0 ms, index 795 ms: 10 candidates, 104014 repo-hours, 1438 releases; waiting 535 ms; commit 0 ms)
2026-11-08T05:22:01Z [load_day 2024-03-28] 2024-03-28 hour 15: 261348 events in 0 files, snapshot none (task 9839 ms: download 7035 ms overlapping gunzip 1582 ms, parse 6724 ms, sort 0 ms, write 0 ms, index 724 ms: 10 candidates, 102089 repo-hours, 1445 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:22:12Z [load_day 2024-03-28] 2024-03-28 hour 16: 251925 events in 0 files, snapshot none (task 9978 ms: download 7270 ms overlapping gunzip 1627 ms, parse 6634 ms, sort 0 ms, write 0 ms, index 888 ms: 7 candidates, 97909 repo-hours, 1253 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:22:12Z [load_day 2024-03-28] 2024-03-28 hour 17: 249763 events in 0 files, snapshot none (task 10222 ms: download 7486 ms overlapping gunzip 1620 ms, parse 6874 ms, sort 0 ms, write 0 ms, index 790 ms: 8 candidates, 92941 repo-hours, 1108 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:22:22Z [load_day 2024-03-28] 2024-03-28 hour 18: 246380 events in 0 files, snapshot none (task 9882 ms: download 6599 ms overlapping gunzip 1644 ms, parse 6646 ms, sort 0 ms, write 0 ms, index 640 ms: 11 candidates, 94195 repo-hours, 1167 releases; waiting 548 ms; commit 0 ms)
2026-11-08T05:22:22Z [load_day 2024-03-28] 2024-03-28 hour 19: 215823 events in 0 files, snapshot none (task 8809 ms: download 5455 ms overlapping gunzip 1455 ms, parse 5777 ms, sort 0 ms, write 0 ms, index 1033 ms: 17 candidates, 76623 repo-hours, 937 releases; waiting 213 ms; commit 0 ms)
2026-11-08T05:22:30Z [load_day 2024-03-28] 2024-03-28 hour 20: 224811 events in 0 files, snapshot none (task 7661 ms: download 5083 ms overlapping gunzip 1305 ms, parse 5021 ms, sort 0 ms, write 0 ms, index 597 ms: 11 candidates, 81497 repo-hours, 984 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:22:30Z [load_day 2024-03-28] 2024-03-28 hour 21: 209994 events in 0 files, snapshot none (task 7635 ms: download 4872 ms overlapping gunzip 1309 ms, parse 4969 ms, sort 0 ms, write 0 ms, index 606 ms: 16 candidates, 69736 repo-hours, 996 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:22:38Z [load_day 2024-03-28] 2024-03-28 hour 22: 194794 events in 0 files, snapshot none (task 7244 ms: download 4724 ms overlapping gunzip 1116 ms, parse 4794 ms, sort 0 ms, write 0 ms, index 478 ms: 25 candidates, 64066 repo-hours, 964 releases; waiting 549 ms; commit 0 ms)
2026-11-08T05:22:38Z [load_day 2024-03-28] 2024-03-28 hour 23: 184440 events in 0 files, snapshot none (task 6058 ms: download 3239 ms overlapping gunzip 893 ms, parse 3769 ms, sort 0 ms, write 0 ms, index 613 ms: 14 candidates, 61307 repo-hours, 774 releases; waiting 193 ms; commit 0 ms)
2026-11-08T05:22:47Z [load_day 2024-03-28] 2024-03-28: repo_hour merged from 24 files to 1 (2042359 rows, 8743 ms)
2026-11-08T05:22:49Z [load_day 2024-03-28] 2024-03-28: index committed in 11210 ms (24 + 1 + 24 files)
2026-11-08T05:22:49Z [load_day 2024-03-28] 2024-03-28: 5349436 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:22:49Z [load_day 2024-03-28] attempt 1 succeeded