orcaLog in

Runs · run 2984

load_day 2024-09-20, attempt 1 succeeded

Host
73ccef5e07c2:180481
Started
2026-11-08T08:00:35Z
Ended
2026-11-08T08:02:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
733 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
175.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2984/load_day/2024-09-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:00:35Z [load_day 2024-09-20] attempt 1 started
2026-11-08T08:00:36Z [load_day 2024-09-20] 2024-09-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:00:44Z [load_day 2024-09-20] 2024-09-20 hour 0: 181997 events in 0 files, snapshot none (task 7590 ms: download 4568 ms overlapping gunzip 1206 ms, parse 4894 ms, sort 0 ms, write 0 ms, index 690 ms: 5 candidates, 88150 repo-hours, 1192 releases; waiting 479 ms; commit 0 ms)
2026-11-08T08:00:44Z [load_day 2024-09-20] 2024-09-20 hour 1: 193372 events in 0 files, snapshot none (task 7615 ms: download 4703 ms overlapping gunzip 1080 ms, parse 4837 ms, sort 0 ms, write 0 ms, index 836 ms: 2 candidates, 104256 repo-hours, 817 releases; waiting 538 ms; commit 0 ms)
2026-11-08T08:00:52Z [load_day 2024-09-20] 2024-09-20 hour 2: 171714 events in 0 files, snapshot none (task 6965 ms: download 4221 ms overlapping gunzip 1025 ms, parse 4395 ms, sort 0 ms, write 0 ms, index 654 ms: 3 candidates, 77320 repo-hours, 911 releases; waiting 586 ms; commit 0 ms)
2026-11-08T08:00:52Z [load_day 2024-09-20] 2024-09-20 hour 3: 190016 events in 0 files, snapshot none (task 6982 ms: download 4048 ms overlapping gunzip 1080 ms, parse 4727 ms, sort 0 ms, write 0 ms, index 587 ms: 3 candidates, 75921 repo-hours, 4108 releases; waiting 279 ms; commit 0 ms)
2026-11-08T08:00:59Z [load_day 2024-09-20] 2024-09-20 hour 4: 161196 events in 0 files, snapshot none (task 6609 ms: download 3227 ms overlapping gunzip 1016 ms, parse 4249 ms, sort 0 ms, write 0 ms, index 497 ms: 5 candidates, 63713 repo-hours, 694 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:01:00Z [load_day 2024-09-20] 2024-09-20 hour 5: 176771 events in 0 files, snapshot none (task 7106 ms: download 4435 ms overlapping gunzip 1075 ms, parse 4463 ms, sort 0 ms, write 0 ms, index 564 ms: 3 candidates, 68983 repo-hours, 964 releases; waiting 706 ms; commit 0 ms)
2026-11-08T08:01:08Z [load_day 2024-09-20] 2024-09-20 hour 6: 211019 events in 0 files, snapshot none (task 8016 ms: download 5015 ms overlapping gunzip 1297 ms, parse 5041 ms, sort 0 ms, write 0 ms, index 749 ms: 3 candidates, 94925 repo-hours, 968 releases; waiting 634 ms; commit 0 ms)
2026-11-08T08:01:08Z [load_day 2024-09-20] 2024-09-20 hour 7: 210974 events in 0 files, snapshot none (task 8400 ms: download 5738 ms overlapping gunzip 1366 ms, parse 5519 ms, sort 0 ms, write 0 ms, index 637 ms: 5 candidates, 85894 repo-hours, 987 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:01:16Z [load_day 2024-09-20] 2024-09-20 hour 8: 219988 events in 0 files, snapshot none (task 7560 ms: download 5138 ms overlapping gunzip 1130 ms, parse 5004 ms, sort 0 ms, write 0 ms, index 648 ms: 10 candidates, 92652 repo-hours, 1189 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:01:16Z [load_day 2024-09-20] 2024-09-20 hour 9: 226033 events in 0 files, snapshot none (task 7389 ms: download 4694 ms overlapping gunzip 1080 ms, parse 4691 ms, sort 0 ms, write 0 ms, index 658 ms: 4 candidates, 97780 repo-hours, 1340 releases; waiting 522 ms; commit 0 ms)
2026-11-08T08:01:24Z [load_day 2024-09-20] 2024-09-20 hour 10: 216744 events in 0 files, snapshot none (task 7808 ms: download 5321 ms overlapping gunzip 1109 ms, parse 4530 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 87943 repo-hours, 1209 releases; waiting 1148 ms; commit 0 ms)
2026-11-08T08:01:24Z [load_day 2024-09-20] 2024-09-20 hour 11: 214472 events in 0 files, snapshot none (task 7425 ms: download 4441 ms overlapping gunzip 1050 ms, parse 4414 ms, sort 0 ms, write 0 ms, index 1082 ms: 2 candidates, 84938 repo-hours, 1171 releases; waiting 561 ms; commit 0 ms)
2026-11-08T08:01:37Z [load_day 2024-09-20] 2024-09-20 hour 12: 264449 events in 0 files, snapshot none (task 12605 ms: download 6870 ms overlapping gunzip 1687 ms, parse 7142 ms, sort 0 ms, write 0 ms, index 2987 ms: 8 candidates, 130038 repo-hours, 1311 releases; waiting 447 ms; commit 0 ms)
2026-11-08T08:01:37Z [load_day 2024-09-20] 2024-09-20 hour 13: 255134 events in 0 files, snapshot none (task 10550 ms: download 7322 ms overlapping gunzip 1645 ms, parse 7292 ms, sort 0 ms, write 0 ms, index 802 ms: 10 candidates, 114067 repo-hours, 1361 releases; waiting 488 ms; commit 0 ms)
2026-11-08T08:01:54Z [load_day 2024-09-20] 2024-09-20 hour 14: 240607 events in 0 files, snapshot none (task 10227 ms: download 6830 ms overlapping gunzip 1745 ms, parse 6786 ms, sort 0 ms, write 0 ms, index 911 ms: 3 candidates, 99890 repo-hours, 1401 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:01:54Z [load_day 2024-09-20] 2024-09-20 hour 15: 238312 events in 0 files, snapshot none (task 10221 ms: download 6722 ms overlapping gunzip 1587 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 1234 ms: 8 candidates, 102286 repo-hours, 1371 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:02:03Z [load_day 2024-09-20] 2024-09-20 hour 16: 223818 events in 0 files, snapshot none (task 8272 ms: download 5810 ms overlapping gunzip 1314 ms, parse 5562 ms, sort 0 ms, write 0 ms, index 679 ms: 10 candidates, 91707 repo-hours, 1267 releases; waiting 488 ms; commit 0 ms)
2026-11-08T08:02:03Z [load_day 2024-09-20] 2024-09-20 hour 17: 217181 events in 0 files, snapshot none (task 8013 ms: download 5292 ms overlapping gunzip 1226 ms, parse 5149 ms, sort 0 ms, write 0 ms, index 642 ms: 6 candidates, 85504 repo-hours, 1241 releases; waiting 625 ms; commit 0 ms)
2026-11-08T08:02:12Z [load_day 2024-09-20] 2024-09-20 hour 18: 221684 events in 0 files, snapshot none (task 8804 ms: download 6282 ms overlapping gunzip 1412 ms, parse 5878 ms, sort 0 ms, write 0 ms, index 736 ms: 6 candidates, 97148 repo-hours, 1165 releases; waiting 493 ms; commit 0 ms)
2026-11-08T08:02:12Z [load_day 2024-09-20] 2024-09-20 hour 19: 194869 events in 0 files, snapshot none (task 7034 ms: download 4581 ms overlapping gunzip 1175 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 563 ms: 9 candidates, 73519 repo-hours, 998 releases; waiting 249 ms; commit 0 ms)
2026-11-08T08:02:19Z [load_day 2024-09-20] 2024-09-20 hour 20: 189149 events in 0 files, snapshot none (task 7174 ms: download 4617 ms overlapping gunzip 1119 ms, parse 4553 ms, sort 0 ms, write 0 ms, index 651 ms: 9 candidates, 73381 repo-hours, 920 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:02:19Z [load_day 2024-09-20] 2024-09-20 hour 21: 181752 events in 0 files, snapshot none (task 6374 ms: download 4019 ms overlapping gunzip 994 ms, parse 4019 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 71612 repo-hours, 982 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:02:25Z [load_day 2024-09-20] 2024-09-20 hour 22: 153025 events in 0 files, snapshot none (task 5545 ms: download 3315 ms overlapping gunzip 865 ms, parse 3374 ms, sort 0 ms, write 0 ms, index 419 ms: 6 candidates, 56326 repo-hours, 957 releases; waiting 562 ms; commit 0 ms)
2026-11-08T08:02:25Z [load_day 2024-09-20] 2024-09-20 hour 23: 142823 events in 0 files, snapshot none (task 4826 ms: download 2833 ms overlapping gunzip 724 ms, parse 2972 ms, sort 0 ms, write 0 ms, index 386 ms: 6 candidates, 52184 repo-hours, 834 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:02:34Z [load_day 2024-09-20] 2024-09-20: repo_hour merged from 24 files to 1 (2070137 rows, 8619 ms)
2026-11-08T08:02:36Z [load_day 2024-09-20] 2024-09-20: index committed in 10957 ms (24 + 1 + 24 files)
2026-11-08T08:02:36Z [load_day 2024-09-20] 2024-09-20: 4897099 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:02:36Z [load_day 2024-09-20] attempt 1 succeeded