orcaLog in

Runs · run 3410

load_day 2025-01-08, attempt 1 succeeded

Host
73ccef5e07c2:234434
Started
2026-11-08T09:43:03Z
Ended
2026-11-08T09:45:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
871 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3410/load_day/2025-01-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:43:03Z [load_day 2025-01-08] attempt 1 started
2026-11-08T09:43:04Z [load_day 2025-01-08] 2025-01-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:43:12Z [load_day 2025-01-08] 2025-01-08 hour 0: 214677 events in 0 files, snapshot none (task 7256 ms: download 4572 ms overlapping gunzip 1115 ms, parse 4783 ms, sort 0 ms, write 0 ms, index 582 ms: 7 candidates, 87078 repo-hours, 1222 releases; waiting 462 ms; commit 0 ms)
2026-11-08T09:43:12Z [load_day 2025-01-08] 2025-01-08 hour 1: 244952 events in 0 files, snapshot none (task 7412 ms: download 4434 ms overlapping gunzip 1115 ms, parse 4804 ms, sort 0 ms, write 0 ms, index 744 ms: 9 candidates, 105603 repo-hours, 852 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:43:20Z [load_day 2025-01-08] 2025-01-08 hour 2: 228913 events in 0 files, snapshot none (task 7623 ms: download 4028 ms overlapping gunzip 1128 ms, parse 4805 ms, sort 0 ms, write 0 ms, index 863 ms: 11 candidates, 75828 repo-hours, 855 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:43:21Z [load_day 2025-01-08] 2025-01-08 hour 3: 248037 events in 0 files, snapshot none (task 8046 ms: download 4865 ms overlapping gunzip 1215 ms, parse 5455 ms, sort 0 ms, write 0 ms, index 624 ms: 4 candidates, 75150 repo-hours, 3770 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:43:27Z [load_day 2025-01-08] 2025-01-08 hour 4: 231498 events in 0 files, snapshot none (task 6820 ms: download 3292 ms overlapping gunzip 1049 ms, parse 4651 ms, sort 0 ms, write 0 ms, index 626 ms: 4 candidates, 63666 repo-hours, 731 releases; waiting 222 ms; commit 0 ms)
2026-11-08T09:43:28Z [load_day 2025-01-08] 2025-01-08 hour 5: 240174 events in 0 files, snapshot none (task 6786 ms: download 3401 ms overlapping gunzip 1044 ms, parse 4533 ms, sort 0 ms, write 0 ms, index 683 ms: 5 candidates, 68930 repo-hours, 719 releases; waiting 238 ms; commit 0 ms)
2026-11-08T09:43:36Z [load_day 2025-01-08] 2025-01-08 hour 6: 260391 events in 0 files, snapshot none (task 7890 ms: download 4502 ms overlapping gunzip 1138 ms, parse 5005 ms, sort 0 ms, write 0 ms, index 921 ms: 7 candidates, 91191 repo-hours, 1096 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:43:36Z [load_day 2025-01-08] 2025-01-08 hour 7: 236700 events in 0 files, snapshot none (task 7727 ms: download 5633 ms overlapping gunzip 1241 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 672 ms: 4 candidates, 80289 repo-hours, 758 releases; waiting 323 ms; commit 0 ms)
2026-11-08T09:43:43Z [load_day 2025-01-08] 2025-01-08 hour 8: 227351 events in 0 files, snapshot none (task 7058 ms: download 4581 ms overlapping gunzip 1096 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 685 ms: 2 candidates, 93662 repo-hours, 1073 releases; waiting 567 ms; commit 0 ms)
2026-11-08T09:43:44Z [load_day 2025-01-08] 2025-01-08 hour 9: 240683 events in 0 files, snapshot none (task 7890 ms: download 5222 ms overlapping gunzip 1248 ms, parse 5019 ms, sort 0 ms, write 0 ms, index 791 ms: 8 candidates, 101779 repo-hours, 1326 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:43:51Z [load_day 2025-01-08] 2025-01-08 hour 10: 229185 events in 0 files, snapshot none (task 7644 ms: download 5092 ms overlapping gunzip 1148 ms, parse 4906 ms, sort 0 ms, write 0 ms, index 661 ms: 5 candidates, 93920 repo-hours, 1262 releases; waiting 611 ms; commit 0 ms)
2026-11-08T09:43:52Z [load_day 2025-01-08] 2025-01-08 hour 11: 222341 events in 0 files, snapshot none (task 7218 ms: download 4651 ms overlapping gunzip 1101 ms, parse 4660 ms, sort 0 ms, write 0 ms, index 650 ms: 8 candidates, 88608 repo-hours, 1177 releases; waiting 532 ms; commit 0 ms)
2026-11-08T09:44:04Z [load_day 2025-01-08] 2025-01-08 hour 12: 268433 events in 0 files, snapshot none (task 11910 ms: download 8054 ms overlapping gunzip 1747 ms, parse 7484 ms, sort 0 ms, write 0 ms, index 1241 ms: 14 candidates, 135936 repo-hours, 1228 releases; waiting 1116 ms; commit 0 ms)
2026-11-08T09:44:04Z [load_day 2025-01-08] 2025-01-08 hour 13: 260215 events in 0 files, snapshot none (task 11657 ms: download 8692 ms overlapping gunzip 1817 ms, parse 8277 ms, sort 0 ms, write 0 ms, index 858 ms: 3 candidates, 119860 repo-hours, 1364 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:44:15Z [load_day 2025-01-08] 2025-01-08 hour 14: 260657 events in 0 files, snapshot none (task 10658 ms: download 7631 ms overlapping gunzip 1698 ms, parse 7265 ms, sort 0 ms, write 0 ms, index 1170 ms: 6 candidates, 106767 repo-hours, 1536 releases; waiting 218 ms; commit 0 ms)
2026-11-08T09:44:15Z [load_day 2025-01-08] 2025-01-08 hour 15: 259412 events in 0 files, snapshot none (task 10173 ms: download 7236 ms overlapping gunzip 1640 ms, parse 6556 ms, sort 0 ms, write 0 ms, index 1098 ms: 12 candidates, 112210 repo-hours, 1637 releases; waiting 553 ms; commit 0 ms)
2026-11-08T09:44:26Z [load_day 2025-01-08] 2025-01-08 hour 16: 246577 events in 0 files, snapshot none (task 10749 ms: download 7498 ms overlapping gunzip 1694 ms, parse 7379 ms, sort 0 ms, write 0 ms, index 827 ms: 11 candidates, 103693 repo-hours, 1530 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:44:26Z [load_day 2025-01-08] 2025-01-08 hour 17: 234345 events in 0 files, snapshot none (task 10223 ms: download 6475 ms overlapping gunzip 1693 ms, parse 6829 ms, sort 0 ms, write 0 ms, index 862 ms: 15 candidates, 95041 repo-hours, 1439 releases; waiting 468 ms; commit 0 ms)
2026-11-08T09:44:36Z [load_day 2025-01-08] 2025-01-08 hour 18: 245744 events in 0 files, snapshot none (task 9483 ms: download 6865 ms overlapping gunzip 1461 ms, parse 6380 ms, sort 0 ms, write 0 ms, index 785 ms: 8 candidates, 107430 repo-hours, 1554 releases; waiting 563 ms; commit 0 ms)
2026-11-08T09:44:36Z [load_day 2025-01-08] 2025-01-08 hour 19: 214171 events in 0 files, snapshot none (task 8925 ms: download 5830 ms overlapping gunzip 1450 ms, parse 5949 ms, sort 0 ms, write 0 ms, index 649 ms: 5 candidates, 82019 repo-hours, 1359 releases; waiting 530 ms; commit 0 ms)
2026-11-08T09:44:46Z [load_day 2025-01-08] 2025-01-08 hour 20: 211497 events in 0 files, snapshot none (task 9354 ms: download 6794 ms overlapping gunzip 1563 ms, parse 6199 ms, sort 0 ms, write 0 ms, index 656 ms: 5 candidates, 83457 repo-hours, 1433 releases; waiting 586 ms; commit 0 ms)
2026-11-08T09:44:46Z [load_day 2025-01-08] 2025-01-08 hour 21: 212050 events in 0 files, snapshot none (task 9179 ms: download 6426 ms overlapping gunzip 1456 ms, parse 6199 ms, sort 0 ms, write 0 ms, index 645 ms: 2 candidates, 84416 repo-hours, 1410 releases; waiting 557 ms; commit 0 ms)
2026-11-08T09:44:54Z [load_day 2025-01-08] 2025-01-08 hour 22: 194505 events in 0 files, snapshot none (task 7764 ms: download 5141 ms overlapping gunzip 1270 ms, parse 5460 ms, sort 0 ms, write 0 ms, index 600 ms: 3 candidates, 73780 repo-hours, 1258 releases; waiting 200 ms; commit 0 ms)
2026-11-08T09:44:54Z [load_day 2025-01-08] 2025-01-08 hour 23: 178801 events in 0 files, snapshot none (task 7393 ms: download 4449 ms overlapping gunzip 1127 ms, parse 4836 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 66262 repo-hours, 894 releases; waiting 487 ms; commit 0 ms)
2026-11-08T09:45:04Z [load_day 2025-01-08] 2025-01-08: repo_hour merged from 24 files to 1 (2196575 rows, 10239 ms)
2026-11-08T09:45:08Z [load_day 2025-01-08] 2025-01-08: index committed in 13594 ms (24 + 1 + 24 files)
2026-11-08T09:45:08Z [load_day 2025-01-08] 2025-01-08: 5611309 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:45:08Z [load_day 2025-01-08] attempt 1 succeeded