orcaLog in

Runs · run 4354

load_day 2025-09-05, attempt 1 succeeded

Host
73ccef5e07c2:373499
Started
2026-11-08T13:42:13Z
Ended
2026-11-08T13:43:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
670 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
146.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4354/load_day/2025-09-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T13:42:13Z [load_day 2025-09-05] attempt 1 started
2026-11-08T13:42:14Z [load_day 2025-09-05] 2025-09-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T13:42:21Z [load_day 2025-09-05] 2025-09-05 hour 0: 157183 events in 0 files, snapshot none (task 6555 ms: download 2766 ms overlapping gunzip 853 ms, parse 3443 ms, sort 0 ms, write 0 ms, index 1480 ms: 17 candidates, 67510 repo-hours, 901 releases; waiting 493 ms; commit 0 ms)
2026-11-08T13:42:21Z [load_day 2025-09-05] 2025-09-05 hour 1: 165263 events in 0 files, snapshot none (task 6015 ms: download 2836 ms overlapping gunzip 866 ms, parse 3602 ms, sort 0 ms, write 0 ms, index 766 ms: 9 candidates, 81326 repo-hours, 703 releases; waiting 502 ms; commit 0 ms)
2026-11-08T13:42:27Z [load_day 2025-09-05] 2025-09-05 hour 2: 157352 events in 0 files, snapshot none (task 5342 ms: download 2991 ms overlapping gunzip 812 ms, parse 3248 ms, sort 0 ms, write 0 ms, index 486 ms: 17 candidates, 61495 repo-hours, 665 releases; waiting 458 ms; commit 0 ms)
2026-11-08T13:42:27Z [load_day 2025-09-05] 2025-09-05 hour 3: 161405 events in 0 files, snapshot none (task 5341 ms: download 2624 ms overlapping gunzip 796 ms, parse 3333 ms, sort 0 ms, write 0 ms, index 547 ms: 9 candidates, 59497 repo-hours, 1749 releases; waiting 393 ms; commit 0 ms)
2026-11-08T13:42:34Z [load_day 2025-09-05] 2025-09-05 hour 4: 156956 events in 0 files, snapshot none (task 5997 ms: download 3744 ms overlapping gunzip 962 ms, parse 3684 ms, sort 0 ms, write 0 ms, index 547 ms: 7 candidates, 54412 repo-hours, 579 releases; waiting 504 ms; commit 0 ms)
2026-11-08T13:42:34Z [load_day 2025-09-05] 2025-09-05 hour 5: 162040 events in 0 files, snapshot none (task 6141 ms: download 3854 ms overlapping gunzip 1007 ms, parse 3766 ms, sort 0 ms, write 0 ms, index 407 ms: 6 candidates, 56819 repo-hours, 567 releases; waiting 708 ms; commit 0 ms)
2026-11-08T13:42:41Z [load_day 2025-09-05] 2025-09-05 hour 6: 169565 events in 0 files, snapshot none (task 6408 ms: download 3528 ms overlapping gunzip 1034 ms, parse 4018 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 68503 repo-hours, 707 releases; waiting 520 ms; commit 0 ms)
2026-11-08T13:42:41Z [load_day 2025-09-05] 2025-09-05 hour 7: 169589 events in 0 files, snapshot none (task 6381 ms: download 3941 ms overlapping gunzip 1008 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 502 ms: 5 candidates, 64765 repo-hours, 737 releases; waiting 510 ms; commit 0 ms)
2026-11-08T13:42:47Z [load_day 2025-09-05] 2025-09-05 hour 8: 166446 events in 0 files, snapshot none (task 5932 ms: download 4029 ms overlapping gunzip 898 ms, parse 3376 ms, sort 0 ms, write 0 ms, index 490 ms: 10 candidates, 67871 repo-hours, 751 releases; waiting 909 ms; commit 0 ms)
2026-11-08T13:42:47Z [load_day 2025-09-05] 2025-09-05 hour 9: 168067 events in 0 files, snapshot none (task 5904 ms: download 3863 ms overlapping gunzip 866 ms, parse 3474 ms, sort 0 ms, write 0 ms, index 518 ms: 5 candidates, 69109 repo-hours, 748 releases; waiting 687 ms; commit 0 ms)
2026-11-08T13:42:53Z [load_day 2025-09-05] 2025-09-05 hour 10: 173409 events in 0 files, snapshot none (task 5624 ms: download 3202 ms overlapping gunzip 852 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 585 ms: 5 candidates, 68595 repo-hours, 776 releases; waiting 651 ms; commit 0 ms)
2026-11-08T13:42:53Z [load_day 2025-09-05] 2025-09-05 hour 11: 168047 events in 0 files, snapshot none (task 5487 ms: download 3221 ms overlapping gunzip 818 ms, parse 3399 ms, sort 0 ms, write 0 ms, index 529 ms: 9 candidates, 69043 repo-hours, 812 releases; waiting 530 ms; commit 0 ms)
2026-11-08T13:43:01Z [load_day 2025-09-05] 2025-09-05 hour 12: 167754 events in 0 files, snapshot none (task 7424 ms: download 4543 ms overlapping gunzip 1117 ms, parse 4780 ms, sort 0 ms, write 0 ms, index 656 ms: 15 candidates, 94675 repo-hours, 819 releases; waiting 516 ms; commit 0 ms)
2026-11-08T13:43:01Z [load_day 2025-09-05] 2025-09-05 hour 13: 162330 events in 0 files, snapshot none (task 7544 ms: download 4845 ms overlapping gunzip 1110 ms, parse 4769 ms, sort 0 ms, write 0 ms, index 624 ms: 10 candidates, 85903 repo-hours, 723 releases; waiting 731 ms; commit 0 ms)
2026-11-08T13:43:11Z [load_day 2025-09-05] 2025-09-05 hour 14: 162917 events in 0 files, snapshot none (task 8983 ms: download 5778 ms overlapping gunzip 1468 ms, parse 5677 ms, sort 0 ms, write 0 ms, index 1118 ms: 7 candidates, 78820 repo-hours, 831 releases; waiting 484 ms; commit 0 ms)
2026-11-08T13:43:11Z [load_day 2025-09-05] 2025-09-05 hour 15: 163094 events in 0 files, snapshot none (task 8505 ms: download 5588 ms overlapping gunzip 1347 ms, parse 5406 ms, sort 0 ms, write 0 ms, index 922 ms: 14 candidates, 79814 repo-hours, 921 releases; waiting 515 ms; commit 0 ms)
2026-11-08T13:43:20Z [load_day 2025-09-05] 2025-09-05 hour 16: 163205 events in 0 files, snapshot none (task 8262 ms: download 4938 ms overlapping gunzip 1359 ms, parse 5639 ms, sort 0 ms, write 0 ms, index 695 ms: 16 candidates, 77949 repo-hours, 870 releases; waiting 271 ms; commit 0 ms)
2026-11-08T13:43:20Z [load_day 2025-09-05] 2025-09-05 hour 17: 156109 events in 0 files, snapshot none (task 7527 ms: download 4739 ms overlapping gunzip 1178 ms, parse 4627 ms, sort 0 ms, write 0 ms, index 744 ms: 12 candidates, 72830 repo-hours, 728 releases; waiting 544 ms; commit 0 ms)
2026-11-08T13:43:27Z [load_day 2025-09-05] 2025-09-05 hour 18: 160763 events in 0 files, snapshot none (task 6977 ms: download 3979 ms overlapping gunzip 1069 ms, parse 4292 ms, sort 0 ms, write 0 ms, index 742 ms: 10 candidates, 79621 repo-hours, 1003 releases; waiting 517 ms; commit 0 ms)
2026-11-08T13:43:28Z [load_day 2025-09-05] 2025-09-05 hour 19: 153471 events in 0 files, snapshot none (task 7672 ms: download 5134 ms overlapping gunzip 1199 ms, parse 4532 ms, sort 0 ms, write 0 ms, index 512 ms: 11 candidates, 66523 repo-hours, 871 releases; waiting 1143 ms; commit 0 ms)
2026-11-08T13:43:34Z [load_day 2025-09-05] 2025-09-05 hour 20: 148597 events in 0 files, snapshot none (task 6848 ms: download 4141 ms overlapping gunzip 1021 ms, parse 4555 ms, sort 0 ms, write 0 ms, index 604 ms: 14 candidates, 65734 repo-hours, 1003 releases; waiting 429 ms; commit 0 ms)
2026-11-08T13:43:35Z [load_day 2025-09-05] 2025-09-05 hour 21: 150308 events in 0 files, snapshot none (task 7192 ms: download 4644 ms overlapping gunzip 1188 ms, parse 4733 ms, sort 0 ms, write 0 ms, index 462 ms: 13 candidates, 61337 repo-hours, 1138 releases; waiting 296 ms; commit 0 ms)
2026-11-08T13:43:42Z [load_day 2025-09-05] 2025-09-05 hour 22: 146889 events in 0 files, snapshot none (task 6813 ms: download 4300 ms overlapping gunzip 1125 ms, parse 4435 ms, sort 0 ms, write 0 ms, index 438 ms: 3 candidates, 57617 repo-hours, 1164 releases; waiting 537 ms; commit 0 ms)
2026-11-08T13:43:42Z [load_day 2025-09-05] 2025-09-05 hour 23: 136809 events in 0 files, snapshot none (task 5846 ms: download 3621 ms overlapping gunzip 908 ms, parse 3757 ms, sort 0 ms, write 0 ms, index 374 ms: 12 candidates, 52045 repo-hours, 1111 releases; waiting 560 ms; commit 0 ms)
2026-11-08T13:43:50Z [load_day 2025-09-05] 2025-09-05: repo_hour merged from 24 files to 1 (1661813 rows, 7942 ms)
2026-11-08T13:43:52Z [load_day 2025-09-05] 2025-09-05: index committed in 10675 ms (24 + 1 + 24 files)
2026-11-08T13:43:52Z [load_day 2025-09-05] 2025-09-05: 3847568 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T13:43:52Z [load_day 2025-09-05] attempt 1 succeeded