orcaLog in

Runs · run 2412

load_day 2024-05-05, attempt 1 succeeded

Host
73ccef5e07c2:118200
Started
2026-11-08T05:57:14Z
Ended
2026-11-08T05:58:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
615 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2412/load_day/2024-05-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:57:14Z [load_day 2024-05-05] attempt 1 started
2026-11-08T05:57:15Z [load_day 2024-05-05] 2024-05-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:57:21Z [load_day 2024-05-05] 2024-05-05 hour 0: 159031 events in 0 files, snapshot none (task 5205 ms: download 3598 ms overlapping gunzip 611 ms, parse 2744 ms, sort 0 ms, write 0 ms, index 613 ms: 14 candidates, 76868 repo-hours, 980 releases; waiting 797 ms; commit 0 ms)
2026-11-08T05:57:21Z [load_day 2024-05-05] 2024-05-05 hour 1: 160893 events in 0 files, snapshot none (task 4429 ms: download 2107 ms overlapping gunzip 528 ms, parse 2573 ms, sort 0 ms, write 0 ms, index 585 ms: 8 candidates, 86801 repo-hours, 769 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:57:25Z [load_day 2024-05-05] 2024-05-05 hour 2: 118911 events in 0 files, snapshot none (task 3498 ms: download 2049 ms overlapping gunzip 460 ms, parse 1974 ms, sort 0 ms, write 0 ms, index 302 ms: 0 candidates, 43445 repo-hours, 666 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:57:25Z [load_day 2024-05-05] 2024-05-05 hour 3: 138703 events in 0 files, snapshot none (task 3880 ms: download 3010 ms overlapping gunzip 502 ms, parse 2214 ms, sort 0 ms, write 0 ms, index 366 ms: 8 candidates, 50186 repo-hours, 2999 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:57:29Z [load_day 2024-05-05] 2024-05-05 hour 4: 129834 events in 0 files, snapshot none (task 4145 ms: download 1849 ms overlapping gunzip 497 ms, parse 2185 ms, sort 0 ms, write 0 ms, index 639 ms: 11 candidates, 46573 repo-hours, 568 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:57:32Z [load_day 2024-05-05] 2024-05-05 hour 5: 142530 events in 0 files, snapshot none (task 6836 ms: download 3964 ms overlapping gunzip 950 ms, parse 4584 ms, sort 0 ms, write 0 ms, index 438 ms: 3 candidates, 48586 repo-hours, 842 releases; waiting 576 ms; commit 0 ms)
2026-11-08T05:57:34Z [load_day 2024-05-05] 2024-05-05 hour 6: 153407 events in 0 files, snapshot none (task 4798 ms: download 2119 ms overlapping gunzip 605 ms, parse 2753 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 62338 repo-hours, 689 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:57:40Z [load_day 2024-05-05] 2024-05-05 hour 7: 191430 events in 0 files, snapshot none (task 7043 ms: download 4042 ms overlapping gunzip 982 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 484 ms: 9 candidates, 51079 repo-hours, 560 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:57:40Z [load_day 2024-05-05] 2024-05-05 hour 8: 174868 events in 0 files, snapshot none (task 4504 ms: download 1970 ms overlapping gunzip 627 ms, parse 2898 ms, sort 0 ms, write 0 ms, index 568 ms: 3 candidates, 56671 repo-hours, 630 releases; waiting 181 ms; commit 0 ms)
2026-11-08T05:57:45Z [load_day 2024-05-05] 2024-05-05 hour 9: 181482 events in 0 files, snapshot none (task 5057 ms: download 2556 ms overlapping gunzip 712 ms, parse 3080 ms, sort 0 ms, write 0 ms, index 485 ms: 7 candidates, 62640 repo-hours, 883 releases; waiting 469 ms; commit 0 ms)
2026-11-08T05:57:46Z [load_day 2024-05-05] 2024-05-05 hour 10: 179734 events in 0 files, snapshot none (task 5746 ms: download 3508 ms overlapping gunzip 815 ms, parse 3483 ms, sort 0 ms, write 0 ms, index 647 ms: 11 candidates, 60586 repo-hours, 817 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:57:51Z [load_day 2024-05-05] 2024-05-05 hour 11: 172752 events in 0 files, snapshot none (task 5413 ms: download 2809 ms overlapping gunzip 778 ms, parse 3496 ms, sort 0 ms, write 0 ms, index 409 ms: 19 candidates, 58286 repo-hours, 734 releases; waiting 441 ms; commit 0 ms)
2026-11-08T05:57:53Z [load_day 2024-05-05] 2024-05-05 hour 12: 250024 events in 0 files, snapshot none (task 6514 ms: download 3348 ms overlapping gunzip 805 ms, parse 3967 ms, sort 0 ms, write 0 ms, index 913 ms: 13 candidates, 101802 repo-hours, 911 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:57:59Z [load_day 2024-05-05] 2024-05-05 hour 13: 199026 events in 0 files, snapshot none (task 6884 ms: download 3745 ms overlapping gunzip 975 ms, parse 4468 ms, sort 0 ms, write 0 ms, index 742 ms: 11 candidates, 86918 repo-hours, 868 releases; waiting 457 ms; commit 0 ms)
2026-11-08T05:57:59Z [load_day 2024-05-05] 2024-05-05 hour 14: 193390 events in 0 files, snapshot none (task 5940 ms: download 3247 ms overlapping gunzip 894 ms, parse 4041 ms, sort 0 ms, write 0 ms, index 558 ms: 13 candidates, 71748 repo-hours, 968 releases; waiting 193 ms; commit 0 ms)
2026-11-08T05:58:06Z [load_day 2024-05-05] 2024-05-05 hour 15: 200167 events in 0 files, snapshot none (task 6527 ms: download 3357 ms overlapping gunzip 946 ms, parse 4279 ms, sort 0 ms, write 0 ms, index 720 ms: 18 candidates, 77759 repo-hours, 962 releases; waiting 332 ms; commit 0 ms)
2026-11-08T05:58:07Z [load_day 2024-05-05] 2024-05-05 hour 16: 209834 events in 0 files, snapshot none (task 7330 ms: download 4081 ms overlapping gunzip 1037 ms, parse 4791 ms, sort 0 ms, write 0 ms, index 728 ms: 6 candidates, 71420 repo-hours, 956 releases; waiting 447 ms; commit 0 ms)
2026-11-08T05:58:14Z [load_day 2024-05-05] 2024-05-05 hour 17: 189457 events in 0 files, snapshot none (task 7382 ms: download 4458 ms overlapping gunzip 960 ms, parse 4543 ms, sort 0 ms, write 0 ms, index 843 ms: 6 candidates, 68709 repo-hours, 794 releases; waiting 768 ms; commit 0 ms)
2026-11-08T05:58:15Z [load_day 2024-05-05] 2024-05-05 hour 18: 201742 events in 0 files, snapshot none (task 6891 ms: download 3862 ms overlapping gunzip 1081 ms, parse 4539 ms, sort 0 ms, write 0 ms, index 619 ms: 11 candidates, 78846 repo-hours, 1008 releases; waiting 325 ms; commit 0 ms)
2026-11-08T05:58:23Z [load_day 2024-05-05] 2024-05-05 hour 19: 177375 events in 0 files, snapshot none (task 8336 ms: download 5176 ms overlapping gunzip 1258 ms, parse 5730 ms, sort 0 ms, write 0 ms, index 556 ms: 10 candidates, 62310 repo-hours, 811 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:58:23Z [load_day 2024-05-05] 2024-05-05 hour 20: 174605 events in 0 files, snapshot none (task 6899 ms: download 3779 ms overlapping gunzip 974 ms, parse 4383 ms, sort 0 ms, write 0 ms, index 671 ms: 11 candidates, 62749 repo-hours, 857 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:58:29Z [load_day 2024-05-05] 2024-05-05 hour 21: 161704 events in 0 files, snapshot none (task 6318 ms: download 2947 ms overlapping gunzip 957 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 498 ms: 13 candidates, 58615 repo-hours, 920 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:58:29Z [load_day 2024-05-05] 2024-05-05 hour 22: 145455 events in 0 files, snapshot none (task 5454 ms: download 2330 ms overlapping gunzip 763 ms, parse 3422 ms, sort 0 ms, write 0 ms, index 508 ms: 13 candidates, 50036 repo-hours, 826 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:58:34Z [load_day 2024-05-05] 2024-05-05 hour 23: 138123 events in 0 files, snapshot none (task 3801 ms: download 1917 ms overlapping gunzip 558 ms, parse 2425 ms, sort 0 ms, write 0 ms, index 353 ms: 14 candidates, 48505 repo-hours, 666 releases; waiting 186 ms; commit 0 ms)
2026-11-08T05:58:41Z [load_day 2024-05-05] 2024-05-05: repo_hour merged from 24 files to 1 (1543476 rows, 7403 ms)
2026-11-08T05:58:44Z [load_day 2024-05-05] 2024-05-05: index committed in 9901 ms (23 + 1 + 24 files)
2026-11-08T05:58:44Z [load_day 2024-05-05] 2024-05-05: 4144477 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:58:44Z [load_day 2024-05-05] attempt 1 succeeded