orcaLog in

Runs · run 2711

load_day 2024-07-13, attempt 1 succeeded

Host
73ccef5e07c2:149253
Started
2026-11-08T06:58:23Z
Ended
2026-11-08T06:59:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
668 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2711/load_day/2024-07-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:58:23Z [load_day 2024-07-13] attempt 1 started
2026-11-08T06:58:24Z [load_day 2024-07-13] 2024-07-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:58:31Z [load_day 2024-07-13] 2024-07-13 hour 0: 156405 events in 0 files, snapshot none (task 6798 ms: download 3623 ms overlapping gunzip 949 ms, parse 4400 ms, sort 0 ms, write 0 ms, index 674 ms: 10 candidates, 84344 repo-hours, 979 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:58:31Z [load_day 2024-07-13] 2024-07-13 hour 1: 162554 events in 0 files, snapshot none (task 6923 ms: download 3859 ms overlapping gunzip 961 ms, parse 4473 ms, sort 0 ms, write 0 ms, index 753 ms: 6 candidates, 94796 repo-hours, 799 releases; waiting 467 ms; commit 0 ms)
2026-11-08T06:58:36Z [load_day 2024-07-13] 2024-07-13 hour 2: 122232 events in 0 files, snapshot none (task 4920 ms: download 2103 ms overlapping gunzip 685 ms, parse 2959 ms, sort 0 ms, write 0 ms, index 465 ms: 2 candidates, 49592 repo-hours, 672 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:58:36Z [load_day 2024-07-13] 2024-07-13 hour 3: 147030 events in 0 files, snapshot none (task 4471 ms: download 2250 ms overlapping gunzip 576 ms, parse 2604 ms, sort 0 ms, write 0 ms, index 523 ms: 4 candidates, 60866 repo-hours, 5442 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:58:41Z [load_day 2024-07-13] 2024-07-13 hour 4: 120958 events in 0 files, snapshot none (task 3956 ms: download 1964 ms overlapping gunzip 568 ms, parse 2543 ms, sort 0 ms, write 0 ms, index 343 ms: 4 candidates, 47705 repo-hours, 502 releases; waiting 195 ms; commit 0 ms)
2026-11-08T06:58:41Z [load_day 2024-07-13] 2024-07-13 hour 5: 134794 events in 0 files, snapshot none (task 4448 ms: download 2291 ms overlapping gunzip 606 ms, parse 2631 ms, sort 0 ms, write 0 ms, index 438 ms: 1 candidates, 54859 repo-hours, 637 releases; waiting 473 ms; commit 0 ms)
2026-11-08T06:58:47Z [load_day 2024-07-13] 2024-07-13 hour 6: 156977 events in 0 files, snapshot none (task 6009 ms: download 2770 ms overlapping gunzip 841 ms, parse 3790 ms, sort 0 ms, write 0 ms, index 632 ms: 5 candidates, 70473 repo-hours, 989 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:58:47Z [load_day 2024-07-13] 2024-07-13 hour 7: 148671 events in 0 files, snapshot none (task 5564 ms: download 2455 ms overlapping gunzip 828 ms, parse 3694 ms, sort 0 ms, write 0 ms, index 526 ms: 8 candidates, 57621 repo-hours, 906 releases; waiting 247 ms; commit 0 ms)
2026-11-08T06:58:52Z [load_day 2024-07-13] 2024-07-13 hour 8: 152386 events in 0 files, snapshot none (task 4578 ms: download 2229 ms overlapping gunzip 601 ms, parse 2473 ms, sort 0 ms, write 0 ms, index 686 ms: 9 candidates, 61751 repo-hours, 776 releases; waiting 553 ms; commit 0 ms)
2026-11-08T06:58:52Z [load_day 2024-07-13] 2024-07-13 hour 9: 155455 events in 0 files, snapshot none (task 4062 ms: download 1592 ms overlapping gunzip 530 ms, parse 2278 ms, sort 0 ms, write 0 ms, index 827 ms: 13 candidates, 67246 repo-hours, 1118 releases; waiting 209 ms; commit 0 ms)
2026-11-08T06:58:57Z [load_day 2024-07-13] 2024-07-13 hour 10: 149140 events in 0 files, snapshot none (task 4242 ms: download 1722 ms overlapping gunzip 601 ms, parse 2672 ms, sort 0 ms, write 0 ms, index 409 ms: 9 candidates, 61155 repo-hours, 818 releases; waiting 300 ms; commit 0 ms)
2026-11-08T06:58:58Z [load_day 2024-07-13] 2024-07-13 hour 11: 146087 events in 0 files, snapshot none (task 4667 ms: download 3095 ms overlapping gunzip 588 ms, parse 2502 ms, sort 0 ms, write 0 ms, index 467 ms: 5 candidates, 58462 repo-hours, 756 releases; waiting 787 ms; commit 0 ms)
2026-11-08T06:59:04Z [load_day 2024-07-13] 2024-07-13 hour 12: 228266 events in 0 files, snapshot none (task 6407 ms: download 3821 ms overlapping gunzip 834 ms, parse 4058 ms, sort 0 ms, write 0 ms, index 705 ms: 7 candidates, 107351 repo-hours, 829 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:59:04Z [load_day 2024-07-13] 2024-07-13 hour 13: 180641 events in 0 files, snapshot none (task 6026 ms: download 3745 ms overlapping gunzip 822 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 86756 repo-hours, 790 releases; waiting 774 ms; commit 0 ms)
2026-11-08T06:59:09Z [load_day 2024-07-13] 2024-07-13 hour 14: 171238 events in 0 files, snapshot none (task 5133 ms: download 3518 ms overlapping gunzip 720 ms, parse 2996 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 71018 repo-hours, 724 releases; waiting 491 ms; commit 0 ms)
2026-11-08T06:59:09Z [load_day 2024-07-13] 2024-07-13 hour 15: 181362 events in 0 files, snapshot none (task 4759 ms: download 2320 ms overlapping gunzip 666 ms, parse 2707 ms, sort 0 ms, write 0 ms, index 587 ms: 11 candidates, 79651 repo-hours, 914 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:59:15Z [load_day 2024-07-13] 2024-07-13 hour 16: 171816 events in 0 files, snapshot none (task 4837 ms: download 2426 ms overlapping gunzip 640 ms, parse 2931 ms, sort 0 ms, write 0 ms, index 496 ms: 8 candidates, 67995 repo-hours, 776 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:59:15Z [load_day 2024-07-13] 2024-07-13 hour 17: 166593 events in 0 files, snapshot none (task 4571 ms: download 2047 ms overlapping gunzip 625 ms, parse 2608 ms, sort 0 ms, write 0 ms, index 541 ms: 5 candidates, 71342 repo-hours, 702 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:59:21Z [load_day 2024-07-13] 2024-07-13 hour 18: 174655 events in 0 files, snapshot none (task 5526 ms: download 2951 ms overlapping gunzip 759 ms, parse 3450 ms, sort 0 ms, write 0 ms, index 566 ms: 6 candidates, 81216 repo-hours, 807 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:59:21Z [load_day 2024-07-13] 2024-07-13 hour 19: 141963 events in 0 files, snapshot none (task 5403 ms: download 2892 ms overlapping gunzip 773 ms, parse 3451 ms, sort 0 ms, write 0 ms, index 446 ms: 5 candidates, 54027 repo-hours, 792 releases; waiting 444 ms; commit 0 ms)
2026-11-08T06:59:26Z [load_day 2024-07-13] 2024-07-13 hour 20: 143444 events in 0 files, snapshot none (task 4745 ms: download 2576 ms overlapping gunzip 655 ms, parse 2962 ms, sort 0 ms, write 0 ms, index 420 ms: 3 candidates, 54157 repo-hours, 649 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:59:26Z [load_day 2024-07-13] 2024-07-13 hour 21: 135301 events in 0 files, snapshot none (task 4460 ms: download 2301 ms overlapping gunzip 619 ms, parse 2679 ms, sort 0 ms, write 0 ms, index 388 ms: 7 candidates, 55865 repo-hours, 856 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:59:30Z [load_day 2024-07-13] 2024-07-13 hour 22: 116553 events in 0 files, snapshot none (task 3965 ms: download 2115 ms overlapping gunzip 555 ms, parse 2334 ms, sort 0 ms, write 0 ms, index 308 ms: 2 candidates, 43326 repo-hours, 721 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:59:30Z [load_day 2024-07-13] 2024-07-13 hour 23: 108732 events in 0 files, snapshot none (task 3853 ms: download 1828 ms overlapping gunzip 520 ms, parse 2257 ms, sort 0 ms, write 0 ms, index 298 ms: 4 candidates, 41177 repo-hours, 535 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:59:38Z [load_day 2024-07-13] 2024-07-13: repo_hour merged from 24 files to 1 (1582751 rows, 7273 ms)
2026-11-08T06:59:41Z [load_day 2024-07-13] 2024-07-13: index committed in 10459 ms (24 + 1 + 24 files)
2026-11-08T06:59:41Z [load_day 2024-07-13] 2024-07-13: 3673253 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:59:41Z [load_day 2024-07-13] attempt 1 succeeded