orcaLog in

Runs · run 2854

load_day 2024-08-17, attempt 1 succeeded

Host
73ccef5e07c2:165259
Started
2026-11-08T07:28:59Z
Ended
2026-11-08T07:30:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
612 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2854/load_day/2024-08-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:28:59Z [load_day 2024-08-17] attempt 1 started
2026-11-08T07:29:00Z [load_day 2024-08-17] 2024-08-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:29:07Z [load_day 2024-08-17] 2024-08-17 hour 0: 165963 events in 0 files, snapshot none (task 6288 ms: download 3178 ms overlapping gunzip 873 ms, parse 3874 ms, sort 0 ms, write 0 ms, index 621 ms: 16 candidates, 85309 repo-hours, 1122 releases; waiting 569 ms; commit 0 ms)
2026-11-08T07:29:07Z [load_day 2024-08-17] 2024-08-17 hour 1: 170321 events in 0 files, snapshot none (task 5840 ms: download 2909 ms overlapping gunzip 813 ms, parse 3667 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 94087 repo-hours, 796 releases; waiting 206 ms; commit 0 ms)
2026-11-08T07:29:12Z [load_day 2024-08-17] 2024-08-17 hour 2: 124822 events in 0 files, snapshot none (task 4534 ms: download 1859 ms overlapping gunzip 639 ms, parse 2774 ms, sort 0 ms, write 0 ms, index 396 ms: 4 candidates, 49303 repo-hours, 717 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:29:12Z [load_day 2024-08-17] 2024-08-17 hour 3: 148964 events in 0 files, snapshot none (task 4829 ms: download 2199 ms overlapping gunzip 701 ms, parse 2915 ms, sort 0 ms, write 0 ms, index 426 ms: 5 candidates, 58899 repo-hours, 4794 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:29:17Z [load_day 2024-08-17] 2024-08-17 hour 4: 127336 events in 0 files, snapshot none (task 4062 ms: download 2044 ms overlapping gunzip 548 ms, parse 2337 ms, sort 0 ms, write 0 ms, index 353 ms: 6 candidates, 47001 repo-hours, 579 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:29:17Z [load_day 2024-08-17] 2024-08-17 hour 5: 132968 events in 0 files, snapshot none (task 4228 ms: download 1974 ms overlapping gunzip 581 ms, parse 2536 ms, sort 0 ms, write 0 ms, index 369 ms: 2 candidates, 49508 repo-hours, 654 releases; waiting 458 ms; commit 0 ms)
2026-11-08T07:29:23Z [load_day 2024-08-17] 2024-08-17 hour 6: 158432 events in 0 files, snapshot none (task 6105 ms: download 2891 ms overlapping gunzip 894 ms, parse 3805 ms, sort 0 ms, write 0 ms, index 573 ms: 8 candidates, 67294 repo-hours, 885 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:29:23Z [load_day 2024-08-17] 2024-08-17 hour 7: 147476 events in 0 files, snapshot none (task 5555 ms: download 2423 ms overlapping gunzip 872 ms, parse 3853 ms, sort 0 ms, write 0 ms, index 413 ms: 6 candidates, 52409 repo-hours, 855 releases; waiting 178 ms; commit 0 ms)
2026-11-08T07:29:29Z [load_day 2024-08-17] 2024-08-17 hour 8: 162860 events in 0 files, snapshot none (task 5862 ms: download 3803 ms overlapping gunzip 738 ms, parse 3187 ms, sort 0 ms, write 0 ms, index 611 ms: 1 candidates, 58629 repo-hours, 867 releases; waiting 1047 ms; commit 0 ms)
2026-11-08T07:29:29Z [load_day 2024-08-17] 2024-08-17 hour 9: 169626 events in 0 files, snapshot none (task 5104 ms: download 2418 ms overlapping gunzip 708 ms, parse 2991 ms, sort 0 ms, write 0 ms, index 609 ms: 2 candidates, 65245 repo-hours, 1047 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:29:35Z [load_day 2024-08-17] 2024-08-17 hour 10: 157965 events in 0 files, snapshot none (task 5253 ms: download 2820 ms overlapping gunzip 699 ms, parse 3114 ms, sort 0 ms, write 0 ms, index 473 ms: 3 candidates, 59226 repo-hours, 760 releases; waiting 721 ms; commit 0 ms)
2026-11-08T07:29:35Z [load_day 2024-08-17] 2024-08-17 hour 11: 160805 events in 0 files, snapshot none (task 5028 ms: download 2464 ms overlapping gunzip 742 ms, parse 3022 ms, sort 0 ms, write 0 ms, index 450 ms: 6 candidates, 57629 repo-hours, 659 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:29:43Z [load_day 2024-08-17] 2024-08-17 hour 12: 233704 events in 0 files, snapshot none (task 7153 ms: download 4030 ms overlapping gunzip 1023 ms, parse 4624 ms, sort 0 ms, write 0 ms, index 720 ms: 6 candidates, 104695 repo-hours, 892 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:29:43Z [load_day 2024-08-17] 2024-08-17 hour 13: 199974 events in 0 files, snapshot none (task 6211 ms: download 3431 ms overlapping gunzip 853 ms, parse 3986 ms, sort 0 ms, write 0 ms, index 614 ms: 11 candidates, 90755 repo-hours, 848 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:29:49Z [load_day 2024-08-17] 2024-08-17 hour 14: 178640 events in 0 files, snapshot none (task 5501 ms: download 2640 ms overlapping gunzip 778 ms, parse 3499 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 68170 repo-hours, 884 releases; waiting 345 ms; commit 0 ms)
2026-11-08T07:29:50Z [load_day 2024-08-17] 2024-08-17 hour 15: 191578 events in 0 files, snapshot none (task 6606 ms: download 3402 ms overlapping gunzip 836 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 617 ms: 4 candidates, 80369 repo-hours, 992 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:29:55Z [load_day 2024-08-17] 2024-08-17 hour 16: 176544 events in 0 files, snapshot none (task 5544 ms: download 2351 ms overlapping gunzip 795 ms, parse 3402 ms, sort 0 ms, write 0 ms, index 616 ms: 26 candidates, 70637 repo-hours, 764 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:29:56Z [load_day 2024-08-17] 2024-08-17 hour 17: 171051 events in 0 files, snapshot none (task 5437 ms: download 2383 ms overlapping gunzip 761 ms, parse 3331 ms, sort 0 ms, write 0 ms, index 502 ms: 7 candidates, 63233 repo-hours, 771 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:30:02Z [load_day 2024-08-17] 2024-08-17 hour 18: 190142 events in 0 files, snapshot none (task 5954 ms: download 2362 ms overlapping gunzip 837 ms, parse 3656 ms, sort 0 ms, write 0 ms, index 680 ms: 0 candidates, 82818 repo-hours, 894 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:30:02Z [load_day 2024-08-17] 2024-08-17 hour 19: 164883 events in 0 files, snapshot none (task 4989 ms: download 2147 ms overlapping gunzip 664 ms, parse 3062 ms, sort 0 ms, write 0 ms, index 494 ms: 7 candidates, 57845 repo-hours, 816 releases; waiting 481 ms; commit 0 ms)
2026-11-08T07:30:06Z [load_day 2024-08-17] 2024-08-17 hour 20: 161204 events in 0 files, snapshot none (task 4086 ms: download 2292 ms overlapping gunzip 502 ms, parse 2347 ms, sort 0 ms, write 0 ms, index 446 ms: 6 candidates, 57282 repo-hours, 729 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:30:07Z [load_day 2024-08-17] 2024-08-17 hour 21: 151248 events in 0 files, snapshot none (task 4135 ms: download 2027 ms overlapping gunzip 494 ms, parse 2240 ms, sort 0 ms, write 0 ms, index 404 ms: 6 candidates, 55534 repo-hours, 891 releases; waiting 649 ms; commit 0 ms)
2026-11-08T07:30:11Z [load_day 2024-08-17] 2024-08-17 hour 22: 131052 events in 0 files, snapshot none (task 3591 ms: download 1921 ms overlapping gunzip 448 ms, parse 2077 ms, sort 0 ms, write 0 ms, index 341 ms: 4 candidates, 45681 repo-hours, 773 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:30:11Z [load_day 2024-08-17] 2024-08-17 hour 23: 127006 events in 0 files, snapshot none (task 3786 ms: download 1844 ms overlapping gunzip 487 ms, parse 2190 ms, sort 0 ms, write 0 ms, index 356 ms: 5 candidates, 46415 repo-hours, 562 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:30:18Z [load_day 2024-08-17] 2024-08-17: repo_hour merged from 24 files to 1 (1567973 rows, 6486 ms)
2026-11-08T07:30:21Z [load_day 2024-08-17] 2024-08-17: index committed in 9528 ms (23 + 1 + 24 files)
2026-11-08T07:30:21Z [load_day 2024-08-17] 2024-08-17: 3904564 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:30:21Z [load_day 2024-08-17] attempt 1 succeeded