orcaLog in

Runs · run 2801

load_day 2024-08-04, attempt 1 succeeded

Host
73ccef5e07c2:159250
Started
2026-11-08T07:17:59Z
Ended
2026-11-08T07:19:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
616 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.4 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2801/load_day/2024-08-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:17:59Z [load_day 2024-08-04] attempt 1 started
2026-11-08T07:17:59Z [load_day 2024-08-04] 2024-08-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:18:05Z [load_day 2024-08-04] 2024-08-04 hour 0: 138433 events in 0 files, snapshot none (task 4978 ms: download 3688 ms overlapping gunzip 541 ms, parse 2435 ms, sort 0 ms, write 0 ms, index 560 ms: 4 candidates, 74170 repo-hours, 990 releases; waiting 967 ms; commit 0 ms)
2026-11-08T07:18:05Z [load_day 2024-08-04] 2024-08-04 hour 1: 157723 events in 0 files, snapshot none (task 4132 ms: download 1748 ms overlapping gunzip 516 ms, parse 2330 ms, sort 0 ms, write 0 ms, index 691 ms: 6 candidates, 94782 repo-hours, 813 releases; waiting 365 ms; commit 0 ms)
2026-11-08T07:18:09Z [load_day 2024-08-04] 2024-08-04 hour 2: 110397 events in 0 files, snapshot none (task 3462 ms: download 2685 ms overlapping gunzip 433 ms, parse 1838 ms, sort 0 ms, write 0 ms, index 335 ms: 3 candidates, 48118 repo-hours, 692 releases; waiting 588 ms; commit 0 ms)
2026-11-08T07:18:09Z [load_day 2024-08-04] 2024-08-04 hour 3: 134735 events in 0 files, snapshot none (task 3616 ms: download 1877 ms overlapping gunzip 430 ms, parse 2072 ms, sort 0 ms, write 0 ms, index 440 ms: 4 candidates, 55920 repo-hours, 5320 releases; waiting 227 ms; commit 0 ms)
2026-11-08T07:18:12Z [load_day 2024-08-04] 2024-08-04 hour 4: 117488 events in 0 files, snapshot none (task 3184 ms: download 2319 ms overlapping gunzip 408 ms, parse 1870 ms, sort 0 ms, write 0 ms, index 366 ms: 2 candidates, 45036 repo-hours, 477 releases; waiting 217 ms; commit 0 ms)
2026-11-08T07:18:13Z [load_day 2024-08-04] 2024-08-04 hour 5: 130112 events in 0 files, snapshot none (task 3555 ms: download 1773 ms overlapping gunzip 443 ms, parse 1970 ms, sort 0 ms, write 0 ms, index 336 ms: 4 candidates, 48286 repo-hours, 643 releases; waiting 573 ms; commit 0 ms)
2026-11-08T07:18:18Z [load_day 2024-08-04] 2024-08-04 hour 6: 154197 events in 0 files, snapshot none (task 5399 ms: download 2657 ms overlapping gunzip 736 ms, parse 3213 ms, sort 0 ms, write 0 ms, index 734 ms: 6 candidates, 66567 repo-hours, 698 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:18:19Z [load_day 2024-08-04] 2024-08-04 hour 7: 144814 events in 0 files, snapshot none (task 5548 ms: download 2916 ms overlapping gunzip 828 ms, parse 3621 ms, sort 0 ms, write 0 ms, index 413 ms: 6 candidates, 53176 repo-hours, 627 releases; waiting 477 ms; commit 0 ms)
2026-11-08T07:18:24Z [load_day 2024-08-04] 2024-08-04 hour 8: 152296 events in 0 files, snapshot none (task 5153 ms: download 2448 ms overlapping gunzip 702 ms, parse 3060 ms, sort 0 ms, write 0 ms, index 533 ms: 6 candidates, 57834 repo-hours, 624 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:18:25Z [load_day 2024-08-04] 2024-08-04 hour 9: 158468 events in 0 files, snapshot none (task 5441 ms: download 2923 ms overlapping gunzip 771 ms, parse 3400 ms, sort 0 ms, write 0 ms, index 485 ms: 7 candidates, 65545 repo-hours, 790 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:18:28Z [load_day 2024-08-04] 2024-08-04 hour 10: 147556 events in 0 files, snapshot none (task 4235 ms: download 2545 ms overlapping gunzip 529 ms, parse 2335 ms, sort 0 ms, write 0 ms, index 508 ms: 4 candidates, 60225 repo-hours, 648 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:18:29Z [load_day 2024-08-04] 2024-08-04 hour 11: 145174 events in 0 files, snapshot none (task 3990 ms: download 1986 ms overlapping gunzip 497 ms, parse 2245 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 57147 repo-hours, 703 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:18:35Z [load_day 2024-08-04] 2024-08-04 hour 12: 225924 events in 0 files, snapshot none (task 5933 ms: download 3018 ms overlapping gunzip 773 ms, parse 3746 ms, sort 0 ms, write 0 ms, index 731 ms: 7 candidates, 106405 repo-hours, 935 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:18:36Z [load_day 2024-08-04] 2024-08-04 hour 13: 184169 events in 0 files, snapshot none (task 5826 ms: download 3144 ms overlapping gunzip 784 ms, parse 3556 ms, sort 0 ms, write 0 ms, index 780 ms: 4 candidates, 86858 repo-hours, 801 releases; waiting 464 ms; commit 0 ms)
2026-11-08T07:18:41Z [load_day 2024-08-04] 2024-08-04 hour 14: 169309 events in 0 files, snapshot none (task 5721 ms: download 2839 ms overlapping gunzip 909 ms, parse 3795 ms, sort 0 ms, write 0 ms, index 535 ms: 3 candidates, 67689 repo-hours, 913 releases; waiting 202 ms; commit 0 ms)
2026-11-08T07:18:43Z [load_day 2024-08-04] 2024-08-04 hour 15: 182532 events in 0 files, snapshot none (task 6434 ms: download 3343 ms overlapping gunzip 880 ms, parse 3992 ms, sort 0 ms, write 0 ms, index 794 ms: 6 candidates, 77945 repo-hours, 938 releases; waiting 474 ms; commit 0 ms)
2026-11-08T07:18:48Z [load_day 2024-08-04] 2024-08-04 hour 16: 172774 events in 0 files, snapshot none (task 6299 ms: download 2176 ms overlapping gunzip 881 ms, parse 3817 ms, sort 0 ms, write 0 ms, index 853 ms: 2 candidates, 68037 repo-hours, 976 releases; waiting 452 ms; commit 0 ms)
2026-11-08T07:18:49Z [load_day 2024-08-04] 2024-08-04 hour 17: 162539 events in 0 files, snapshot none (task 5667 ms: download 2766 ms overlapping gunzip 790 ms, parse 3511 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 64125 repo-hours, 911 releases; waiting 470 ms; commit 0 ms)
2026-11-08T07:18:54Z [load_day 2024-08-04] 2024-08-04 hour 18: 180734 events in 0 files, snapshot none (task 6251 ms: download 2935 ms overlapping gunzip 838 ms, parse 3844 ms, sort 0 ms, write 0 ms, index 831 ms: 4 candidates, 82233 repo-hours, 871 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:18:55Z [load_day 2024-08-04] 2024-08-04 hour 19: 151787 events in 0 files, snapshot none (task 5336 ms: download 2300 ms overlapping gunzip 724 ms, parse 3377 ms, sort 0 ms, write 0 ms, index 593 ms: 4 candidates, 55185 repo-hours, 762 releases; waiting 339 ms; commit 0 ms)
2026-11-08T07:19:00Z [load_day 2024-08-04] 2024-08-04 hour 20: 146208 events in 0 files, snapshot none (task 5534 ms: download 3607 ms overlapping gunzip 798 ms, parse 3309 ms, sort 0 ms, write 0 ms, index 390 ms: 6 candidates, 54636 repo-hours, 781 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:19:00Z [load_day 2024-08-04] 2024-08-04 hour 21: 147915 events in 0 files, snapshot none (task 4922 ms: download 1994 ms overlapping gunzip 673 ms, parse 3027 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 60777 repo-hours, 880 releases; waiting 381 ms; commit 0 ms)
2026-11-08T07:19:06Z [load_day 2024-08-04] 2024-08-04 hour 22: 126415 events in 0 files, snapshot none (task 5150 ms: download 2241 ms overlapping gunzip 755 ms, parse 3117 ms, sort 0 ms, write 0 ms, index 557 ms: 6 candidates, 48506 repo-hours, 890 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:19:06Z [load_day 2024-08-04] 2024-08-04 hour 23: 124246 events in 0 files, snapshot none (task 4961 ms: download 2588 ms overlapping gunzip 702 ms, parse 3090 ms, sort 0 ms, write 0 ms, index 394 ms: 3 candidates, 49828 repo-hours, 576 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:19:13Z [load_day 2024-08-04] 2024-08-04: repo_hour merged from 24 files to 1 (1549030 rows, 7237 ms)
2026-11-08T07:19:16Z [load_day 2024-08-04] 2024-08-04: index committed in 9921 ms (24 + 1 + 24 files)
2026-11-08T07:19:16Z [load_day 2024-08-04] 2024-08-04: 3665945 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:19:16Z [load_day 2024-08-04] attempt 1 succeeded