orcaLog in

Runs · run 2658

load_day 2024-06-30, attempt 1 succeeded

Host
73ccef5e07c2:143447
Started
2026-11-08T06:46:30Z
Ended
2026-11-08T06:47:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
644 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.6 s, up to 2.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2658/load_day/2024-06-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:46:30Z [load_day 2024-06-30] attempt 1 started
2026-11-08T06:46:32Z [load_day 2024-06-30] 2024-06-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:46:37Z [load_day 2024-06-30] 2024-06-30 hour 0: 142755 events in 0 files, snapshot none (task 4894 ms: download 2638 ms overlapping gunzip 635 ms, parse 2855 ms, sort 0 ms, write 0 ms, index 544 ms: 2 candidates, 76698 repo-hours, 2549 releases; waiting 547 ms; commit 0 ms)
2026-11-08T06:46:37Z [load_day 2024-06-30] 2024-06-30 hour 1: 151329 events in 0 files, snapshot none (task 4758 ms: download 2196 ms overlapping gunzip 606 ms, parse 2792 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 90502 repo-hours, 2353 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:46:42Z [load_day 2024-06-30] 2024-06-30 hour 2: 115111 events in 0 files, snapshot none (task 3997 ms: download 1918 ms overlapping gunzip 559 ms, parse 2531 ms, sort 0 ms, write 0 ms, index 365 ms: 4 candidates, 48705 repo-hours, 2246 releases; waiting 261 ms; commit 0 ms)
2026-11-08T06:46:42Z [load_day 2024-06-30] 2024-06-30 hour 3: 136377 events in 0 files, snapshot none (task 4773 ms: download 2828 ms overlapping gunzip 659 ms, parse 2892 ms, sort 0 ms, write 0 ms, index 428 ms: 6 candidates, 55824 repo-hours, 6962 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:46:46Z [load_day 2024-06-30] 2024-06-30 hour 4: 116183 events in 0 files, snapshot none (task 3601 ms: download 1714 ms overlapping gunzip 391 ms, parse 1805 ms, sort 0 ms, write 0 ms, index 632 ms: 6 candidates, 44605 repo-hours, 1958 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:46:47Z [load_day 2024-06-30] 2024-06-30 hour 5: 126965 events in 0 files, snapshot none (task 4239 ms: download 2106 ms overlapping gunzip 558 ms, parse 2387 ms, sort 0 ms, write 0 ms, index 482 ms: 2 candidates, 49170 repo-hours, 1935 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:46:50Z [load_day 2024-06-30] 2024-06-30 hour 6: 144890 events in 0 files, snapshot none (task 3951 ms: download 2021 ms overlapping gunzip 517 ms, parse 2215 ms, sort 0 ms, write 0 ms, index 484 ms: 4 candidates, 65410 repo-hours, 2081 releases; waiting 459 ms; commit 0 ms)
2026-11-08T06:46:54Z [load_day 2024-06-30] 2024-06-30 hour 7: 138504 events in 0 files, snapshot none (task 5710 ms: download 3665 ms overlapping gunzip 657 ms, parse 2930 ms, sort 0 ms, write 0 ms, index 473 ms: 5 candidates, 53373 repo-hours, 2005 releases; waiting 1304 ms; commit 0 ms)
2026-11-08T06:46:56Z [load_day 2024-06-30] 2024-06-30 hour 8: 147275 events in 0 files, snapshot none (task 4960 ms: download 3450 ms overlapping gunzip 635 ms, parse 2609 ms, sort 0 ms, write 0 ms, index 463 ms: 11 candidates, 57260 repo-hours, 2077 releases; waiting 734 ms; commit 0 ms)
2026-11-08T06:47:00Z [load_day 2024-06-30] 2024-06-30 hour 9: 157110 events in 0 files, snapshot none (task 5585 ms: download 2185 ms overlapping gunzip 763 ms, parse 3328 ms, sort 0 ms, write 0 ms, index 706 ms: 6 candidates, 66928 repo-hours, 2132 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:47:02Z [load_day 2024-06-30] 2024-06-30 hour 10: 159422 events in 0 files, snapshot none (task 5949 ms: download 3054 ms overlapping gunzip 891 ms, parse 3913 ms, sort 0 ms, write 0 ms, index 529 ms: 12 candidates, 68826 repo-hours, 2144 releases; waiting 335 ms; commit 0 ms)
2026-11-08T06:47:06Z [load_day 2024-06-30] 2024-06-30 hour 11: 159288 events in 0 files, snapshot none (task 5609 ms: download 2228 ms overlapping gunzip 703 ms, parse 3213 ms, sort 0 ms, write 0 ms, index 850 ms: 5 candidates, 66901 repo-hours, 2098 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:47:09Z [load_day 2024-06-30] 2024-06-30 hour 12: 229796 events in 0 files, snapshot none (task 6062 ms: download 3017 ms overlapping gunzip 742 ms, parse 3662 ms, sort 0 ms, write 0 ms, index 885 ms: 10 candidates, 105606 repo-hours, 2189 releases; waiting 449 ms; commit 0 ms)
2026-11-08T06:47:11Z [load_day 2024-06-30] 2024-06-30 hour 13: 183834 events in 0 files, snapshot none (task 4894 ms: download 2448 ms overlapping gunzip 608 ms, parse 2872 ms, sort 0 ms, write 0 ms, index 713 ms: 16 candidates, 87583 repo-hours, 2307 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:47:14Z [load_day 2024-06-30] 2024-06-30 hour 14: 170677 events in 0 files, snapshot none (task 4901 ms: download 2670 ms overlapping gunzip 618 ms, parse 2764 ms, sort 0 ms, write 0 ms, index 668 ms: 11 candidates, 70085 repo-hours, 2310 releases; waiting 549 ms; commit 0 ms)
2026-11-08T06:47:17Z [load_day 2024-06-30] 2024-06-30 hour 15: 185220 events in 0 files, snapshot none (task 4816 ms: download 2676 ms overlapping gunzip 626 ms, parse 2688 ms, sort 0 ms, write 0 ms, index 626 ms: 9 candidates, 82264 repo-hours, 2341 releases; waiting 587 ms; commit 0 ms)
2026-11-08T06:47:19Z [load_day 2024-06-30] 2024-06-30 hour 16: 167444 events in 0 files, snapshot none (task 4526 ms: download 2550 ms overlapping gunzip 607 ms, parse 2636 ms, sort 0 ms, write 0 ms, index 538 ms: 20 candidates, 68488 repo-hours, 2186 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:47:22Z [load_day 2024-06-30] 2024-06-30 hour 17: 160774 events in 0 files, snapshot none (task 4555 ms: download 2858 ms overlapping gunzip 574 ms, parse 2453 ms, sort 0 ms, write 0 ms, index 487 ms: 7 candidates, 63703 repo-hours, 2293 releases; waiting 702 ms; commit 0 ms)
2026-11-08T06:47:24Z [load_day 2024-06-30] 2024-06-30 hour 18: 175410 events in 0 files, snapshot none (task 4559 ms: download 2180 ms overlapping gunzip 549 ms, parse 2476 ms, sort 0 ms, write 0 ms, index 700 ms: 5 candidates, 81792 repo-hours, 2235 releases; waiting 555 ms; commit 0 ms)
2026-11-08T06:47:28Z [load_day 2024-06-30] 2024-06-30 hour 19: 151727 events in 0 files, snapshot none (task 5757 ms: download 2875 ms overlapping gunzip 902 ms, parse 3638 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 56285 repo-hours, 1928 releases; waiting 380 ms; commit 0 ms)
2026-11-08T06:47:34Z [load_day 2024-06-30] 2024-06-30 hour 20: 145943 events in 0 files, snapshot none (task 9712 ms: download 2531 ms overlapping gunzip 638 ms, parse 2800 ms, sort 0 ms, write 0 ms, index 5430 ms: 9 candidates, 56951 repo-hours, 2300 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:47:40Z [load_day 2024-06-30] 2024-06-30 hour 21: 145788 events in 0 files, snapshot none (task 5875 ms: download 3324 ms overlapping gunzip 857 ms, parse 3731 ms, sort 0 ms, write 0 ms, index 486 ms: 6 candidates, 59276 repo-hours, 2277 releases; waiting 519 ms; commit 0 ms)
2026-11-08T06:47:40Z [load_day 2024-06-30] 2024-06-30 hour 22: 129011 events in 0 files, snapshot none (task 5387 ms: download 2545 ms overlapping gunzip 782 ms, parse 3273 ms, sort 0 ms, write 0 ms, index 476 ms: 9 candidates, 48574 repo-hours, 2008 releases; waiting 549 ms; commit 0 ms)
2026-11-08T06:47:46Z [load_day 2024-06-30] 2024-06-30 hour 23: 127705 events in 0 files, snapshot none (task 4876 ms: download 3679 ms overlapping gunzip 635 ms, parse 2587 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 50036 repo-hours, 1820 releases; waiting 849 ms; commit 0 ms)
2026-11-08T06:47:54Z [load_day 2024-06-30] 2024-06-30: repo_hour merged from 24 files to 1 (1574845 rows, 7666 ms)
2026-11-08T06:47:56Z [load_day 2024-06-30] 2024-06-30: index committed in 10106 ms (24 + 1 + 24 files)
2026-11-08T06:47:56Z [load_day 2024-06-30] 2024-06-30: 3668538 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:47:56Z [load_day 2024-06-30] attempt 1 succeeded