orcaLog in

Runs · run 4834

load_day 2026-01-17, attempt 1 succeeded

Host
73ccef5e07c2:430859
Started
2026-11-08T15:03:37Z
Ended
2026-11-08T15:04:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
753 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.7 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4834/load_day/2026-01-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:03:37Z [load_day 2026-01-17] attempt 1 started
2026-11-08T15:03:38Z [load_day 2026-01-17] 2026-01-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:03:42Z [load_day 2026-01-17] 2026-01-17 hour 0: 146303 events in 0 files, snapshot none (task 3573 ms: download 2266 ms overlapping gunzip 495 ms, parse 1440 ms, sort 0 ms, write 0 ms, index 553 ms: 9 candidates, 71220 repo-hours, 854 releases; waiting 801 ms; commit 0 ms)
2026-11-08T15:03:42Z [load_day 2026-01-17] 2026-01-17 hour 1: 148896 events in 0 files, snapshot none (task 3210 ms: download 1944 ms overlapping gunzip 420 ms, parse 1416 ms, sort 0 ms, write 0 ms, index 600 ms: 9 candidates, 86343 repo-hours, 719 releases; waiting 483 ms; commit 0 ms)
2026-11-08T15:03:46Z [load_day 2026-01-17] 2026-01-17 hour 2: 141720 events in 0 files, snapshot none (task 2940 ms: download 1996 ms overlapping gunzip 450 ms, parse 1148 ms, sort 0 ms, write 0 ms, index 525 ms: 6 candidates, 68718 repo-hours, 652 releases; waiting 517 ms; commit 0 ms)
2026-11-08T15:03:46Z [load_day 2026-01-17] 2026-01-17 hour 3: 139951 events in 0 files, snapshot none (task 2964 ms: download 1935 ms overlapping gunzip 388 ms, parse 1087 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 66257 repo-hours, 925 releases; waiting 546 ms; commit 0 ms)
2026-11-08T15:03:50Z [load_day 2026-01-17] 2026-01-17 hour 4: 144197 events in 0 files, snapshot none (task 3754 ms: download 1985 ms overlapping gunzip 553 ms, parse 1679 ms, sort 0 ms, write 0 ms, index 677 ms: 5 candidates, 69482 repo-hours, 1361 releases; waiting 526 ms; commit 0 ms)
2026-11-08T15:03:50Z [load_day 2026-01-17] 2026-01-17 hour 5: 143447 events in 0 files, snapshot none (task 3819 ms: download 1862 ms overlapping gunzip 573 ms, parse 1837 ms, sort 0 ms, write 0 ms, index 541 ms: 8 candidates, 65557 repo-hours, 597 releases; waiting 573 ms; commit 0 ms)
2026-11-08T15:04:02Z [load_day 2026-01-17] 2026-01-17 hour 6: 163102 events in 0 files, snapshot none (task 3186 ms: download 1857 ms overlapping gunzip 330 ms, parse 1305 ms, sort 0 ms, write 0 ms, index 731 ms: 4 candidates, 92428 repo-hours, 212 releases; waiting 526 ms; commit 0 ms)
2026-11-08T15:04:02Z [load_day 2026-01-17] 2026-01-17 hour 7: 143313 events in 0 files, snapshot none (task 3130 ms: download 2015 ms overlapping gunzip 394 ms, parse 1318 ms, sort 0 ms, write 0 ms, index 529 ms: 8 candidates, 64387 repo-hours, 656 releases; waiting 578 ms; commit 0 ms)
2026-11-08T15:04:06Z [load_day 2026-01-17] 2026-01-17 hour 8: 146086 events in 0 files, snapshot none (task 3577 ms: download 2336 ms overlapping gunzip 339 ms, parse 1080 ms, sort 0 ms, write 0 ms, index 523 ms: 9 candidates, 70410 repo-hours, 758 releases; waiting 1334 ms; commit 0 ms)
2026-11-08T15:04:06Z [load_day 2026-01-17] 2026-01-17 hour 9: 148081 events in 0 files, snapshot none (task 3796 ms: download 2478 ms overlapping gunzip 382 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 552 ms: 8 candidates, 70465 repo-hours, 757 releases; waiting 1060 ms; commit 0 ms)
2026-11-08T15:04:09Z [load_day 2026-01-17] 2026-01-17 hour 10: 151911 events in 0 files, snapshot none (task 2848 ms: download 1754 ms overlapping gunzip 345 ms, parse 1079 ms, sort 0 ms, write 0 ms, index 607 ms: 5 candidates, 72360 repo-hours, 650 releases; waiting 525 ms; commit 0 ms)
2026-11-08T15:04:10Z [load_day 2026-01-17] 2026-01-17 hour 11: 152956 events in 0 files, snapshot none (task 3368 ms: download 2160 ms overlapping gunzip 364 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 573 ms: 6 candidates, 73893 repo-hours, 607 releases; waiting 930 ms; commit 0 ms)
2026-11-08T15:04:12Z [load_day 2026-01-17] 2026-01-17 hour 12: 159705 events in 0 files, snapshot none (task 2795 ms: download 1498 ms overlapping gunzip 221 ms, parse 822 ms, sort 0 ms, write 0 ms, index 879 ms: 5 candidates, 102239 repo-hours, 269 releases; waiting 568 ms; commit 0 ms)
2026-11-08T15:04:14Z [load_day 2026-01-17] 2026-01-17 hour 13: 159631 events in 0 files, snapshot none (task 3855 ms: download 2448 ms overlapping gunzip 369 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 758 ms: 10 candidates, 90665 repo-hours, 634 releases; waiting 1244 ms; commit 0 ms)
2026-11-08T15:04:17Z [load_day 2026-01-17] 2026-01-17 hour 14: 153729 events in 0 files, snapshot none (task 4306 ms: download 2359 ms overlapping gunzip 387 ms, parse 1195 ms, sort 0 ms, write 0 ms, index 1002 ms: 7 candidates, 77917 repo-hours, 718 releases; waiting 1404 ms; commit 0 ms)
2026-11-08T15:04:18Z [load_day 2026-01-17] 2026-01-17 hour 15: 151661 events in 0 files, snapshot none (task 3719 ms: download 2251 ms overlapping gunzip 515 ms, parse 1601 ms, sort 0 ms, write 0 ms, index 665 ms: 11 candidates, 76189 repo-hours, 727 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:04:22Z [load_day 2026-01-17] 2026-01-17 hour 16: 153575 events in 0 files, snapshot none (task 4340 ms: download 2836 ms overlapping gunzip 554 ms, parse 1739 ms, sort 0 ms, write 0 ms, index 625 ms: 7 candidates, 77274 repo-hours, 805 releases; waiting 1070 ms; commit 0 ms)
2026-11-08T15:04:22Z [load_day 2026-01-17] 2026-01-17 hour 17: 150981 events in 0 files, snapshot none (task 3871 ms: download 2236 ms overlapping gunzip 575 ms, parse 1798 ms, sort 0 ms, write 0 ms, index 598 ms: 5 candidates, 73996 repo-hours, 726 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:04:26Z [load_day 2026-01-17] 2026-01-17 hour 18: 152428 events in 0 files, snapshot none (task 3735 ms: download 2555 ms overlapping gunzip 453 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 560 ms: 2 candidates, 76849 repo-hours, 826 releases; waiting 968 ms; commit 0 ms)
2026-11-08T15:04:26Z [load_day 2026-01-17] 2026-01-17 hour 19: 146086 events in 0 files, snapshot none (task 3260 ms: download 2097 ms overlapping gunzip 375 ms, parse 1152 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 66673 repo-hours, 746 releases; waiting 695 ms; commit 0 ms)
2026-11-08T15:04:31Z [load_day 2026-01-17] 2026-01-17 hour 20: 149630 events in 0 files, snapshot none (task 3611 ms: download 2352 ms overlapping gunzip 488 ms, parse 1633 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 69499 repo-hours, 738 releases; waiting 593 ms; commit 0 ms)
2026-11-08T15:04:31Z [load_day 2026-01-17] 2026-01-17 hour 21: 147108 events in 0 files, snapshot none (task 3525 ms: download 2186 ms overlapping gunzip 539 ms, parse 1579 ms, sort 0 ms, write 0 ms, index 555 ms: 2 candidates, 67076 repo-hours, 827 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:04:34Z [load_day 2026-01-17] 2026-01-17 hour 22: 143942 events in 0 files, snapshot none (task 3512 ms: download 2021 ms overlapping gunzip 596 ms, parse 1558 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 60394 repo-hours, 925 releases; waiting 462 ms; commit 0 ms)
2026-11-08T15:04:35Z [load_day 2026-01-17] 2026-01-17 hour 23: 141143 events in 0 files, snapshot none (task 3428 ms: download 1935 ms overlapping gunzip 475 ms, parse 1529 ms, sort 0 ms, write 0 ms, index 584 ms: 9 candidates, 62713 repo-hours, 736 releases; waiting 524 ms; commit 0 ms)
2026-11-08T15:04:42Z [load_day 2026-01-17] 2026-01-17: repo_hour merged from 24 files to 1 (1773004 rows, 7853 ms)
2026-11-08T15:04:45Z [load_day 2026-01-17] 2026-01-17: index committed in 10963 ms (24 + 1 + 24 files)
2026-11-08T15:04:45Z [load_day 2026-01-17] 2026-01-17: 3579582 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:04:45Z [load_day 2026-01-17] attempt 1 succeeded