orcaLog in

Runs · run 4814

load_day 2026-01-11, attempt 1 succeeded

Host
73ccef5e07c2:428573
Started
2026-11-08T15:00:24Z
Ended
2026-11-08T15:01:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.8 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4814/load_day/2026-01-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:00:24Z [load_day 2026-01-11] attempt 1 started
2026-11-08T15:00:25Z [load_day 2026-01-11] 2026-01-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:00:29Z [load_day 2026-01-11] 2026-01-11 hour 0: 139196 events in 0 files, snapshot none (task 3594 ms: download 2421 ms overlapping gunzip 395 ms, parse 1343 ms, sort 0 ms, write 0 ms, index 465 ms: 7 candidates, 61833 repo-hours, 888 releases; waiting 1099 ms; commit 0 ms)
2026-11-08T15:00:30Z [load_day 2026-01-11] 2026-01-11 hour 1: 149112 events in 0 files, snapshot none (task 3730 ms: download 2198 ms overlapping gunzip 446 ms, parse 1560 ms, sort 0 ms, write 0 ms, index 732 ms: 4 candidates, 87123 repo-hours, 677 releases; waiting 660 ms; commit 0 ms)
2026-11-08T15:00:33Z [load_day 2026-01-11] 2026-01-11 hour 2: 144329 events in 0 files, snapshot none (task 3364 ms: download 2162 ms overlapping gunzip 375 ms, parse 1105 ms, sort 0 ms, write 0 ms, index 583 ms: 3 candidates, 73284 repo-hours, 724 releases; waiting 800 ms; commit 0 ms)
2026-11-08T15:00:33Z [load_day 2026-01-11] 2026-01-11 hour 3: 143928 events in 0 files, snapshot none (task 2946 ms: download 1941 ms overlapping gunzip 348 ms, parse 1080 ms, sort 0 ms, write 0 ms, index 502 ms: 11 candidates, 64392 repo-hours, 858 releases; waiting 717 ms; commit 0 ms)
2026-11-08T15:00:37Z [load_day 2026-01-11] 2026-01-11 hour 4: 141764 events in 0 files, snapshot none (task 2999 ms: download 1755 ms overlapping gunzip 359 ms, parse 1111 ms, sort 0 ms, write 0 ms, index 578 ms: 6 candidates, 68374 repo-hours, 1471 releases; waiting 652 ms; commit 0 ms)
2026-11-08T15:00:38Z [load_day 2026-01-11] 2026-01-11 hour 5: 142466 events in 0 files, snapshot none (task 3746 ms: download 2646 ms overlapping gunzip 410 ms, parse 1165 ms, sort 0 ms, write 0 ms, index 489 ms: 13 candidates, 61318 repo-hours, 628 releases; waiting 1369 ms; commit 0 ms)
2026-11-08T15:00:41Z [load_day 2026-01-11] 2026-01-11 hour 6: 145166 events in 0 files, snapshot none (task 3442 ms: download 2215 ms overlapping gunzip 371 ms, parse 1055 ms, sort 0 ms, write 0 ms, index 559 ms: 5 candidates, 72385 repo-hours, 618 releases; waiting 991 ms; commit 0 ms)
2026-11-08T15:00:42Z [load_day 2026-01-11] 2026-01-11 hour 7: 145908 events in 0 files, snapshot none (task 4010 ms: download 2614 ms overlapping gunzip 363 ms, parse 1023 ms, sort 0 ms, write 0 ms, index 487 ms: 6 candidates, 65250 repo-hours, 579 releases; waiting 1853 ms; commit 0 ms)
2026-11-08T15:00:45Z [load_day 2026-01-11] 2026-01-11 hour 8: 149402 events in 0 files, snapshot none (task 4002 ms: download 2504 ms overlapping gunzip 494 ms, parse 1328 ms, sort 0 ms, write 0 ms, index 733 ms: 8 candidates, 69233 repo-hours, 674 releases; waiting 1160 ms; commit 0 ms)
2026-11-08T15:00:46Z [load_day 2026-01-11] 2026-01-11 hour 9: 144325 events in 0 files, snapshot none (task 3619 ms: download 2164 ms overlapping gunzip 440 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 541 ms: 8 candidates, 67700 repo-hours, 629 releases; waiting 728 ms; commit 0 ms)
2026-11-08T15:00:50Z [load_day 2026-01-11] 2026-01-11 hour 10: 145014 events in 0 files, snapshot none (task 3782 ms: download 2180 ms overlapping gunzip 439 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 904 ms: 5 candidates, 68633 repo-hours, 650 releases; waiting 824 ms; commit 0 ms)
2026-11-08T15:00:50Z [load_day 2026-01-11] 2026-01-11 hour 11: 149761 events in 0 files, snapshot none (task 3600 ms: download 2198 ms overlapping gunzip 496 ms, parse 1472 ms, sort 0 ms, write 0 ms, index 612 ms: 3 candidates, 69708 repo-hours, 666 releases; waiting 643 ms; commit 0 ms)
2026-11-08T15:00:54Z [load_day 2026-01-11] 2026-01-11 hour 12: 157366 events in 0 files, snapshot none (task 3629 ms: download 2305 ms overlapping gunzip 357 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 832 ms: 5 candidates, 94771 repo-hours, 622 releases; waiting 937 ms; commit 0 ms)
2026-11-08T15:00:54Z [load_day 2026-01-11] 2026-01-11 hour 13: 155271 events in 0 files, snapshot none (task 3719 ms: download 2050 ms overlapping gunzip 466 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 860 ms: 4 candidates, 87327 repo-hours, 646 releases; waiting 649 ms; commit 0 ms)
2026-11-08T15:00:59Z [load_day 2026-01-11] 2026-01-11 hour 14: 150581 events in 0 files, snapshot none (task 4362 ms: download 2802 ms overlapping gunzip 480 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 848 ms: 6 candidates, 74855 repo-hours, 708 releases; waiting 1232 ms; commit 0 ms)
2026-11-08T15:00:59Z [load_day 2026-01-11] 2026-01-11 hour 15: 149702 events in 0 files, snapshot none (task 4128 ms: download 2552 ms overlapping gunzip 520 ms, parse 1396 ms, sort 0 ms, write 0 ms, index 908 ms: 7 candidates, 73963 repo-hours, 776 releases; waiting 958 ms; commit 0 ms)
2026-11-08T15:01:04Z [load_day 2026-01-11] 2026-01-11 hour 16: 151583 events in 0 files, snapshot none (task 4175 ms: download 2435 ms overlapping gunzip 639 ms, parse 1929 ms, sort 0 ms, write 0 ms, index 681 ms: 5 candidates, 78715 repo-hours, 745 releases; waiting 581 ms; commit 0 ms)
2026-11-08T15:01:04Z [load_day 2026-01-11] 2026-01-11 hour 17: 153079 events in 0 files, snapshot none (task 4251 ms: download 2589 ms overlapping gunzip 636 ms, parse 2008 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 72949 repo-hours, 751 releases; waiting 622 ms; commit 0 ms)
2026-11-08T15:01:08Z [load_day 2026-01-11] 2026-01-11 hour 18: 151545 events in 0 files, snapshot none (task 3608 ms: download 2201 ms overlapping gunzip 538 ms, parse 1592 ms, sort 0 ms, write 0 ms, index 621 ms: 4 candidates, 79236 repo-hours, 778 releases; waiting 564 ms; commit 0 ms)
2026-11-08T15:01:08Z [load_day 2026-01-11] 2026-01-11 hour 19: 150028 events in 0 files, snapshot none (task 3821 ms: download 2460 ms overlapping gunzip 516 ms, parse 1597 ms, sort 0 ms, write 0 ms, index 721 ms: 4 candidates, 66427 repo-hours, 708 releases; waiting 653 ms; commit 0 ms)
2026-11-08T15:01:12Z [load_day 2026-01-11] 2026-01-11 hour 20: 147653 events in 0 files, snapshot none (task 3808 ms: download 2348 ms overlapping gunzip 436 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 867 ms: 7 candidates, 67733 repo-hours, 777 releases; waiting 861 ms; commit 0 ms)
2026-11-08T15:01:13Z [load_day 2026-01-11] 2026-01-11 hour 21: 148993 events in 0 files, snapshot none (task 4392 ms: download 2959 ms overlapping gunzip 470 ms, parse 1454 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 65833 repo-hours, 817 releases; waiting 1458 ms; commit 0 ms)
2026-11-08T15:01:17Z [load_day 2026-01-11] 2026-01-11 hour 22: 146664 events in 0 files, snapshot none (task 4533 ms: download 3101 ms overlapping gunzip 500 ms, parse 1585 ms, sort 0 ms, write 0 ms, index 604 ms: 7 candidates, 65995 repo-hours, 811 releases; waiting 1543 ms; commit 0 ms)
2026-11-08T15:01:17Z [load_day 2026-01-11] 2026-01-11 hour 23: 140101 events in 0 files, snapshot none (task 3586 ms: download 2017 ms overlapping gunzip 454 ms, parse 1606 ms, sort 0 ms, write 0 ms, index 570 ms: 5 candidates, 63565 repo-hours, 674 releases; waiting 620 ms; commit 0 ms)
2026-11-08T15:01:25Z [load_day 2026-01-11] 2026-01-11: repo_hour merged from 24 files to 1 (1720602 rows, 7389 ms)
2026-11-08T15:01:28Z [load_day 2026-01-11] 2026-01-11: index committed in 10260 ms (24 + 1 + 24 files)
2026-11-08T15:01:28Z [load_day 2026-01-11] 2026-01-11: 3542937 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:01:28Z [load_day 2026-01-11] attempt 1 succeeded