orcaLog in

Runs · run 4762

load_day 2025-12-28, attempt 1 succeeded

Host
73ccef5e07c2:422450
Started
2026-11-08T14:52:54Z
Ended
2026-11-08T14:53:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
644 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
64.9 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4762/load_day/2025-12-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:52:54Z [load_day 2025-12-28] attempt 1 started
2026-11-08T14:52:55Z [load_day 2025-12-28] 2025-12-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:52:59Z [load_day 2025-12-28] 2025-12-28 hour 0: 134121 events in 0 files, snapshot none (task 3557 ms: download 2329 ms overlapping gunzip 389 ms, parse 1229 ms, sort 0 ms, write 0 ms, index 456 ms: 4 candidates, 59067 repo-hours, 1230 releases; waiting 1180 ms; commit 0 ms)
2026-11-08T14:52:59Z [load_day 2025-12-28] 2025-12-28 hour 1: 144674 events in 0 files, snapshot none (task 3105 ms: download 1654 ms overlapping gunzip 358 ms, parse 1280 ms, sort 0 ms, write 0 ms, index 617 ms: 7 candidates, 81822 repo-hours, 799 releases; waiting 517 ms; commit 0 ms)
2026-11-08T14:53:03Z [load_day 2025-12-28] 2025-12-28 hour 2: 137194 events in 0 files, snapshot none (task 2962 ms: download 2076 ms overlapping gunzip 362 ms, parse 1111 ms, sort 0 ms, write 0 ms, index 519 ms: 1 candidates, 66282 repo-hours, 859 releases; waiting 657 ms; commit 0 ms)
2026-11-08T14:53:03Z [load_day 2025-12-28] 2025-12-28 hour 3: 131804 events in 0 files, snapshot none (task 2985 ms: download 1859 ms overlapping gunzip 365 ms, parse 1151 ms, sort 0 ms, write 0 ms, index 450 ms: 11 candidates, 52590 repo-hours, 947 releases; waiting 640 ms; commit 0 ms)
2026-11-08T14:53:07Z [load_day 2025-12-28] 2025-12-28 hour 4: 139099 events in 0 files, snapshot none (task 3283 ms: download 2204 ms overlapping gunzip 376 ms, parse 1190 ms, sort 0 ms, write 0 ms, index 448 ms: 6 candidates, 62923 repo-hours, 1648 releases; waiting 794 ms; commit 0 ms)
2026-11-08T14:53:07Z [load_day 2025-12-28] 2025-12-28 hour 5: 137030 events in 0 files, snapshot none (task 2717 ms: download 1660 ms overlapping gunzip 321 ms, parse 993 ms, sort 0 ms, write 0 ms, index 454 ms: 3 candidates, 57430 repo-hours, 818 releases; waiting 643 ms; commit 0 ms)
2026-11-08T14:53:10Z [load_day 2025-12-28] 2025-12-28 hour 6: 141692 events in 0 files, snapshot none (task 3406 ms: download 2256 ms overlapping gunzip 317 ms, parse 975 ms, sort 0 ms, write 0 ms, index 524 ms: 8 candidates, 65636 repo-hours, 964 releases; waiting 1235 ms; commit 0 ms)
2026-11-08T14:53:10Z [load_day 2025-12-28] 2025-12-28 hour 7: 141381 events in 0 files, snapshot none (task 2868 ms: download 1940 ms overlapping gunzip 326 ms, parse 1048 ms, sort 0 ms, write 0 ms, index 426 ms: 6 candidates, 57882 repo-hours, 577 releases; waiting 705 ms; commit 0 ms)
2026-11-08T14:53:14Z [load_day 2025-12-28] 2025-12-28 hour 8: 140594 events in 0 files, snapshot none (task 3177 ms: download 2224 ms overlapping gunzip 411 ms, parse 1245 ms, sort 0 ms, write 0 ms, index 516 ms: 3 candidates, 62161 repo-hours, 886 releases; waiting 686 ms; commit 0 ms)
2026-11-08T14:53:14Z [load_day 2025-12-28] 2025-12-28 hour 9: 143551 events in 0 files, snapshot none (task 3491 ms: download 2238 ms overlapping gunzip 473 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 456 ms: 2 candidates, 62602 repo-hours, 786 releases; waiting 729 ms; commit 0 ms)
2026-11-08T14:53:18Z [load_day 2025-12-28] 2025-12-28 hour 10: 146336 events in 0 files, snapshot none (task 3565 ms: download 2316 ms overlapping gunzip 482 ms, parse 1451 ms, sort 0 ms, write 0 ms, index 698 ms: 7 candidates, 65852 repo-hours, 758 releases; waiting 579 ms; commit 0 ms)
2026-11-08T14:53:18Z [load_day 2025-12-28] 2025-12-28 hour 11: 147142 events in 0 files, snapshot none (task 3389 ms: download 1973 ms overlapping gunzip 435 ms, parse 1423 ms, sort 0 ms, write 0 ms, index 629 ms: 3 candidates, 62847 repo-hours, 658 releases; waiting 606 ms; commit 0 ms)
2026-11-08T14:53:23Z [load_day 2025-12-28] 2025-12-28 hour 12: 153698 events in 0 files, snapshot none (task 3985 ms: download 1898 ms overlapping gunzip 543 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 676 ms: 5 candidates, 88490 repo-hours, 590 releases; waiting 843 ms; commit 0 ms)
2026-11-08T14:53:23Z [load_day 2025-12-28] 2025-12-28 hour 13: 149084 events in 0 files, snapshot none (task 3752 ms: download 1929 ms overlapping gunzip 494 ms, parse 1540 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 78106 repo-hours, 530 releases; waiting 745 ms; commit 0 ms)
2026-11-08T14:53:27Z [load_day 2025-12-28] 2025-12-28 hour 14: 150265 events in 0 files, snapshot none (task 3356 ms: download 2181 ms overlapping gunzip 474 ms, parse 1444 ms, sort 0 ms, write 0 ms, index 535 ms: 6 candidates, 70014 repo-hours, 670 releases; waiting 580 ms; commit 0 ms)
2026-11-08T14:53:27Z [load_day 2025-12-28] 2025-12-28 hour 15: 150215 events in 0 files, snapshot none (task 3045 ms: download 1531 ms overlapping gunzip 467 ms, parse 1398 ms, sort 0 ms, write 0 ms, index 675 ms: 2 candidates, 71120 repo-hours, 757 releases; waiting 204 ms; commit 0 ms)
2026-11-08T14:53:31Z [load_day 2025-12-28] 2025-12-28 hour 16: 147407 events in 0 files, snapshot none (task 3589 ms: download 2151 ms overlapping gunzip 471 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 635 ms: 4 candidates, 69954 repo-hours, 740 releases; waiting 673 ms; commit 0 ms)
2026-11-08T14:53:31Z [load_day 2025-12-28] 2025-12-28 hour 17: 146852 events in 0 files, snapshot none (task 3517 ms: download 2403 ms overlapping gunzip 444 ms, parse 1533 ms, sort 0 ms, write 0 ms, index 575 ms: 5 candidates, 66397 repo-hours, 699 releases; waiting 681 ms; commit 0 ms)
2026-11-08T14:53:35Z [load_day 2025-12-28] 2025-12-28 hour 18: 147056 events in 0 files, snapshot none (task 3451 ms: download 1661 ms overlapping gunzip 513 ms, parse 1638 ms, sort 0 ms, write 0 ms, index 628 ms: 4 candidates, 71686 repo-hours, 750 releases; waiting 387 ms; commit 0 ms)
2026-11-08T14:53:35Z [load_day 2025-12-28] 2025-12-28 hour 19: 144421 events in 0 files, snapshot none (task 3468 ms: download 2149 ms overlapping gunzip 509 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 575 ms: 4 candidates, 61521 repo-hours, 683 releases; waiting 548 ms; commit 0 ms)
2026-11-08T14:53:39Z [load_day 2025-12-28] 2025-12-28 hour 20: 142424 events in 0 files, snapshot none (task 3477 ms: download 1901 ms overlapping gunzip 463 ms, parse 1481 ms, sort 0 ms, write 0 ms, index 672 ms: 7 candidates, 61221 repo-hours, 727 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:53:39Z [load_day 2025-12-28] 2025-12-28 hour 21: 138832 events in 0 files, snapshot none (task 3368 ms: download 1847 ms overlapping gunzip 453 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 479 ms: 2 candidates, 59213 repo-hours, 713 releases; waiting 730 ms; commit 0 ms)
2026-11-08T14:53:43Z [load_day 2025-12-28] 2025-12-28 hour 22: 138139 events in 0 files, snapshot none (task 3537 ms: download 2213 ms overlapping gunzip 448 ms, parse 1378 ms, sort 0 ms, write 0 ms, index 667 ms: 3 candidates, 58160 repo-hours, 740 releases; waiting 783 ms; commit 0 ms)
2026-11-08T14:53:43Z [load_day 2025-12-28] 2025-12-28 hour 23: 139455 events in 0 files, snapshot none (task 3674 ms: download 2100 ms overlapping gunzip 404 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 674 ms: 3 candidates, 57347 repo-hours, 665 releases; waiting 876 ms; commit 0 ms)
2026-11-08T14:53:50Z [load_day 2025-12-28] 2025-12-28: repo_hour merged from 24 files to 1 (1570323 rows, 7570 ms)
2026-11-08T14:53:54Z [load_day 2025-12-28] 2025-12-28: index committed in 10946 ms (24 + 1 + 24 files)
2026-11-08T14:53:54Z [load_day 2025-12-28] 2025-12-28: 3432466 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:53:54Z [load_day 2025-12-28] attempt 1 succeeded