orcaLog in

Runs · run 4809

load_day 2026-01-10, attempt 1 succeeded

Host
73ccef5e07c2:427772
Started
2026-11-08T14:59:34Z
Ended
2026-11-08T15:00:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
681 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.1 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4809/load_day/2026-01-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:59:34Z [load_day 2026-01-10] attempt 1 started
2026-11-08T14:59:35Z [load_day 2026-01-10] 2026-01-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:59:39Z [load_day 2026-01-10] 2026-01-10 hour 0: 145793 events in 0 files, snapshot none (task 3782 ms: download 2205 ms overlapping gunzip 475 ms, parse 1545 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 73072 repo-hours, 825 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:59:39Z [load_day 2026-01-10] 2026-01-10 hour 1: 148476 events in 0 files, snapshot none (task 3716 ms: download 2248 ms overlapping gunzip 511 ms, parse 1544 ms, sort 0 ms, write 0 ms, index 766 ms: 7 candidates, 89199 repo-hours, 738 releases; waiting 598 ms; commit 0 ms)
2026-11-08T14:59:43Z [load_day 2026-01-10] 2026-01-10 hour 2: 144575 events in 0 files, snapshot none (task 3722 ms: download 2430 ms overlapping gunzip 489 ms, parse 1603 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 73065 repo-hours, 738 releases; waiting 715 ms; commit 0 ms)
2026-11-08T14:59:43Z [load_day 2026-01-10] 2026-01-10 hour 3: 140314 events in 0 files, snapshot none (task 3245 ms: download 1737 ms overlapping gunzip 481 ms, parse 1500 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 65100 repo-hours, 853 releases; waiting 558 ms; commit 0 ms)
2026-11-08T14:59:48Z [load_day 2026-01-10] 2026-01-10 hour 4: 141406 events in 0 files, snapshot none (task 3866 ms: download 2472 ms overlapping gunzip 434 ms, parse 1378 ms, sort 0 ms, write 0 ms, index 584 ms: 5 candidates, 66896 repo-hours, 1454 releases; waiting 1189 ms; commit 0 ms)
2026-11-08T14:59:48Z [load_day 2026-01-10] 2026-01-10 hour 5: 141822 events in 0 files, snapshot none (task 3664 ms: download 2246 ms overlapping gunzip 502 ms, parse 1622 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 64154 repo-hours, 750 releases; waiting 654 ms; commit 0 ms)
2026-11-08T14:59:52Z [load_day 2026-01-10] 2026-01-10 hour 6: 145499 events in 0 files, snapshot none (task 3760 ms: download 2594 ms overlapping gunzip 470 ms, parse 1513 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 73053 repo-hours, 705 releases; waiting 856 ms; commit 0 ms)
2026-11-08T14:59:52Z [load_day 2026-01-10] 2026-01-10 hour 7: 149785 events in 0 files, snapshot none (task 3774 ms: download 2093 ms overlapping gunzip 646 ms, parse 1710 ms, sort 0 ms, write 0 ms, index 552 ms: 11 candidates, 66711 repo-hours, 640 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:59:56Z [load_day 2026-01-10] 2026-01-10 hour 8: 146000 events in 0 files, snapshot none (task 3821 ms: download 2575 ms overlapping gunzip 524 ms, parse 1718 ms, sort 0 ms, write 0 ms, index 660 ms: 7 candidates, 66940 repo-hours, 690 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:59:56Z [load_day 2026-01-10] 2026-01-10 hour 9: 146715 events in 0 files, snapshot none (task 3601 ms: download 1741 ms overlapping gunzip 511 ms, parse 1648 ms, sort 0 ms, write 0 ms, index 698 ms: 4 candidates, 69675 repo-hours, 749 releases; waiting 405 ms; commit 0 ms)
2026-11-08T15:00:02Z [load_day 2026-01-10] 2026-01-10 hour 10: 145873 events in 0 files, snapshot none (task 4769 ms: download 2470 ms overlapping gunzip 743 ms, parse 2341 ms, sort 0 ms, write 0 ms, index 830 ms: 7 candidates, 70558 repo-hours, 682 releases; waiting 541 ms; commit 0 ms)
2026-11-08T15:00:02Z [load_day 2026-01-10] 2026-01-10 hour 11: 147103 events in 0 files, snapshot none (task 4474 ms: download 2364 ms overlapping gunzip 748 ms, parse 2031 ms, sort 0 ms, write 0 ms, index 957 ms: 6 candidates, 70339 repo-hours, 646 releases; waiting 415 ms; commit 0 ms)
2026-11-08T15:00:07Z [load_day 2026-01-10] 2026-01-10 hour 12: 155844 events in 0 files, snapshot none (task 5123 ms: download 2929 ms overlapping gunzip 597 ms, parse 1871 ms, sort 0 ms, write 0 ms, index 794 ms: 7 candidates, 93903 repo-hours, 535 releases; waiting 1444 ms; commit 0 ms)
2026-11-08T15:00:07Z [load_day 2026-01-10] 2026-01-10 hour 13: 153372 events in 0 files, snapshot none (task 4232 ms: download 2416 ms overlapping gunzip 465 ms, parse 1469 ms, sort 0 ms, write 0 ms, index 1167 ms: 5 candidates, 84708 repo-hours, 551 releases; waiting 828 ms; commit 0 ms)
2026-11-08T15:00:12Z [load_day 2026-01-10] 2026-01-10 hour 14: 146761 events in 0 files, snapshot none (task 4202 ms: download 2823 ms overlapping gunzip 724 ms, parse 1915 ms, sort 0 ms, write 0 ms, index 609 ms: 8 candidates, 70862 repo-hours, 682 releases; waiting 554 ms; commit 0 ms)
2026-11-08T15:00:12Z [load_day 2026-01-10] 2026-01-10 hour 15: 152189 events in 0 files, snapshot none (task 4371 ms: download 2545 ms overlapping gunzip 723 ms, parse 2143 ms, sort 0 ms, write 0 ms, index 604 ms: 4 candidates, 74682 repo-hours, 782 releases; waiting 571 ms; commit 0 ms)
2026-11-08T15:00:16Z [load_day 2026-01-10] 2026-01-10 hour 16: 148650 events in 0 files, snapshot none (task 3528 ms: download 2301 ms overlapping gunzip 373 ms, parse 1147 ms, sort 0 ms, write 0 ms, index 699 ms: 8 candidates, 76125 repo-hours, 725 releases; waiting 1043 ms; commit 0 ms)
2026-11-08T15:00:17Z [load_day 2026-01-10] 2026-01-10 hour 17: 149907 events in 0 files, snapshot none (task 3856 ms: download 2238 ms overlapping gunzip 400 ms, parse 1221 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 72458 repo-hours, 687 releases; waiting 983 ms; commit 0 ms)
2026-11-08T15:00:21Z [load_day 2026-01-10] 2026-01-10 hour 18: 151801 events in 0 files, snapshot none (task 3980 ms: download 2422 ms overlapping gunzip 375 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 606 ms: 4 candidates, 77781 repo-hours, 723 releases; waiting 1056 ms; commit 0 ms)
2026-11-08T15:00:21Z [load_day 2026-01-10] 2026-01-10 hour 19: 144978 events in 0 files, snapshot none (task 3116 ms: download 2113 ms overlapping gunzip 378 ms, parse 1078 ms, sort 0 ms, write 0 ms, index 522 ms: 5 candidates, 62569 repo-hours, 681 releases; waiting 863 ms; commit 0 ms)
2026-11-08T15:00:24Z [load_day 2026-01-10] 2026-01-10 hour 20: 146607 events in 0 files, snapshot none (task 2750 ms: download 1679 ms overlapping gunzip 348 ms, parse 1062 ms, sort 0 ms, write 0 ms, index 518 ms: 6 candidates, 67742 repo-hours, 673 releases; waiting 453 ms; commit 0 ms)
2026-11-08T15:00:25Z [load_day 2026-01-10] 2026-01-10 hour 21: 147751 events in 0 files, snapshot none (task 4017 ms: download 2692 ms overlapping gunzip 380 ms, parse 1250 ms, sort 0 ms, write 0 ms, index 572 ms: 2 candidates, 66931 repo-hours, 772 releases; waiting 1214 ms; commit 0 ms)
2026-11-08T15:00:29Z [load_day 2026-01-10] 2026-01-10 hour 22: 143629 events in 0 files, snapshot none (task 4884 ms: download 3094 ms overlapping gunzip 481 ms, parse 1603 ms, sort 0 ms, write 0 ms, index 518 ms: 6 candidates, 63372 repo-hours, 849 releases; waiting 1979 ms; commit 0 ms)
2026-11-08T15:00:30Z [load_day 2026-01-10] 2026-01-10 hour 23: 140049 events in 0 files, snapshot none (task 3741 ms: download 1987 ms overlapping gunzip 498 ms, parse 1594 ms, sort 0 ms, write 0 ms, index 535 ms: 9 candidates, 61392 repo-hours, 730 releases; waiting 631 ms; commit 0 ms)
2026-11-08T15:00:37Z [load_day 2026-01-10] 2026-01-10: repo_hour merged from 24 files to 1 (1721287 rows, 7401 ms)
2026-11-08T15:00:40Z [load_day 2026-01-10] 2026-01-10: index committed in 10862 ms (24 + 1 + 24 files)
2026-11-08T15:00:40Z [load_day 2026-01-10] 2026-01-10: 3524899 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:00:40Z [load_day 2026-01-10] attempt 1 succeeded