orcaLog in

Runs · run 1863

load_day 2023-12-16, attempt 1 succeeded

Host
73ccef5e07c2:10001
Started
2026-11-08T03:46:44Z
Ended
2026-11-08T03:48:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
575 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
99.6 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1863/load_day/2023-12-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:46:44Z [load_day 2023-12-16] attempt 1 started
2026-11-08T03:46:46Z [load_day 2023-12-16] 2023-12-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:46:52Z [load_day 2023-12-16] 2023-12-16 hour 0: 150530 events in 0 files, snapshot none (task 5693 ms: download 3359 ms overlapping gunzip 903 ms, parse 3420 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 79418 repo-hours, 1131 releases; waiting 534 ms; commit 0 ms)
2026-11-08T03:46:52Z [load_day 2023-12-16] 2023-12-16 hour 1: 171735 events in 0 files, snapshot none (task 5468 ms: download 2917 ms overlapping gunzip 860 ms, parse 3443 ms, sort 0 ms, write 0 ms, index 608 ms: 3 candidates, 80243 repo-hours, 794 releases; waiting 272 ms; commit 0 ms)
2026-11-08T03:46:57Z [load_day 2023-12-16] 2023-12-16 hour 2: 133332 events in 0 files, snapshot none (task 4495 ms: download 3103 ms overlapping gunzip 672 ms, parse 2669 ms, sort 0 ms, write 0 ms, index 383 ms: 7 candidates, 44837 repo-hours, 655 releases; waiting 482 ms; commit 0 ms)
2026-11-08T03:46:57Z [load_day 2023-12-16] 2023-12-16 hour 3: 120046 events in 0 files, snapshot none (task 4371 ms: download 2373 ms overlapping gunzip 595 ms, parse 2493 ms, sort 0 ms, write 0 ms, index 478 ms: 5 candidates, 44300 repo-hours, 697 releases; waiting 492 ms; commit 0 ms)
2026-11-08T03:47:02Z [load_day 2023-12-16] 2023-12-16 hour 4: 122108 events in 0 files, snapshot none (task 4049 ms: download 2205 ms overlapping gunzip 596 ms, parse 2352 ms, sort 0 ms, write 0 ms, index 312 ms: 5 candidates, 43787 repo-hours, 645 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:47:02Z [load_day 2023-12-16] 2023-12-16 hour 5: 119341 events in 0 files, snapshot none (task 4238 ms: download 2317 ms overlapping gunzip 598 ms, parse 2454 ms, sort 0 ms, write 0 ms, index 413 ms: 4 candidates, 45303 repo-hours, 532 releases; waiting 524 ms; commit 0 ms)
2026-11-08T03:47:07Z [load_day 2023-12-16] 2023-12-16 hour 6: 131747 events in 0 files, snapshot none (task 4269 ms: download 2119 ms overlapping gunzip 537 ms, parse 2213 ms, sort 0 ms, write 0 ms, index 731 ms: 1 candidates, 53245 repo-hours, 933 releases; waiting 210 ms; commit 0 ms)
2026-11-08T03:47:07Z [load_day 2023-12-16] 2023-12-16 hour 7: 130427 events in 0 files, snapshot none (task 4595 ms: download 1858 ms overlapping gunzip 450 ms, parse 1956 ms, sort 0 ms, write 0 ms, index 1771 ms: 2 candidates, 48379 repo-hours, 843 releases; waiting 174 ms; commit 0 ms)
2026-11-08T03:47:11Z [load_day 2023-12-16] 2023-12-16 hour 8: 134325 events in 0 files, snapshot none (task 4097 ms: download 1763 ms overlapping gunzip 600 ms, parse 2505 ms, sort 0 ms, write 0 ms, index 460 ms: 6 candidates, 51006 repo-hours, 836 releases; waiting 191 ms; commit 0 ms)
2026-11-08T03:47:11Z [load_day 2023-12-16] 2023-12-16 hour 9: 136185 events in 0 files, snapshot none (task 4139 ms: download 2123 ms overlapping gunzip 506 ms, parse 2324 ms, sort 0 ms, write 0 ms, index 558 ms: 4 candidates, 51129 repo-hours, 929 releases; waiting 484 ms; commit 0 ms)
2026-11-08T03:47:17Z [load_day 2023-12-16] 2023-12-16 hour 10: 139826 events in 0 files, snapshot none (task 5223 ms: download 2604 ms overlapping gunzip 779 ms, parse 3192 ms, sort 0 ms, write 0 ms, index 459 ms: 6 candidates, 54142 repo-hours, 657 releases; waiting 474 ms; commit 0 ms)
2026-11-08T03:47:17Z [load_day 2023-12-16] 2023-12-16 hour 11: 140516 events in 0 files, snapshot none (task 4857 ms: download 2203 ms overlapping gunzip 692 ms, parse 2988 ms, sort 0 ms, write 0 ms, index 447 ms: 7 candidates, 52911 repo-hours, 763 releases; waiting 476 ms; commit 0 ms)
2026-11-08T03:47:24Z [load_day 2023-12-16] 2023-12-16 hour 12: 216101 events in 0 files, snapshot none (task 6266 ms: download 2817 ms overlapping gunzip 782 ms, parse 3810 ms, sort 0 ms, write 0 ms, index 807 ms: 12 candidates, 85660 repo-hours, 1621 releases; waiting 520 ms; commit 0 ms)
2026-11-08T03:47:24Z [load_day 2023-12-16] 2023-12-16 hour 13: 175012 events in 0 files, snapshot none (task 6180 ms: download 2912 ms overlapping gunzip 806 ms, parse 3780 ms, sort 0 ms, write 0 ms, index 838 ms: 6 candidates, 78515 repo-hours, 1364 releases; waiting 489 ms; commit 0 ms)
2026-11-08T03:47:29Z [load_day 2023-12-16] 2023-12-16 hour 14: 158839 events in 0 files, snapshot none (task 5089 ms: download 2232 ms overlapping gunzip 720 ms, parse 3042 ms, sort 0 ms, write 0 ms, index 563 ms: 3 candidates, 62143 repo-hours, 813 releases; waiting 475 ms; commit 0 ms)
2026-11-08T03:47:30Z [load_day 2023-12-16] 2023-12-16 hour 15: 162677 events in 0 files, snapshot none (task 5197 ms: download 2439 ms overlapping gunzip 683 ms, parse 3199 ms, sort 0 ms, write 0 ms, index 565 ms: 6 candidates, 64582 repo-hours, 892 releases; waiting 503 ms; commit 0 ms)
2026-11-08T03:47:35Z [load_day 2023-12-16] 2023-12-16 hour 16: 160796 events in 0 files, snapshot none (task 4773 ms: download 2640 ms overlapping gunzip 638 ms, parse 2821 ms, sort 0 ms, write 0 ms, index 524 ms: 9 candidates, 63138 repo-hours, 785 releases; waiting 482 ms; commit 0 ms)
2026-11-08T03:47:35Z [load_day 2023-12-16] 2023-12-16 hour 17: 143587 events in 0 files, snapshot none (task 4944 ms: download 2498 ms overlapping gunzip 722 ms, parse 3039 ms, sort 0 ms, write 0 ms, index 453 ms: 8 candidates, 58061 repo-hours, 672 releases; waiting 466 ms; commit 0 ms)
2026-11-08T03:47:41Z [load_day 2023-12-16] 2023-12-16 hour 18: 148676 events in 0 files, snapshot none (task 5545 ms: download 3010 ms overlapping gunzip 784 ms, parse 3431 ms, sort 0 ms, write 0 ms, index 549 ms: 8 candidates, 64655 repo-hours, 837 releases; waiting 503 ms; commit 0 ms)
2026-11-08T03:47:41Z [load_day 2023-12-16] 2023-12-16 hour 19: 138737 events in 0 files, snapshot none (task 4743 ms: download 3053 ms overlapping gunzip 654 ms, parse 2970 ms, sort 0 ms, write 0 ms, index 365 ms: 11 candidates, 51269 repo-hours, 797 releases; waiting 475 ms; commit 0 ms)
2026-11-08T03:47:47Z [load_day 2023-12-16] 2023-12-16 hour 20: 148044 events in 0 files, snapshot none (task 5409 ms: download 2670 ms overlapping gunzip 747 ms, parse 3422 ms, sort 0 ms, write 0 ms, index 409 ms: 5 candidates, 50625 repo-hours, 647 releases; waiting 544 ms; commit 0 ms)
2026-11-08T03:47:47Z [load_day 2023-12-16] 2023-12-16 hour 21: 137756 events in 0 files, snapshot none (task 4960 ms: download 2242 ms overlapping gunzip 702 ms, parse 3060 ms, sort 0 ms, write 0 ms, index 431 ms: 2 candidates, 46020 repo-hours, 728 releases; waiting 505 ms; commit 0 ms)
2026-11-08T03:47:51Z [load_day 2023-12-16] 2023-12-16 hour 22: 131269 events in 0 files, snapshot none (task 3716 ms: download 1716 ms overlapping gunzip 527 ms, parse 2095 ms, sort 0 ms, write 0 ms, index 363 ms: 8 candidates, 41312 repo-hours, 643 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:47:51Z [load_day 2023-12-16] 2023-12-16 hour 23: 136040 events in 0 files, snapshot none (task 4100 ms: download 2293 ms overlapping gunzip 537 ms, parse 2384 ms, sort 0 ms, write 0 ms, index 336 ms: 6 candidates, 40020 repo-hours, 544 releases; waiting 532 ms; commit 0 ms)
2026-11-08T03:47:58Z [load_day 2023-12-16] 2023-12-16: repo_hour merged from 24 files to 1 (1354700 rows, 6691 ms)
2026-11-08T03:48:00Z [load_day 2023-12-16] 2023-12-16: index committed in 8943 ms (24 + 1 + 24 files)
2026-11-08T03:48:00Z [load_day 2023-12-16] 2023-12-16: 3487652 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:48:00Z [load_day 2023-12-16] attempt 1 succeeded