orcaLog in

Runs · run 4848

load_day 2026-01-21, attempt 1 succeeded

Host
73ccef5e07c2:432851
Started
2026-11-08T15:05:50Z
Ended
2026-11-08T15:06:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
749 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.2 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4848/load_day/2026-01-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:05:50Z [load_day 2026-01-21] attempt 1 started
2026-11-08T15:05:51Z [load_day 2026-01-21] 2026-01-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:05:56Z [load_day 2026-01-21] 2026-01-21 hour 0: 141844 events in 0 files, snapshot none (task 4030 ms: download 2508 ms overlapping gunzip 489 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 568 ms: 5 candidates, 73129 repo-hours, 798 releases; waiting 1260 ms; commit 0 ms)
2026-11-08T15:05:56Z [load_day 2026-01-21] 2026-01-21 hour 1: 147976 events in 0 files, snapshot none (task 3196 ms: download 2006 ms overlapping gunzip 420 ms, parse 1298 ms, sort 0 ms, write 0 ms, index 617 ms: 10 candidates, 85170 repo-hours, 701 releases; waiting 578 ms; commit 0 ms)
2026-11-08T15:06:00Z [load_day 2026-01-21] 2026-01-21 hour 2: 146743 events in 0 files, snapshot none (task 3320 ms: download 2031 ms overlapping gunzip 452 ms, parse 1385 ms, sort 0 ms, write 0 ms, index 656 ms: 8 candidates, 80953 repo-hours, 649 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:06:00Z [load_day 2026-01-21] 2026-01-21 hour 3: 145993 events in 0 files, snapshot none (task 3507 ms: download 2342 ms overlapping gunzip 493 ms, parse 1470 ms, sort 0 ms, write 0 ms, index 579 ms: 9 candidates, 71287 repo-hours, 868 releases; waiting 665 ms; commit 0 ms)
2026-11-08T15:06:04Z [load_day 2026-01-21] 2026-01-21 hour 4: 145956 events in 0 files, snapshot none (task 3909 ms: download 2151 ms overlapping gunzip 563 ms, parse 1804 ms, sort 0 ms, write 0 ms, index 668 ms: 10 candidates, 73867 repo-hours, 1556 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:06:04Z [load_day 2026-01-21] 2026-01-21 hour 5: 139910 events in 0 files, snapshot none (task 4309 ms: download 2684 ms overlapping gunzip 474 ms, parse 1560 ms, sort 0 ms, write 0 ms, index 547 ms: 7 candidates, 67305 repo-hours, 690 releases; waiting 1363 ms; commit 0 ms)
2026-11-08T15:06:09Z [load_day 2026-01-21] 2026-01-21 hour 6: 147571 events in 0 files, snapshot none (task 4346 ms: download 3008 ms overlapping gunzip 451 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 722 ms: 2 candidates, 79788 repo-hours, 672 releases; waiting 1579 ms; commit 0 ms)
2026-11-08T15:06:10Z [load_day 2026-01-21] 2026-01-21 hour 7: 145391 events in 0 files, snapshot none (task 4662 ms: download 2884 ms overlapping gunzip 452 ms, parse 1316 ms, sort 0 ms, write 0 ms, index 606 ms: 7 candidates, 74947 repo-hours, 637 releases; waiting 1900 ms; commit 0 ms)
2026-11-08T15:06:13Z [load_day 2026-01-21] 2026-01-21 hour 8: 141018 events in 0 files, snapshot none (task 4063 ms: download 2432 ms overlapping gunzip 428 ms, parse 1339 ms, sort 0 ms, write 0 ms, index 925 ms: 2 candidates, 75915 repo-hours, 697 releases; waiting 827 ms; commit 0 ms)
2026-11-08T15:06:14Z [load_day 2026-01-21] 2026-01-21 hour 9: 141914 events in 0 files, snapshot none (task 3278 ms: download 1975 ms overlapping gunzip 450 ms, parse 1270 ms, sort 0 ms, write 0 ms, index 639 ms: 4 candidates, 77058 repo-hours, 771 releases; waiting 590 ms; commit 0 ms)
2026-11-08T15:06:18Z [load_day 2026-01-21] 2026-01-21 hour 10: 135294 events in 0 files, snapshot none (task 3748 ms: download 2714 ms overlapping gunzip 410 ms, parse 1174 ms, sort 0 ms, write 0 ms, index 583 ms: 2 candidates, 76169 repo-hours, 566 releases; waiting 1274 ms; commit 0 ms)
2026-11-08T15:06:18Z [load_day 2026-01-21] 2026-01-21 hour 11: 137609 events in 0 files, snapshot none (task 3356 ms: download 2116 ms overlapping gunzip 391 ms, parse 1184 ms, sort 0 ms, write 0 ms, index 599 ms: 5 candidates, 74309 repo-hours, 563 releases; waiting 846 ms; commit 0 ms)
2026-11-08T15:06:23Z [load_day 2026-01-21] 2026-01-21 hour 12: 151569 events in 0 files, snapshot none (task 4549 ms: download 2315 ms overlapping gunzip 460 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 773 ms: 6 candidates, 92509 repo-hours, 398 releases; waiting 1503 ms; commit 0 ms)
2026-11-08T15:06:23Z [load_day 2026-01-21] 2026-01-21 hour 13: 151162 events in 0 files, snapshot none (task 4697 ms: download 2756 ms overlapping gunzip 443 ms, parse 1483 ms, sort 0 ms, write 0 ms, index 764 ms: 6 candidates, 90111 repo-hours, 411 releases; waiting 1657 ms; commit 0 ms)
2026-11-08T15:06:28Z [load_day 2026-01-21] 2026-01-21 hour 14: 138638 events in 0 files, snapshot none (task 4981 ms: download 3988 ms overlapping gunzip 474 ms, parse 1502 ms, sort 0 ms, write 0 ms, index 579 ms: 8 candidates, 79677 repo-hours, 594 releases; waiting 2101 ms; commit 0 ms)
2026-11-08T15:06:28Z [load_day 2026-01-21] 2026-01-21 hour 15: 139414 events in 0 files, snapshot none (task 3612 ms: download 2310 ms overlapping gunzip 470 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 733 ms: 6 candidates, 80003 repo-hours, 653 releases; waiting 635 ms; commit 0 ms)
2026-11-08T15:06:33Z [load_day 2026-01-21] 2026-01-21 hour 16: 136555 events in 0 files, snapshot none (task 3818 ms: download 2629 ms overlapping gunzip 547 ms, parse 1523 ms, sort 0 ms, write 0 ms, index 562 ms: 5 candidates, 77584 repo-hours, 612 releases; waiting 857 ms; commit 0 ms)
2026-11-08T15:06:33Z [load_day 2026-01-21] 2026-01-21 hour 17: 135558 events in 0 files, snapshot none (task 3476 ms: download 2026 ms overlapping gunzip 499 ms, parse 1437 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 74053 repo-hours, 472 releases; waiting 560 ms; commit 0 ms)
2026-11-08T15:06:36Z [load_day 2026-01-21] 2026-01-21 hour 18: 137192 events in 0 files, snapshot none (task 3225 ms: download 1789 ms overlapping gunzip 372 ms, parse 1067 ms, sort 0 ms, write 0 ms, index 694 ms: 8 candidates, 79078 repo-hours, 321 releases; waiting 653 ms; commit 0 ms)
2026-11-08T15:06:37Z [load_day 2026-01-21] 2026-01-21 hour 19: 145362 events in 0 files, snapshot none (task 3397 ms: download 1950 ms overlapping gunzip 523 ms, parse 1387 ms, sort 0 ms, write 0 ms, index 550 ms: 12 candidates, 74758 repo-hours, 624 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:06:41Z [load_day 2026-01-21] 2026-01-21 hour 20: 142822 events in 0 files, snapshot none (task 3778 ms: download 2498 ms overlapping gunzip 517 ms, parse 1656 ms, sort 0 ms, write 0 ms, index 663 ms: 9 candidates, 73669 repo-hours, 670 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:06:41Z [load_day 2026-01-21] 2026-01-21 hour 21: 143026 events in 0 files, snapshot none (task 3738 ms: download 2483 ms overlapping gunzip 559 ms, parse 1684 ms, sort 0 ms, write 0 ms, index 579 ms: 8 candidates, 71556 repo-hours, 714 releases; waiting 603 ms; commit 0 ms)
2026-11-08T15:06:46Z [load_day 2026-01-21] 2026-01-21 hour 22: 144084 events in 0 files, snapshot none (task 4994 ms: download 3923 ms overlapping gunzip 680 ms, parse 1999 ms, sort 0 ms, write 0 ms, index 591 ms: 7 candidates, 70357 repo-hours, 888 releases; waiting 1340 ms; commit 0 ms)
2026-11-08T15:06:46Z [load_day 2026-01-21] 2026-01-21 hour 23: 148655 events in 0 files, snapshot none (task 4690 ms: download 2464 ms overlapping gunzip 664 ms, parse 2421 ms, sort 0 ms, write 0 ms, index 756 ms: 9 candidates, 72363 repo-hours, 561 releases; waiting 566 ms; commit 0 ms)
2026-11-08T15:06:56Z [load_day 2026-01-21] 2026-01-21: repo_hour merged from 24 files to 1 (1845615 rows, 9767 ms)
2026-11-08T15:06:59Z [load_day 2026-01-21] 2026-01-21: index committed in 12370 ms (24 + 1 + 24 files)
2026-11-08T15:06:59Z [load_day 2026-01-21] 2026-01-21: 3431256 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:06:59Z [load_day 2026-01-21] attempt 1 succeeded