orcaLog in

Runs · run 4787

load_day 2026-01-04, attempt 1 succeeded

Host
73ccef5e07c2:425080
Started
2026-11-08T14:56:15Z
Ended
2026-11-08T14:57:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
671 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
68.9 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4787/load_day/2026-01-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:56:15Z [load_day 2026-01-04] attempt 1 started
2026-11-08T14:56:16Z [load_day 2026-01-04] 2026-01-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:56:20Z [load_day 2026-01-04] 2026-01-04 hour 0: 135328 events in 0 files, snapshot none (task 3538 ms: download 1972 ms overlapping gunzip 452 ms, parse 1462 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 62071 repo-hours, 932 releases; waiting 706 ms; commit 0 ms)
2026-11-08T14:56:20Z [load_day 2026-01-04] 2026-01-04 hour 1: 149862 events in 0 files, snapshot none (task 3648 ms: download 1487 ms overlapping gunzip 433 ms, parse 1468 ms, sort 0 ms, write 0 ms, index 1033 ms: 3 candidates, 88926 repo-hours, 773 releases; waiting 403 ms; commit 0 ms)
2026-11-08T14:56:24Z [load_day 2026-01-04] 2026-01-04 hour 2: 143067 events in 0 files, snapshot none (task 3812 ms: download 1776 ms overlapping gunzip 526 ms, parse 1753 ms, sort 0 ms, write 0 ms, index 758 ms: 4 candidates, 76007 repo-hours, 682 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:56:24Z [load_day 2026-01-04] 2026-01-04 hour 3: 136731 events in 0 files, snapshot none (task 3363 ms: download 2002 ms overlapping gunzip 452 ms, parse 1361 ms, sort 0 ms, write 0 ms, index 576 ms: 6 candidates, 63577 repo-hours, 886 releases; waiting 665 ms; commit 0 ms)
2026-11-08T14:56:28Z [load_day 2026-01-04] 2026-01-04 hour 4: 139435 events in 0 files, snapshot none (task 3436 ms: download 1721 ms overlapping gunzip 523 ms, parse 1600 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 66643 repo-hours, 1527 releases; waiting 346 ms; commit 0 ms)
2026-11-08T14:56:29Z [load_day 2026-01-04] 2026-01-04 hour 5: 143750 events in 0 files, snapshot none (task 3678 ms: download 1820 ms overlapping gunzip 648 ms, parse 1639 ms, sort 0 ms, write 0 ms, index 562 ms: 7 candidates, 63603 repo-hours, 625 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:56:33Z [load_day 2026-01-04] 2026-01-04 hour 6: 147381 events in 0 files, snapshot none (task 4290 ms: download 2637 ms overlapping gunzip 616 ms, parse 1942 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 73050 repo-hours, 714 releases; waiting 805 ms; commit 0 ms)
2026-11-08T14:56:33Z [load_day 2026-01-04] 2026-01-04 hour 7: 143707 events in 0 files, snapshot none (task 3945 ms: download 2534 ms overlapping gunzip 634 ms, parse 1687 ms, sort 0 ms, write 0 ms, index 765 ms: 1 candidates, 67769 repo-hours, 579 releases; waiting 609 ms; commit 0 ms)
2026-11-08T14:56:37Z [load_day 2026-01-04] 2026-01-04 hour 8: 143288 events in 0 files, snapshot none (task 3732 ms: download 2270 ms overlapping gunzip 534 ms, parse 1704 ms, sort 0 ms, write 0 ms, index 614 ms: 8 candidates, 69100 repo-hours, 624 releases; waiting 397 ms; commit 0 ms)
2026-11-08T14:56:37Z [load_day 2026-01-04] 2026-01-04 hour 9: 149051 events in 0 files, snapshot none (task 3711 ms: download 2006 ms overlapping gunzip 555 ms, parse 1803 ms, sort 0 ms, write 0 ms, index 601 ms: 10 candidates, 68970 repo-hours, 724 releases; waiting 531 ms; commit 0 ms)
2026-11-08T14:56:42Z [load_day 2026-01-04] 2026-01-04 hour 10: 146773 events in 0 files, snapshot none (task 3521 ms: download 1895 ms overlapping gunzip 531 ms, parse 1737 ms, sort 0 ms, write 0 ms, index 614 ms: 10 candidates, 70345 repo-hours, 631 releases; waiting 387 ms; commit 0 ms)
2026-11-08T14:56:42Z [load_day 2026-01-04] 2026-01-04 hour 11: 146833 events in 0 files, snapshot none (task 3377 ms: download 2291 ms overlapping gunzip 460 ms, parse 1346 ms, sort 0 ms, write 0 ms, index 560 ms: 7 candidates, 68408 repo-hours, 640 releases; waiting 673 ms; commit 0 ms)
2026-11-08T14:56:46Z [load_day 2026-01-04] 2026-01-04 hour 12: 154813 events in 0 files, snapshot none (task 3661 ms: download 1989 ms overlapping gunzip 475 ms, parse 1505 ms, sort 0 ms, write 0 ms, index 781 ms: 5 candidates, 93761 repo-hours, 555 releases; waiting 648 ms; commit 0 ms)
2026-11-08T14:56:46Z [load_day 2026-01-04] 2026-01-04 hour 13: 156257 events in 0 files, snapshot none (task 3644 ms: download 2014 ms overlapping gunzip 495 ms, parse 1565 ms, sort 0 ms, write 0 ms, index 710 ms: 23 candidates, 84806 repo-hours, 620 releases; waiting 550 ms; commit 0 ms)
2026-11-08T14:56:50Z [load_day 2026-01-04] 2026-01-04 hour 14: 155493 events in 0 files, snapshot none (task 3828 ms: download 2492 ms overlapping gunzip 547 ms, parse 1585 ms, sort 0 ms, write 0 ms, index 721 ms: 9 candidates, 74301 repo-hours, 769 releases; waiting 710 ms; commit 0 ms)
2026-11-08T14:56:50Z [load_day 2026-01-04] 2026-01-04 hour 15: 152784 events in 0 files, snapshot none (task 4096 ms: download 2931 ms overlapping gunzip 560 ms, parse 1502 ms, sort 0 ms, write 0 ms, index 555 ms: 5 candidates, 74103 repo-hours, 780 releases; waiting 1189 ms; commit 0 ms)
2026-11-08T14:56:54Z [load_day 2026-01-04] 2026-01-04 hour 16: 152130 events in 0 files, snapshot none (task 3436 ms: download 2143 ms overlapping gunzip 484 ms, parse 1358 ms, sort 0 ms, write 0 ms, index 603 ms: 6 candidates, 75484 repo-hours, 792 releases; waiting 681 ms; commit 0 ms)
2026-11-08T14:56:54Z [load_day 2026-01-04] 2026-01-04 hour 17: 150670 events in 0 files, snapshot none (task 3076 ms: download 1741 ms overlapping gunzip 388 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 699 ms: 6 candidates, 72249 repo-hours, 752 releases; waiting 537 ms; commit 0 ms)
2026-11-08T14:56:58Z [load_day 2026-01-04] 2026-01-04 hour 18: 147289 events in 0 files, snapshot none (task 3230 ms: download 1630 ms overlapping gunzip 445 ms, parse 1367 ms, sort 0 ms, write 0 ms, index 649 ms: 4 candidates, 74182 repo-hours, 791 releases; waiting 310 ms; commit 0 ms)
2026-11-08T14:56:58Z [load_day 2026-01-04] 2026-01-04 hour 19: 147939 events in 0 files, snapshot none (task 3026 ms: download 2088 ms overlapping gunzip 369 ms, parse 1126 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 66638 repo-hours, 674 releases; waiting 707 ms; commit 0 ms)
2026-11-08T14:57:02Z [load_day 2026-01-04] 2026-01-04 hour 20: 145351 events in 0 files, snapshot none (task 3336 ms: download 1900 ms overlapping gunzip 447 ms, parse 1311 ms, sort 0 ms, write 0 ms, index 590 ms: 4 candidates, 67506 repo-hours, 704 releases; waiting 684 ms; commit 0 ms)
2026-11-08T14:57:02Z [load_day 2026-01-04] 2026-01-04 hour 21: 144483 events in 0 files, snapshot none (task 3135 ms: download 1865 ms overlapping gunzip 386 ms, parse 1168 ms, sort 0 ms, write 0 ms, index 718 ms: 7 candidates, 65733 repo-hours, 812 releases; waiting 539 ms; commit 0 ms)
2026-11-08T14:57:07Z [load_day 2026-01-04] 2026-01-04 hour 22: 144299 events in 0 files, snapshot none (task 4385 ms: download 2745 ms overlapping gunzip 490 ms, parse 1474 ms, sort 0 ms, write 0 ms, index 667 ms: 7 candidates, 64326 repo-hours, 755 releases; waiting 1260 ms; commit 0 ms)
2026-11-08T14:57:07Z [load_day 2026-01-04] 2026-01-04 hour 23: 142596 events in 0 files, snapshot none (task 3342 ms: download 1929 ms overlapping gunzip 420 ms, parse 1338 ms, sort 0 ms, write 0 ms, index 726 ms: 9 candidates, 59001 repo-hours, 812 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:57:14Z [load_day 2026-01-04] 2026-01-04: repo_hour merged from 24 files to 1 (1710559 rows, 7627 ms)
2026-11-08T14:57:17Z [load_day 2026-01-04] 2026-01-04: index committed in 10346 ms (24 + 1 + 24 files)
2026-11-08T14:57:17Z [load_day 2026-01-04] 2026-01-04: 3519310 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:57:17Z [load_day 2026-01-04] attempt 1 succeeded