orcaLog in

Runs · run 4959

load_day 2026-02-21, attempt 1 succeeded

Host
73ccef5e07c2:446080
Started
2026-11-08T15:23:02Z
Ended
2026-11-08T15:24:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
708 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.9 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4959/load_day/2026-02-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:23:02Z [load_day 2026-02-21] attempt 1 started
2026-11-08T15:23:03Z [load_day 2026-02-21] 2026-02-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:23:07Z [load_day 2026-02-21] 2026-02-21 hour 0: 144966 events in 0 files, snapshot none (task 3696 ms: download 2530 ms overlapping gunzip 475 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 517 ms: 5 candidates, 69269 repo-hours, 1022 releases; waiting 839 ms; commit 0 ms)
2026-11-08T15:23:07Z [load_day 2026-02-21] 2026-02-21 hour 1: 154857 events in 0 files, snapshot none (task 3348 ms: download 1920 ms overlapping gunzip 436 ms, parse 1372 ms, sort 0 ms, write 0 ms, index 731 ms: 9 candidates, 87206 repo-hours, 850 releases; waiting 534 ms; commit 0 ms)
2026-11-08T15:23:11Z [load_day 2026-02-21] 2026-02-21 hour 2: 150839 events in 0 files, snapshot none (task 3709 ms: download 2668 ms overlapping gunzip 479 ms, parse 1542 ms, sort 0 ms, write 0 ms, index 612 ms: 7 candidates, 76319 repo-hours, 817 releases; waiting 738 ms; commit 0 ms)
2026-11-08T15:23:11Z [load_day 2026-02-21] 2026-02-21 hour 3: 142489 events in 0 files, snapshot none (task 3415 ms: download 2403 ms overlapping gunzip 489 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 61884 repo-hours, 898 releases; waiting 607 ms; commit 0 ms)
2026-11-08T15:23:16Z [load_day 2026-02-21] 2026-02-21 hour 4: 144516 events in 0 files, snapshot none (task 3652 ms: download 2327 ms overlapping gunzip 407 ms, parse 1232 ms, sort 0 ms, write 0 ms, index 543 ms: 10 candidates, 70886 repo-hours, 1697 releases; waiting 1203 ms; commit 0 ms)
2026-11-08T15:23:16Z [load_day 2026-02-21] 2026-02-21 hour 5: 145210 events in 0 files, snapshot none (task 3195 ms: download 2111 ms overlapping gunzip 388 ms, parse 1168 ms, sort 0 ms, write 0 ms, index 571 ms: 4 candidates, 69820 repo-hours, 798 releases; waiting 753 ms; commit 0 ms)
2026-11-08T15:23:20Z [load_day 2026-02-21] 2026-02-21 hour 6: 150874 events in 0 files, snapshot none (task 3417 ms: download 2179 ms overlapping gunzip 473 ms, parse 1429 ms, sort 0 ms, write 0 ms, index 588 ms: 8 candidates, 75458 repo-hours, 946 releases; waiting 570 ms; commit 0 ms)
2026-11-08T15:23:20Z [load_day 2026-02-21] 2026-02-21 hour 7: 153135 events in 0 files, snapshot none (task 2981 ms: download 1616 ms overlapping gunzip 408 ms, parse 1280 ms, sort 0 ms, write 0 ms, index 625 ms: 6 candidates, 65834 repo-hours, 733 releases; waiting 272 ms; commit 0 ms)
2026-11-08T15:23:25Z [load_day 2026-02-21] 2026-02-21 hour 8: 150474 events in 0 files, snapshot none (task 4513 ms: download 3215 ms overlapping gunzip 636 ms, parse 2001 ms, sort 0 ms, write 0 ms, index 732 ms: 8 candidates, 68260 repo-hours, 897 releases; waiting 922 ms; commit 0 ms)
2026-11-08T15:23:25Z [load_day 2026-02-21] 2026-02-21 hour 9: 149550 events in 0 files, snapshot none (task 4537 ms: download 2203 ms overlapping gunzip 630 ms, parse 1811 ms, sort 0 ms, write 0 ms, index 1121 ms: 12 candidates, 73441 repo-hours, 852 releases; waiting 641 ms; commit 0 ms)
2026-11-08T15:23:29Z [load_day 2026-02-21] 2026-02-21 hour 10: 149419 events in 0 files, snapshot none (task 3632 ms: download 2246 ms overlapping gunzip 541 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 740 ms: 9 candidates, 74208 repo-hours, 861 releases; waiting 423 ms; commit 0 ms)
2026-11-08T15:23:29Z [load_day 2026-02-21] 2026-02-21 hour 11: 149234 events in 0 files, snapshot none (task 3770 ms: download 2030 ms overlapping gunzip 585 ms, parse 1785 ms, sort 0 ms, write 0 ms, index 568 ms: 4 candidates, 71621 repo-hours, 838 releases; waiting 472 ms; commit 0 ms)
2026-11-08T15:23:33Z [load_day 2026-02-21] 2026-02-21 hour 12: 157591 events in 0 files, snapshot none (task 3715 ms: download 2224 ms overlapping gunzip 473 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 760 ms: 8 candidates, 91464 repo-hours, 675 releases; waiting 742 ms; commit 0 ms)
2026-11-08T15:23:34Z [load_day 2026-02-21] 2026-02-21 hour 13: 155242 events in 0 files, snapshot none (task 4025 ms: download 2310 ms overlapping gunzip 486 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 799 ms: 6 candidates, 90429 repo-hours, 736 releases; waiting 826 ms; commit 0 ms)
2026-11-08T15:23:38Z [load_day 2026-02-21] 2026-02-21 hour 14: 155073 events in 0 files, snapshot none (task 3999 ms: download 2325 ms overlapping gunzip 587 ms, parse 1831 ms, sort 0 ms, write 0 ms, index 702 ms: 11 candidates, 78059 repo-hours, 1050 releases; waiting 619 ms; commit 0 ms)
2026-11-08T15:23:38Z [load_day 2026-02-21] 2026-02-21 hour 15: 158375 events in 0 files, snapshot none (task 4038 ms: download 2064 ms overlapping gunzip 553 ms, parse 1819 ms, sort 0 ms, write 0 ms, index 856 ms: 3 candidates, 82133 repo-hours, 1005 releases; waiting 531 ms; commit 0 ms)
2026-11-08T15:23:43Z [load_day 2026-02-21] 2026-02-21 hour 16: 154852 events in 0 files, snapshot none (task 4730 ms: download 3879 ms overlapping gunzip 500 ms, parse 1522 ms, sort 0 ms, write 0 ms, index 588 ms: 8 candidates, 78638 repo-hours, 969 releases; waiting 1892 ms; commit 0 ms)
2026-11-08T15:23:43Z [load_day 2026-02-21] 2026-02-21 hour 17: 153993 events in 0 files, snapshot none (task 3656 ms: download 2001 ms overlapping gunzip 475 ms, parse 1492 ms, sort 0 ms, write 0 ms, index 857 ms: 7 candidates, 76397 repo-hours, 1238 releases; waiting 505 ms; commit 0 ms)
2026-11-08T15:23:48Z [load_day 2026-02-21] 2026-02-21 hour 18: 155511 events in 0 files, snapshot none (task 3881 ms: download 2166 ms overlapping gunzip 476 ms, parse 1507 ms, sort 0 ms, write 0 ms, index 732 ms: 5 candidates, 82672 repo-hours, 1445 releases; waiting 860 ms; commit 0 ms)
2026-11-08T15:23:48Z [load_day 2026-02-21] 2026-02-21 hour 19: 152575 events in 0 files, snapshot none (task 3158 ms: download 1795 ms overlapping gunzip 479 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 647 ms: 9 candidates, 73395 repo-hours, 1030 releases; waiting 262 ms; commit 0 ms)
2026-11-08T15:23:52Z [load_day 2026-02-21] 2026-02-21 hour 20: 152166 events in 0 files, snapshot none (task 3910 ms: download 2389 ms overlapping gunzip 584 ms, parse 1838 ms, sort 0 ms, write 0 ms, index 623 ms: 8 candidates, 73291 repo-hours, 1036 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:23:52Z [load_day 2026-02-21] 2026-02-21 hour 21: 155298 events in 0 files, snapshot none (task 3638 ms: download 1653 ms overlapping gunzip 596 ms, parse 1906 ms, sort 0 ms, write 0 ms, index 579 ms: 4 candidates, 73391 repo-hours, 1125 releases; waiting 259 ms; commit 0 ms)
2026-11-08T15:23:56Z [load_day 2026-02-21] 2026-02-21 hour 22: 149855 events in 0 files, snapshot none (task 3428 ms: download 2429 ms overlapping gunzip 461 ms, parse 1478 ms, sort 0 ms, write 0 ms, index 511 ms: 8 candidates, 69527 repo-hours, 1203 releases; waiting 676 ms; commit 0 ms)
2026-11-08T15:23:56Z [load_day 2026-02-21] 2026-02-21 hour 23: 147045 events in 0 files, snapshot none (task 3503 ms: download 2255 ms overlapping gunzip 456 ms, parse 1415 ms, sort 0 ms, write 0 ms, index 447 ms: 5 candidates, 65028 repo-hours, 1196 releases; waiting 632 ms; commit 0 ms)
2026-11-08T15:24:04Z [load_day 2026-02-21] 2026-02-21: repo_hour merged from 24 files to 1 (1798630 rows, 8041 ms)
2026-11-08T15:24:07Z [load_day 2026-02-21] 2026-02-21: index committed in 11058 ms (24 + 1 + 24 files)
2026-11-08T15:24:07Z [load_day 2026-02-21] 2026-02-21: 3633139 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:24:07Z [load_day 2026-02-21] attempt 1 succeeded