orcaLog in

Runs · run 4929

load_day 2026-02-13, attempt 1 succeeded

Host
73ccef5e07c2:442471
Started
2026-11-08T15:18:38Z
Ended
2026-11-08T15:19:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
716 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.8 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4929/load_day/2026-02-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:18:38Z [load_day 2026-02-13] attempt 1 started
2026-11-08T15:18:39Z [load_day 2026-02-13] 2026-02-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:18:43Z [load_day 2026-02-13] 2026-02-13 hour 0: 140140 events in 0 files, snapshot none (task 3214 ms: download 2016 ms overlapping gunzip 429 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 653 ms: 6 candidates, 68457 repo-hours, 952 releases; waiting 587 ms; commit 0 ms)
2026-11-08T15:18:43Z [load_day 2026-02-13] 2026-02-13 hour 1: 150365 events in 0 files, snapshot none (task 3675 ms: download 2715 ms overlapping gunzip 416 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 617 ms: 6 candidates, 86911 repo-hours, 795 releases; waiting 1080 ms; commit 0 ms)
2026-11-08T15:18:48Z [load_day 2026-02-13] 2026-02-13 hour 2: 145807 events in 0 files, snapshot none (task 4496 ms: download 2931 ms overlapping gunzip 508 ms, parse 1559 ms, sort 0 ms, write 0 ms, index 889 ms: 3 candidates, 83058 repo-hours, 781 releases; waiting 1256 ms; commit 0 ms)
2026-11-08T15:18:48Z [load_day 2026-02-13] 2026-02-13 hour 3: 141288 events in 0 files, snapshot none (task 3797 ms: download 2229 ms overlapping gunzip 447 ms, parse 1352 ms, sort 0 ms, write 0 ms, index 1041 ms: 4 candidates, 69600 repo-hours, 895 releases; waiting 595 ms; commit 0 ms)
2026-11-08T15:18:53Z [load_day 2026-02-13] 2026-02-13 hour 4: 144380 events in 0 files, snapshot none (task 4179 ms: download 2281 ms overlapping gunzip 646 ms, parse 2008 ms, sort 0 ms, write 0 ms, index 604 ms: 4 candidates, 72098 repo-hours, 819 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:18:53Z [load_day 2026-02-13] 2026-02-13 hour 5: 145036 events in 0 files, snapshot none (task 3652 ms: download 2085 ms overlapping gunzip 543 ms, parse 1738 ms, sort 0 ms, write 0 ms, index 751 ms: 7 candidates, 75815 repo-hours, 1351 releases; waiting 256 ms; commit 0 ms)
2026-11-08T15:18:57Z [load_day 2026-02-13] 2026-02-13 hour 6: 149697 events in 0 files, snapshot none (task 3952 ms: download 2039 ms overlapping gunzip 619 ms, parse 1852 ms, sort 0 ms, write 0 ms, index 804 ms: 7 candidates, 77846 repo-hours, 841 releases; waiting 368 ms; commit 0 ms)
2026-11-08T15:18:57Z [load_day 2026-02-13] 2026-02-13 hour 7: 146099 events in 0 files, snapshot none (task 4169 ms: download 2323 ms overlapping gunzip 620 ms, parse 1811 ms, sort 0 ms, write 0 ms, index 751 ms: 7 candidates, 77312 repo-hours, 800 releases; waiting 729 ms; commit 0 ms)
2026-11-08T15:19:02Z [load_day 2026-02-13] 2026-02-13 hour 8: 145548 events in 0 files, snapshot none (task 4225 ms: download 2298 ms overlapping gunzip 712 ms, parse 2038 ms, sort 0 ms, write 0 ms, index 676 ms: 7 candidates, 78186 repo-hours, 826 releases; waiting 504 ms; commit 0 ms)
2026-11-08T15:19:02Z [load_day 2026-02-13] 2026-02-13 hour 9: 144367 events in 0 files, snapshot none (task 3917 ms: download 2412 ms overlapping gunzip 548 ms, parse 1680 ms, sort 0 ms, write 0 ms, index 729 ms: 6 candidates, 79262 repo-hours, 794 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:19:07Z [load_day 2026-02-13] 2026-02-13 hour 10: 144832 events in 0 files, snapshot none (task 4727 ms: download 2218 ms overlapping gunzip 578 ms, parse 1969 ms, sort 0 ms, write 0 ms, index 879 ms: 9 candidates, 79432 repo-hours, 668 releases; waiting 510 ms; commit 0 ms)
2026-11-08T15:19:08Z [load_day 2026-02-13] 2026-02-13 hour 11: 149179 events in 0 files, snapshot none (task 5548 ms: download 3959 ms overlapping gunzip 536 ms, parse 1753 ms, sort 0 ms, write 0 ms, index 678 ms: 3 candidates, 81261 repo-hours, 665 releases; waiting 2306 ms; commit 0 ms)
2026-11-08T15:19:12Z [load_day 2026-02-13] 2026-02-13 hour 12: 155778 events in 0 files, snapshot none (task 4433 ms: download 2641 ms overlapping gunzip 590 ms, parse 1861 ms, sort 0 ms, write 0 ms, index 1109 ms: 5 candidates, 93699 repo-hours, 565 releases; waiting 556 ms; commit 0 ms)
2026-11-08T15:19:13Z [load_day 2026-02-13] 2026-02-13 hour 13: 154515 events in 0 files, snapshot none (task 3811 ms: download 2000 ms overlapping gunzip 516 ms, parse 1668 ms, sort 0 ms, write 0 ms, index 721 ms: 8 candidates, 94805 repo-hours, 368 releases; waiting 527 ms; commit 0 ms)
2026-11-08T15:19:17Z [load_day 2026-02-13] 2026-02-13 hour 14: 150283 events in 0 files, snapshot none (task 3980 ms: download 2474 ms overlapping gunzip 635 ms, parse 1879 ms, sort 0 ms, write 0 ms, index 795 ms: 8 candidates, 86617 repo-hours, 425 releases; waiting 406 ms; commit 0 ms)
2026-11-08T15:19:17Z [load_day 2026-02-13] 2026-02-13 hour 15: 144156 events in 0 files, snapshot none (task 3872 ms: download 1965 ms overlapping gunzip 618 ms, parse 1718 ms, sort 0 ms, write 0 ms, index 776 ms: 8 candidates, 84388 repo-hours, 386 releases; waiting 493 ms; commit 0 ms)
2026-11-08T15:19:21Z [load_day 2026-02-13] 2026-02-13 hour 16: 139720 events in 0 files, snapshot none (task 3931 ms: download 2801 ms overlapping gunzip 467 ms, parse 1382 ms, sort 0 ms, write 0 ms, index 728 ms: 10 candidates, 81805 repo-hours, 543 releases; waiting 1103 ms; commit 0 ms)
2026-11-08T15:19:21Z [load_day 2026-02-13] 2026-02-13 hour 17: 138623 events in 0 files, snapshot none (task 4141 ms: download 2509 ms overlapping gunzip 432 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 609 ms: 9 candidates, 80827 repo-hours, 321 releases; waiting 1381 ms; commit 0 ms)
2026-11-08T15:19:25Z [load_day 2026-02-13] 2026-02-13 hour 18: 139138 events in 0 files, snapshot none (task 3164 ms: download 1632 ms overlapping gunzip 337 ms, parse 1110 ms, sort 0 ms, write 0 ms, index 739 ms: 12 candidates, 88070 repo-hours, 60 releases; waiting 691 ms; commit 0 ms)
2026-11-08T15:19:25Z [load_day 2026-02-13] 2026-02-13 hour 19: 142210 events in 0 files, snapshot none (task 2761 ms: download 1524 ms overlapping gunzip 277 ms, parse 1026 ms, sort 0 ms, write 0 ms, index 671 ms: 6 candidates, 88322 repo-hours, 42 releases; waiting 490 ms; commit 0 ms)
2026-11-08T15:19:28Z [load_day 2026-02-13] 2026-02-13 hour 20: 147318 events in 0 files, snapshot none (task 2550 ms: download 1469 ms overlapping gunzip 262 ms, parse 910 ms, sort 0 ms, write 0 ms, index 735 ms: 12 candidates, 86149 repo-hours, 126 releases; waiting 428 ms; commit 0 ms)
2026-11-08T15:19:29Z [load_day 2026-02-13] 2026-02-13 hour 21: 155427 events in 0 files, snapshot none (task 3306 ms: download 1942 ms overlapping gunzip 391 ms, parse 1187 ms, sort 0 ms, write 0 ms, index 804 ms: 6 candidates, 89929 repo-hours, 171 releases; waiting 630 ms; commit 0 ms)
2026-11-08T15:19:31Z [load_day 2026-02-13] 2026-02-13 hour 22: 147380 events in 0 files, snapshot none (task 2965 ms: download 1784 ms overlapping gunzip 422 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 641 ms: 6 candidates, 74624 repo-hours, 662 releases; waiting 270 ms; commit 0 ms)
2026-11-08T15:19:33Z [load_day 2026-02-13] 2026-02-13 hour 23: 142065 events in 0 files, snapshot none (task 3434 ms: download 2209 ms overlapping gunzip 460 ms, parse 1410 ms, sort 0 ms, write 0 ms, index 668 ms: 4 candidates, 67967 repo-hours, 1005 releases; waiting 640 ms; commit 0 ms)
2026-11-08T15:19:41Z [load_day 2026-02-13] 2026-02-13: repo_hour merged from 24 files to 1 (1946440 rows, 8555 ms)
2026-11-08T15:19:44Z [load_day 2026-02-13] 2026-02-13: index committed in 11261 ms (24 + 1 + 24 files)
2026-11-08T15:19:44Z [load_day 2026-02-13] 2026-02-13: 3503351 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:19:44Z [load_day 2026-02-13] attempt 1 succeeded