orcaLog in

Runs · run 5042

load_day 2026-03-16, attempt 1 succeeded

Host
73ccef5e07c2:456154
Started
2026-11-08T15:35:33Z
Ended
2026-11-08T15:36:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
801 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
68.4 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5042/load_day/2026-03-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:35:33Z [load_day 2026-03-16] attempt 1 started
2026-11-08T15:35:34Z [load_day 2026-03-16] 2026-03-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:35:38Z [load_day 2026-03-16] 2026-03-16 hour 0: 148580 events in 0 files, snapshot none (task 3455 ms: download 1986 ms overlapping gunzip 573 ms, parse 1577 ms, sort 0 ms, write 0 ms, index 597 ms: 8 candidates, 71787 repo-hours, 1123 releases; waiting 382 ms; commit 0 ms)
2026-11-08T15:35:38Z [load_day 2026-03-16] 2026-03-16 hour 1: 153588 events in 0 files, snapshot none (task 3217 ms: download 1986 ms overlapping gunzip 444 ms, parse 1361 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 87324 repo-hours, 558 releases; waiting 506 ms; commit 0 ms)
2026-11-08T15:35:42Z [load_day 2026-03-16] 2026-03-16 hour 2: 153572 events in 0 files, snapshot none (task 2940 ms: download 1581 ms overlapping gunzip 364 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 624 ms: 13 candidates, 87557 repo-hours, 560 releases; waiting 471 ms; commit 0 ms)
2026-11-08T15:35:42Z [load_day 2026-03-16] 2026-03-16 hour 3: 150408 events in 0 files, snapshot none (task 3557 ms: download 2308 ms overlapping gunzip 429 ms, parse 1344 ms, sort 0 ms, write 0 ms, index 648 ms: 12 candidates, 76615 repo-hours, 740 releases; waiting 580 ms; commit 0 ms)
2026-11-08T15:35:47Z [load_day 2026-03-16] 2026-03-16 hour 4: 147965 events in 0 files, snapshot none (task 4010 ms: download 2251 ms overlapping gunzip 570 ms, parse 1689 ms, sort 0 ms, write 0 ms, index 753 ms: 11 candidates, 71961 repo-hours, 924 releases; waiting 690 ms; commit 0 ms)
2026-11-08T15:35:47Z [load_day 2026-03-16] 2026-03-16 hour 5: 151518 events in 0 files, snapshot none (task 4439 ms: download 2723 ms overlapping gunzip 592 ms, parse 1720 ms, sort 0 ms, write 0 ms, index 669 ms: 4 candidates, 79250 repo-hours, 818 releases; waiting 809 ms; commit 0 ms)
2026-11-08T15:35:51Z [load_day 2026-03-16] 2026-03-16 hour 6: 152953 events in 0 files, snapshot none (task 3392 ms: download 1755 ms overlapping gunzip 505 ms, parse 1596 ms, sort 0 ms, write 0 ms, index 688 ms: 9 candidates, 79263 repo-hours, 679 releases; waiting 307 ms; commit 0 ms)
2026-11-08T15:35:51Z [load_day 2026-03-16] 2026-03-16 hour 7: 153735 events in 0 files, snapshot none (task 3310 ms: download 1983 ms overlapping gunzip 443 ms, parse 1368 ms, sort 0 ms, write 0 ms, index 622 ms: 11 candidates, 83006 repo-hours, 547 releases; waiting 550 ms; commit 0 ms)
2026-11-08T15:35:54Z [load_day 2026-03-16] 2026-03-16 hour 8: 153756 events in 0 files, snapshot none (task 3127 ms: download 1558 ms overlapping gunzip 447 ms, parse 1386 ms, sort 0 ms, write 0 ms, index 730 ms: 6 candidates, 85788 repo-hours, 400 releases; waiting 233 ms; commit 0 ms)
2026-11-08T15:35:55Z [load_day 2026-03-16] 2026-03-16 hour 9: 156122 events in 0 files, snapshot none (task 3692 ms: download 2519 ms overlapping gunzip 388 ms, parse 1099 ms, sort 0 ms, write 0 ms, index 672 ms: 9 candidates, 87435 repo-hours, 313 releases; waiting 1183 ms; commit 0 ms)
2026-11-08T15:35:58Z [load_day 2026-03-16] 2026-03-16 hour 10: 155438 events in 0 files, snapshot none (task 3490 ms: download 1987 ms overlapping gunzip 329 ms, parse 1014 ms, sort 0 ms, write 0 ms, index 801 ms: 9 candidates, 89450 repo-hours, 260 releases; waiting 765 ms; commit 0 ms)
2026-11-08T15:36:00Z [load_day 2026-03-16] 2026-03-16 hour 11: 156302 events in 0 files, snapshot none (task 3798 ms: download 1993 ms overlapping gunzip 354 ms, parse 1080 ms, sort 0 ms, write 0 ms, index 1320 ms: 11 candidates, 86476 repo-hours, 362 releases; waiting 731 ms; commit 0 ms)
2026-11-08T15:36:02Z [load_day 2026-03-16] 2026-03-16 hour 12: 159173 events in 0 files, snapshot none (task 3341 ms: download 1855 ms overlapping gunzip 299 ms, parse 917 ms, sort 0 ms, write 0 ms, index 947 ms: 8 candidates, 94090 repo-hours, 234 releases; waiting 832 ms; commit 0 ms)
2026-11-08T15:36:03Z [load_day 2026-03-16] 2026-03-16 hour 13: 159316 events in 0 files, snapshot none (task 2789 ms: download 1654 ms overlapping gunzip 240 ms, parse 812 ms, sort 0 ms, write 0 ms, index 703 ms: 10 candidates, 94829 repo-hours, 51 releases; waiting 699 ms; commit 0 ms)
2026-11-08T15:36:06Z [load_day 2026-03-16] 2026-03-16 hour 14: 156291 events in 0 files, snapshot none (task 3155 ms: download 1978 ms overlapping gunzip 233 ms, parse 803 ms, sort 0 ms, write 0 ms, index 751 ms: 13 candidates, 91983 repo-hours, 116 releases; waiting 1010 ms; commit 0 ms)
2026-11-08T15:36:06Z [load_day 2026-03-16] 2026-03-16 hour 15: 151791 events in 0 files, snapshot none (task 2595 ms: download 1419 ms overlapping gunzip 239 ms, parse 773 ms, sort 0 ms, write 0 ms, index 692 ms: 11 candidates, 87443 repo-hours, 128 releases; waiting 655 ms; commit 0 ms)
2026-11-08T15:36:10Z [load_day 2026-03-16] 2026-03-16 hour 16: 153180 events in 0 files, snapshot none (task 3190 ms: download 1820 ms overlapping gunzip 274 ms, parse 870 ms, sort 0 ms, write 0 ms, index 707 ms: 7 candidates, 86571 repo-hours, 112 releases; waiting 968 ms; commit 0 ms)
2026-11-08T15:36:10Z [load_day 2026-03-16] 2026-03-16 hour 17: 155463 events in 0 files, snapshot none (task 2632 ms: download 1552 ms overlapping gunzip 240 ms, parse 832 ms, sort 0 ms, write 0 ms, index 660 ms: 11 candidates, 84846 repo-hours, 131 releases; waiting 576 ms; commit 0 ms)
2026-11-08T15:36:13Z [load_day 2026-03-16] 2026-03-16 hour 18: 160127 events in 0 files, snapshot none (task 3016 ms: download 1821 ms overlapping gunzip 287 ms, parse 873 ms, sort 0 ms, write 0 ms, index 706 ms: 11 candidates, 87653 repo-hours, 193 releases; waiting 796 ms; commit 0 ms)
2026-11-08T15:36:13Z [load_day 2026-03-16] 2026-03-16 hour 19: 163129 events in 0 files, snapshot none (task 2591 ms: download 1268 ms overlapping gunzip 284 ms, parse 991 ms, sort 0 ms, write 0 ms, index 693 ms: 11 candidates, 85382 repo-hours, 150 releases; waiting 303 ms; commit 0 ms)
2026-11-08T15:36:17Z [load_day 2026-03-16] 2026-03-16 hour 20: 154189 events in 0 files, snapshot none (task 2903 ms: download 1394 ms overlapping gunzip 322 ms, parse 1015 ms, sort 0 ms, write 0 ms, index 639 ms: 14 candidates, 83444 repo-hours, 235 releases; waiting 347 ms; commit 0 ms)
2026-11-08T15:36:17Z [load_day 2026-03-16] 2026-03-16 hour 21: 154906 events in 0 files, snapshot none (task 3045 ms: download 1875 ms overlapping gunzip 390 ms, parse 1219 ms, sort 0 ms, write 0 ms, index 600 ms: 9 candidates, 82264 repo-hours, 469 releases; waiting 509 ms; commit 0 ms)
2026-11-08T15:36:21Z [load_day 2026-03-16] 2026-03-16 hour 22: 151254 events in 0 files, snapshot none (task 3620 ms: download 2387 ms overlapping gunzip 461 ms, parse 1438 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 76953 repo-hours, 573 releases; waiting 753 ms; commit 0 ms)
2026-11-08T15:36:21Z [load_day 2026-03-16] 2026-03-16 hour 23: 153514 events in 0 files, snapshot none (task 3486 ms: download 2150 ms overlapping gunzip 475 ms, parse 1449 ms, sort 0 ms, write 0 ms, index 601 ms: 3 candidates, 77316 repo-hours, 703 releases; waiting 613 ms; commit 0 ms)
2026-11-08T15:36:30Z [load_day 2026-03-16] 2026-03-16: repo_hour merged from 24 files to 1 (2018686 rows, 9313 ms)
2026-11-08T15:36:33Z [load_day 2026-03-16] 2026-03-16: index committed in 12167 ms (24 + 1 + 24 files)
2026-11-08T15:36:33Z [load_day 2026-03-16] 2026-03-16: 3706270 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:36:33Z [load_day 2026-03-16] attempt 1 succeeded