orcaLog in

Runs · run 4537

load_day 2025-10-24, attempt 1 succeeded

Host
73ccef5e07c2:396454
Started
2026-11-08T14:17:28Z
Ended
2026-11-08T14:18:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
657 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.7 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4537/load_day/2025-10-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:17:28Z [load_day 2025-10-24] attempt 1 started
2026-11-08T14:17:29Z [load_day 2025-10-24] 2025-10-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:17:33Z [load_day 2025-10-24] 2025-10-24 hour 0: 146802 events in 0 files, snapshot none (task 2979 ms: download 1554 ms overlapping gunzip 392 ms, parse 1265 ms, sort 0 ms, write 0 ms, index 709 ms: 1 candidates, 74085 repo-hours, 708 releases; waiting 287 ms; commit 0 ms)
2026-11-08T14:17:34Z [load_day 2025-10-24] 2025-10-24 hour 1: 150541 events in 0 files, snapshot none (task 3354 ms: download 2020 ms overlapping gunzip 410 ms, parse 1220 ms, sort 0 ms, write 0 ms, index 758 ms: 4 candidates, 85909 repo-hours, 701 releases; waiting 635 ms; commit 0 ms)
2026-11-08T14:17:37Z [load_day 2025-10-24] 2025-10-24 hour 2: 144466 events in 0 files, snapshot none (task 3626 ms: download 2518 ms overlapping gunzip 479 ms, parse 1550 ms, sort 0 ms, write 0 ms, index 540 ms: 4 candidates, 67336 repo-hours, 536 releases; waiting 757 ms; commit 0 ms)
2026-11-08T14:17:37Z [load_day 2025-10-24] 2025-10-24 hour 3: 143471 events in 0 files, snapshot none (task 3524 ms: download 1938 ms overlapping gunzip 532 ms, parse 1662 ms, sort 0 ms, write 0 ms, index 473 ms: 5 candidates, 64388 repo-hours, 1413 releases; waiting 417 ms; commit 0 ms)
2026-11-08T14:17:41Z [load_day 2025-10-24] 2025-10-24 hour 4: 143276 events in 0 files, snapshot none (task 3219 ms: download 2128 ms overlapping gunzip 432 ms, parse 1382 ms, sort 0 ms, write 0 ms, index 451 ms: 1 candidates, 61537 repo-hours, 451 releases; waiting 595 ms; commit 0 ms)
2026-11-08T14:17:41Z [load_day 2025-10-24] 2025-10-24 hour 5: 139997 events in 0 files, snapshot none (task 3182 ms: download 1952 ms overlapping gunzip 494 ms, parse 1508 ms, sort 0 ms, write 0 ms, index 432 ms: 2 candidates, 61278 repo-hours, 450 releases; waiting 397 ms; commit 0 ms)
2026-11-08T14:17:44Z [load_day 2025-10-24] 2025-10-24 hour 6: 144544 events in 0 files, snapshot none (task 2720 ms: download 764 ms overlapping gunzip 344 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 835 ms: 4 candidates, 73489 repo-hours, 622 releases; waiting 23 ms; commit 0 ms)
2026-11-08T14:17:45Z [load_day 2025-10-24] 2025-10-24 hour 7: 145621 events in 0 files, snapshot none (task 3494 ms: download 2294 ms overlapping gunzip 510 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 539 ms: 4 candidates, 70322 repo-hours, 592 releases; waiting 506 ms; commit 0 ms)
2026-11-08T14:17:49Z [load_day 2025-10-24] 2025-10-24 hour 8: 148600 events in 0 files, snapshot none (task 3795 ms: download 2340 ms overlapping gunzip 513 ms, parse 1710 ms, sort 0 ms, write 0 ms, index 545 ms: 4 candidates, 72224 repo-hours, 624 releases; waiting 690 ms; commit 0 ms)
2026-11-08T14:17:49Z [load_day 2025-10-24] 2025-10-24 hour 9: 146723 events in 0 files, snapshot none (task 3224 ms: download 2310 ms overlapping gunzip 592 ms, parse 1633 ms, sort 0 ms, write 0 ms, index 561 ms: 6 candidates, 69309 repo-hours, 598 releases; waiting 198 ms; commit 0 ms)
2026-11-08T14:17:53Z [load_day 2025-10-24] 2025-10-24 hour 10: 148340 events in 0 files, snapshot none (task 3350 ms: download 1836 ms overlapping gunzip 456 ms, parse 1318 ms, sort 0 ms, write 0 ms, index 643 ms: 7 candidates, 70231 repo-hours, 592 releases; waiting 557 ms; commit 0 ms)
2026-11-08T14:17:54Z [load_day 2025-10-24] 2025-10-24 hour 11: 147247 events in 0 files, snapshot none (task 4097 ms: download 2591 ms overlapping gunzip 518 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 564 ms: 6 candidates, 68496 repo-hours, 609 releases; waiting 1039 ms; commit 0 ms)
2026-11-08T14:17:57Z [load_day 2025-10-24] 2025-10-24 hour 12: 155484 events in 0 files, snapshot none (task 4127 ms: download 2307 ms overlapping gunzip 427 ms, parse 1474 ms, sort 0 ms, write 0 ms, index 998 ms: 5 candidates, 89293 repo-hours, 385 releases; waiting 937 ms; commit 0 ms)
2026-11-08T14:17:58Z [load_day 2025-10-24] 2025-10-24 hour 13: 155141 events in 0 files, snapshot none (task 3888 ms: download 1941 ms overlapping gunzip 561 ms, parse 1779 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 83956 repo-hours, 445 releases; waiting 545 ms; commit 0 ms)
2026-11-08T14:18:02Z [load_day 2025-10-24] 2025-10-24 hour 14: 146018 events in 0 files, snapshot none (task 4380 ms: download 2342 ms overlapping gunzip 526 ms, parse 1750 ms, sort 0 ms, write 0 ms, index 1160 ms: 7 candidates, 73686 repo-hours, 567 releases; waiting 615 ms; commit 0 ms)
2026-11-08T14:18:03Z [load_day 2025-10-24] 2025-10-24 hour 15: 147178 events in 0 files, snapshot none (task 4341 ms: download 2888 ms overlapping gunzip 511 ms, parse 1623 ms, sort 0 ms, write 0 ms, index 581 ms: 8 candidates, 76029 repo-hours, 657 releases; waiting 1199 ms; commit 0 ms)
2026-11-08T14:18:07Z [load_day 2025-10-24] 2025-10-24 hour 16: 146875 events in 0 files, snapshot none (task 4139 ms: download 2094 ms overlapping gunzip 514 ms, parse 1731 ms, sort 0 ms, write 0 ms, index 900 ms: 8 candidates, 73423 repo-hours, 635 releases; waiting 650 ms; commit 0 ms)
2026-11-08T14:18:07Z [load_day 2025-10-24] 2025-10-24 hour 17: 146215 events in 0 files, snapshot none (task 3951 ms: download 2392 ms overlapping gunzip 581 ms, parse 1874 ms, sort 0 ms, write 0 ms, index 527 ms: 3 candidates, 68965 repo-hours, 548 releases; waiting 577 ms; commit 0 ms)
2026-11-08T14:18:13Z [load_day 2025-10-24] 2025-10-24 hour 18: 145675 events in 0 files, snapshot none (task 5667 ms: download 4526 ms overlapping gunzip 515 ms, parse 1678 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 72172 repo-hours, 599 releases; waiting 2627 ms; commit 0 ms)
2026-11-08T14:18:13Z [load_day 2025-10-24] 2025-10-24 hour 19: 146704 events in 0 files, snapshot none (task 3110 ms: download 1929 ms overlapping gunzip 505 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 581 ms: 7 candidates, 66911 repo-hours, 523 releases; waiting 277 ms; commit 0 ms)
2026-11-08T14:18:17Z [load_day 2025-10-24] 2025-10-24 hour 20: 145287 events in 0 files, snapshot none (task 3197 ms: download 2289 ms overlapping gunzip 444 ms, parse 1235 ms, sort 0 ms, write 0 ms, index 538 ms: 13 candidates, 69334 repo-hours, 516 releases; waiting 666 ms; commit 0 ms)
2026-11-08T14:18:17Z [load_day 2025-10-24] 2025-10-24 hour 21: 142541 events in 0 files, snapshot none (task 3330 ms: download 2208 ms overlapping gunzip 406 ms, parse 1275 ms, sort 0 ms, write 0 ms, index 448 ms: 10 candidates, 64603 repo-hours, 621 releases; waiting 828 ms; commit 0 ms)
2026-11-08T14:18:20Z [load_day 2025-10-24] 2025-10-24 hour 22: 144443 events in 0 files, snapshot none (task 3051 ms: download 2112 ms overlapping gunzip 393 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 434 ms: 8 candidates, 60345 repo-hours, 624 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:18:20Z [load_day 2025-10-24] 2025-10-24 hour 23: 142918 events in 0 files, snapshot none (task 3372 ms: download 2385 ms overlapping gunzip 407 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 429 ms: 3 candidates, 57741 repo-hours, 664 releases; waiting 898 ms; commit 0 ms)
2026-11-08T14:18:28Z [load_day 2025-10-24] 2025-10-24: repo_hour merged from 24 files to 1 (1695062 rows, 7586 ms)
2026-11-08T14:18:31Z [load_day 2025-10-24] 2025-10-24: index committed in 10315 ms (24 + 1 + 24 files)
2026-11-08T14:18:31Z [load_day 2025-10-24] 2025-10-24: 3514107 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:18:31Z [load_day 2025-10-24] attempt 1 succeeded