orcaLog in

Runs · run 4753

load_day 2025-12-25, attempt 1 succeeded

Host
73ccef5e07c2:421390
Started
2026-11-08T14:51:07Z
Ended
2026-11-08T14:52:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
656 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.7 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4753/load_day/2025-12-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:51:07Z [load_day 2025-12-25] attempt 1 started
2026-11-08T14:51:08Z [load_day 2025-12-25] 2025-12-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:51:12Z [load_day 2025-12-25] 2025-12-25 hour 0: 136061 events in 0 files, snapshot none (task 3370 ms: download 2066 ms overlapping gunzip 390 ms, parse 1356 ms, sort 0 ms, write 0 ms, index 544 ms: 5 candidates, 67508 repo-hours, 857 releases; waiting 716 ms; commit 0 ms)
2026-11-08T14:51:12Z [load_day 2025-12-25] 2025-12-25 hour 1: 145534 events in 0 files, snapshot none (task 3495 ms: download 2088 ms overlapping gunzip 391 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 834 ms: 9 candidates, 88550 repo-hours, 664 releases; waiting 702 ms; commit 0 ms)
2026-11-08T14:51:16Z [load_day 2025-12-25] 2025-12-25 hour 2: 133206 events in 0 files, snapshot none (task 3538 ms: download 2129 ms overlapping gunzip 401 ms, parse 1285 ms, sort 0 ms, write 0 ms, index 585 ms: 5 candidates, 70544 repo-hours, 653 releases; waiting 714 ms; commit 0 ms)
2026-11-08T14:51:16Z [load_day 2025-12-25] 2025-12-25 hour 3: 133221 events in 0 files, snapshot none (task 3466 ms: download 1986 ms overlapping gunzip 516 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 469 ms: 5 candidates, 59504 repo-hours, 922 releases; waiting 678 ms; commit 0 ms)
2026-11-08T14:51:20Z [load_day 2025-12-25] 2025-12-25 hour 4: 136656 events in 0 files, snapshot none (task 3961 ms: download 2137 ms overlapping gunzip 484 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 502 ms: 6 candidates, 65110 repo-hours, 1535 releases; waiting 1105 ms; commit 0 ms)
2026-11-08T14:51:20Z [load_day 2025-12-25] 2025-12-25 hour 5: 140995 events in 0 files, snapshot none (task 3310 ms: download 2180 ms overlapping gunzip 406 ms, parse 1236 ms, sort 0 ms, write 0 ms, index 613 ms: 3 candidates, 64597 repo-hours, 528 releases; waiting 718 ms; commit 0 ms)
2026-11-08T14:51:25Z [load_day 2025-12-25] 2025-12-25 hour 6: 142951 events in 0 files, snapshot none (task 3563 ms: download 2151 ms overlapping gunzip 493 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 588 ms: 4 candidates, 72385 repo-hours, 657 releases; waiting 567 ms; commit 0 ms)
2026-11-08T14:51:25Z [load_day 2025-12-25] 2025-12-25 hour 7: 145987 events in 0 files, snapshot none (task 3478 ms: download 2066 ms overlapping gunzip 478 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 557 ms: 5 candidates, 62050 repo-hours, 520 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:51:29Z [load_day 2025-12-25] 2025-12-25 hour 8: 144487 events in 0 files, snapshot none (task 3352 ms: download 1972 ms overlapping gunzip 452 ms, parse 1431 ms, sort 0 ms, write 0 ms, index 672 ms: 6 candidates, 70599 repo-hours, 584 releases; waiting 489 ms; commit 0 ms)
2026-11-08T14:51:29Z [load_day 2025-12-25] 2025-12-25 hour 9: 142137 events in 0 files, snapshot none (task 3275 ms: download 1502 ms overlapping gunzip 437 ms, parse 1363 ms, sort 0 ms, write 0 ms, index 865 ms: 5 candidates, 67648 repo-hours, 576 releases; waiting 390 ms; commit 0 ms)
2026-11-08T14:51:33Z [load_day 2025-12-25] 2025-12-25 hour 10: 147298 events in 0 files, snapshot none (task 3358 ms: download 1785 ms overlapping gunzip 483 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 632 ms: 7 candidates, 69652 repo-hours, 560 releases; waiting 375 ms; commit 0 ms)
2026-11-08T14:51:33Z [load_day 2025-12-25] 2025-12-25 hour 11: 145130 events in 0 files, snapshot none (task 3340 ms: download 2008 ms overlapping gunzip 460 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 488 ms: 2 candidates, 64506 repo-hours, 543 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:51:37Z [load_day 2025-12-25] 2025-12-25 hour 12: 153851 events in 0 files, snapshot none (task 3920 ms: download 2456 ms overlapping gunzip 488 ms, parse 1543 ms, sort 0 ms, write 0 ms, index 624 ms: 6 candidates, 89710 repo-hours, 566 releases; waiting 951 ms; commit 0 ms)
2026-11-08T14:51:37Z [load_day 2025-12-25] 2025-12-25 hour 13: 151642 events in 0 files, snapshot none (task 3402 ms: download 1905 ms overlapping gunzip 487 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 692 ms: 6 candidates, 82247 repo-hours, 542 releases; waiting 431 ms; commit 0 ms)
2026-11-08T14:51:41Z [load_day 2025-12-25] 2025-12-25 hour 14: 147308 events in 0 files, snapshot none (task 3068 ms: download 1864 ms overlapping gunzip 376 ms, parse 1136 ms, sort 0 ms, write 0 ms, index 642 ms: 8 candidates, 70244 repo-hours, 582 releases; waiting 625 ms; commit 0 ms)
2026-11-08T14:51:41Z [load_day 2025-12-25] 2025-12-25 hour 15: 147468 events in 0 files, snapshot none (task 3267 ms: download 2046 ms overlapping gunzip 439 ms, parse 1319 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 71238 repo-hours, 682 releases; waiting 595 ms; commit 0 ms)
2026-11-08T14:51:44Z [load_day 2025-12-25] 2025-12-25 hour 16: 145148 events in 0 files, snapshot none (task 3220 ms: download 2021 ms overlapping gunzip 319 ms, parse 999 ms, sort 0 ms, write 0 ms, index 447 ms: 5 candidates, 65246 repo-hours, 593 releases; waiting 793 ms; commit 0 ms)
2026-11-08T14:51:46Z [load_day 2025-12-25] 2025-12-25 hour 17: 146113 events in 0 files, snapshot none (task 4943 ms: download 3937 ms overlapping gunzip 345 ms, parse 1023 ms, sort 0 ms, write 0 ms, index 528 ms: 4 candidates, 66155 repo-hours, 520 releases; waiting 2710 ms; commit 0 ms)
2026-11-08T14:51:48Z [load_day 2025-12-25] 2025-12-25 hour 18: 145581 events in 0 files, snapshot none (task 2875 ms: download 1827 ms overlapping gunzip 298 ms, parse 945 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 69151 repo-hours, 635 releases; waiting 688 ms; commit 0 ms)
2026-11-08T14:51:50Z [load_day 2025-12-25] 2025-12-25 hour 19: 139466 events in 0 files, snapshot none (task 2947 ms: download 1969 ms overlapping gunzip 293 ms, parse 920 ms, sort 0 ms, write 0 ms, index 459 ms: 2 candidates, 57903 repo-hours, 545 releases; waiting 935 ms; commit 0 ms)
2026-11-08T14:51:51Z [load_day 2025-12-25] 2025-12-25 hour 20: 139711 events in 0 files, snapshot none (task 2650 ms: download 1651 ms overlapping gunzip 327 ms, parse 1013 ms, sort 0 ms, write 0 ms, index 458 ms: 3 candidates, 56945 repo-hours, 611 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:51:53Z [load_day 2025-12-25] 2025-12-25 hour 21: 136510 events in 0 files, snapshot none (task 2824 ms: download 1797 ms overlapping gunzip 329 ms, parse 1014 ms, sort 0 ms, write 0 ms, index 436 ms: 3 candidates, 53294 repo-hours, 751 releases; waiting 717 ms; commit 0 ms)
2026-11-08T14:51:55Z [load_day 2025-12-25] 2025-12-25 hour 22: 133907 events in 0 files, snapshot none (task 3102 ms: download 2288 ms overlapping gunzip 312 ms, parse 993 ms, sort 0 ms, write 0 ms, index 405 ms: 1 candidates, 53905 repo-hours, 864 releases; waiting 1106 ms; commit 0 ms)
2026-11-08T14:51:57Z [load_day 2025-12-25] 2025-12-25 hour 23: 135065 events in 0 files, snapshot none (task 3234 ms: download 2125 ms overlapping gunzip 416 ms, parse 1274 ms, sort 0 ms, write 0 ms, index 431 ms: 0 candidates, 54990 repo-hours, 785 releases; waiting 826 ms; commit 0 ms)
2026-11-08T14:52:04Z [load_day 2025-12-25] 2025-12-25: repo_hour merged from 24 files to 1 (1613681 rows, 7371 ms)
2026-11-08T14:52:08Z [load_day 2025-12-25] 2025-12-25: index committed in 10768 ms (23 + 1 + 24 files)
2026-11-08T14:52:08Z [load_day 2025-12-25] 2025-12-25: 3415433 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:52:08Z [load_day 2025-12-25] attempt 1 succeeded