orcaLog in

Runs · run 4617

load_day 2025-11-15, attempt 1 succeeded

Host
73ccef5e07c2:404893
Started
2026-11-08T14:29:01Z
Ended
2026-11-08T14:29:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
664 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
63.5 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4617/load_day/2025-11-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:29:01Z [load_day 2025-11-15] attempt 1 started
2026-11-08T14:29:02Z [load_day 2025-11-15] 2025-11-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:29:06Z [load_day 2025-11-15] 2025-11-15 hour 0: 143140 events in 0 files, snapshot none (task 3387 ms: download 2062 ms overlapping gunzip 414 ms, parse 1303 ms, sort 0 ms, write 0 ms, index 686 ms: 5 candidates, 70342 repo-hours, 822 releases; waiting 594 ms; commit 0 ms)
2026-11-08T14:29:06Z [load_day 2025-11-15] 2025-11-15 hour 1: 149284 events in 0 files, snapshot none (task 3259 ms: download 1822 ms overlapping gunzip 323 ms, parse 1112 ms, sort 0 ms, write 0 ms, index 825 ms: 8 candidates, 90030 repo-hours, 716 releases; waiting 705 ms; commit 0 ms)
2026-11-08T14:29:09Z [load_day 2025-11-15] 2025-11-15 hour 2: 134768 events in 0 files, snapshot none (task 2571 ms: download 1409 ms overlapping gunzip 394 ms, parse 1226 ms, sort 0 ms, write 0 ms, index 471 ms: 8 candidates, 62751 repo-hours, 594 releases; waiting 179 ms; commit 0 ms)
2026-11-08T14:29:09Z [load_day 2025-11-15] 2025-11-15 hour 3: 138640 events in 0 files, snapshot none (task 2396 ms: download 1280 ms overlapping gunzip 339 ms, parse 1105 ms, sort 0 ms, write 0 ms, index 461 ms: 4 candidates, 65521 repo-hours, 1600 releases; waiting 230 ms; commit 0 ms)
2026-11-08T14:29:13Z [load_day 2025-11-15] 2025-11-15 hour 4: 139996 events in 0 files, snapshot none (task 2949 ms: download 2013 ms overlapping gunzip 372 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 497 ms: 9 candidates, 60345 repo-hours, 487 releases; waiting 646 ms; commit 0 ms)
2026-11-08T14:29:13Z [load_day 2025-11-15] 2025-11-15 hour 5: 139324 events in 0 files, snapshot none (task 2938 ms: download 1923 ms overlapping gunzip 410 ms, parse 1337 ms, sort 0 ms, write 0 ms, index 406 ms: 4 candidates, 58358 repo-hours, 509 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:29:17Z [load_day 2025-11-15] 2025-11-15 hour 6: 142701 events in 0 files, snapshot none (task 3549 ms: download 1971 ms overlapping gunzip 359 ms, parse 1110 ms, sort 0 ms, write 0 ms, index 1028 ms: 9 candidates, 68037 repo-hours, 652 releases; waiting 707 ms; commit 0 ms)
2026-11-08T14:29:17Z [load_day 2025-11-15] 2025-11-15 hour 7: 143872 events in 0 files, snapshot none (task 3506 ms: download 2200 ms overlapping gunzip 378 ms, parse 1143 ms, sort 0 ms, write 0 ms, index 717 ms: 4 candidates, 61838 repo-hours, 580 releases; waiting 901 ms; commit 0 ms)
2026-11-08T14:29:20Z [load_day 2025-11-15] 2025-11-15 hour 8: 145603 events in 0 files, snapshot none (task 3171 ms: download 1880 ms overlapping gunzip 445 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 65713 repo-hours, 564 releases; waiting 566 ms; commit 0 ms)
2026-11-08T14:29:21Z [load_day 2025-11-15] 2025-11-15 hour 9: 141583 events in 0 files, snapshot none (task 3080 ms: download 2013 ms overlapping gunzip 397 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 538 ms: 2 candidates, 62966 repo-hours, 577 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:29:25Z [load_day 2025-11-15] 2025-11-15 hour 10: 149140 events in 0 files, snapshot none (task 3443 ms: download 823 ms overlapping gunzip 648 ms, parse 1966 ms, sort 0 ms, write 0 ms, index 608 ms: 2 candidates, 67959 repo-hours, 526 releases; waiting 13 ms; commit 0 ms)
2026-11-08T14:29:25Z [load_day 2025-11-15] 2025-11-15 hour 11: 146171 events in 0 files, snapshot none (task 3336 ms: download 2096 ms overlapping gunzip 512 ms, parse 1691 ms, sort 0 ms, write 0 ms, index 495 ms: 5 candidates, 64522 repo-hours, 464 releases; waiting 356 ms; commit 0 ms)
2026-11-08T14:29:29Z [load_day 2025-11-15] 2025-11-15 hour 12: 157410 events in 0 files, snapshot none (task 3512 ms: download 917 ms overlapping gunzip 567 ms, parse 1800 ms, sort 0 ms, write 0 ms, index 908 ms: 3 candidates, 91487 repo-hours, 521 releases; waiting 20 ms; commit 0 ms)
2026-11-08T14:29:29Z [load_day 2025-11-15] 2025-11-15 hour 13: 151607 events in 0 files, snapshot none (task 3231 ms: download 539 ms overlapping gunzip 455 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 964 ms: 3 candidates, 81690 repo-hours, 449 releases; waiting 18 ms; commit 0 ms)
2026-11-08T14:29:32Z [load_day 2025-11-15] 2025-11-15 hour 14: 150630 events in 0 files, snapshot none (task 2809 ms: download 1563 ms overlapping gunzip 357 ms, parse 1103 ms, sort 0 ms, write 0 ms, index 739 ms: 4 candidates, 70075 repo-hours, 558 releases; waiting 200 ms; commit 0 ms)
2026-11-08T14:29:32Z [load_day 2025-11-15] 2025-11-15 hour 15: 149917 events in 0 files, snapshot none (task 2741 ms: download 557 ms overlapping gunzip 377 ms, parse 1195 ms, sort 0 ms, write 0 ms, index 932 ms: 6 candidates, 71763 repo-hours, 618 releases; waiting 13 ms; commit 0 ms)
2026-11-08T14:29:35Z [load_day 2025-11-15] 2025-11-15 hour 16: 147340 events in 0 files, snapshot none (task 2610 ms: download 795 ms overlapping gunzip 417 ms, parse 1219 ms, sort 0 ms, write 0 ms, index 734 ms: 4 candidates, 71565 repo-hours, 617 releases; waiting 22 ms; commit 0 ms)
2026-11-08T14:29:35Z [load_day 2025-11-15] 2025-11-15 hour 17: 150631 events in 0 files, snapshot none (task 2487 ms: download 763 ms overlapping gunzip 411 ms, parse 1226 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 69831 repo-hours, 553 releases; waiting 16 ms; commit 0 ms)
2026-11-08T14:29:38Z [load_day 2025-11-15] 2025-11-15 hour 18: 148966 events in 0 files, snapshot none (task 2681 ms: download 703 ms overlapping gunzip 445 ms, parse 1431 ms, sort 0 ms, write 0 ms, index 559 ms: 5 candidates, 75160 repo-hours, 620 releases; waiting 21 ms; commit 0 ms)
2026-11-08T14:29:38Z [load_day 2025-11-15] 2025-11-15 hour 19: 143611 events in 0 files, snapshot none (task 2613 ms: download 1034 ms overlapping gunzip 437 ms, parse 1463 ms, sort 0 ms, write 0 ms, index 485 ms: 6 candidates, 62462 repo-hours, 523 releases; waiting 14 ms; commit 0 ms)
2026-11-08T14:29:41Z [load_day 2025-11-15] 2025-11-15 hour 20: 144304 events in 0 files, snapshot none (task 2337 ms: download 796 ms overlapping gunzip 365 ms, parse 1187 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 63106 repo-hours, 520 releases; waiting 15 ms; commit 0 ms)
2026-11-08T14:29:41Z [load_day 2025-11-15] 2025-11-15 hour 21: 141538 events in 0 files, snapshot none (task 2399 ms: download 759 ms overlapping gunzip 384 ms, parse 1215 ms, sort 0 ms, write 0 ms, index 555 ms: 7 candidates, 61280 repo-hours, 575 releases; waiting 21 ms; commit 0 ms)
2026-11-08T14:29:44Z [load_day 2025-11-15] 2025-11-15 hour 22: 140145 events in 0 files, snapshot none (task 2308 ms: download 733 ms overlapping gunzip 387 ms, parse 1173 ms, sort 0 ms, write 0 ms, index 550 ms: 9 candidates, 60841 repo-hours, 769 releases; waiting 14 ms; commit 0 ms)
2026-11-08T14:29:44Z [load_day 2025-11-15] 2025-11-15 hour 23: 139680 events in 0 files, snapshot none (task 2147 ms: download 678 ms overlapping gunzip 345 ms, parse 1161 ms, sort 0 ms, write 0 ms, index 426 ms: 3 candidates, 59432 repo-hours, 758 releases; waiting 20 ms; commit 0 ms)
2026-11-08T14:29:51Z [load_day 2025-11-15] 2025-11-15: repo_hour merged from 24 files to 1 (1637074 rows, 7060 ms)
2026-11-08T14:29:54Z [load_day 2025-11-15] 2025-11-15: index committed in 10111 ms (24 + 1 + 24 files)
2026-11-08T14:29:54Z [load_day 2025-11-15] 2025-11-15: 3480001 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:29:54Z [load_day 2025-11-15] attempt 1 succeeded