orcaLog in

Runs · run 4759

load_day 2025-12-27, attempt 1 succeeded

Host
73ccef5e07c2:422028
Started
2026-11-08T14:52:08Z
Ended
2026-11-08T14:53:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
654 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
65.0 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4759/load_day/2025-12-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:52:08Z [load_day 2025-12-27] attempt 1 started
2026-11-08T14:52:09Z [load_day 2025-12-27] 2025-12-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:52:13Z [load_day 2025-12-27] 2025-12-27 hour 0: 140724 events in 0 files, snapshot none (task 3493 ms: download 2199 ms overlapping gunzip 492 ms, parse 1506 ms, sort 0 ms, write 0 ms, index 631 ms: 7 candidates, 69227 repo-hours, 845 releases; waiting 499 ms; commit 0 ms)
2026-11-08T14:52:14Z [load_day 2025-12-27] 2025-12-27 hour 1: 149455 events in 0 files, snapshot none (task 3812 ms: download 2144 ms overlapping gunzip 552 ms, parse 1821 ms, sort 0 ms, write 0 ms, index 679 ms: 5 candidates, 87024 repo-hours, 688 releases; waiting 490 ms; commit 0 ms)
2026-11-08T14:52:18Z [load_day 2025-12-27] 2025-12-27 hour 2: 139604 events in 0 files, snapshot none (task 3855 ms: download 1996 ms overlapping gunzip 544 ms, parse 1826 ms, sort 0 ms, write 0 ms, index 595 ms: 6 candidates, 67412 repo-hours, 701 releases; waiting 579 ms; commit 0 ms)
2026-11-08T14:52:18Z [load_day 2025-12-27] 2025-12-27 hour 3: 135952 events in 0 files, snapshot none (task 3491 ms: download 1952 ms overlapping gunzip 536 ms, parse 1574 ms, sort 0 ms, write 0 ms, index 519 ms: 5 candidates, 63157 repo-hours, 917 releases; waiting 508 ms; commit 0 ms)
2026-11-08T14:52:21Z [load_day 2025-12-27] 2025-12-27 hour 4: 137857 events in 0 files, snapshot none (task 3310 ms: download 2226 ms overlapping gunzip 469 ms, parse 1436 ms, sort 0 ms, write 0 ms, index 472 ms: 0 candidates, 59223 repo-hours, 1277 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:52:21Z [load_day 2025-12-27] 2025-12-27 hour 5: 143626 events in 0 files, snapshot none (task 3126 ms: download 1297 ms overlapping gunzip 405 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 891 ms: 2 candidates, 62624 repo-hours, 556 releases; waiting 264 ms; commit 0 ms)
2026-11-08T14:52:26Z [load_day 2025-12-27] 2025-12-27 hour 6: 146500 events in 0 files, snapshot none (task 3732 ms: download 1986 ms overlapping gunzip 493 ms, parse 1445 ms, sort 0 ms, write 0 ms, index 714 ms: 3 candidates, 71121 repo-hours, 677 releases; waiting 566 ms; commit 0 ms)
2026-11-08T14:52:26Z [load_day 2025-12-27] 2025-12-27 hour 7: 145107 events in 0 files, snapshot none (task 3687 ms: download 2109 ms overlapping gunzip 457 ms, parse 1536 ms, sort 0 ms, write 0 ms, index 646 ms: 7 candidates, 62981 repo-hours, 584 releases; waiting 711 ms; commit 0 ms)
2026-11-08T14:52:30Z [load_day 2025-12-27] 2025-12-27 hour 8: 141696 events in 0 files, snapshot none (task 4162 ms: download 2768 ms overlapping gunzip 554 ms, parse 1578 ms, sort 0 ms, write 0 ms, index 515 ms: 4 candidates, 63264 repo-hours, 607 releases; waiting 1155 ms; commit 0 ms)
2026-11-08T14:52:30Z [load_day 2025-12-27] 2025-12-27 hour 9: 144388 events in 0 files, snapshot none (task 3687 ms: download 2690 ms overlapping gunzip 485 ms, parse 1542 ms, sort 0 ms, write 0 ms, index 542 ms: 8 candidates, 65456 repo-hours, 699 releases; waiting 729 ms; commit 0 ms)
2026-11-08T14:52:34Z [load_day 2025-12-27] 2025-12-27 hour 10: 147876 events in 0 files, snapshot none (task 3696 ms: download 2396 ms overlapping gunzip 484 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 582 ms: 3 candidates, 68655 repo-hours, 749 releases; waiting 760 ms; commit 0 ms)
2026-11-08T14:52:34Z [load_day 2025-12-27] 2025-12-27 hour 11: 144365 events in 0 files, snapshot none (task 3537 ms: download 2204 ms overlapping gunzip 521 ms, parse 1520 ms, sort 0 ms, write 0 ms, index 576 ms: 5 candidates, 64701 repo-hours, 693 releases; waiting 558 ms; commit 0 ms)
2026-11-08T14:52:38Z [load_day 2025-12-27] 2025-12-27 hour 12: 157304 events in 0 files, snapshot none (task 3620 ms: download 2100 ms overlapping gunzip 402 ms, parse 1349 ms, sort 0 ms, write 0 ms, index 868 ms: 4 candidates, 92056 repo-hours, 726 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:52:38Z [load_day 2025-12-27] 2025-12-27 hour 13: 152238 events in 0 files, snapshot none (task 3368 ms: download 2066 ms overlapping gunzip 394 ms, parse 1312 ms, sort 0 ms, write 0 ms, index 691 ms: 4 candidates, 79123 repo-hours, 744 releases; waiting 657 ms; commit 0 ms)
2026-11-08T14:52:42Z [load_day 2025-12-27] 2025-12-27 hour 14: 147853 events in 0 files, snapshot none (task 3180 ms: download 1974 ms overlapping gunzip 416 ms, parse 1198 ms, sort 0 ms, write 0 ms, index 674 ms: 2 candidates, 66224 repo-hours, 920 releases; waiting 613 ms; commit 0 ms)
2026-11-08T14:52:43Z [load_day 2025-12-27] 2025-12-27 hour 15: 150265 events in 0 files, snapshot none (task 4166 ms: download 2680 ms overlapping gunzip 419 ms, parse 1337 ms, sort 0 ms, write 0 ms, index 544 ms: 3 candidates, 68144 repo-hours, 702 releases; waiting 1549 ms; commit 0 ms)
2026-11-08T14:52:47Z [load_day 2025-12-27] 2025-12-27 hour 16: 148190 events in 0 files, snapshot none (task 4208 ms: download 3146 ms overlapping gunzip 374 ms, parse 1165 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 68563 repo-hours, 694 releases; waiting 1727 ms; commit 0 ms)
2026-11-08T14:52:47Z [load_day 2025-12-27] 2025-12-27 hour 17: 147717 events in 0 files, snapshot none (task 3398 ms: download 2416 ms overlapping gunzip 371 ms, parse 1120 ms, sort 0 ms, write 0 ms, index 575 ms: 3 candidates, 65911 repo-hours, 705 releases; waiting 1036 ms; commit 0 ms)
2026-11-08T14:52:50Z [load_day 2025-12-27] 2025-12-27 hour 18: 146696 events in 0 files, snapshot none (task 2818 ms: download 1404 ms overlapping gunzip 337 ms, parse 1111 ms, sort 0 ms, write 0 ms, index 603 ms: 3 candidates, 70106 repo-hours, 942 releases; waiting 473 ms; commit 0 ms)
2026-11-08T14:52:50Z [load_day 2025-12-27] 2025-12-27 hour 19: 142222 events in 0 files, snapshot none (task 2780 ms: download 1856 ms overlapping gunzip 330 ms, parse 1071 ms, sort 0 ms, write 0 ms, index 453 ms: 6 candidates, 58264 repo-hours, 870 releases; waiting 633 ms; commit 0 ms)
2026-11-08T14:52:53Z [load_day 2025-12-27] 2025-12-27 hour 20: 142072 events in 0 files, snapshot none (task 3066 ms: download 1763 ms overlapping gunzip 354 ms, parse 1166 ms, sort 0 ms, write 0 ms, index 490 ms: 5 candidates, 59731 repo-hours, 959 releases; waiting 702 ms; commit 0 ms)
2026-11-08T14:52:53Z [load_day 2025-12-27] 2025-12-27 hour 21: 139405 events in 0 files, snapshot none (task 2632 ms: download 1520 ms overlapping gunzip 305 ms, parse 1006 ms, sort 0 ms, write 0 ms, index 478 ms: 2 candidates, 57089 repo-hours, 757 releases; waiting 370 ms; commit 0 ms)
2026-11-08T14:52:57Z [load_day 2025-12-27] 2025-12-27 hour 22: 139163 events in 0 files, snapshot none (task 3612 ms: download 2025 ms overlapping gunzip 555 ms, parse 1635 ms, sort 0 ms, write 0 ms, index 514 ms: 3 candidates, 55147 repo-hours, 921 releases; waiting 623 ms; commit 0 ms)
2026-11-08T14:52:57Z [load_day 2025-12-27] 2025-12-27 hour 23: 137484 events in 0 files, snapshot none (task 3512 ms: download 1770 ms overlapping gunzip 486 ms, parse 1525 ms, sort 0 ms, write 0 ms, index 700 ms: 4 candidates, 53672 repo-hours, 870 releases; waiting 522 ms; commit 0 ms)
2026-11-08T14:53:04Z [load_day 2025-12-27] 2025-12-27: repo_hour merged from 24 files to 1 (1598875 rows, 6990 ms)
2026-11-08T14:53:08Z [load_day 2025-12-27] 2025-12-27: index committed in 10343 ms (23 + 1 + 24 files)
2026-11-08T14:53:08Z [load_day 2025-12-27] 2025-12-27: 3467759 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:53:08Z [load_day 2025-12-27] attempt 1 succeeded