orcaLog in

Runs · run 4678

load_day 2025-12-04, attempt 1 succeeded

Host
73ccef5e07c2:412311
Started
2026-11-08T14:39:29Z
Ended
2026-11-08T14:40:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
709 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.2 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4678/load_day/2025-12-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:39:29Z [load_day 2025-12-04] attempt 1 started
2026-11-08T14:39:30Z [load_day 2025-12-04] 2025-12-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:39:34Z [load_day 2025-12-04] 2025-12-04 hour 0: 144139 events in 0 files, snapshot none (task 3591 ms: download 1965 ms overlapping gunzip 373 ms, parse 1221 ms, sort 0 ms, write 0 ms, index 1022 ms: 8 candidates, 72598 repo-hours, 737 releases; waiting 678 ms; commit 0 ms)
2026-11-08T14:39:35Z [load_day 2025-12-04] 2025-12-04 hour 1: 151075 events in 0 files, snapshot none (task 4158 ms: download 2597 ms overlapping gunzip 486 ms, parse 1547 ms, sort 0 ms, write 0 ms, index 786 ms: 8 candidates, 89196 repo-hours, 663 releases; waiting 1039 ms; commit 0 ms)
2026-11-08T14:39:39Z [load_day 2025-12-04] 2025-12-04 hour 2: 144487 events in 0 files, snapshot none (task 3974 ms: download 2385 ms overlapping gunzip 397 ms, parse 1345 ms, sort 0 ms, write 0 ms, index 876 ms: 6 candidates, 73119 repo-hours, 612 releases; waiting 1090 ms; commit 0 ms)
2026-11-08T14:39:39Z [load_day 2025-12-04] 2025-12-04 hour 3: 147585 events in 0 files, snapshot none (task 3860 ms: download 2277 ms overlapping gunzip 541 ms, parse 1595 ms, sort 0 ms, write 0 ms, index 609 ms: 5 candidates, 71764 repo-hours, 1206 releases; waiting 803 ms; commit 0 ms)
2026-11-08T14:39:43Z [load_day 2025-12-04] 2025-12-04 hour 4: 145710 events in 0 files, snapshot none (task 3263 ms: download 2111 ms overlapping gunzip 355 ms, parse 1089 ms, sort 0 ms, write 0 ms, index 563 ms: 5 candidates, 68202 repo-hours, 827 releases; waiting 861 ms; commit 0 ms)
2026-11-08T14:39:43Z [load_day 2025-12-04] 2025-12-04 hour 5: 145639 events in 0 files, snapshot none (task 3475 ms: download 2041 ms overlapping gunzip 361 ms, parse 1087 ms, sort 0 ms, write 0 ms, index 734 ms: 6 candidates, 67768 repo-hours, 637 releases; waiting 809 ms; commit 0 ms)
2026-11-08T14:39:51Z [load_day 2025-12-04] 2025-12-04 hour 6: 146275 events in 0 files, snapshot none (task 4575 ms: download 2919 ms overlapping gunzip 367 ms, parse 1129 ms, sort 0 ms, write 0 ms, index 562 ms: 2 candidates, 76001 repo-hours, 671 releases; waiting 2163 ms; commit 0 ms)
2026-11-08T14:39:51Z [load_day 2025-12-04] 2025-12-04 hour 7: 144577 events in 0 files, snapshot none (task 2686 ms: download 1665 ms overlapping gunzip 354 ms, parse 1066 ms, sort 0 ms, write 0 ms, index 576 ms: 6 candidates, 73098 repo-hours, 555 releases; waiting 398 ms; commit 0 ms)
2026-11-08T14:39:55Z [load_day 2025-12-04] 2025-12-04 hour 8: 144374 events in 0 files, snapshot none (task 3300 ms: download 2028 ms overlapping gunzip 424 ms, parse 1257 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 76131 repo-hours, 839 releases; waiting 720 ms; commit 0 ms)
2026-11-08T14:39:55Z [load_day 2025-12-04] 2025-12-04 hour 9: 145683 events in 0 files, snapshot none (task 3134 ms: download 1851 ms overlapping gunzip 401 ms, parse 1229 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 76830 repo-hours, 678 releases; waiting 592 ms; commit 0 ms)
2026-11-08T14:39:59Z [load_day 2025-12-04] 2025-12-04 hour 10: 145611 events in 0 files, snapshot none (task 3971 ms: download 2479 ms overlapping gunzip 456 ms, parse 1409 ms, sort 0 ms, write 0 ms, index 733 ms: 3 candidates, 76401 repo-hours, 673 releases; waiting 792 ms; commit 0 ms)
2026-11-08T14:39:59Z [load_day 2025-12-04] 2025-12-04 hour 11: 145589 events in 0 files, snapshot none (task 3618 ms: download 2410 ms overlapping gunzip 549 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 74768 repo-hours, 677 releases; waiting 665 ms; commit 0 ms)
2026-11-08T14:40:04Z [load_day 2025-12-04] 2025-12-04 hour 12: 161803 events in 0 files, snapshot none (task 4402 ms: download 2384 ms overlapping gunzip 507 ms, parse 1698 ms, sort 0 ms, write 0 ms, index 1130 ms: 7 candidates, 99743 repo-hours, 486 releases; waiting 692 ms; commit 0 ms)
2026-11-08T14:40:04Z [load_day 2025-12-04] 2025-12-04 hour 13: 150371 events in 0 files, snapshot none (task 4534 ms: download 2871 ms overlapping gunzip 508 ms, parse 1462 ms, sort 0 ms, write 0 ms, index 987 ms: 6 candidates, 90668 repo-hours, 496 releases; waiting 1265 ms; commit 0 ms)
2026-11-08T14:40:09Z [load_day 2025-12-04] 2025-12-04 hour 14: 145780 events in 0 files, snapshot none (task 4198 ms: download 2089 ms overlapping gunzip 629 ms, parse 1900 ms, sort 0 ms, write 0 ms, index 941 ms: 9 candidates, 80874 repo-hours, 649 releases; waiting 319 ms; commit 0 ms)
2026-11-08T14:40:09Z [load_day 2025-12-04] 2025-12-04 hour 15: 145045 events in 0 files, snapshot none (task 4322 ms: download 2592 ms overlapping gunzip 545 ms, parse 1856 ms, sort 0 ms, write 0 ms, index 946 ms: 4 candidates, 80583 repo-hours, 798 releases; waiting 610 ms; commit 0 ms)
2026-11-08T14:40:14Z [load_day 2025-12-04] 2025-12-04 hour 16: 146657 events in 0 files, snapshot none (task 4451 ms: download 2635 ms overlapping gunzip 621 ms, parse 1969 ms, sort 0 ms, write 0 ms, index 878 ms: 5 candidates, 80242 repo-hours, 700 releases; waiting 694 ms; commit 0 ms)
2026-11-08T14:40:14Z [load_day 2025-12-04] 2025-12-04 hour 17: 147594 events in 0 files, snapshot none (task 4267 ms: download 2539 ms overlapping gunzip 562 ms, parse 1717 ms, sort 0 ms, write 0 ms, index 1017 ms: 11 candidates, 78700 repo-hours, 567 releases; waiting 629 ms; commit 0 ms)
2026-11-08T14:40:18Z [load_day 2025-12-04] 2025-12-04 hour 18: 150184 events in 0 files, snapshot none (task 4143 ms: download 2746 ms overlapping gunzip 477 ms, parse 1450 ms, sort 0 ms, write 0 ms, index 682 ms: 7 candidates, 83127 repo-hours, 626 releases; waiting 1183 ms; commit 0 ms)
2026-11-08T14:40:18Z [load_day 2025-12-04] 2025-12-04 hour 19: 144293 events in 0 files, snapshot none (task 3755 ms: download 2549 ms overlapping gunzip 443 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 674 ms: 7 candidates, 72347 repo-hours, 646 releases; waiting 810 ms; commit 0 ms)
2026-11-08T14:40:22Z [load_day 2025-12-04] 2025-12-04 hour 20: 146801 events in 0 files, snapshot none (task 3461 ms: download 2068 ms overlapping gunzip 543 ms, parse 1698 ms, sort 0 ms, write 0 ms, index 591 ms: 6 candidates, 72324 repo-hours, 622 releases; waiting 322 ms; commit 0 ms)
2026-11-08T14:40:23Z [load_day 2025-12-04] 2025-12-04 hour 21: 146325 events in 0 files, snapshot none (task 3672 ms: download 2479 ms overlapping gunzip 529 ms, parse 1495 ms, sort 0 ms, write 0 ms, index 591 ms: 10 candidates, 69660 repo-hours, 730 releases; waiting 731 ms; commit 0 ms)
2026-11-08T14:40:27Z [load_day 2025-12-04] 2025-12-04 hour 22: 140918 events in 0 files, snapshot none (task 3702 ms: download 2453 ms overlapping gunzip 543 ms, parse 1619 ms, sort 0 ms, write 0 ms, index 588 ms: 8 candidates, 66598 repo-hours, 770 releases; waiting 658 ms; commit 0 ms)
2026-11-08T14:40:27Z [load_day 2025-12-04] 2025-12-04 hour 23: 147326 events in 0 files, snapshot none (task 3631 ms: download 2376 ms overlapping gunzip 513 ms, parse 1660 ms, sort 0 ms, write 0 ms, index 545 ms: 10 candidates, 66241 repo-hours, 791 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:40:35Z [load_day 2025-12-04] 2025-12-04: repo_hour merged from 24 files to 1 (1836983 rows, 8106 ms)
2026-11-08T14:40:41Z [load_day 2025-12-04] 2025-12-04: index committed in 14538 ms (24 + 1 + 24 files)
2026-11-08T14:40:41Z [load_day 2025-12-04] 2025-12-04: 3523841 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:40:41Z [load_day 2025-12-04] attempt 1 succeeded