orcaLog in

Runs · run 4676

load_day 2025-12-03, attempt 1 succeeded

Host
73ccef5e07c2:411888
Started
2026-11-08T14:38:49Z
Ended
2026-11-08T14:39:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
789 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.5 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4676/load_day/2025-12-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:38:49Z [load_day 2025-12-03] attempt 1 started
2026-11-08T14:38:50Z [load_day 2025-12-03] 2025-12-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:38:54Z [load_day 2025-12-03] 2025-12-03 hour 0: 149015 events in 0 files, snapshot none (task 4209 ms: download 2860 ms overlapping gunzip 434 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 76882 repo-hours, 774 releases; waiting 1365 ms; commit 0 ms)
2026-11-08T14:38:54Z [load_day 2025-12-03] 2025-12-03 hour 1: 153169 events in 0 files, snapshot none (task 3028 ms: download 1911 ms overlapping gunzip 392 ms, parse 1297 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 91653 repo-hours, 652 releases; waiting 417 ms; commit 0 ms)
2026-11-08T14:38:58Z [load_day 2025-12-03] 2025-12-03 hour 2: 146277 events in 0 files, snapshot none (task 3165 ms: download 1731 ms overlapping gunzip 358 ms, parse 1094 ms, sort 0 ms, write 0 ms, index 814 ms: 9 candidates, 72995 repo-hours, 638 releases; waiting 488 ms; commit 0 ms)
2026-11-08T14:38:58Z [load_day 2025-12-03] 2025-12-03 hour 3: 150481 events in 0 files, snapshot none (task 3648 ms: download 1722 ms overlapping gunzip 393 ms, parse 1335 ms, sort 0 ms, write 0 ms, index 752 ms: 7 candidates, 74429 repo-hours, 1410 releases; waiting 749 ms; commit 0 ms)
2026-11-08T14:39:03Z [load_day 2025-12-03] 2025-12-03 hour 4: 149439 events in 0 files, snapshot none (task 4407 ms: download 2868 ms overlapping gunzip 450 ms, parse 1464 ms, sort 0 ms, write 0 ms, index 772 ms: 6 candidates, 71629 repo-hours, 670 releases; waiting 1434 ms; commit 0 ms)
2026-11-08T14:39:04Z [load_day 2025-12-03] 2025-12-03 hour 5: 150500 events in 0 files, snapshot none (task 4702 ms: download 3266 ms overlapping gunzip 504 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 573 ms: 8 candidates, 72614 repo-hours, 547 releases; waiting 1784 ms; commit 0 ms)
2026-11-08T14:39:07Z [load_day 2025-12-03] 2025-12-03 hour 6: 151589 events in 0 files, snapshot none (task 3769 ms: download 2556 ms overlapping gunzip 496 ms, parse 1521 ms, sort 0 ms, write 0 ms, index 651 ms: 6 candidates, 80024 repo-hours, 628 releases; waiting 727 ms; commit 0 ms)
2026-11-08T14:39:08Z [load_day 2025-12-03] 2025-12-03 hour 7: 148502 events in 0 files, snapshot none (task 4321 ms: download 3119 ms overlapping gunzip 480 ms, parse 1455 ms, sort 0 ms, write 0 ms, index 584 ms: 4 candidates, 73796 repo-hours, 565 releases; waiting 1430 ms; commit 0 ms)
2026-11-08T14:39:12Z [load_day 2025-12-03] 2025-12-03 hour 8: 143847 events in 0 files, snapshot none (task 3843 ms: download 2038 ms overlapping gunzip 460 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 848 ms: 8 candidates, 75604 repo-hours, 484 releases; waiting 745 ms; commit 0 ms)
2026-11-08T14:39:13Z [load_day 2025-12-03] 2025-12-03 hour 9: 148405 events in 0 files, snapshot none (task 3570 ms: download 2068 ms overlapping gunzip 439 ms, parse 1383 ms, sort 0 ms, write 0 ms, index 647 ms: 8 candidates, 78157 repo-hours, 536 releases; waiting 501 ms; commit 0 ms)
2026-11-08T14:39:16Z [load_day 2025-12-03] 2025-12-03 hour 10: 147904 events in 0 files, snapshot none (task 3712 ms: download 2507 ms overlapping gunzip 466 ms, parse 1476 ms, sort 0 ms, write 0 ms, index 691 ms: 5 candidates, 79175 repo-hours, 490 releases; waiting 764 ms; commit 0 ms)
2026-11-08T14:39:16Z [load_day 2025-12-03] 2025-12-03 hour 11: 151057 events in 0 files, snapshot none (task 3446 ms: download 2063 ms overlapping gunzip 489 ms, parse 1441 ms, sort 0 ms, write 0 ms, index 567 ms: 5 candidates, 77528 repo-hours, 547 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:39:19Z [load_day 2025-12-03] 2025-12-03 hour 12: 154382 events in 0 files, snapshot none (task 2646 ms: download 1187 ms overlapping gunzip 313 ms, parse 1047 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 94699 repo-hours, 342 releases; waiting 266 ms; commit 0 ms)
2026-11-08T14:39:20Z [load_day 2025-12-03] 2025-12-03 hour 13: 151226 events in 0 files, snapshot none (task 3128 ms: download 1961 ms overlapping gunzip 331 ms, parse 1018 ms, sort 0 ms, write 0 ms, index 668 ms: 10 candidates, 89830 repo-hours, 378 releases; waiting 755 ms; commit 0 ms)
2026-11-08T14:39:23Z [load_day 2025-12-03] 2025-12-03 hour 14: 153888 events in 0 files, snapshot none (task 3232 ms: download 1997 ms overlapping gunzip 394 ms, parse 1235 ms, sort 0 ms, write 0 ms, index 683 ms: 10 candidates, 83623 repo-hours, 438 releases; waiting 636 ms; commit 0 ms)
2026-11-08T14:39:24Z [load_day 2025-12-03] 2025-12-03 hour 15: 148943 events in 0 files, snapshot none (task 3088 ms: download 2013 ms overlapping gunzip 387 ms, parse 1206 ms, sort 0 ms, write 0 ms, index 591 ms: 9 candidates, 83654 repo-hours, 491 releases; waiting 601 ms; commit 0 ms)
2026-11-08T14:39:27Z [load_day 2025-12-03] 2025-12-03 hour 16: 148974 events in 0 files, snapshot none (task 3923 ms: download 2730 ms overlapping gunzip 432 ms, parse 1231 ms, sort 0 ms, write 0 ms, index 615 ms: 6 candidates, 81881 repo-hours, 554 releases; waiting 1345 ms; commit 0 ms)
2026-11-08T14:39:28Z [load_day 2025-12-03] 2025-12-03 hour 17: 149275 events in 0 files, snapshot none (task 3738 ms: download 2621 ms overlapping gunzip 448 ms, parse 1326 ms, sort 0 ms, write 0 ms, index 664 ms: 6 candidates, 79773 repo-hours, 528 releases; waiting 913 ms; commit 0 ms)
2026-11-08T14:39:32Z [load_day 2025-12-03] 2025-12-03 hour 18: 149616 events in 0 files, snapshot none (task 3574 ms: download 2090 ms overlapping gunzip 405 ms, parse 1311 ms, sort 0 ms, write 0 ms, index 633 ms: 11 candidates, 82521 repo-hours, 764 releases; waiting 890 ms; commit 0 ms)
2026-11-08T14:39:32Z [load_day 2025-12-03] 2025-12-03 hour 19: 148105 events in 0 files, snapshot none (task 3087 ms: download 2061 ms overlapping gunzip 385 ms, parse 1156 ms, sort 0 ms, write 0 ms, index 540 ms: 9 candidates, 74670 repo-hours, 553 releases; waiting 720 ms; commit 0 ms)
2026-11-08T14:39:36Z [load_day 2025-12-03] 2025-12-03 hour 20: 147987 events in 0 files, snapshot none (task 3386 ms: download 2130 ms overlapping gunzip 510 ms, parse 1496 ms, sort 0 ms, write 0 ms, index 584 ms: 9 candidates, 76175 repo-hours, 546 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:39:36Z [load_day 2025-12-03] 2025-12-03 hour 21: 148736 events in 0 files, snapshot none (task 3304 ms: download 1805 ms overlapping gunzip 535 ms, parse 1650 ms, sort 0 ms, write 0 ms, index 562 ms: 6 candidates, 73019 repo-hours, 649 releases; waiting 240 ms; commit 0 ms)
2026-11-08T14:39:40Z [load_day 2025-12-03] 2025-12-03 hour 22: 142316 events in 0 files, snapshot none (task 3475 ms: download 2042 ms overlapping gunzip 535 ms, parse 1547 ms, sort 0 ms, write 0 ms, index 531 ms: 11 candidates, 69143 repo-hours, 657 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:39:40Z [load_day 2025-12-03] 2025-12-03 hour 23: 147785 events in 0 files, snapshot none (task 3482 ms: download 2326 ms overlapping gunzip 470 ms, parse 1464 ms, sort 0 ms, write 0 ms, index 476 ms: 5 candidates, 64318 repo-hours, 739 releases; waiting 783 ms; commit 0 ms)
2026-11-08T14:39:48Z [load_day 2025-12-03] 2025-12-03: repo_hour merged from 24 files to 1 (1877792 rows, 8065 ms)
2026-11-08T14:39:51Z [load_day 2025-12-03] 2025-12-03: index committed in 11052 ms (24 + 1 + 24 files)
2026-11-08T14:39:51Z [load_day 2025-12-03] 2025-12-03: 3581418 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:39:51Z [load_day 2025-12-03] attempt 1 succeeded