orcaLog in

Runs · run 4573

load_day 2025-11-03, attempt 1 succeeded

Host
73ccef5e07c2:400306
Started
2026-11-08T14:22:47Z
Ended
2026-11-08T14:23:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
699 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.3 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4573/load_day/2025-11-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:22:47Z [load_day 2025-11-03] attempt 1 started
2026-11-08T14:22:48Z [load_day 2025-11-03] 2025-11-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:22:52Z [load_day 2025-11-03] 2025-11-03 hour 0: 142026 events in 0 files, snapshot none (task 3431 ms: download 2364 ms overlapping gunzip 464 ms, parse 1390 ms, sort 0 ms, write 0 ms, index 505 ms: 7 candidates, 69476 repo-hours, 756 releases; waiting 738 ms; commit 0 ms)
2026-11-08T14:22:52Z [load_day 2025-11-03] 2025-11-03 hour 1: 151556 events in 0 files, snapshot none (task 3050 ms: download 1798 ms overlapping gunzip 401 ms, parse 1217 ms, sort 0 ms, write 0 ms, index 640 ms: 6 candidates, 89895 repo-hours, 575 releases; waiting 503 ms; commit 0 ms)
2026-11-08T14:22:56Z [load_day 2025-11-03] 2025-11-03 hour 2: 142872 events in 0 files, snapshot none (task 3457 ms: download 2370 ms overlapping gunzip 489 ms, parse 1420 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 71076 repo-hours, 547 releases; waiting 575 ms; commit 0 ms)
2026-11-08T14:22:56Z [load_day 2025-11-03] 2025-11-03 hour 3: 142928 events in 0 files, snapshot none (task 3136 ms: download 2104 ms overlapping gunzip 408 ms, parse 1296 ms, sort 0 ms, write 0 ms, index 558 ms: 15 candidates, 67634 repo-hours, 1312 releases; waiting 579 ms; commit 0 ms)
2026-11-08T14:23:00Z [load_day 2025-11-03] 2025-11-03 hour 4: 144118 events in 0 files, snapshot none (task 2933 ms: download 2046 ms overlapping gunzip 369 ms, parse 1150 ms, sort 0 ms, write 0 ms, index 473 ms: 20 candidates, 65284 repo-hours, 631 releases; waiting 586 ms; commit 0 ms)
2026-11-08T14:23:00Z [load_day 2025-11-03] 2025-11-03 hour 5: 143133 events in 0 files, snapshot none (task 3734 ms: download 2833 ms overlapping gunzip 398 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 547 ms: 2 candidates, 66265 repo-hours, 470 releases; waiting 1202 ms; commit 0 ms)
2026-11-08T14:23:03Z [load_day 2025-11-03] 2025-11-03 hour 6: 147039 events in 0 files, snapshot none (task 2928 ms: download 1771 ms overlapping gunzip 383 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 665 ms: 3 candidates, 75355 repo-hours, 547 releases; waiting 415 ms; commit 0 ms)
2026-11-08T14:23:04Z [load_day 2025-11-03] 2025-11-03 hour 7: 145795 events in 0 files, snapshot none (task 3274 ms: download 2233 ms overlapping gunzip 425 ms, parse 1268 ms, sort 0 ms, write 0 ms, index 568 ms: 6 candidates, 69282 repo-hours, 489 releases; waiting 668 ms; commit 0 ms)
2026-11-08T14:23:07Z [load_day 2025-11-03] 2025-11-03 hour 8: 144354 events in 0 files, snapshot none (task 3406 ms: download 2356 ms overlapping gunzip 444 ms, parse 1395 ms, sort 0 ms, write 0 ms, index 567 ms: 10 candidates, 73469 repo-hours, 602 releases; waiting 688 ms; commit 0 ms)
2026-11-08T14:23:08Z [load_day 2025-11-03] 2025-11-03 hour 9: 141363 events in 0 files, snapshot none (task 2950 ms: download 1725 ms overlapping gunzip 411 ms, parse 1234 ms, sort 0 ms, write 0 ms, index 585 ms: 4 candidates, 74225 repo-hours, 688 releases; waiting 282 ms; commit 0 ms)
2026-11-08T14:23:12Z [load_day 2025-11-03] 2025-11-03 hour 10: 146587 events in 0 files, snapshot none (task 3882 ms: download 2625 ms overlapping gunzip 431 ms, parse 1389 ms, sort 0 ms, write 0 ms, index 644 ms: 6 candidates, 75332 repo-hours, 560 releases; waiting 1088 ms; commit 0 ms)
2026-11-08T14:23:12Z [load_day 2025-11-03] 2025-11-03 hour 11: 145056 events in 0 files, snapshot none (task 3462 ms: download 2318 ms overlapping gunzip 405 ms, parse 1231 ms, sort 0 ms, write 0 ms, index 611 ms: 6 candidates, 72457 repo-hours, 584 releases; waiting 861 ms; commit 0 ms)
2026-11-08T14:23:16Z [load_day 2025-11-03] 2025-11-03 hour 12: 159464 events in 0 files, snapshot none (task 3142 ms: download 1731 ms overlapping gunzip 375 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 726 ms: 5 candidates, 97171 repo-hours, 450 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:23:16Z [load_day 2025-11-03] 2025-11-03 hour 13: 153829 events in 0 files, snapshot none (task 3186 ms: download 1846 ms overlapping gunzip 396 ms, parse 1218 ms, sort 0 ms, write 0 ms, index 706 ms: 5 candidates, 89467 repo-hours, 435 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:23:20Z [load_day 2025-11-03] 2025-11-03 hour 14: 144638 events in 0 files, snapshot none (task 3400 ms: download 2040 ms overlapping gunzip 422 ms, parse 1274 ms, sort 0 ms, write 0 ms, index 614 ms: 8 candidates, 78561 repo-hours, 552 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:23:20Z [load_day 2025-11-03] 2025-11-03 hour 15: 149781 events in 0 files, snapshot none (task 3836 ms: download 2683 ms overlapping gunzip 413 ms, parse 1263 ms, sort 0 ms, write 0 ms, index 685 ms: 9 candidates, 79797 repo-hours, 563 releases; waiting 1240 ms; commit 0 ms)
2026-11-08T14:23:24Z [load_day 2025-11-03] 2025-11-03 hour 16: 145277 events in 0 files, snapshot none (task 3728 ms: download 2618 ms overlapping gunzip 393 ms, parse 1153 ms, sort 0 ms, write 0 ms, index 654 ms: 3 candidates, 77877 repo-hours, 462 releases; waiting 1116 ms; commit 0 ms)
2026-11-08T14:23:25Z [load_day 2025-11-03] 2025-11-03 hour 17: 147666 events in 0 files, snapshot none (task 3652 ms: download 2341 ms overlapping gunzip 408 ms, parse 1294 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 76193 repo-hours, 543 releases; waiting 955 ms; commit 0 ms)
2026-11-08T14:23:28Z [load_day 2025-11-03] 2025-11-03 hour 18: 154280 events in 0 files, snapshot none (task 3770 ms: download 2709 ms overlapping gunzip 418 ms, parse 1257 ms, sort 0 ms, write 0 ms, index 573 ms: 5 candidates, 81228 repo-hours, 648 releases; waiting 1224 ms; commit 0 ms)
2026-11-08T14:23:29Z [load_day 2025-11-03] 2025-11-03 hour 19: 146098 events in 0 files, snapshot none (task 3490 ms: download 2234 ms overlapping gunzip 397 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 566 ms: 10 candidates, 71762 repo-hours, 563 releases; waiting 853 ms; commit 0 ms)
2026-11-08T14:23:33Z [load_day 2025-11-03] 2025-11-03 hour 20: 144610 events in 0 files, snapshot none (task 4319 ms: download 2694 ms overlapping gunzip 701 ms, parse 2112 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 71025 repo-hours, 547 releases; waiting 576 ms; commit 0 ms)
2026-11-08T14:23:33Z [load_day 2025-11-03] 2025-11-03 hour 21: 145219 events in 0 files, snapshot none (task 4482 ms: download 2896 ms overlapping gunzip 649 ms, parse 1963 ms, sort 0 ms, write 0 ms, index 697 ms: 4 candidates, 69551 repo-hours, 628 releases; waiting 868 ms; commit 0 ms)
2026-11-08T14:23:39Z [load_day 2025-11-03] 2025-11-03 hour 22: 143878 events in 0 files, snapshot none (task 4962 ms: download 2866 ms overlapping gunzip 820 ms, parse 2469 ms, sort 0 ms, write 0 ms, index 782 ms: 5 candidates, 67538 repo-hours, 720 releases; waiting 512 ms; commit 0 ms)
2026-11-08T14:23:39Z [load_day 2025-11-03] 2025-11-03 hour 23: 143632 events in 0 files, snapshot none (task 4913 ms: download 2708 ms overlapping gunzip 874 ms, parse 2643 ms, sort 0 ms, write 0 ms, index 608 ms: 6 candidates, 63341 repo-hours, 693 releases; waiting 330 ms; commit 0 ms)
2026-11-08T14:23:48Z [load_day 2025-11-03] 2025-11-03: repo_hour merged from 24 files to 1 (1793261 rows, 8737 ms)
2026-11-08T14:23:51Z [load_day 2025-11-03] 2025-11-03: index committed in 11572 ms (24 + 1 + 24 files)
2026-11-08T14:23:51Z [load_day 2025-11-03] 2025-11-03: 3515199 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:23:51Z [load_day 2025-11-03] attempt 1 succeeded