orcaLog in

Runs · run 4509

load_day 2025-10-16, attempt 1 succeeded

Host
73ccef5e07c2:393648
Started
2026-11-08T14:13:22Z
Ended
2026-11-08T14:14:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
675 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
70.6 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4509/load_day/2025-10-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:13:22Z [load_day 2025-10-16] attempt 1 started
2026-11-08T14:13:23Z [load_day 2025-10-16] 2025-10-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:13:27Z [load_day 2025-10-16] 2025-10-16 hour 0: 140598 events in 0 files, snapshot none (task 3732 ms: download 2325 ms overlapping gunzip 423 ms, parse 1326 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 73373 repo-hours, 762 releases; waiting 950 ms; commit 0 ms)
2026-11-08T14:13:27Z [load_day 2025-10-16] 2025-10-16 hour 1: 153779 events in 0 files, snapshot none (task 3237 ms: download 1546 ms overlapping gunzip 351 ms, parse 1102 ms, sort 0 ms, write 0 ms, index 1040 ms: 4 candidates, 91977 repo-hours, 687 releases; waiting 311 ms; commit 0 ms)
2026-11-08T14:13:32Z [load_day 2025-10-16] 2025-10-16 hour 2: 140829 events in 0 files, snapshot none (task 4078 ms: download 2227 ms overlapping gunzip 581 ms, parse 1664 ms, sort 0 ms, write 0 ms, index 744 ms: 1 candidates, 67885 repo-hours, 574 releases; waiting 588 ms; commit 0 ms)
2026-11-08T14:13:32Z [load_day 2025-10-16] 2025-10-16 hour 3: 143245 events in 0 files, snapshot none (task 3800 ms: download 2616 ms overlapping gunzip 518 ms, parse 1671 ms, sort 0 ms, write 0 ms, index 611 ms: 3 candidates, 66411 repo-hours, 1482 releases; waiting 741 ms; commit 0 ms)
2026-11-08T14:13:36Z [load_day 2025-10-16] 2025-10-16 hour 4: 141991 events in 0 files, snapshot none (task 4017 ms: download 2798 ms overlapping gunzip 434 ms, parse 1452 ms, sort 0 ms, write 0 ms, index 454 ms: 4 candidates, 62013 repo-hours, 481 releases; waiting 1039 ms; commit 0 ms)
2026-11-08T14:13:36Z [load_day 2025-10-16] 2025-10-16 hour 5: 143480 events in 0 files, snapshot none (task 3661 ms: download 1930 ms overlapping gunzip 441 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 649 ms: 4 candidates, 65371 repo-hours, 714 releases; waiting 528 ms; commit 0 ms)
2026-11-08T14:13:40Z [load_day 2025-10-16] 2025-10-16 hour 6: 148576 events in 0 files, snapshot none (task 3370 ms: download 1926 ms overlapping gunzip 529 ms, parse 1593 ms, sort 0 ms, write 0 ms, index 679 ms: 1 candidates, 76212 repo-hours, 565 releases; waiting 288 ms; commit 0 ms)
2026-11-08T14:13:41Z [load_day 2025-10-16] 2025-10-16 hour 7: 141870 events in 0 files, snapshot none (task 3668 ms: download 2109 ms overlapping gunzip 535 ms, parse 1650 ms, sort 0 ms, write 0 ms, index 564 ms: 7 candidates, 68995 repo-hours, 566 releases; waiting 575 ms; commit 0 ms)
2026-11-08T14:13:44Z [load_day 2025-10-16] 2025-10-16 hour 8: 142874 events in 0 files, snapshot none (task 3474 ms: download 2016 ms overlapping gunzip 532 ms, parse 1679 ms, sort 0 ms, write 0 ms, index 573 ms: 2 candidates, 73947 repo-hours, 632 releases; waiting 471 ms; commit 0 ms)
2026-11-08T14:13:44Z [load_day 2025-10-16] 2025-10-16 hour 9: 144508 events in 0 files, snapshot none (task 3411 ms: download 2178 ms overlapping gunzip 480 ms, parse 1369 ms, sort 0 ms, write 0 ms, index 646 ms: 7 candidates, 76239 repo-hours, 668 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:13:48Z [load_day 2025-10-16] 2025-10-16 hour 10: 144287 events in 0 files, snapshot none (task 2999 ms: download 1455 ms overlapping gunzip 439 ms, parse 1341 ms, sort 0 ms, write 0 ms, index 639 ms: 6 candidates, 73005 repo-hours, 629 releases; waiting 297 ms; commit 0 ms)
2026-11-08T14:13:49Z [load_day 2025-10-16] 2025-10-16 hour 11: 146030 events in 0 files, snapshot none (task 3424 ms: download 2218 ms overlapping gunzip 435 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 566 ms: 8 candidates, 71816 repo-hours, 616 releases; waiting 851 ms; commit 0 ms)
2026-11-08T14:13:51Z [load_day 2025-10-16] 2025-10-16 hour 12: 155165 events in 0 files, snapshot none (task 3047 ms: download 1705 ms overlapping gunzip 332 ms, parse 1067 ms, sort 0 ms, write 0 ms, index 674 ms: 4 candidates, 94553 repo-hours, 456 releases; waiting 668 ms; commit 0 ms)
2026-11-08T14:13:53Z [load_day 2025-10-16] 2025-10-16 hour 13: 148197 events in 0 files, snapshot none (task 3911 ms: download 2216 ms overlapping gunzip 350 ms, parse 1140 ms, sort 0 ms, write 0 ms, index 669 ms: 4 candidates, 85334 repo-hours, 478 releases; waiting 1396 ms; commit 0 ms)
2026-11-08T14:13:55Z [load_day 2025-10-16] 2025-10-16 hour 14: 143988 events in 0 files, snapshot none (task 3466 ms: download 2210 ms overlapping gunzip 391 ms, parse 1182 ms, sort 0 ms, write 0 ms, index 772 ms: 5 candidates, 76625 repo-hours, 559 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:13:57Z [load_day 2025-10-16] 2025-10-16 hour 15: 146626 events in 0 files, snapshot none (task 3364 ms: download 2291 ms overlapping gunzip 438 ms, parse 1374 ms, sort 0 ms, write 0 ms, index 611 ms: 6 candidates, 75943 repo-hours, 540 releases; waiting 636 ms; commit 0 ms)
2026-11-08T14:13:59Z [load_day 2025-10-16] 2025-10-16 hour 16: 147925 events in 0 files, snapshot none (task 3414 ms: download 2252 ms overlapping gunzip 413 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 781 ms: 5 candidates, 75894 repo-hours, 594 releases; waiting 735 ms; commit 0 ms)
2026-11-08T14:14:01Z [load_day 2025-10-16] 2025-10-16 hour 17: 149901 events in 0 files, snapshot none (task 3393 ms: download 2326 ms overlapping gunzip 433 ms, parse 1372 ms, sort 0 ms, write 0 ms, index 564 ms: 7 candidates, 73132 repo-hours, 628 releases; waiting 695 ms; commit 0 ms)
2026-11-08T14:14:03Z [load_day 2025-10-16] 2025-10-16 hour 18: 148325 events in 0 files, snapshot none (task 3445 ms: download 2294 ms overlapping gunzip 387 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 687 ms: 6 candidates, 77200 repo-hours, 674 releases; waiting 872 ms; commit 0 ms)
2026-11-08T14:14:05Z [load_day 2025-10-16] 2025-10-16 hour 19: 147780 events in 0 files, snapshot none (task 4083 ms: download 2242 ms overlapping gunzip 374 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 1289 ms: 2 candidates, 69140 repo-hours, 628 releases; waiting 890 ms; commit 0 ms)
2026-11-08T14:14:09Z [load_day 2025-10-16] 2025-10-16 hour 20: 146036 events in 0 files, snapshot none (task 3188 ms: download 2084 ms overlapping gunzip 371 ms, parse 1129 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 69178 repo-hours, 596 releases; waiting 752 ms; commit 0 ms)
2026-11-08T14:14:10Z [load_day 2025-10-16] 2025-10-16 hour 21: 139410 events in 0 files, snapshot none (task 4145 ms: download 2690 ms overlapping gunzip 378 ms, parse 1169 ms, sort 0 ms, write 0 ms, index 433 ms: 1 candidates, 62437 repo-hours, 645 releases; waiting 1824 ms; commit 0 ms)
2026-11-08T14:14:13Z [load_day 2025-10-16] 2025-10-16 hour 22: 140947 events in 0 files, snapshot none (task 2842 ms: download 1988 ms overlapping gunzip 328 ms, parse 1041 ms, sort 0 ms, write 0 ms, index 449 ms: 4 candidates, 61163 repo-hours, 620 releases; waiting 743 ms; commit 0 ms)
2026-11-08T14:14:14Z [load_day 2025-10-16] 2025-10-16 hour 23: 140859 events in 0 files, snapshot none (task 3150 ms: download 2286 ms overlapping gunzip 340 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 404 ms: 8 candidates, 58396 repo-hours, 582 releases; waiting 977 ms; commit 0 ms)
2026-11-08T14:14:22Z [load_day 2025-10-16] 2025-10-16: repo_hour merged from 24 files to 1 (1746239 rows, 7934 ms)
2026-11-08T14:14:25Z [load_day 2025-10-16] 2025-10-16: index committed in 11003 ms (24 + 1 + 24 files)
2026-11-08T14:14:25Z [load_day 2025-10-16] 2025-10-16: 3487226 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:14:25Z [load_day 2025-10-16] attempt 1 succeeded