orcaLog in

Runs · run 4551

load_day 2025-10-28, attempt 1 succeeded

Host
73ccef5e07c2:397941
Started
2026-11-08T14:19:27Z
Ended
2026-11-08T14:20:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
719 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
66.6 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4551/load_day/2025-10-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:19:27Z [load_day 2025-10-28] attempt 1 started
2026-11-08T14:19:28Z [load_day 2025-10-28] 2025-10-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:19:34Z [load_day 2025-10-28] 2025-10-28 hour 0: 162558 events in 0 files, snapshot none (task 3425 ms: download 1921 ms overlapping gunzip 491 ms, parse 1547 ms, sort 0 ms, write 0 ms, index 548 ms: 2 candidates, 64374 repo-hours, 418 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:19:34Z [load_day 2025-10-28] 2025-10-28 hour 1: 172613 events in 0 files, snapshot none (task 3350 ms: download 2265 ms overlapping gunzip 357 ms, parse 1327 ms, sort 0 ms, write 0 ms, index 662 ms: 5 candidates, 79426 repo-hours, 154 releases; waiting 677 ms; commit 0 ms)
2026-11-08T14:19:37Z [load_day 2025-10-28] 2025-10-28 hour 2: 163068 events in 0 files, snapshot none (task 3436 ms: download 2260 ms overlapping gunzip 380 ms, parse 1398 ms, sort 0 ms, write 0 ms, index 604 ms: 2 candidates, 56640 repo-hours, 274 releases; waiting 776 ms; commit 0 ms)
2026-11-08T14:19:37Z [load_day 2025-10-28] 2025-10-28 hour 3: 162786 events in 0 files, snapshot none (task 3262 ms: download 1959 ms overlapping gunzip 470 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 494 ms: 5 candidates, 57101 repo-hours, 829 releases; waiting 509 ms; commit 0 ms)
2026-11-08T14:19:41Z [load_day 2025-10-28] 2025-10-28 hour 4: 161627 events in 0 files, snapshot none (task 3052 ms: download 2036 ms overlapping gunzip 393 ms, parse 1244 ms, sort 0 ms, write 0 ms, index 542 ms: 5 candidates, 51179 repo-hours, 241 releases; waiting 536 ms; commit 0 ms)
2026-11-08T14:19:41Z [load_day 2025-10-28] 2025-10-28 hour 5: 164478 events in 0 files, snapshot none (task 3339 ms: download 1973 ms overlapping gunzip 493 ms, parse 1514 ms, sort 0 ms, write 0 ms, index 449 ms: 1 candidates, 51929 repo-hours, 285 releases; waiting 534 ms; commit 0 ms)
2026-11-08T14:19:45Z [load_day 2025-10-28] 2025-10-28 hour 6: 168794 events in 0 files, snapshot none (task 3430 ms: download 1901 ms overlapping gunzip 413 ms, parse 1382 ms, sort 0 ms, write 0 ms, index 564 ms: 2 candidates, 59088 repo-hours, 202 releases; waiting 696 ms; commit 0 ms)
2026-11-08T14:19:45Z [load_day 2025-10-28] 2025-10-28 hour 7: 166132 events in 0 files, snapshot none (task 3316 ms: download 2079 ms overlapping gunzip 469 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 429 ms: 4 candidates, 57490 repo-hours, 233 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:19:49Z [load_day 2025-10-28] 2025-10-28 hour 8: 158071 events in 0 files, snapshot none (task 3336 ms: download 2225 ms overlapping gunzip 408 ms, parse 1314 ms, sort 0 ms, write 0 ms, index 554 ms: 1 candidates, 67014 repo-hours, 359 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:19:49Z [load_day 2025-10-28] 2025-10-28 hour 9: 150372 events in 0 files, snapshot none (task 3610 ms: download 2001 ms overlapping gunzip 523 ms, parse 1493 ms, sort 0 ms, write 0 ms, index 720 ms: 1 candidates, 69346 repo-hours, 550 releases; waiting 533 ms; commit 0 ms)
2026-11-08T14:19:58Z [load_day 2025-10-28] 2025-10-28 hour 10: 148757 events in 0 files, snapshot none (task 3451 ms: download 2089 ms overlapping gunzip 405 ms, parse 1350 ms, sort 0 ms, write 0 ms, index 656 ms: 3 candidates, 68659 repo-hours, 577 releases; waiting 739 ms; commit 0 ms)
2026-11-08T14:19:58Z [load_day 2025-10-28] 2025-10-28 hour 11: 150158 events in 0 files, snapshot none (task 3542 ms: download 2363 ms overlapping gunzip 445 ms, parse 1404 ms, sort 0 ms, write 0 ms, index 713 ms: 2 candidates, 70475 repo-hours, 548 releases; waiting 726 ms; commit 0 ms)
2026-11-08T14:20:02Z [load_day 2025-10-28] 2025-10-28 hour 12: 160183 events in 0 files, snapshot none (task 3171 ms: download 1698 ms overlapping gunzip 381 ms, parse 1095 ms, sort 0 ms, write 0 ms, index 853 ms: 2 candidates, 97621 repo-hours, 398 releases; waiting 607 ms; commit 0 ms)
2026-11-08T14:20:03Z [load_day 2025-10-28] 2025-10-28 hour 13: 151246 events in 0 files, snapshot none (task 3977 ms: download 2609 ms overlapping gunzip 439 ms, parse 1464 ms, sort 0 ms, write 0 ms, index 660 ms: 9 candidates, 89422 repo-hours, 475 releases; waiting 913 ms; commit 0 ms)
2026-11-08T14:20:06Z [load_day 2025-10-28] 2025-10-28 hour 14: 146690 events in 0 files, snapshot none (task 3479 ms: download 1675 ms overlapping gunzip 451 ms, parse 1307 ms, sort 0 ms, write 0 ms, index 834 ms: 6 candidates, 78438 repo-hours, 580 releases; waiting 450 ms; commit 0 ms)
2026-11-08T14:20:07Z [load_day 2025-10-28] 2025-10-28 hour 15: 146107 events in 0 files, snapshot none (task 3604 ms: download 2010 ms overlapping gunzip 501 ms, parse 1447 ms, sort 0 ms, write 0 ms, index 699 ms: 8 candidates, 78351 repo-hours, 556 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:20:10Z [load_day 2025-10-28] 2025-10-28 hour 16: 144647 events in 0 files, snapshot none (task 4067 ms: download 2675 ms overlapping gunzip 469 ms, parse 1515 ms, sort 0 ms, write 0 ms, index 625 ms: 9 candidates, 78766 repo-hours, 558 releases; waiting 1123 ms; commit 0 ms)
2026-11-08T14:20:11Z [load_day 2025-10-28] 2025-10-28 hour 17: 145443 events in 0 files, snapshot none (task 3517 ms: download 2126 ms overlapping gunzip 525 ms, parse 1557 ms, sort 0 ms, write 0 ms, index 612 ms: 8 candidates, 75575 repo-hours, 608 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:20:14Z [load_day 2025-10-28] 2025-10-28 hour 18: 145167 events in 0 files, snapshot none (task 3564 ms: download 2072 ms overlapping gunzip 418 ms, parse 1291 ms, sort 0 ms, write 0 ms, index 891 ms: 7 candidates, 78789 repo-hours, 623 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:20:15Z [load_day 2025-10-28] 2025-10-28 hour 19: 146427 events in 0 files, snapshot none (task 3917 ms: download 2582 ms overlapping gunzip 562 ms, parse 1705 ms, sort 0 ms, write 0 ms, index 516 ms: 3 candidates, 68947 repo-hours, 667 releases; waiting 794 ms; commit 0 ms)
2026-11-08T14:20:19Z [load_day 2025-10-28] 2025-10-28 hour 20: 141654 events in 0 files, snapshot none (task 3756 ms: download 2702 ms overlapping gunzip 447 ms, parse 1294 ms, sort 0 ms, write 0 ms, index 509 ms: 5 candidates, 70538 repo-hours, 673 releases; waiting 1183 ms; commit 0 ms)
2026-11-08T14:20:19Z [load_day 2025-10-28] 2025-10-28 hour 21: 144395 events in 0 files, snapshot none (task 3197 ms: download 2130 ms overlapping gunzip 433 ms, parse 1257 ms, sort 0 ms, write 0 ms, index 502 ms: 3 candidates, 68324 repo-hours, 669 releases; waiting 662 ms; commit 0 ms)
2026-11-08T14:20:23Z [load_day 2025-10-28] 2025-10-28 hour 22: 142880 events in 0 files, snapshot none (task 3632 ms: download 2439 ms overlapping gunzip 415 ms, parse 1223 ms, sort 0 ms, write 0 ms, index 509 ms: 5 candidates, 65245 repo-hours, 557 releases; waiting 1130 ms; commit 0 ms)
2026-11-08T14:20:23Z [load_day 2025-10-28] 2025-10-28 hour 23: 143326 events in 0 files, snapshot none (task 2592 ms: download 1791 ms overlapping gunzip 376 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 443 ms: 6 candidates, 61517 repo-hours, 639 releases; waiting 324 ms; commit 0 ms)
2026-11-08T14:20:30Z [load_day 2025-10-28] 2025-10-28: repo_hour merged from 24 files to 1 (1664254 rows, 7540 ms)
2026-11-08T14:20:36Z [load_day 2025-10-28] 2025-10-28: index committed in 13764 ms (24 + 1 + 24 files)
2026-11-08T14:20:36Z [load_day 2025-10-28] 2025-10-28: 3687579 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:20:36Z [load_day 2025-10-28] attempt 1 succeeded