orcaLog in

Runs · run 4858

load_day 2026-01-23, attempt 1 succeeded

Host
73ccef5e07c2:433916
Started
2026-11-08T15:07:00Z
Ended
2026-11-08T15:08:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
737 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.2 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4858/load_day/2026-01-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:07:00Z [load_day 2026-01-23] attempt 1 started
2026-11-08T15:07:01Z [load_day 2026-01-23] 2026-01-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:07:05Z [load_day 2026-01-23] 2026-01-23 hour 0: 143185 events in 0 files, snapshot none (task 3821 ms: download 2335 ms overlapping gunzip 534 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 751 ms: 5 candidates, 72231 repo-hours, 783 releases; waiting 609 ms; commit 0 ms)
2026-11-08T15:07:05Z [load_day 2026-01-23] 2026-01-23 hour 1: 151501 events in 0 files, snapshot none (task 3474 ms: download 2180 ms overlapping gunzip 503 ms, parse 1444 ms, sort 0 ms, write 0 ms, index 743 ms: 9 candidates, 90616 repo-hours, 588 releases; waiting 514 ms; commit 0 ms)
2026-11-08T15:07:10Z [load_day 2026-01-23] 2026-01-23 hour 2: 149226 events in 0 files, snapshot none (task 3912 ms: download 2433 ms overlapping gunzip 472 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 817 ms: 12 candidates, 78682 repo-hours, 651 releases; waiting 732 ms; commit 0 ms)
2026-11-08T15:07:10Z [load_day 2026-01-23] 2026-01-23 hour 3: 145610 events in 0 files, snapshot none (task 3847 ms: download 2430 ms overlapping gunzip 540 ms, parse 1675 ms, sort 0 ms, write 0 ms, index 672 ms: 7 candidates, 70379 repo-hours, 775 releases; waiting 626 ms; commit 0 ms)
2026-11-08T15:07:14Z [load_day 2026-01-23] 2026-01-23 hour 4: 144697 events in 0 files, snapshot none (task 3547 ms: download 2256 ms overlapping gunzip 521 ms, parse 1481 ms, sort 0 ms, write 0 ms, index 571 ms: 11 candidates, 72236 repo-hours, 1401 releases; waiting 646 ms; commit 0 ms)
2026-11-08T15:07:14Z [load_day 2026-01-23] 2026-01-23 hour 5: 143004 events in 0 files, snapshot none (task 3373 ms: download 1629 ms overlapping gunzip 572 ms, parse 1784 ms, sort 0 ms, write 0 ms, index 542 ms: 5 candidates, 69148 repo-hours, 675 releases; waiting 188 ms; commit 0 ms)
2026-11-08T15:07:18Z [load_day 2026-01-23] 2026-01-23 hour 6: 147069 events in 0 files, snapshot none (task 3317 ms: download 2154 ms overlapping gunzip 403 ms, parse 1228 ms, sort 0 ms, write 0 ms, index 702 ms: 10 candidates, 79491 repo-hours, 783 releases; waiting 668 ms; commit 0 ms)
2026-11-08T15:07:19Z [load_day 2026-01-23] 2026-01-23 hour 7: 151481 events in 0 files, snapshot none (task 4746 ms: download 3029 ms overlapping gunzip 501 ms, parse 1357 ms, sort 0 ms, write 0 ms, index 670 ms: 9 candidates, 78781 repo-hours, 710 releases; waiting 1774 ms; commit 0 ms)
2026-11-08T15:07:21Z [load_day 2026-01-23] 2026-01-23 hour 8: 144147 events in 0 files, snapshot none (task 3163 ms: download 1854 ms overlapping gunzip 457 ms, parse 1302 ms, sort 0 ms, write 0 ms, index 718 ms: 6 candidates, 76352 repo-hours, 865 releases; waiting 341 ms; commit 0 ms)
2026-11-08T15:07:23Z [load_day 2026-01-23] 2026-01-23 hour 9: 146543 events in 0 files, snapshot none (task 3193 ms: download 2102 ms overlapping gunzip 423 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 646 ms: 10 candidates, 79119 repo-hours, 717 releases; waiting 585 ms; commit 0 ms)
2026-11-08T15:07:26Z [load_day 2026-01-23] 2026-01-23 hour 10: 142243 events in 0 files, snapshot none (task 3702 ms: download 2189 ms overlapping gunzip 397 ms, parse 1165 ms, sort 0 ms, write 0 ms, index 578 ms: 7 candidates, 78178 repo-hours, 625 releases; waiting 1158 ms; commit 0 ms)
2026-11-08T15:07:27Z [load_day 2026-01-23] 2026-01-23 hour 11: 143308 events in 0 files, snapshot none (task 3523 ms: download 2311 ms overlapping gunzip 404 ms, parse 1216 ms, sort 0 ms, write 0 ms, index 569 ms: 6 candidates, 76636 repo-hours, 720 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T15:07:29Z [load_day 2026-01-23] 2026-01-23 hour 12: 154490 events in 0 files, snapshot none (task 3253 ms: download 2005 ms overlapping gunzip 339 ms, parse 1048 ms, sort 0 ms, write 0 ms, index 652 ms: 4 candidates, 93339 repo-hours, 511 releases; waiting 835 ms; commit 0 ms)
2026-11-08T15:07:30Z [load_day 2026-01-23] 2026-01-23 hour 13: 156897 events in 0 files, snapshot none (task 2613 ms: download 1325 ms overlapping gunzip 304 ms, parse 979 ms, sort 0 ms, write 0 ms, index 689 ms: 8 candidates, 93509 repo-hours, 420 releases; waiting 254 ms; commit 0 ms)
2026-11-08T15:07:34Z [load_day 2026-01-23] 2026-01-23 hour 14: 146305 events in 0 files, snapshot none (task 3970 ms: download 2250 ms overlapping gunzip 536 ms, parse 1484 ms, sort 0 ms, write 0 ms, index 769 ms: 9 candidates, 81522 repo-hours, 517 releases; waiting 852 ms; commit 0 ms)
2026-11-08T15:07:35Z [load_day 2026-01-23] 2026-01-23 hour 15: 147914 events in 0 files, snapshot none (task 3690 ms: download 2259 ms overlapping gunzip 541 ms, parse 1498 ms, sort 0 ms, write 0 ms, index 653 ms: 9 candidates, 83366 repo-hours, 600 releases; waiting 678 ms; commit 0 ms)
2026-11-08T15:07:39Z [load_day 2026-01-23] 2026-01-23 hour 16: 143730 events in 0 files, snapshot none (task 4108 ms: download 2465 ms overlapping gunzip 452 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 740 ms: 6 candidates, 78643 repo-hours, 628 releases; waiting 1059 ms; commit 0 ms)
2026-11-08T15:07:39Z [load_day 2026-01-23] 2026-01-23 hour 17: 147937 events in 0 files, snapshot none (task 3249 ms: download 1432 ms overlapping gunzip 382 ms, parse 1162 ms, sort 0 ms, write 0 ms, index 1061 ms: 5 candidates, 79535 repo-hours, 605 releases; waiting 299 ms; commit 0 ms)
2026-11-08T15:07:43Z [load_day 2026-01-23] 2026-01-23 hour 18: 147417 events in 0 files, snapshot none (task 3530 ms: download 1826 ms overlapping gunzip 567 ms, parse 1627 ms, sort 0 ms, write 0 ms, index 672 ms: 12 candidates, 81821 repo-hours, 610 releases; waiting 320 ms; commit 0 ms)
2026-11-08T15:07:43Z [load_day 2026-01-23] 2026-01-23 hour 19: 141471 events in 0 files, snapshot none (task 3398 ms: download 1746 ms overlapping gunzip 559 ms, parse 1621 ms, sort 0 ms, write 0 ms, index 570 ms: 7 candidates, 73471 repo-hours, 690 releases; waiting 288 ms; commit 0 ms)
2026-11-08T15:07:47Z [load_day 2026-01-23] 2026-01-23 hour 20: 141661 events in 0 files, snapshot none (task 3957 ms: download 2200 ms overlapping gunzip 598 ms, parse 1812 ms, sort 0 ms, write 0 ms, index 549 ms: 13 candidates, 70304 repo-hours, 678 releases; waiting 603 ms; commit 0 ms)
2026-11-08T15:07:47Z [load_day 2026-01-23] 2026-01-23 hour 21: 144413 events in 0 files, snapshot none (task 3947 ms: download 2476 ms overlapping gunzip 658 ms, parse 1838 ms, sort 0 ms, write 0 ms, index 537 ms: 18 candidates, 70842 repo-hours, 740 releases; waiting 564 ms; commit 0 ms)
2026-11-08T15:07:52Z [load_day 2026-01-23] 2026-01-23 hour 22: 143565 events in 0 files, snapshot none (task 3736 ms: download 2112 ms overlapping gunzip 545 ms, parse 1740 ms, sort 0 ms, write 0 ms, index 557 ms: 9 candidates, 68503 repo-hours, 873 releases; waiting 549 ms; commit 0 ms)
2026-11-08T15:07:52Z [load_day 2026-01-23] 2026-01-23 hour 23: 141718 events in 0 files, snapshot none (task 3520 ms: download 1868 ms overlapping gunzip 522 ms, parse 1628 ms, sort 0 ms, write 0 ms, index 563 ms: 10 candidates, 66063 repo-hours, 798 releases; waiting 516 ms; commit 0 ms)
2026-11-08T15:08:00Z [load_day 2026-01-23] 2026-01-23: repo_hour merged from 24 files to 1 (1862767 rows, 8276 ms)
2026-11-08T15:08:04Z [load_day 2026-01-23] 2026-01-23: index committed in 11880 ms (24 + 1 + 24 files)
2026-11-08T15:08:04Z [load_day 2026-01-23] 2026-01-23: 3509532 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:08:04Z [load_day 2026-01-23] attempt 1 succeeded