orcaLog in

Runs · run 4545

load_day 2025-10-26, attempt 1 succeeded

Host
73ccef5e07c2:397399
Started
2026-11-08T14:18:31Z
Ended
2026-11-08T14:19:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
641 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
62.0 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4545/load_day/2025-10-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:18:31Z [load_day 2025-10-26] attempt 1 started
2026-11-08T14:18:32Z [load_day 2025-10-26] 2025-10-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:18:36Z [load_day 2025-10-26] 2025-10-26 hour 0: 135941 events in 0 files, snapshot none (task 3197 ms: download 2046 ms overlapping gunzip 348 ms, parse 1184 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 63366 repo-hours, 760 releases; waiting 743 ms; commit 0 ms)
2026-11-08T14:18:36Z [load_day 2025-10-26] 2025-10-26 hour 1: 147886 events in 0 files, snapshot none (task 3391 ms: download 2284 ms overlapping gunzip 347 ms, parse 1127 ms, sort 0 ms, write 0 ms, index 671 ms: 5 candidates, 87087 repo-hours, 717 releases; waiting 943 ms; commit 0 ms)
2026-11-08T14:18:40Z [load_day 2025-10-26] 2025-10-26 hour 2: 133152 events in 0 files, snapshot none (task 2743 ms: download 1352 ms overlapping gunzip 307 ms, parse 1020 ms, sort 0 ms, write 0 ms, index 776 ms: 5 candidates, 60063 repo-hours, 708 releases; waiting 316 ms; commit 0 ms)
2026-11-08T14:18:40Z [load_day 2025-10-26] 2025-10-26 hour 3: 138308 events in 0 files, snapshot none (task 3110 ms: download 1970 ms overlapping gunzip 365 ms, parse 1133 ms, sort 0 ms, write 0 ms, index 583 ms: 4 candidates, 58474 repo-hours, 1829 releases; waiting 712 ms; commit 0 ms)
2026-11-08T14:18:43Z [load_day 2025-10-26] 2025-10-26 hour 4: 141751 events in 0 files, snapshot none (task 2592 ms: download 1736 ms overlapping gunzip 309 ms, parse 1003 ms, sort 0 ms, write 0 ms, index 481 ms: 7 candidates, 56331 repo-hours, 468 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:18:43Z [load_day 2025-10-26] 2025-10-26 hour 5: 142266 events in 0 files, snapshot none (task 2752 ms: download 1842 ms overlapping gunzip 300 ms, parse 972 ms, sort 0 ms, write 0 ms, index 461 ms: 5 candidates, 57434 repo-hours, 478 releases; waiting 709 ms; commit 0 ms)
2026-11-08T14:18:46Z [load_day 2025-10-26] 2025-10-26 hour 6: 142759 events in 0 files, snapshot none (task 3160 ms: download 2180 ms overlapping gunzip 302 ms, parse 960 ms, sort 0 ms, write 0 ms, index 605 ms: 4 candidates, 65599 repo-hours, 498 releases; waiting 1052 ms; commit 0 ms)
2026-11-08T14:18:47Z [load_day 2025-10-26] 2025-10-26 hour 7: 143367 events in 0 files, snapshot none (task 3125 ms: download 2119 ms overlapping gunzip 319 ms, parse 1000 ms, sort 0 ms, write 0 ms, index 534 ms: 5 candidates, 57730 repo-hours, 415 releases; waiting 938 ms; commit 0 ms)
2026-11-08T14:18:50Z [load_day 2025-10-26] 2025-10-26 hour 8: 145005 events in 0 files, snapshot none (task 3227 ms: download 1931 ms overlapping gunzip 310 ms, parse 959 ms, sort 0 ms, write 0 ms, index 763 ms: 7 candidates, 63479 repo-hours, 454 releases; waiting 881 ms; commit 0 ms)
2026-11-08T14:18:51Z [load_day 2025-10-26] 2025-10-26 hour 9: 148331 events in 0 files, snapshot none (task 3470 ms: download 2263 ms overlapping gunzip 398 ms, parse 1299 ms, sort 0 ms, write 0 ms, index 525 ms: 14 candidates, 63189 repo-hours, 552 releases; waiting 906 ms; commit 0 ms)
2026-11-08T14:18:54Z [load_day 2025-10-26] 2025-10-26 hour 10: 143247 events in 0 files, snapshot none (task 2859 ms: download 1653 ms overlapping gunzip 353 ms, parse 1080 ms, sort 0 ms, write 0 ms, index 555 ms: 8 candidates, 64069 repo-hours, 460 releases; waiting 572 ms; commit 0 ms)
2026-11-08T14:18:54Z [load_day 2025-10-26] 2025-10-26 hour 11: 147612 events in 0 files, snapshot none (task 2953 ms: download 1879 ms overlapping gunzip 362 ms, parse 1235 ms, sort 0 ms, write 0 ms, index 514 ms: 8 candidates, 62415 repo-hours, 515 releases; waiting 570 ms; commit 0 ms)
2026-11-08T14:18:58Z [load_day 2025-10-26] 2025-10-26 hour 12: 156315 events in 0 files, snapshot none (task 3538 ms: download 1638 ms overlapping gunzip 356 ms, parse 1176 ms, sort 0 ms, write 0 ms, index 1034 ms: 8 candidates, 91675 repo-hours, 483 releases; waiting 639 ms; commit 0 ms)
2026-11-08T14:18:58Z [load_day 2025-10-26] 2025-10-26 hour 13: 156967 events in 0 files, snapshot none (task 3381 ms: download 1756 ms overlapping gunzip 347 ms, parse 1271 ms, sort 0 ms, write 0 ms, index 880 ms: 5 candidates, 82706 repo-hours, 474 releases; waiting 495 ms; commit 0 ms)
2026-11-08T14:19:02Z [load_day 2025-10-26] 2025-10-26 hour 14: 151050 events in 0 files, snapshot none (task 3488 ms: download 1836 ms overlapping gunzip 483 ms, parse 1595 ms, sort 0 ms, write 0 ms, index 554 ms: 2 candidates, 70983 repo-hours, 609 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:19:02Z [load_day 2025-10-26] 2025-10-26 hour 15: 148271 events in 0 files, snapshot none (task 3153 ms: download 1918 ms overlapping gunzip 415 ms, parse 1384 ms, sort 0 ms, write 0 ms, index 589 ms: 2 candidates, 69325 repo-hours, 620 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:19:05Z [load_day 2025-10-26] 2025-10-26 hour 16: 148993 events in 0 files, snapshot none (task 3309 ms: download 2251 ms overlapping gunzip 451 ms, parse 1390 ms, sort 0 ms, write 0 ms, index 536 ms: 0 candidates, 70117 repo-hours, 608 releases; waiting 598 ms; commit 0 ms)
2026-11-08T14:19:05Z [load_day 2025-10-26] 2025-10-26 hour 17: 150169 events in 0 files, snapshot none (task 3489 ms: download 2214 ms overlapping gunzip 477 ms, parse 1532 ms, sort 0 ms, write 0 ms, index 579 ms: 2 candidates, 68918 repo-hours, 527 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:19:09Z [load_day 2025-10-26] 2025-10-26 hour 18: 153132 events in 0 files, snapshot none (task 3245 ms: download 2208 ms overlapping gunzip 435 ms, parse 1359 ms, sort 0 ms, write 0 ms, index 614 ms: 5 candidates, 76368 repo-hours, 630 releases; waiting 613 ms; commit 0 ms)
2026-11-08T14:19:09Z [load_day 2025-10-26] 2025-10-26 hour 19: 145866 events in 0 files, snapshot none (task 3319 ms: download 2126 ms overlapping gunzip 408 ms, parse 1308 ms, sort 0 ms, write 0 ms, index 610 ms: 7 candidates, 62442 repo-hours, 549 releases; waiting 708 ms; commit 0 ms)
2026-11-08T14:19:12Z [load_day 2025-10-26] 2025-10-26 hour 20: 143839 events in 0 files, snapshot none (task 2711 ms: download 1757 ms overlapping gunzip 297 ms, parse 946 ms, sort 0 ms, write 0 ms, index 469 ms: 4 candidates, 61690 repo-hours, 565 releases; waiting 694 ms; commit 0 ms)
2026-11-08T14:19:13Z [load_day 2025-10-26] 2025-10-26 hour 21: 145674 events in 0 files, snapshot none (task 3221 ms: download 2040 ms overlapping gunzip 351 ms, parse 1100 ms, sort 0 ms, write 0 ms, index 458 ms: 7 candidates, 63262 repo-hours, 670 releases; waiting 1086 ms; commit 0 ms)
2026-11-08T14:19:16Z [load_day 2025-10-26] 2025-10-26 hour 22: 144850 events in 0 files, snapshot none (task 2742 ms: download 1886 ms overlapping gunzip 329 ms, parse 1095 ms, sort 0 ms, write 0 ms, index 459 ms: 5 candidates, 60145 repo-hours, 611 releases; waiting 609 ms; commit 0 ms)
2026-11-08T14:19:16Z [load_day 2025-10-26] 2025-10-26 hour 23: 139915 events in 0 files, snapshot none (task 2514 ms: download 1363 ms overlapping gunzip 315 ms, parse 1017 ms, sort 0 ms, write 0 ms, index 436 ms: 7 candidates, 56576 repo-hours, 549 releases; waiting 492 ms; commit 0 ms)
2026-11-08T14:19:23Z [load_day 2025-10-26] 2025-10-26: repo_hour merged from 24 files to 1 (1593443 rows, 6748 ms)
2026-11-08T14:19:26Z [load_day 2025-10-26] 2025-10-26: index committed in 9879 ms (23 + 1 + 24 files)
2026-11-08T14:19:26Z [load_day 2025-10-26] 2025-10-26: 3494666 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:19:26Z [load_day 2025-10-26] attempt 1 succeeded