orcaLog in

Runs · run 4828

load_day 2026-01-15, attempt 1 succeeded

Host
73ccef5e07c2:430209
Started
2026-11-08T15:02:37Z
Ended
2026-11-08T15:03:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
854 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.7 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4828/load_day/2026-01-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:02:37Z [load_day 2026-01-15] attempt 1 started
2026-11-08T15:02:38Z [load_day 2026-01-15] 2026-01-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:02:42Z [load_day 2026-01-15] 2026-01-15 hour 0: 142883 events in 0 files, snapshot none (task 3358 ms: download 2098 ms overlapping gunzip 410 ms, parse 1243 ms, sort 0 ms, write 0 ms, index 558 ms: 6 candidates, 74460 repo-hours, 778 releases; waiting 770 ms; commit 0 ms)
2026-11-08T15:02:42Z [load_day 2026-01-15] 2026-01-15 hour 1: 148447 events in 0 files, snapshot none (task 3543 ms: download 2487 ms overlapping gunzip 365 ms, parse 1190 ms, sort 0 ms, write 0 ms, index 614 ms: 9 candidates, 90712 repo-hours, 776 releases; waiting 1024 ms; commit 0 ms)
2026-11-08T15:02:46Z [load_day 2026-01-15] 2026-01-15 hour 2: 149441 events in 0 files, snapshot none (task 3326 ms: download 2286 ms overlapping gunzip 463 ms, parse 1362 ms, sort 0 ms, write 0 ms, index 555 ms: 7 candidates, 80620 repo-hours, 769 releases; waiting 574 ms; commit 0 ms)
2026-11-08T15:02:46Z [load_day 2026-01-15] 2026-01-15 hour 3: 141671 events in 0 files, snapshot none (task 3020 ms: download 1587 ms overlapping gunzip 458 ms, parse 1306 ms, sort 0 ms, write 0 ms, index 547 ms: 6 candidates, 70288 repo-hours, 865 releases; waiting 239 ms; commit 0 ms)
2026-11-08T15:02:50Z [load_day 2026-01-15] 2026-01-15 hour 4: 144460 events in 0 files, snapshot none (task 3364 ms: download 2270 ms overlapping gunzip 403 ms, parse 1208 ms, sort 0 ms, write 0 ms, index 601 ms: 8 candidates, 73424 repo-hours, 1487 releases; waiting 893 ms; commit 0 ms)
2026-11-08T15:02:50Z [load_day 2026-01-15] 2026-01-15 hour 5: 147468 events in 0 files, snapshot none (task 3853 ms: download 2584 ms overlapping gunzip 395 ms, parse 1193 ms, sort 0 ms, write 0 ms, index 558 ms: 8 candidates, 72524 repo-hours, 667 releases; waiting 1404 ms; commit 0 ms)
2026-11-08T15:02:54Z [load_day 2026-01-15] 2026-01-15 hour 6: 148464 events in 0 files, snapshot none (task 4284 ms: download 2697 ms overlapping gunzip 380 ms, parse 1137 ms, sort 0 ms, write 0 ms, index 570 ms: 7 candidates, 79549 repo-hours, 706 releases; waiting 1872 ms; commit 0 ms)
2026-11-08T15:02:54Z [load_day 2026-01-15] 2026-01-15 hour 7: 149763 events in 0 files, snapshot none (task 3446 ms: download 2294 ms overlapping gunzip 462 ms, parse 1270 ms, sort 0 ms, write 0 ms, index 603 ms: 9 candidates, 75927 repo-hours, 713 releases; waiting 764 ms; commit 0 ms)
2026-11-08T15:02:59Z [load_day 2026-01-15] 2026-01-15 hour 8: 145626 events in 0 files, snapshot none (task 3640 ms: download 2401 ms overlapping gunzip 490 ms, parse 1509 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 78464 repo-hours, 772 releases; waiting 701 ms; commit 0 ms)
2026-11-08T15:02:59Z [load_day 2026-01-15] 2026-01-15 hour 9: 148681 events in 0 files, snapshot none (task 3723 ms: download 2553 ms overlapping gunzip 432 ms, parse 1295 ms, sort 0 ms, write 0 ms, index 660 ms: 5 candidates, 81109 repo-hours, 785 releases; waiting 1022 ms; commit 0 ms)
2026-11-08T15:03:03Z [load_day 2026-01-15] 2026-01-15 hour 10: 146228 events in 0 files, snapshot none (task 3731 ms: download 2161 ms overlapping gunzip 675 ms, parse 2004 ms, sort 0 ms, write 0 ms, index 747 ms: 6 candidates, 80316 repo-hours, 738 releases; waiting 74 ms; commit 0 ms)
2026-11-08T15:03:03Z [load_day 2026-01-15] 2026-01-15 hour 11: 149930 events in 0 files, snapshot none (task 3863 ms: download 1614 ms overlapping gunzip 762 ms, parse 2127 ms, sort 0 ms, write 0 ms, index 717 ms: 5 candidates, 78499 repo-hours, 762 releases; waiting 14 ms; commit 0 ms)
2026-11-08T15:03:07Z [load_day 2026-01-15] 2026-01-15 hour 12: 153766 events in 0 files, snapshot none (task 3180 ms: download 1064 ms overlapping gunzip 506 ms, parse 1611 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 96158 repo-hours, 506 releases; waiting 24 ms; commit 0 ms)
2026-11-08T15:03:07Z [load_day 2026-01-15] 2026-01-15 hour 13: 152506 events in 0 files, snapshot none (task 3011 ms: download 794 ms overlapping gunzip 550 ms, parse 1518 ms, sort 0 ms, write 0 ms, index 721 ms: 8 candidates, 92480 repo-hours, 439 releases; waiting 23 ms; commit 0 ms)
2026-11-08T15:03:10Z [load_day 2026-01-15] 2026-01-15 hour 14: 147046 events in 0 files, snapshot none (task 2620 ms: download 789 ms overlapping gunzip 437 ms, parse 1247 ms, sort 0 ms, write 0 ms, index 715 ms: 10 candidates, 85815 repo-hours, 526 releases; waiting 24 ms; commit 0 ms)
2026-11-08T15:03:10Z [load_day 2026-01-15] 2026-01-15 hour 15: 146635 events in 0 files, snapshot none (task 2818 ms: download 689 ms overlapping gunzip 457 ms, parse 1281 ms, sort 0 ms, write 0 ms, index 847 ms: 8 candidates, 81750 repo-hours, 709 releases; waiting 14 ms; commit 0 ms)
2026-11-08T15:03:12Z [load_day 2026-01-15] 2026-01-15 hour 16: 114755 events in 0 files, snapshot none (task 2107 ms: download 438 ms overlapping gunzip 354 ms, parse 987 ms, sort 0 ms, write 0 ms, index 523 ms: 10 candidates, 68325 repo-hours, 501 releases; waiting 19 ms; commit 0 ms)
2026-11-08T15:03:12Z [load_day 2026-01-15] 2026-01-15 hour 17: 75125 events in 0 files, snapshot none (task 1562 ms: download 427 ms overlapping gunzip 249 ms, parse 713 ms, sort 0 ms, write 0 ms, index 374 ms: 5 candidates, 47796 repo-hours, 355 releases; waiting 17 ms; commit 0 ms)
2026-11-08T15:03:16Z [load_day 2026-01-15] 2026-01-15 hour 18: 139955 events in 0 files, snapshot none (task 3217 ms: download 778 ms overlapping gunzip 610 ms, parse 1624 ms, sort 0 ms, write 0 ms, index 745 ms: 8 candidates, 83166 repo-hours, 536 releases; waiting 30 ms; commit 0 ms)
2026-11-08T15:03:16Z [load_day 2026-01-15] 2026-01-15 hour 19: 139130 events in 0 files, snapshot none (task 3146 ms: download 1052 ms overlapping gunzip 612 ms, parse 1662 ms, sort 0 ms, write 0 ms, index 618 ms: 9 candidates, 71895 repo-hours, 689 releases; waiting 21 ms; commit 0 ms)
2026-11-08T15:03:20Z [load_day 2026-01-15] 2026-01-15 hour 20: 148998 events in 0 files, snapshot none (task 3316 ms: download 1185 ms overlapping gunzip 597 ms, parse 1777 ms, sort 0 ms, write 0 ms, index 718 ms: 8 candidates, 76517 repo-hours, 784 releases; waiting 16 ms; commit 0 ms)
2026-11-08T15:03:20Z [load_day 2026-01-15] 2026-01-15 hour 21: 148127 events in 0 files, snapshot none (task 3557 ms: download 973 ms overlapping gunzip 682 ms, parse 1943 ms, sort 0 ms, write 0 ms, index 584 ms: 10 candidates, 73298 repo-hours, 765 releases; waiting 15 ms; commit 0 ms)
2026-11-08T15:03:24Z [load_day 2026-01-15] 2026-01-15 hour 22: 148827 events in 0 files, snapshot none (task 3758 ms: download 1983 ms overlapping gunzip 576 ms, parse 1746 ms, sort 0 ms, write 0 ms, index 522 ms: 5 candidates, 71768 repo-hours, 863 releases; waiting 446 ms; commit 0 ms)
2026-11-08T15:03:24Z [load_day 2026-01-15] 2026-01-15 hour 23: 141192 events in 0 files, snapshot none (task 2605 ms: download 579 ms overlapping gunzip 443 ms, parse 1313 ms, sort 0 ms, write 0 ms, index 639 ms: 4 candidates, 63034 repo-hours, 875 releases; waiting 16 ms; commit 0 ms)
2026-11-08T15:03:32Z [load_day 2026-01-15] 2026-01-15: repo_hour merged from 24 files to 1 (1847894 rows, 7941 ms)
2026-11-08T15:03:36Z [load_day 2026-01-15] 2026-01-15: index committed in 11408 ms (24 + 1 + 24 files)
2026-11-08T15:03:36Z [load_day 2026-01-15] 2026-01-15: 3419124 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:03:36Z [load_day 2026-01-15] attempt 1 succeeded