orcaLog in

Runs · run 5023

load_day 2026-03-11, attempt 1 succeeded

Host
73ccef5e07c2:453921
Started
2026-11-08T15:33:04Z
Ended
2026-11-08T15:34:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
737 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.6 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5023/load_day/2026-03-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:33:04Z [load_day 2026-03-11] attempt 1 started
2026-11-08T15:33:05Z [load_day 2026-03-11] 2026-03-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:33:09Z [load_day 2026-03-11] 2026-03-11 hour 0: 149116 events in 0 files, snapshot none (task 3231 ms: download 2226 ms overlapping gunzip 397 ms, parse 1222 ms, sort 0 ms, write 0 ms, index 582 ms: 7 candidates, 77164 repo-hours, 744 releases; waiting 668 ms; commit 0 ms)
2026-11-08T15:33:10Z [load_day 2026-03-11] 2026-03-11 hour 1: 157655 events in 0 files, snapshot none (task 3549 ms: download 1833 ms overlapping gunzip 362 ms, parse 1275 ms, sort 0 ms, write 0 ms, index 898 ms: 8 candidates, 92270 repo-hours, 518 releases; waiting 660 ms; commit 0 ms)
2026-11-08T15:33:13Z [load_day 2026-03-11] 2026-03-11 hour 2: 159501 events in 0 files, snapshot none (task 3743 ms: download 2356 ms overlapping gunzip 462 ms, parse 1383 ms, sort 0 ms, write 0 ms, index 737 ms: 7 candidates, 92086 repo-hours, 479 releases; waiting 801 ms; commit 0 ms)
2026-11-08T15:33:14Z [load_day 2026-03-11] 2026-03-11 hour 3: 152332 events in 0 files, snapshot none (task 3825 ms: download 2286 ms overlapping gunzip 558 ms, parse 1649 ms, sort 0 ms, write 0 ms, index 598 ms: 7 candidates, 76981 repo-hours, 978 releases; waiting 693 ms; commit 0 ms)
2026-11-08T15:33:18Z [load_day 2026-03-11] 2026-03-11 hour 4: 156185 events in 0 files, snapshot none (task 3906 ms: download 2460 ms overlapping gunzip 540 ms, parse 1588 ms, sort 0 ms, write 0 ms, index 679 ms: 8 candidates, 77662 repo-hours, 824 releases; waiting 797 ms; commit 0 ms)
2026-11-08T15:33:18Z [load_day 2026-03-11] 2026-03-11 hour 5: 157364 events in 0 files, snapshot none (task 3914 ms: download 2407 ms overlapping gunzip 546 ms, parse 1474 ms, sort 0 ms, write 0 ms, index 650 ms: 10 candidates, 81863 repo-hours, 681 releases; waiting 898 ms; commit 0 ms)
2026-11-08T15:33:22Z [load_day 2026-03-11] 2026-03-11 hour 6: 151105 events in 0 files, snapshot none (task 3718 ms: download 2171 ms overlapping gunzip 465 ms, parse 1378 ms, sort 0 ms, write 0 ms, index 734 ms: 7 candidates, 80344 repo-hours, 729 releases; waiting 781 ms; commit 0 ms)
2026-11-08T15:33:22Z [load_day 2026-03-11] 2026-03-11 hour 7: 155422 events in 0 files, snapshot none (task 3315 ms: download 2076 ms overlapping gunzip 393 ms, parse 1169 ms, sort 0 ms, write 0 ms, index 745 ms: 9 candidates, 84570 repo-hours, 501 releases; waiting 697 ms; commit 0 ms)
2026-11-08T15:33:26Z [load_day 2026-03-11] 2026-03-11 hour 8: 155311 events in 0 files, snapshot none (task 3324 ms: download 1874 ms overlapping gunzip 411 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 701 ms: 9 candidates, 87618 repo-hours, 460 releases; waiting 498 ms; commit 0 ms)
2026-11-08T15:33:26Z [load_day 2026-03-11] 2026-03-11 hour 9: 154345 events in 0 files, snapshot none (task 3361 ms: download 1961 ms overlapping gunzip 403 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 87851 repo-hours, 360 releases; waiting 500 ms; commit 0 ms)
2026-11-08T15:33:30Z [load_day 2026-03-11] 2026-03-11 hour 10: 155720 events in 0 files, snapshot none (task 4058 ms: download 2194 ms overlapping gunzip 440 ms, parse 1337 ms, sort 0 ms, write 0 ms, index 809 ms: 9 candidates, 88811 repo-hours, 364 releases; waiting 960 ms; commit 0 ms)
2026-11-08T15:33:30Z [load_day 2026-03-11] 2026-03-11 hour 11: 152302 events in 0 files, snapshot none (task 3877 ms: download 2296 ms overlapping gunzip 514 ms, parse 1609 ms, sort 0 ms, write 0 ms, index 807 ms: 6 candidates, 83697 repo-hours, 442 releases; waiting 643 ms; commit 0 ms)
2026-11-08T15:33:34Z [load_day 2026-03-11] 2026-03-11 hour 12: 162788 events in 0 files, snapshot none (task 3566 ms: download 1826 ms overlapping gunzip 355 ms, parse 1241 ms, sort 0 ms, write 0 ms, index 870 ms: 6 candidates, 99575 repo-hours, 240 releases; waiting 713 ms; commit 0 ms)
2026-11-08T15:33:34Z [load_day 2026-03-11] 2026-03-11 hour 13: 163812 events in 0 files, snapshot none (task 3267 ms: download 1664 ms overlapping gunzip 333 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 839 ms: 10 candidates, 101781 repo-hours, 126 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:33:38Z [load_day 2026-03-11] 2026-03-11 hour 14: 155925 events in 0 files, snapshot none (task 3159 ms: download 1943 ms overlapping gunzip 297 ms, parse 968 ms, sort 0 ms, write 0 ms, index 794 ms: 10 candidates, 92288 repo-hours, 179 releases; waiting 811 ms; commit 0 ms)
2026-11-08T15:33:38Z [load_day 2026-03-11] 2026-03-11 hour 15: 157644 events in 0 files, snapshot none (task 2883 ms: download 1858 ms overlapping gunzip 295 ms, parse 901 ms, sort 0 ms, write 0 ms, index 683 ms: 7 candidates, 92136 repo-hours, 243 releases; waiting 684 ms; commit 0 ms)
2026-11-08T15:33:41Z [load_day 2026-03-11] 2026-03-11 hour 16: 160779 events in 0 files, snapshot none (task 2653 ms: download 1486 ms overlapping gunzip 296 ms, parse 997 ms, sort 0 ms, write 0 ms, index 695 ms: 11 candidates, 90127 repo-hours, 272 releases; waiting 350 ms; commit 0 ms)
2026-11-08T15:33:42Z [load_day 2026-03-11] 2026-03-11 hour 17: 158896 events in 0 files, snapshot none (task 3623 ms: download 2166 ms overlapping gunzip 308 ms, parse 978 ms, sort 0 ms, write 0 ms, index 730 ms: 15 candidates, 90039 repo-hours, 256 releases; waiting 1318 ms; commit 0 ms)
2026-11-08T15:33:44Z [load_day 2026-03-11] 2026-03-11 hour 18: 156312 events in 0 files, snapshot none (task 2636 ms: download 1337 ms overlapping gunzip 294 ms, parse 894 ms, sort 0 ms, write 0 ms, index 845 ms: 10 candidates, 90744 repo-hours, 258 releases; waiting 321 ms; commit 0 ms)
2026-11-08T15:33:45Z [load_day 2026-03-11] 2026-03-11 hour 19: 151963 events in 0 files, snapshot none (task 2930 ms: download 1781 ms overlapping gunzip 321 ms, parse 1043 ms, sort 0 ms, write 0 ms, index 655 ms: 10 candidates, 84083 repo-hours, 426 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:33:48Z [load_day 2026-03-11] 2026-03-11 hour 20: 155065 events in 0 files, snapshot none (task 3505 ms: download 1752 ms overlapping gunzip 418 ms, parse 1238 ms, sort 0 ms, write 0 ms, index 755 ms: 8 candidates, 85193 repo-hours, 463 releases; waiting 749 ms; commit 0 ms)
2026-11-08T15:33:49Z [load_day 2026-03-11] 2026-03-11 hour 21: 151980 events in 0 files, snapshot none (task 3264 ms: download 2057 ms overlapping gunzip 440 ms, parse 1278 ms, sort 0 ms, write 0 ms, index 652 ms: 6 candidates, 80592 repo-hours, 527 releases; waiting 565 ms; commit 0 ms)
2026-11-08T15:33:52Z [load_day 2026-03-11] 2026-03-11 hour 22: 148852 events in 0 files, snapshot none (task 3621 ms: download 2123 ms overlapping gunzip 470 ms, parse 1365 ms, sort 0 ms, write 0 ms, index 662 ms: 8 candidates, 75609 repo-hours, 781 releases; waiting 780 ms; commit 0 ms)
2026-11-08T15:33:53Z [load_day 2026-03-11] 2026-03-11 hour 23: 145266 events in 0 files, snapshot none (task 3296 ms: download 2161 ms overlapping gunzip 478 ms, parse 1429 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 74286 repo-hours, 890 releases; waiting 519 ms; commit 0 ms)
2026-11-08T15:34:02Z [load_day 2026-03-11] 2026-03-11: repo_hour merged from 24 files to 1 (2067370 rows, 9034 ms)
2026-11-08T15:34:05Z [load_day 2026-03-11] 2026-03-11: index committed in 12037 ms (24 + 1 + 24 files)
2026-11-08T15:34:05Z [load_day 2026-03-11] 2026-03-11: 3725640 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:34:05Z [load_day 2026-03-11] attempt 1 succeeded