orcaLog in

Runs · run 3015

load_day 2024-09-27, attempt 1 succeeded

Host
73ccef5e07c2:184230
Started
2026-11-08T08:06:53Z
Ended
2026-11-08T08:08:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
735 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
144.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3015/load_day/2024-09-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:06:53Z [load_day 2024-09-27] attempt 1 started
2026-11-08T08:06:54Z [load_day 2024-09-27] 2024-09-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:07:00Z [load_day 2024-09-27] 2024-09-27 hour 0: 176724 events in 0 files, snapshot none (task 5206 ms: download 2116 ms overlapping gunzip 765 ms, parse 2962 ms, sort 0 ms, write 0 ms, index 937 ms: 11 candidates, 86049 repo-hours, 1217 releases; waiting 268 ms; commit 0 ms)
2026-11-08T08:07:01Z [load_day 2024-09-27] 2024-09-27 hour 1: 191842 events in 0 files, snapshot none (task 6211 ms: download 3714 ms overlapping gunzip 828 ms, parse 3419 ms, sort 0 ms, write 0 ms, index 997 ms: 10 candidates, 104924 repo-hours, 826 releases; waiting 557 ms; commit 0 ms)
2026-11-08T08:07:05Z [load_day 2024-09-27] 2024-09-27 hour 2: 169840 events in 0 files, snapshot none (task 4922 ms: download 2732 ms overlapping gunzip 749 ms, parse 2831 ms, sort 0 ms, write 0 ms, index 522 ms: 5 candidates, 77112 repo-hours, 777 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:07:06Z [load_day 2024-09-27] 2024-09-27 hour 3: 183818 events in 0 files, snapshot none (task 4972 ms: download 2531 ms overlapping gunzip 719 ms, parse 2807 ms, sort 0 ms, write 0 ms, index 591 ms: 5 candidates, 76412 repo-hours, 3984 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:07:12Z [load_day 2024-09-27] 2024-09-27 hour 4: 168045 events in 0 files, snapshot none (task 6382 ms: download 3133 ms overlapping gunzip 1000 ms, parse 3990 ms, sort 0 ms, write 0 ms, index 607 ms: 4 candidates, 64279 repo-hours, 634 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:07:13Z [load_day 2024-09-27] 2024-09-27 hour 5: 176318 events in 0 files, snapshot none (task 5998 ms: download 3282 ms overlapping gunzip 940 ms, parse 3961 ms, sort 0 ms, write 0 ms, index 603 ms: 4 candidates, 68923 repo-hours, 862 releases; waiting 184 ms; commit 0 ms)
2026-11-08T08:07:21Z [load_day 2024-09-27] 2024-09-27 hour 6: 214456 events in 0 files, snapshot none (task 7950 ms: download 5094 ms overlapping gunzip 1348 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 734 ms: 8 candidates, 96519 repo-hours, 1157 releases; waiting 589 ms; commit 0 ms)
2026-11-08T08:07:21Z [load_day 2024-09-27] 2024-09-27 hour 7: 214586 events in 0 files, snapshot none (task 8004 ms: download 5446 ms overlapping gunzip 1315 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 602 ms: 12 candidates, 87175 repo-hours, 1105 releases; waiting 562 ms; commit 0 ms)
2026-11-08T08:07:27Z [load_day 2024-09-27] 2024-09-27 hour 8: 225856 events in 0 files, snapshot none (task 6524 ms: download 4130 ms overlapping gunzip 981 ms, parse 3764 ms, sort 0 ms, write 0 ms, index 649 ms: 6 candidates, 93797 repo-hours, 1230 releases; waiting 634 ms; commit 0 ms)
2026-11-08T08:07:28Z [load_day 2024-09-27] 2024-09-27 hour 9: 234175 events in 0 files, snapshot none (task 6634 ms: download 4122 ms overlapping gunzip 1044 ms, parse 3887 ms, sort 0 ms, write 0 ms, index 759 ms: 7 candidates, 98951 repo-hours, 1435 releases; waiting 612 ms; commit 0 ms)
2026-11-08T08:07:34Z [load_day 2024-09-27] 2024-09-27 hour 10: 217660 events in 0 files, snapshot none (task 5676 ms: download 3237 ms overlapping gunzip 857 ms, parse 3306 ms, sort 0 ms, write 0 ms, index 663 ms: 10 candidates, 88449 repo-hours, 1133 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:07:35Z [load_day 2024-09-27] 2024-09-27 hour 11: 216732 events in 0 files, snapshot none (task 5903 ms: download 4186 ms overlapping gunzip 868 ms, parse 3297 ms, sort 0 ms, write 0 ms, index 648 ms: 9 candidates, 84562 repo-hours, 1069 releases; waiting 709 ms; commit 0 ms)
2026-11-08T08:07:42Z [load_day 2024-09-27] 2024-09-27 hour 12: 266672 events in 0 files, snapshot none (task 8527 ms: download 5353 ms overlapping gunzip 1210 ms, parse 5125 ms, sort 0 ms, write 0 ms, index 1004 ms: 11 candidates, 134403 repo-hours, 1284 releases; waiting 870 ms; commit 0 ms)
2026-11-08T08:07:43Z [load_day 2024-09-27] 2024-09-27 hour 13: 253765 events in 0 files, snapshot none (task 8402 ms: download 5499 ms overlapping gunzip 1327 ms, parse 5048 ms, sort 0 ms, write 0 ms, index 1107 ms: 6 candidates, 117055 repo-hours, 1318 releases; waiting 575 ms; commit 0 ms)
2026-11-08T08:07:52Z [load_day 2024-09-27] 2024-09-27 hour 14: 237451 events in 0 files, snapshot none (task 8587 ms: download 4822 ms overlapping gunzip 1455 ms, parse 5322 ms, sort 0 ms, write 0 ms, index 988 ms: 4 candidates, 98868 repo-hours, 1336 releases; waiting 484 ms; commit 0 ms)
2026-11-08T08:07:53Z [load_day 2024-09-27] 2024-09-27 hour 15: 243582 events in 0 files, snapshot none (task 8514 ms: download 5788 ms overlapping gunzip 1400 ms, parse 5495 ms, sort 0 ms, write 0 ms, index 750 ms: 7 candidates, 104034 repo-hours, 1394 releases; waiting 561 ms; commit 0 ms)
2026-11-08T08:08:00Z [load_day 2024-09-27] 2024-09-27 hour 16: 231252 events in 0 files, snapshot none (task 7421 ms: download 4613 ms overlapping gunzip 1184 ms, parse 4384 ms, sort 0 ms, write 0 ms, index 1029 ms: 10 candidates, 95251 repo-hours, 1170 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:08:00Z [load_day 2024-09-27] 2024-09-27 hour 17: 217016 events in 0 files, snapshot none (task 6617 ms: download 4075 ms overlapping gunzip 1027 ms, parse 4052 ms, sort 0 ms, write 0 ms, index 801 ms: 11 candidates, 86884 repo-hours, 1106 releases; waiting 439 ms; commit 0 ms)
2026-11-08T08:08:08Z [load_day 2024-09-27] 2024-09-27 hour 18: 229672 events in 0 files, snapshot none (task 7320 ms: download 4757 ms overlapping gunzip 1083 ms, parse 4487 ms, sort 0 ms, write 0 ms, index 722 ms: 4 candidates, 101439 repo-hours, 1217 releases; waiting 734 ms; commit 0 ms)
2026-11-08T08:08:08Z [load_day 2024-09-27] 2024-09-27 hour 19: 203841 events in 0 files, snapshot none (task 6062 ms: download 3415 ms overlapping gunzip 992 ms, parse 3695 ms, sort 0 ms, write 0 ms, index 633 ms: 7 candidates, 77455 repo-hours, 1053 releases; waiting 380 ms; commit 0 ms)
2026-11-08T08:08:14Z [load_day 2024-09-27] 2024-09-27 hour 20: 189237 events in 0 files, snapshot none (task 5805 ms: download 3413 ms overlapping gunzip 909 ms, parse 3560 ms, sort 0 ms, write 0 ms, index 511 ms: 11 candidates, 72611 repo-hours, 1007 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:08:14Z [load_day 2024-09-27] 2024-09-27 hour 21: 180576 events in 0 files, snapshot none (task 6141 ms: download 3804 ms overlapping gunzip 958 ms, parse 3798 ms, sort 0 ms, write 0 ms, index 529 ms: 12 candidates, 70265 repo-hours, 1015 releases; waiting 495 ms; commit 0 ms)
2026-11-08T08:08:19Z [load_day 2024-09-27] 2024-09-27 hour 22: 161013 events in 0 files, snapshot none (task 4974 ms: download 2770 ms overlapping gunzip 787 ms, parse 2942 ms, sort 0 ms, write 0 ms, index 410 ms: 4 candidates, 57784 repo-hours, 953 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:08:19Z [load_day 2024-09-27] 2024-09-27 hour 23: 144424 events in 0 files, snapshot none (task 4609 ms: download 3000 ms overlapping gunzip 709 ms, parse 2719 ms, sort 0 ms, write 0 ms, index 353 ms: 3 candidates, 52249 repo-hours, 827 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:08:28Z [load_day 2024-09-27] 2024-09-27: repo_hour merged from 24 files to 1 (2095450 rows, 8655 ms)
2026-11-08T08:08:31Z [load_day 2024-09-27] 2024-09-27: index committed in 11158 ms (24 + 1 + 24 files)
2026-11-08T08:08:31Z [load_day 2024-09-27] 2024-09-27: 4948553 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:08:31Z [load_day 2024-09-27] attempt 1 succeeded