orcaLog in

Runs · run 2349

load_day 2024-04-20, attempt 1 succeeded

Host
73ccef5e07c2:112018
Started
2026-11-08T05:41:51Z
Ended
2026-11-08T05:43:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
601 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
123.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2349/load_day/2024-04-20/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:41:51Z [load_day 2024-04-20] attempt 1 started
2026-11-08T05:41:52Z [load_day 2024-04-20] 2024-04-20: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:41:58Z [load_day 2024-04-20] 2024-04-20 hour 0: 175444 events in 0 files, snapshot none (task 5984 ms: download 3344 ms overlapping gunzip 800 ms, parse 3990 ms, sort 0 ms, write 0 ms, index 619 ms: 10 candidates, 82573 repo-hours, 1153 releases; waiting 310 ms; commit 0 ms)
2026-11-08T05:41:58Z [load_day 2024-04-20] 2024-04-20 hour 1: 167805 events in 0 files, snapshot none (task 6127 ms: download 3082 ms overlapping gunzip 810 ms, parse 3558 ms, sort 0 ms, write 0 ms, index 1022 ms: 6 candidates, 83737 repo-hours, 725 releases; waiting 471 ms; commit 0 ms)
2026-11-08T05:42:04Z [load_day 2024-04-20] 2024-04-20 hour 2: 134142 events in 0 files, snapshot none (task 5488 ms: download 2800 ms overlapping gunzip 823 ms, parse 3431 ms, sort 0 ms, write 0 ms, index 422 ms: 6 candidates, 47894 repo-hours, 656 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:42:04Z [load_day 2024-04-20] 2024-04-20 hour 3: 133577 events in 0 files, snapshot none (task 5275 ms: download 2567 ms overlapping gunzip 730 ms, parse 3222 ms, sort 0 ms, write 0 ms, index 515 ms: 6 candidates, 47470 repo-hours, 771 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:42:09Z [load_day 2024-04-20] 2024-04-20 hour 4: 138914 events in 0 files, snapshot none (task 4223 ms: download 1956 ms overlapping gunzip 559 ms, parse 2544 ms, sort 0 ms, write 0 ms, index 365 ms: 4 candidates, 46445 repo-hours, 539 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:42:10Z [load_day 2024-04-20] 2024-04-20 hour 5: 145624 events in 0 files, snapshot none (task 5206 ms: download 3287 ms overlapping gunzip 690 ms, parse 2992 ms, sort 0 ms, write 0 ms, index 510 ms: 2 candidates, 50467 repo-hours, 690 releases; waiting 688 ms; commit 0 ms)
2026-11-08T05:42:15Z [load_day 2024-04-20] 2024-04-20 hour 6: 161778 events in 0 files, snapshot none (task 5898 ms: download 2670 ms overlapping gunzip 794 ms, parse 3836 ms, sort 0 ms, write 0 ms, index 531 ms: 5 candidates, 61569 repo-hours, 1266 releases; waiting 477 ms; commit 0 ms)
2026-11-08T05:42:16Z [load_day 2024-04-20] 2024-04-20 hour 7: 165223 events in 0 files, snapshot none (task 5764 ms: download 3157 ms overlapping gunzip 820 ms, parse 3706 ms, sort 0 ms, write 0 ms, index 422 ms: 9 candidates, 55775 repo-hours, 1266 releases; waiting 539 ms; commit 0 ms)
2026-11-08T05:42:22Z [load_day 2024-04-20] 2024-04-20 hour 8: 175061 events in 0 files, snapshot none (task 6253 ms: download 2469 ms overlapping gunzip 865 ms, parse 3969 ms, sort 0 ms, write 0 ms, index 605 ms: 13 candidates, 65675 repo-hours, 1138 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:42:23Z [load_day 2024-04-20] 2024-04-20 hour 9: 170059 events in 0 files, snapshot none (task 5865 ms: download 2874 ms overlapping gunzip 797 ms, parse 3745 ms, sort 0 ms, write 0 ms, index 566 ms: 11 candidates, 59289 repo-hours, 1040 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:42:29Z [load_day 2024-04-20] 2024-04-20 hour 10: 174559 events in 0 files, snapshot none (task 6000 ms: download 3082 ms overlapping gunzip 817 ms, parse 3807 ms, sort 0 ms, write 0 ms, index 546 ms: 17 candidates, 61911 repo-hours, 913 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:42:29Z [load_day 2024-04-20] 2024-04-20 hour 11: 166471 events in 0 files, snapshot none (task 6097 ms: download 3026 ms overlapping gunzip 822 ms, parse 3689 ms, sort 0 ms, write 0 ms, index 606 ms: 6 candidates, 59322 repo-hours, 1877 releases; waiting 427 ms; commit 0 ms)
2026-11-08T05:42:36Z [load_day 2024-04-20] 2024-04-20 hour 12: 251571 events in 0 files, snapshot none (task 7202 ms: download 3824 ms overlapping gunzip 958 ms, parse 4703 ms, sort 0 ms, write 0 ms, index 818 ms: 13 candidates, 96341 repo-hours, 1264 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:42:37Z [load_day 2024-04-20] 2024-04-20 hour 13: 200744 events in 0 files, snapshot none (task 6926 ms: download 4030 ms overlapping gunzip 948 ms, parse 4418 ms, sort 0 ms, write 0 ms, index 716 ms: 11 candidates, 85306 repo-hours, 1015 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:42:43Z [load_day 2024-04-20] 2024-04-20 hour 14: 196000 events in 0 files, snapshot none (task 6120 ms: download 3858 ms overlapping gunzip 894 ms, parse 3767 ms, sort 0 ms, write 0 ms, index 512 ms: 12 candidates, 70024 repo-hours, 1017 releases; waiting 655 ms; commit 0 ms)
2026-11-08T05:42:43Z [load_day 2024-04-20] 2024-04-20 hour 15: 193604 events in 0 files, snapshot none (task 5607 ms: download 3154 ms overlapping gunzip 760 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 546 ms: 7 candidates, 72525 repo-hours, 1095 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:42:50Z [load_day 2024-04-20] 2024-04-20 hour 16: 202949 events in 0 files, snapshot none (task 6956 ms: download 4178 ms overlapping gunzip 971 ms, parse 4568 ms, sort 0 ms, write 0 ms, index 659 ms: 12 candidates, 70277 repo-hours, 1016 releases; waiting 479 ms; commit 0 ms)
2026-11-08T05:42:50Z [load_day 2024-04-20] 2024-04-20 hour 17: 183476 events in 0 files, snapshot none (task 6783 ms: download 4041 ms overlapping gunzip 1002 ms, parse 4524 ms, sort 0 ms, write 0 ms, index 553 ms: 11 candidates, 66044 repo-hours, 1075 releases; waiting 437 ms; commit 0 ms)
2026-11-08T05:42:57Z [load_day 2024-04-20] 2024-04-20 hour 18: 194595 events in 0 files, snapshot none (task 5776 ms: download 2438 ms overlapping gunzip 771 ms, parse 3516 ms, sort 0 ms, write 0 ms, index 724 ms: 8 candidates, 71052 repo-hours, 1197 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:42:57Z [load_day 2024-04-20] 2024-04-20 hour 19: 168566 events in 0 files, snapshot none (task 5957 ms: download 3312 ms overlapping gunzip 827 ms, parse 3838 ms, sort 0 ms, write 0 ms, index 560 ms: 11 candidates, 58712 repo-hours, 1207 releases; waiting 455 ms; commit 0 ms)
2026-11-08T05:43:02Z [load_day 2024-04-20] 2024-04-20 hour 20: 161038 events in 0 files, snapshot none (task 4805 ms: download 3534 ms overlapping gunzip 634 ms, parse 2813 ms, sort 0 ms, write 0 ms, index 417 ms: 8 candidates, 57390 repo-hours, 714 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:43:02Z [load_day 2024-04-20] 2024-04-20 hour 21: 170579 events in 0 files, snapshot none (task 5103 ms: download 3560 ms overlapping gunzip 621 ms, parse 2775 ms, sort 0 ms, write 0 ms, index 430 ms: 27 candidates, 49896 repo-hours, 752 releases; waiting 965 ms; commit 0 ms)
2026-11-08T05:43:08Z [load_day 2024-04-20] 2024-04-20 hour 22: 148028 events in 0 files, snapshot none (task 5436 ms: download 4069 ms overlapping gunzip 669 ms, parse 3027 ms, sort 0 ms, write 0 ms, index 366 ms: 7 candidates, 45725 repo-hours, 737 releases; waiting 946 ms; commit 0 ms)
2026-11-08T05:43:08Z [load_day 2024-04-20] 2024-04-20 hour 23: 138880 events in 0 files, snapshot none (task 5189 ms: download 2963 ms overlapping gunzip 734 ms, parse 3258 ms, sort 0 ms, write 0 ms, index 356 ms: 9 candidates, 43096 repo-hours, 570 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:43:15Z [load_day 2024-04-20] 2024-04-20: repo_hour merged from 24 files to 1 (1508515 rows, 7216 ms)
2026-11-08T05:43:18Z [load_day 2024-04-20] 2024-04-20: index committed in 9603 ms (24 + 1 + 24 files)
2026-11-08T05:43:18Z [load_day 2024-04-20] 2024-04-20: 4118687 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:43:18Z [load_day 2024-04-20] attempt 1 succeeded