orcaLog in

Runs · run 2820

load_day 2024-08-09, attempt 1 succeeded

Host
73ccef5e07c2:161374
Started
2026-11-08T07:22:10Z
Ended
2026-11-08T07:24:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
693 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
164.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2820/load_day/2024-08-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:22:10Z [load_day 2024-08-09] attempt 1 started
2026-11-08T07:22:16Z [load_day 2024-08-09] 2024-08-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:22:25Z [load_day 2024-08-09] 2024-08-09 hour 0: 179405 events in 0 files, snapshot none (task 7290 ms: download 4037 ms overlapping gunzip 1101 ms, parse 4706 ms, sort 0 ms, write 0 ms, index 719 ms: 7 candidates, 91290 repo-hours, 1282 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:22:26Z [load_day 2024-08-09] 2024-08-09 hour 1: 190264 events in 0 files, snapshot none (task 8344 ms: download 4874 ms overlapping gunzip 1253 ms, parse 5300 ms, sort 0 ms, write 0 ms, index 762 ms: 8 candidates, 107054 repo-hours, 775 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:22:32Z [load_day 2024-08-09] 2024-08-09 hour 2: 154040 events in 0 files, snapshot none (task 6559 ms: download 2856 ms overlapping gunzip 894 ms, parse 3941 ms, sort 0 ms, write 0 ms, index 935 ms: 3 candidates, 66377 repo-hours, 817 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:22:33Z [load_day 2024-08-09] 2024-08-09 hour 3: 171282 events in 0 files, snapshot none (task 6390 ms: download 2860 ms overlapping gunzip 914 ms, parse 4021 ms, sort 0 ms, write 0 ms, index 725 ms: 3 candidates, 73664 repo-hours, 5414 releases; waiting 467 ms; commit 0 ms)
2026-11-08T07:22:38Z [load_day 2024-08-09] 2024-08-09 hour 4: 141221 events in 0 files, snapshot none (task 5066 ms: download 2703 ms overlapping gunzip 720 ms, parse 3176 ms, sort 0 ms, write 0 ms, index 402 ms: 0 candidates, 56797 repo-hours, 618 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:22:39Z [load_day 2024-08-09] 2024-08-09 hour 5: 154800 events in 0 files, snapshot none (task 5646 ms: download 3426 ms overlapping gunzip 853 ms, parse 3661 ms, sort 0 ms, write 0 ms, index 442 ms: 7 candidates, 63738 repo-hours, 907 releases; waiting 472 ms; commit 0 ms)
2026-11-08T07:22:46Z [load_day 2024-08-09] 2024-08-09 hour 6: 188391 events in 0 files, snapshot none (task 7657 ms: download 4734 ms overlapping gunzip 1196 ms, parse 5030 ms, sort 0 ms, write 0 ms, index 611 ms: 8 candidates, 88115 repo-hours, 943 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:22:47Z [load_day 2024-08-09] 2024-08-09 hour 7: 191270 events in 0 files, snapshot none (task 7378 ms: download 4927 ms overlapping gunzip 1154 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 586 ms: 3 candidates, 79009 repo-hours, 1194 releases; waiting 455 ms; commit 0 ms)
2026-11-08T07:22:55Z [load_day 2024-08-09] 2024-08-09 hour 8: 203818 events in 0 files, snapshot none (task 8473 ms: download 5719 ms overlapping gunzip 1263 ms, parse 5663 ms, sort 0 ms, write 0 ms, index 721 ms: 8 candidates, 86673 repo-hours, 1137 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:22:56Z [load_day 2024-08-09] 2024-08-09 hour 9: 217636 events in 0 files, snapshot none (task 8564 ms: download 6091 ms overlapping gunzip 1409 ms, parse 5737 ms, sort 0 ms, write 0 ms, index 640 ms: 5 candidates, 94292 repo-hours, 1405 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:23:03Z [load_day 2024-08-09] 2024-08-09 hour 10: 202686 events in 0 files, snapshot none (task 7463 ms: download 4746 ms overlapping gunzip 1229 ms, parse 5151 ms, sort 0 ms, write 0 ms, index 585 ms: 6 candidates, 83023 repo-hours, 1047 releases; waiting 223 ms; commit 0 ms)
2026-11-08T07:23:04Z [load_day 2024-08-09] 2024-08-09 hour 11: 198395 events in 0 files, snapshot none (task 7417 ms: download 4910 ms overlapping gunzip 1208 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 583 ms: 3 candidates, 78593 repo-hours, 1013 releases; waiting 206 ms; commit 0 ms)
2026-11-08T07:23:11Z [load_day 2024-08-09] 2024-08-09 hour 12: 256634 events in 0 files, snapshot none (task 7588 ms: download 4760 ms overlapping gunzip 1093 ms, parse 4944 ms, sort 0 ms, write 0 ms, index 792 ms: 9 candidates, 125604 repo-hours, 1195 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:23:12Z [load_day 2024-08-09] 2024-08-09 hour 13: 227748 events in 0 files, snapshot none (task 7533 ms: download 4945 ms overlapping gunzip 1156 ms, parse 4819 ms, sort 0 ms, write 0 ms, index 743 ms: 8 candidates, 106302 repo-hours, 1209 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:23:20Z [load_day 2024-08-09] 2024-08-09 hour 14: 212854 events in 0 files, snapshot none (task 8415 ms: download 4666 ms overlapping gunzip 1287 ms, parse 5471 ms, sort 0 ms, write 0 ms, index 903 ms: 8 candidates, 90104 repo-hours, 1231 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:23:22Z [load_day 2024-08-09] 2024-08-09 hour 15: 218675 events in 0 files, snapshot none (task 9162 ms: download 6067 ms overlapping gunzip 1426 ms, parse 6020 ms, sort 0 ms, write 0 ms, index 911 ms: 12 candidates, 95770 repo-hours, 1314 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:23:29Z [load_day 2024-08-09] 2024-08-09 hour 16: 200407 events in 0 files, snapshot none (task 8684 ms: download 5943 ms overlapping gunzip 1332 ms, parse 5567 ms, sort 0 ms, write 0 ms, index 639 ms: 9 candidates, 83595 repo-hours, 1140 releases; waiting 806 ms; commit 0 ms)
2026-11-08T07:23:32Z [load_day 2024-08-09] 2024-08-09 hour 17: 195826 events in 0 files, snapshot none (task 8828 ms: download 5627 ms overlapping gunzip 1251 ms, parse 5514 ms, sort 0 ms, write 0 ms, index 1272 ms: 7 candidates, 77937 repo-hours, 1153 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:23:38Z [load_day 2024-08-09] 2024-08-09 hour 18: 208281 events in 0 files, snapshot none (task 8630 ms: download 4767 ms overlapping gunzip 1414 ms, parse 5649 ms, sort 0 ms, write 0 ms, index 729 ms: 7 candidates, 94352 repo-hours, 1195 releases; waiting 592 ms; commit 0 ms)
2026-11-08T07:23:39Z [load_day 2024-08-09] 2024-08-09 hour 19: 185158 events in 0 files, snapshot none (task 6849 ms: download 4333 ms overlapping gunzip 1040 ms, parse 4185 ms, sort 0 ms, write 0 ms, index 587 ms: 10 candidates, 70567 repo-hours, 1008 releases; waiting 732 ms; commit 0 ms)
2026-11-08T07:23:46Z [load_day 2024-08-09] 2024-08-09 hour 20: 182249 events in 0 files, snapshot none (task 7132 ms: download 4663 ms overlapping gunzip 1089 ms, parse 4684 ms, sort 0 ms, write 0 ms, index 513 ms: 11 candidates, 70399 repo-hours, 886 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:23:46Z [load_day 2024-08-09] 2024-08-09 hour 21: 173458 events in 0 files, snapshot none (task 7165 ms: download 4729 ms overlapping gunzip 1085 ms, parse 4760 ms, sort 0 ms, write 0 ms, index 539 ms: 10 candidates, 68735 repo-hours, 1046 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:23:52Z [load_day 2024-08-09] 2024-08-09 hour 22: 148922 events in 0 files, snapshot none (task 5674 ms: download 3366 ms overlapping gunzip 827 ms, parse 3397 ms, sort 0 ms, write 0 ms, index 469 ms: 8 candidates, 54758 repo-hours, 1064 releases; waiting 672 ms; commit 0 ms)
2026-11-08T07:23:52Z [load_day 2024-08-09] 2024-08-09 hour 23: 139368 events in 0 files, snapshot none (task 4838 ms: download 2636 ms overlapping gunzip 740 ms, parse 3026 ms, sort 0 ms, write 0 ms, index 435 ms: 8 candidates, 51133 repo-hours, 891 releases; waiting 322 ms; commit 0 ms)
2026-11-08T07:24:00Z [load_day 2024-08-09] 2024-08-09: repo_hour merged from 24 files to 1 (1957881 rows, 8131 ms)
2026-11-08T07:24:03Z [load_day 2024-08-09] 2024-08-09: index committed in 11178 ms (23 + 1 + 24 files)
2026-11-08T07:24:03Z [load_day 2024-08-09] 2024-08-09: 4542788 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:24:03Z [load_day 2024-08-09] attempt 1 succeeded