orcaLog in

Runs · run 2600

load_day 2024-06-16, attempt 1 succeeded

Host
73ccef5e07c2:137298
Started
2026-11-08T06:33:59Z
Ended
2026-11-08T06:35:20Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
663 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.8 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2600/load_day/2024-06-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:33:59Z [load_day 2024-06-16] attempt 1 started
2026-11-08T06:34:00Z [load_day 2024-06-16] 2024-06-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:34:04Z [load_day 2024-06-16] 2024-06-16 hour 0: 148029 events in 0 files, snapshot none (task 3976 ms: download 1156 ms overlapping gunzip 506 ms, parse 2273 ms, sort 0 ms, write 0 ms, index 678 ms: 4 candidates, 78286 repo-hours, 1040 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:34:04Z [load_day 2024-06-16] 2024-06-16 hour 1: 153553 events in 0 files, snapshot none (task 3906 ms: download 1095 ms overlapping gunzip 501 ms, parse 2330 ms, sort 0 ms, write 0 ms, index 879 ms: 3 candidates, 88508 repo-hours, 824 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:34:08Z [load_day 2024-06-16] 2024-06-16 hour 2: 117033 events in 0 files, snapshot none (task 3825 ms: download 1215 ms overlapping gunzip 609 ms, parse 2546 ms, sort 0 ms, write 0 ms, index 445 ms: 10 candidates, 46291 repo-hours, 667 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:34:09Z [load_day 2024-06-16] 2024-06-16 hour 3: 142799 events in 0 files, snapshot none (task 4188 ms: download 1340 ms overlapping gunzip 663 ms, parse 2836 ms, sort 0 ms, write 0 ms, index 485 ms: 3 candidates, 58445 repo-hours, 5370 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:34:13Z [load_day 2024-06-16] 2024-06-16 hour 4: 123265 events in 0 files, snapshot none (task 4323 ms: download 925 ms overlapping gunzip 700 ms, parse 2834 ms, sort 0 ms, write 0 ms, index 583 ms: 5 candidates, 45596 repo-hours, 492 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:34:14Z [load_day 2024-06-16] 2024-06-16 hour 5: 128782 events in 0 files, snapshot none (task 4542 ms: download 1473 ms overlapping gunzip 731 ms, parse 3011 ms, sort 0 ms, write 0 ms, index 576 ms: 6 candidates, 48431 repo-hours, 704 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:34:18Z [load_day 2024-06-16] 2024-06-16 hour 6: 152171 events in 0 files, snapshot none (task 4274 ms: download 1469 ms overlapping gunzip 662 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 507 ms: 4 candidates, 66392 repo-hours, 801 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:34:19Z [load_day 2024-06-16] 2024-06-16 hour 7: 144028 events in 0 files, snapshot none (task 4153 ms: download 1900 ms overlapping gunzip 690 ms, parse 2793 ms, sort 0 ms, write 0 ms, index 443 ms: 5 candidates, 53295 repo-hours, 635 releases; waiting 26 ms; commit 0 ms)
2026-11-08T06:34:24Z [load_day 2024-06-16] 2024-06-16 hour 8: 151201 events in 0 files, snapshot none (task 5386 ms: download 2536 ms overlapping gunzip 989 ms, parse 3775 ms, sort 0 ms, write 0 ms, index 425 ms: 2 candidates, 57807 repo-hours, 722 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:34:25Z [load_day 2024-06-16] 2024-06-16 hour 9: 169952 events in 0 files, snapshot none (task 5408 ms: download 2840 ms overlapping gunzip 889 ms, parse 3676 ms, sort 0 ms, write 0 ms, index 596 ms: 11 candidates, 70376 repo-hours, 868 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:34:30Z [load_day 2024-06-16] 2024-06-16 hour 10: 162991 events in 0 files, snapshot none (task 5606 ms: download 2222 ms overlapping gunzip 896 ms, parse 3889 ms, sort 0 ms, write 0 ms, index 628 ms: 6 candidates, 65872 repo-hours, 830 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:34:31Z [load_day 2024-06-16] 2024-06-16 hour 11: 160683 events in 0 files, snapshot none (task 5867 ms: download 2782 ms overlapping gunzip 921 ms, parse 3985 ms, sort 0 ms, write 0 ms, index 736 ms: 4 candidates, 66939 repo-hours, 762 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:34:37Z [load_day 2024-06-16] 2024-06-16 hour 12: 233432 events in 0 files, snapshot none (task 6323 ms: download 2935 ms overlapping gunzip 854 ms, parse 4097 ms, sort 0 ms, write 0 ms, index 1152 ms: 13 candidates, 105146 repo-hours, 1047 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:34:37Z [load_day 2024-06-16] 2024-06-16 hour 13: 188513 events in 0 files, snapshot none (task 5277 ms: download 2430 ms overlapping gunzip 822 ms, parse 3531 ms, sort 0 ms, write 0 ms, index 681 ms: 7 candidates, 87976 repo-hours, 894 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:34:43Z [load_day 2024-06-16] 2024-06-16 hour 14: 173533 events in 0 files, snapshot none (task 6115 ms: download 2823 ms overlapping gunzip 873 ms, parse 4303 ms, sort 0 ms, write 0 ms, index 715 ms: 14 candidates, 68830 repo-hours, 902 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:34:45Z [load_day 2024-06-16] 2024-06-16 hour 15: 186779 events in 0 files, snapshot none (task 7084 ms: download 3581 ms overlapping gunzip 1087 ms, parse 4796 ms, sort 0 ms, write 0 ms, index 946 ms: 12 candidates, 79556 repo-hours, 1124 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:34:53Z [load_day 2024-06-16] 2024-06-16 hour 16: 172389 events in 0 files, snapshot none (task 7383 ms: download 3291 ms overlapping gunzip 1212 ms, parse 5072 ms, sort 0 ms, write 0 ms, index 890 ms: 48 candidates, 68702 repo-hours, 860 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:34:53Z [load_day 2024-06-16] 2024-06-16 hour 17: 159284 events in 0 files, snapshot none (task 6933 ms: download 2100 ms overlapping gunzip 1138 ms, parse 4558 ms, sort 0 ms, write 0 ms, index 1000 ms: 17 candidates, 61844 repo-hours, 863 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:34:59Z [load_day 2024-06-16] 2024-06-16 hour 18: 179285 events in 0 files, snapshot none (task 5631 ms: download 3106 ms overlapping gunzip 905 ms, parse 3923 ms, sort 0 ms, write 0 ms, index 590 ms: 9 candidates, 79630 repo-hours, 1266 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:34:59Z [load_day 2024-06-16] 2024-06-16 hour 19: 155798 events in 0 files, snapshot none (task 5692 ms: download 3159 ms overlapping gunzip 1018 ms, parse 3983 ms, sort 0 ms, write 0 ms, index 475 ms: 8 candidates, 57092 repo-hours, 1896 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:35:05Z [load_day 2024-06-16] 2024-06-16 hour 20: 149275 events in 0 files, snapshot none (task 5920 ms: download 2739 ms overlapping gunzip 960 ms, parse 4190 ms, sort 0 ms, write 0 ms, index 580 ms: 8 candidates, 56226 repo-hours, 1457 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:35:05Z [load_day 2024-06-16] 2024-06-16 hour 21: 159330 events in 0 files, snapshot none (task 5865 ms: download 2755 ms overlapping gunzip 840 ms, parse 4055 ms, sort 0 ms, write 0 ms, index 750 ms: 8 candidates, 70276 repo-hours, 1625 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:35:10Z [load_day 2024-06-16] 2024-06-16 hour 22: 146331 events in 0 files, snapshot none (task 4215 ms: download 1784 ms overlapping gunzip 678 ms, parse 2864 ms, sort 0 ms, write 0 ms, index 470 ms: 4 candidates, 60298 repo-hours, 1715 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:35:10Z [load_day 2024-06-16] 2024-06-16 hour 23: 141794 events in 0 files, snapshot none (task 4139 ms: download 1716 ms overlapping gunzip 678 ms, parse 2741 ms, sort 0 ms, write 0 ms, index 512 ms: 6 candidates, 61059 repo-hours, 1398 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:35:17Z [load_day 2024-06-16] 2024-06-16: repo_hour merged from 24 files to 1 (1602873 rows, 7394 ms)
2026-11-08T06:35:20Z [load_day 2024-06-16] 2024-06-16: index committed in 10063 ms (24 + 1 + 24 files)
2026-11-08T06:35:20Z [load_day 2024-06-16] 2024-06-16: 3800230 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:35:20Z [load_day 2024-06-16] attempt 1 succeeded