orcaLog in

Runs · run 2398

load_day 2024-05-01, attempt 1 succeeded

Host
73ccef5e07c2:116802
Started
2026-11-08T05:53:09Z
Ended
2026-11-08T05:55:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
679 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.3 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2398/load_day/2024-05-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:53:09Z [load_day 2024-05-01] attempt 1 started
2026-11-08T05:53:10Z [load_day 2024-05-01] 2024-05-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:53:21Z [load_day 2024-05-01] 2024-05-01 hour 0: 207506 events in 0 files, snapshot none (task 10063 ms: download 6799 ms overlapping gunzip 1644 ms, parse 6984 ms, sort 0 ms, write 0 ms, index 668 ms: 15 candidates, 93777 repo-hours, 1250 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:53:21Z [load_day 2024-05-01] 2024-05-01 hour 1: 206945 events in 0 files, snapshot none (task 9777 ms: download 6313 ms overlapping gunzip 1547 ms, parse 6634 ms, sort 0 ms, write 0 ms, index 797 ms: 7 candidates, 100415 repo-hours, 1348 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:53:30Z [load_day 2024-05-01] 2024-05-01 hour 2: 176118 events in 0 files, snapshot none (task 8721 ms: download 5917 ms overlapping gunzip 1433 ms, parse 5729 ms, sort 0 ms, write 0 ms, index 408 ms: 5 candidates, 56939 repo-hours, 874 releases; waiting 706 ms; commit 0 ms)
2026-11-08T05:53:30Z [load_day 2024-05-01] 2024-05-01 hour 3: 182374 events in 0 files, snapshot none (task 8356 ms: download 5293 ms overlapping gunzip 1275 ms, parse 5716 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 61001 repo-hours, 2679 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:53:38Z [load_day 2024-05-01] 2024-05-01 hour 4: 172591 events in 0 files, snapshot none (task 7005 ms: download 4482 ms overlapping gunzip 1102 ms, parse 4665 ms, sort 0 ms, write 0 ms, index 429 ms: 24 candidates, 56709 repo-hours, 712 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:53:39Z [load_day 2024-05-01] 2024-05-01 hour 5: 175391 events in 0 files, snapshot none (task 8343 ms: download 5014 ms overlapping gunzip 1262 ms, parse 5067 ms, sort 0 ms, write 0 ms, index 1274 ms: 8 candidates, 59649 repo-hours, 760 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:53:47Z [load_day 2024-05-01] 2024-05-01 hour 6: 188065 events in 0 files, snapshot none (task 6093 ms: download 3747 ms overlapping gunzip 931 ms, parse 3883 ms, sort 0 ms, write 0 ms, index 556 ms: 7 candidates, 71923 repo-hours, 928 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:53:47Z [load_day 2024-05-01] 2024-05-01 hour 7: 191197 events in 0 files, snapshot none (task 5955 ms: download 3725 ms overlapping gunzip 912 ms, parse 3862 ms, sort 0 ms, write 0 ms, index 454 ms: 7 candidates, 64743 repo-hours, 1011 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:53:54Z [load_day 2024-05-01] 2024-05-01 hour 8: 218206 events in 0 files, snapshot none (task 6934 ms: download 4569 ms overlapping gunzip 1054 ms, parse 4604 ms, sort 0 ms, write 0 ms, index 516 ms: 7 candidates, 69160 repo-hours, 1266 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:53:55Z [load_day 2024-05-01] 2024-05-01 hour 9: 226475 events in 0 files, snapshot none (task 7431 ms: download 5087 ms overlapping gunzip 1169 ms, parse 4865 ms, sort 0 ms, write 0 ms, index 554 ms: 2 candidates, 74978 repo-hours, 1117 releases; waiting 600 ms; commit 0 ms)
2026-11-08T05:54:04Z [load_day 2024-05-01] 2024-05-01 hour 10: 215172 events in 0 files, snapshot none (task 9289 ms: download 6586 ms overlapping gunzip 1507 ms, parse 6226 ms, sort 0 ms, write 0 ms, index 561 ms: 11 candidates, 73994 repo-hours, 999 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:54:04Z [load_day 2024-05-01] 2024-05-01 hour 11: 208895 events in 0 files, snapshot none (task 9309 ms: download 6757 ms overlapping gunzip 1612 ms, parse 6336 ms, sort 0 ms, write 0 ms, index 649 ms: 10 candidates, 72052 repo-hours, 995 releases; waiting 470 ms; commit 0 ms)
2026-11-08T05:54:15Z [load_day 2024-05-01] 2024-05-01 hour 12: 270821 events in 0 files, snapshot none (task 11043 ms: download 8094 ms overlapping gunzip 1736 ms, parse 7677 ms, sort 0 ms, write 0 ms, index 892 ms: 6 candidates, 112093 repo-hours, 1205 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:54:16Z [load_day 2024-05-01] 2024-05-01 hour 13: 242899 events in 0 files, snapshot none (task 11300 ms: download 8230 ms overlapping gunzip 1754 ms, parse 7819 ms, sort 0 ms, write 0 ms, index 984 ms: 7 candidates, 102240 repo-hours, 1171 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:54:28Z [load_day 2024-05-01] 2024-05-01 hour 14: 245681 events in 0 files, snapshot none (task 11667 ms: download 7910 ms overlapping gunzip 1843 ms, parse 7947 ms, sort 0 ms, write 0 ms, index 1104 ms: 10 candidates, 92730 repo-hours, 1154 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:54:28Z [load_day 2024-05-01] 2024-05-01 hour 15: 246131 events in 0 files, snapshot none (task 11364 ms: download 7993 ms overlapping gunzip 1829 ms, parse 7833 ms, sort 0 ms, write 0 ms, index 949 ms: 8 candidates, 95509 repo-hours, 1235 releases; waiting 466 ms; commit 0 ms)
2026-11-08T05:54:38Z [load_day 2024-05-01] 2024-05-01 hour 16: 247264 events in 0 files, snapshot none (task 10386 ms: download 7701 ms overlapping gunzip 1702 ms, parse 7171 ms, sort 0 ms, write 0 ms, index 697 ms: 9 candidates, 90186 repo-hours, 1962 releases; waiting 548 ms; commit 0 ms)
2026-11-08T05:54:39Z [load_day 2024-05-01] 2024-05-01 hour 17: 244044 events in 0 files, snapshot none (task 10460 ms: download 7669 ms overlapping gunzip 1639 ms, parse 7425 ms, sort 0 ms, write 0 ms, index 661 ms: 9 candidates, 86788 repo-hours, 1256 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:54:48Z [load_day 2024-05-01] 2024-05-01 hour 18: 263359 events in 0 files, snapshot none (task 9212 ms: download 6294 ms overlapping gunzip 1443 ms, parse 6248 ms, sort 0 ms, write 0 ms, index 768 ms: 14 candidates, 94206 repo-hours, 1281 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:54:49Z [load_day 2024-05-01] 2024-05-01 hour 19: 232009 events in 0 files, snapshot none (task 9335 ms: download 6653 ms overlapping gunzip 1451 ms, parse 6534 ms, sort 0 ms, write 0 ms, index 622 ms: 14 candidates, 81081 repo-hours, 1099 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:54:59Z [load_day 2024-05-01] 2024-05-01 hour 20: 220349 events in 0 files, snapshot none (task 9965 ms: download 7274 ms overlapping gunzip 1639 ms, parse 6781 ms, sort 0 ms, write 0 ms, index 771 ms: 9 candidates, 80486 repo-hours, 984 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:54:59Z [load_day 2024-05-01] 2024-05-01 hour 21: 204349 events in 0 files, snapshot none (task 9058 ms: download 6200 ms overlapping gunzip 1488 ms, parse 6017 ms, sort 0 ms, write 0 ms, index 684 ms: 14 candidates, 73011 repo-hours, 1105 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:55:06Z [load_day 2024-05-01] 2024-05-01 hour 22: 177606 events in 0 files, snapshot none (task 7547 ms: download 5002 ms overlapping gunzip 1154 ms, parse 5053 ms, sort 0 ms, write 0 ms, index 589 ms: 10 candidates, 61002 repo-hours, 953 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:55:06Z [load_day 2024-05-01] 2024-05-01 hour 23: 170052 events in 0 files, snapshot none (task 6839 ms: download 4436 ms overlapping gunzip 1043 ms, parse 4480 ms, sort 0 ms, write 0 ms, index 524 ms: 3 candidates, 58146 repo-hours, 752 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:55:15Z [load_day 2024-05-01] 2024-05-01: repo_hour merged from 24 files to 1 (1882818 rows, 8387 ms)
2026-11-08T05:55:17Z [load_day 2024-05-01] 2024-05-01: index committed in 10757 ms (24 + 1 + 24 files)
2026-11-08T05:55:17Z [load_day 2024-05-01] 2024-05-01: 5133499 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:55:17Z [load_day 2024-05-01] attempt 1 succeeded