orcaLog in

Runs · run 2302

load_day 2024-04-09, attempt 1 succeeded

Host
73ccef5e07c2:107754
Started
2026-11-08T05:31:34Z
Ended
2026-11-08T05:33:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
701 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
196.4 s, up to 3.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2302/load_day/2024-04-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:31:34Z [load_day 2024-04-09] attempt 1 started
2026-11-08T05:31:35Z [load_day 2024-04-09] 2024-04-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:31:43Z [load_day 2024-04-09] 2024-04-09 hour 0: 237019 events in 0 files, snapshot none (task 7903 ms: download 4750 ms overlapping gunzip 1150 ms, parse 5107 ms, sort 0 ms, write 0 ms, index 882 ms: 11 candidates, 100815 repo-hours, 1101 releases; waiting 460 ms; commit 0 ms)
2026-11-08T05:31:43Z [load_day 2024-04-09] 2024-04-09 hour 1: 242849 events in 0 files, snapshot none (task 7431 ms: download 4477 ms overlapping gunzip 1020 ms, parse 4591 ms, sort 0 ms, write 0 ms, index 1068 ms: 14 candidates, 103053 repo-hours, 803 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:31:51Z [load_day 2024-04-09] 2024-04-09 hour 2: 214994 events in 0 files, snapshot none (task 6801 ms: download 4104 ms overlapping gunzip 988 ms, parse 4302 ms, sort 0 ms, write 0 ms, index 678 ms: 21 candidates, 68984 repo-hours, 848 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:31:51Z [load_day 2024-04-09] 2024-04-09 hour 3: 210306 events in 0 files, snapshot none (task 6796 ms: download 4325 ms overlapping gunzip 1025 ms, parse 4248 ms, sort 0 ms, write 0 ms, index 626 ms: 9 candidates, 65683 repo-hours, 941 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:31:58Z [load_day 2024-04-09] 2024-04-09 hour 4: 203370 events in 0 files, snapshot none (task 7030 ms: download 3666 ms overlapping gunzip 1172 ms, parse 4690 ms, sort 0 ms, write 0 ms, index 586 ms: 10 candidates, 60929 repo-hours, 786 releases; waiting 11 ms; commit 0 ms)
2026-11-08T05:31:59Z [load_day 2024-04-09] 2024-04-09 hour 5: 222188 events in 0 files, snapshot none (task 7671 ms: download 5095 ms overlapping gunzip 1256 ms, parse 5126 ms, sort 0 ms, write 0 ms, index 514 ms: 6 candidates, 68912 repo-hours, 795 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:32:07Z [load_day 2024-04-09] 2024-04-09 hour 6: 250259 events in 0 files, snapshot none (task 7862 ms: download 4244 ms overlapping gunzip 1235 ms, parse 4922 ms, sort 0 ms, write 0 ms, index 975 ms: 8 candidates, 87666 repo-hours, 1089 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:32:08Z [load_day 2024-04-09] 2024-04-09 hour 7: 251526 events in 0 files, snapshot none (task 8689 ms: download 5718 ms overlapping gunzip 1321 ms, parse 5593 ms, sort 0 ms, write 0 ms, index 789 ms: 6 candidates, 87328 repo-hours, 1079 releases; waiting 669 ms; commit 0 ms)
2026-11-08T05:32:15Z [load_day 2024-04-09] 2024-04-09 hour 8: 266387 events in 0 files, snapshot none (task 7957 ms: download 5202 ms overlapping gunzip 1262 ms, parse 5111 ms, sort 0 ms, write 0 ms, index 792 ms: 10 candidates, 94812 repo-hours, 1195 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:32:16Z [load_day 2024-04-09] 2024-04-09 hour 9: 268972 events in 0 files, snapshot none (task 7412 ms: download 4936 ms overlapping gunzip 1205 ms, parse 4871 ms, sort 0 ms, write 0 ms, index 658 ms: 6 candidates, 94850 repo-hours, 1409 releases; waiting 411 ms; commit 0 ms)
2026-11-08T05:32:23Z [load_day 2024-04-09] 2024-04-09 hour 10: 257083 events in 0 files, snapshot none (task 7295 ms: download 4731 ms overlapping gunzip 1165 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 654 ms: 9 candidates, 89624 repo-hours, 1231 releases; waiting 376 ms; commit 0 ms)
2026-11-08T05:32:24Z [load_day 2024-04-09] 2024-04-09 hour 11: 261586 events in 0 files, snapshot none (task 6858 ms: download 4309 ms overlapping gunzip 1143 ms, parse 4682 ms, sort 0 ms, write 0 ms, index 636 ms: 4 candidates, 86913 repo-hours, 1196 releases; waiting 151 ms; commit 0 ms)
2026-11-08T05:32:34Z [load_day 2024-04-09] 2024-04-09 hour 12: 304822 events in 0 files, snapshot none (task 10719 ms: download 7598 ms overlapping gunzip 1580 ms, parse 7313 ms, sort 0 ms, write 0 ms, index 1037 ms: 11 candidates, 120821 repo-hours, 1508 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:32:35Z [load_day 2024-04-09] 2024-04-09 hour 13: 287965 events in 0 files, snapshot none (task 11070 ms: download 7755 ms overlapping gunzip 1706 ms, parse 7253 ms, sort 0 ms, write 0 ms, index 1326 ms: 6 candidates, 112739 repo-hours, 1288 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:32:45Z [load_day 2024-04-09] 2024-04-09 hour 14: 283554 events in 0 files, snapshot none (task 10544 ms: download 7419 ms overlapping gunzip 1701 ms, parse 7354 ms, sort 0 ms, write 0 ms, index 766 ms: 8 candidates, 102977 repo-hours, 1343 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:32:46Z [load_day 2024-04-09] 2024-04-09 hour 15: 280409 events in 0 files, snapshot none (task 9902 ms: download 7049 ms overlapping gunzip 1504 ms, parse 6561 ms, sort 0 ms, write 0 ms, index 824 ms: 9 candidates, 100411 repo-hours, 1401 releases; waiting 693 ms; commit 0 ms)
2026-11-08T05:32:56Z [load_day 2024-04-09] 2024-04-09 hour 16: 275273 events in 0 files, snapshot none (task 9716 ms: download 7020 ms overlapping gunzip 1495 ms, parse 6671 ms, sort 0 ms, write 0 ms, index 721 ms: 9 candidates, 95222 repo-hours, 1281 releases; waiting 530 ms; commit 0 ms)
2026-11-08T05:32:56Z [load_day 2024-04-09] 2024-04-09 hour 17: 267377 events in 0 files, snapshot none (task 9315 ms: download 6686 ms overlapping gunzip 1450 ms, parse 6405 ms, sort 0 ms, write 0 ms, index 678 ms: 9 candidates, 87227 repo-hours, 1180 releases; waiting 532 ms; commit 0 ms)
2026-11-08T05:33:05Z [load_day 2024-04-09] 2024-04-09 hour 18: 269165 events in 0 files, snapshot none (task 9105 ms: download 6358 ms overlapping gunzip 1432 ms, parse 6166 ms, sort 0 ms, write 0 ms, index 706 ms: 6 candidates, 93697 repo-hours, 1937 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:33:05Z [load_day 2024-04-09] 2024-04-09 hour 19: 249225 events in 0 files, snapshot none (task 8957 ms: download 6519 ms overlapping gunzip 1485 ms, parse 6172 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 78713 repo-hours, 1242 releases; waiting 476 ms; commit 0 ms)
2026-11-08T05:33:14Z [load_day 2024-04-09] 2024-04-09 hour 20: 244002 events in 0 files, snapshot none (task 8637 ms: download 6044 ms overlapping gunzip 1378 ms, parse 5823 ms, sort 0 ms, write 0 ms, index 582 ms: 8 candidates, 80259 repo-hours, 1025 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:33:14Z [load_day 2024-04-09] 2024-04-09 hour 21: 229234 events in 0 files, snapshot none (task 8656 ms: download 6248 ms overlapping gunzip 1345 ms, parse 5624 ms, sort 0 ms, write 0 ms, index 576 ms: 4 candidates, 72463 repo-hours, 1068 releases; waiting 780 ms; commit 0 ms)
2026-11-08T05:33:23Z [load_day 2024-04-09] 2024-04-09 hour 22: 219220 events in 0 files, snapshot none (task 8042 ms: download 5245 ms overlapping gunzip 1245 ms, parse 5338 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 64950 repo-hours, 971 releases; waiting 546 ms; commit 0 ms)
2026-11-08T05:33:23Z [load_day 2024-04-09] 2024-04-09 hour 23: 209242 events in 0 files, snapshot none (task 7087 ms: download 4221 ms overlapping gunzip 1045 ms, parse 4568 ms, sort 0 ms, write 0 ms, index 692 ms: 4 candidates, 59086 repo-hours, 748 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:33:32Z [load_day 2024-04-09] 2024-04-09: repo_hour merged from 24 files to 1 (2078134 rows, 9093 ms)
2026-11-08T05:33:39Z [load_day 2024-04-09] 2024-04-09: index committed in 16664 ms (24 + 1 + 24 files)
2026-11-08T05:33:39Z [load_day 2024-04-09] 2024-04-09: 6006027 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:33:39Z [load_day 2024-04-09] attempt 1 succeeded