orcaLog in

Runs · run 2645

load_day 2024-06-27, attempt 1 succeeded

Host
73ccef5e07c2:142065
Started
2026-11-08T06:43:30Z
Ended
2026-11-08T06:46:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
763 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
178.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2645/load_day/2024-06-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:43:30Z [load_day 2024-06-27] attempt 1 started
2026-11-08T06:43:31Z [load_day 2024-06-27] 2024-06-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:43:39Z [load_day 2024-06-27] 2024-06-27 hour 0: 185673 events in 0 files, snapshot none (task 7815 ms: download 3845 ms overlapping gunzip 1158 ms, parse 4893 ms, sort 0 ms, write 0 ms, index 1035 ms: 10 candidates, 97848 repo-hours, 3061 releases; waiting 473 ms; commit 0 ms)
2026-11-08T06:43:39Z [load_day 2024-06-27] 2024-06-27 hour 1: 192529 events in 0 files, snapshot none (task 7813 ms: download 4067 ms overlapping gunzip 1120 ms, parse 4835 ms, sort 0 ms, write 0 ms, index 1097 ms: 7 candidates, 107616 repo-hours, 2731 releases; waiting 489 ms; commit 0 ms)
2026-11-08T06:43:45Z [load_day 2024-06-27] 2024-06-27 hour 2: 157919 events in 0 files, snapshot none (task 5468 ms: download 2872 ms overlapping gunzip 796 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 495 ms: 3 candidates, 64978 repo-hours, 2599 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:44:26Z [load_day 2024-06-27] 2024-06-27 hour 3: 183419 events in 0 files, snapshot none (task 46641 ms: download 45299 ms overlapping gunzip 1061 ms, parse 5231 ms, sort 0 ms, write 0 ms, index 670 ms: 3 candidates, 76009 repo-hours, 7421 releases; waiting 39027 ms; commit 0 ms)
2026-11-08T06:44:26Z [load_day 2024-06-27] 2024-06-27 hour 4: 156086 events in 0 files, snapshot none (task 5829 ms: download 4539 ms overlapping gunzip 780 ms, parse 3187 ms, sort 0 ms, write 0 ms, index 490 ms: 2 candidates, 60742 repo-hours, 1936 releases; waiting 1026 ms; commit 0 ms)
2026-11-08T06:44:33Z [load_day 2024-06-27] 2024-06-27 hour 5: 172628 events in 0 files, snapshot none (task 5755 ms: download 3334 ms overlapping gunzip 831 ms, parse 3594 ms, sort 0 ms, write 0 ms, index 522 ms: 6 candidates, 68394 repo-hours, 1967 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:44:33Z [load_day 2024-06-27] 2024-06-27 hour 6: 206648 events in 0 files, snapshot none (task 6623 ms: download 4094 ms overlapping gunzip 972 ms, parse 4158 ms, sort 0 ms, write 0 ms, index 649 ms: 13 candidates, 94630 repo-hours, 1935 releases; waiting 537 ms; commit 0 ms)
2026-11-08T06:44:40Z [load_day 2024-06-27] 2024-06-27 hour 7: 194243 events in 0 files, snapshot none (task 6603 ms: download 3891 ms overlapping gunzip 974 ms, parse 4097 ms, sort 0 ms, write 0 ms, index 683 ms: 10 candidates, 82778 repo-hours, 1580 releases; waiting 548 ms; commit 0 ms)
2026-11-08T06:44:41Z [load_day 2024-06-27] 2024-06-27 hour 8: 218225 events in 0 files, snapshot none (task 7708 ms: download 6032 ms overlapping gunzip 1110 ms, parse 4516 ms, sort 0 ms, write 0 ms, index 638 ms: 10 candidates, 91854 repo-hours, 2013 releases; waiting 1099 ms; commit 0 ms)
2026-11-08T06:44:49Z [load_day 2024-06-27] 2024-06-27 hour 9: 226567 events in 0 files, snapshot none (task 8931 ms: download 6082 ms overlapping gunzip 1393 ms, parse 5959 ms, sort 0 ms, write 0 ms, index 741 ms: 8 candidates, 99468 repo-hours, 2013 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:44:51Z [load_day 2024-06-27] 2024-06-27 hour 10: 213183 events in 0 files, snapshot none (task 9006 ms: download 6182 ms overlapping gunzip 1339 ms, parse 5858 ms, sort 0 ms, write 0 ms, index 853 ms: 10 candidates, 89074 repo-hours, 1931 releases; waiting 574 ms; commit 0 ms)
2026-11-08T06:44:58Z [load_day 2024-06-27] 2024-06-27 hour 11: 214619 events in 0 files, snapshot none (task 8464 ms: download 5555 ms overlapping gunzip 1346 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 845 ms: 15 candidates, 85806 repo-hours, 1969 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:45:01Z [load_day 2024-06-27] 2024-06-27 hour 12: 266910 events in 0 files, snapshot none (task 9186 ms: download 5945 ms overlapping gunzip 1320 ms, parse 6004 ms, sort 0 ms, write 0 ms, index 1108 ms: 13 candidates, 131234 repo-hours, 2003 releases; waiting 460 ms; commit 0 ms)
2026-11-08T06:45:10Z [load_day 2024-06-27] 2024-06-27 hour 13: 252206 events in 0 files, snapshot none (task 11134 ms: download 7236 ms overlapping gunzip 1559 ms, parse 6994 ms, sort 0 ms, write 0 ms, index 793 ms: 11 candidates, 113709 repo-hours, 2034 releases; waiting 850 ms; commit 0 ms)
2026-11-08T06:45:11Z [load_day 2024-06-27] 2024-06-27 hour 14: 248668 events in 0 files, snapshot none (task 9787 ms: download 7155 ms overlapping gunzip 1628 ms, parse 6671 ms, sort 0 ms, write 0 ms, index 694 ms: 11 candidates, 101612 repo-hours, 1942 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:45:21Z [load_day 2024-06-27] 2024-06-27 hour 15: 244557 events in 0 files, snapshot none (task 9889 ms: download 7054 ms overlapping gunzip 1522 ms, parse 6720 ms, sort 0 ms, write 0 ms, index 821 ms: 15 candidates, 106359 repo-hours, 2217 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:45:21Z [load_day 2024-06-27] 2024-06-27 hour 16: 222106 events in 0 files, snapshot none (task 9707 ms: download 7129 ms overlapping gunzip 1532 ms, parse 6610 ms, sort 0 ms, write 0 ms, index 714 ms: 7 candidates, 93264 repo-hours, 1812 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:45:31Z [load_day 2024-06-27] 2024-06-27 hour 17: 211011 events in 0 files, snapshot none (task 8827 ms: download 6206 ms overlapping gunzip 1348 ms, parse 6009 ms, sort 0 ms, write 0 ms, index 712 ms: 7 candidates, 84664 repo-hours, 1762 releases; waiting 452 ms; commit 0 ms)
2026-11-08T06:45:31Z [load_day 2024-06-27] 2024-06-27 hour 18: 221870 events in 0 files, snapshot none (task 8964 ms: download 6261 ms overlapping gunzip 1467 ms, parse 5944 ms, sort 0 ms, write 0 ms, index 710 ms: 8 candidates, 98570 repo-hours, 2236 releases; waiting 461 ms; commit 0 ms)
2026-11-08T06:45:39Z [load_day 2024-06-27] 2024-06-27 hour 19: 198032 events in 0 files, snapshot none (task 8329 ms: download 5971 ms overlapping gunzip 1309 ms, parse 5629 ms, sort 0 ms, write 0 ms, index 578 ms: 12 candidates, 76143 repo-hours, 2841 releases; waiting 548 ms; commit 0 ms)
2026-11-08T06:45:39Z [load_day 2024-06-27] 2024-06-27 hour 20: 195594 events in 0 files, snapshot none (task 7940 ms: download 5372 ms overlapping gunzip 1214 ms, parse 5242 ms, sort 0 ms, write 0 ms, index 624 ms: 9 candidates, 74048 repo-hours, 2598 releases; waiting 487 ms; commit 0 ms)
2026-11-08T06:45:47Z [load_day 2024-06-27] 2024-06-27 hour 21: 191785 events in 0 files, snapshot none (task 7699 ms: download 5040 ms overlapping gunzip 1235 ms, parse 5115 ms, sort 0 ms, write 0 ms, index 557 ms: 8 candidates, 73062 repo-hours, 2571 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:45:47Z [load_day 2024-06-27] 2024-06-27 hour 22: 160533 events in 0 files, snapshot none (task 7422 ms: download 4622 ms overlapping gunzip 1295 ms, parse 4835 ms, sort 0 ms, write 0 ms, index 461 ms: 8 candidates, 58496 repo-hours, 2663 releases; waiting 535 ms; commit 0 ms)
2026-11-08T06:45:53Z [load_day 2024-06-27] 2024-06-27 hour 23: 146790 events in 0 files, snapshot none (task 4594 ms: download 2468 ms overlapping gunzip 685 ms, parse 2927 ms, sort 0 ms, write 0 ms, index 400 ms: 13 candidates, 54448 repo-hours, 2429 releases; waiting 282 ms; commit 0 ms)
2026-11-08T06:46:01Z [load_day 2024-06-27] 2024-06-27: repo_hour merged from 24 files to 1 (2084806 rows, 8613 ms)
2026-11-08T06:46:04Z [load_day 2024-06-27] 2024-06-27: index committed in 11214 ms (24 + 1 + 24 files)
2026-11-08T06:46:04Z [load_day 2024-06-27] 2024-06-27: 4881801 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:46:04Z [load_day 2024-06-27] attempt 1 succeeded