orcaLog in

Runs · run 3839

load_day 2025-04-29, attempt 1 succeeded

Host
73ccef5e07c2:295555
Started
2026-11-08T11:39:53Z
Ended
2026-11-08T11:42:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
860 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
216.2 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3839/load_day/2025-04-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:39:53Z [load_day 2025-04-29] attempt 1 started
2026-11-08T11:39:54Z [load_day 2025-04-29] 2025-04-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:40:07Z [load_day 2025-04-29] 2025-04-29 hour 0: 212511 events in 0 files, snapshot none (task 12230 ms: download 8416 ms overlapping gunzip 1976 ms, parse 8242 ms, sort 0 ms, write 0 ms, index 1119 ms: 6 candidates, 97630 repo-hours, 1268 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:40:07Z [load_day 2025-04-29] 2025-04-29 hour 1: 238322 events in 0 files, snapshot none (task 12253 ms: download 8181 ms overlapping gunzip 1934 ms, parse 8241 ms, sort 0 ms, write 0 ms, index 1177 ms: 10 candidates, 128837 repo-hours, 924 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:40:18Z [load_day 2025-04-29] 2025-04-29 hour 2: 220966 events in 0 files, snapshot none (task 10500 ms: download 7537 ms overlapping gunzip 1779 ms, parse 7049 ms, sort 0 ms, write 0 ms, index 832 ms: 8 candidates, 97628 repo-hours, 916 releases; waiting 588 ms; commit 0 ms)
2026-11-08T11:40:18Z [load_day 2025-04-29] 2025-04-29 hour 3: 214956 events in 0 files, snapshot none (task 8040 ms: download 4660 ms overlapping gunzip 1256 ms, parse 5261 ms, sort 0 ms, write 0 ms, index 1006 ms: 6 candidates, 91797 repo-hours, 2897 releases; waiting 229 ms; commit 0 ms)
2026-11-08T11:40:26Z [load_day 2025-04-29] 2025-04-29 hour 4: 201037 events in 0 files, snapshot none (task 7700 ms: download 4109 ms overlapping gunzip 1083 ms, parse 4729 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 78091 repo-hours, 858 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:40:27Z [load_day 2025-04-29] 2025-04-29 hour 5: 213155 events in 0 files, snapshot none (task 8442 ms: download 4730 ms overlapping gunzip 1354 ms, parse 5733 ms, sort 0 ms, write 0 ms, index 887 ms: 8 candidates, 84086 repo-hours, 1018 releases; waiting 255 ms; commit 0 ms)
2026-11-08T11:40:37Z [load_day 2025-04-29] 2025-04-29 hour 6: 238088 events in 0 files, snapshot none (task 9553 ms: download 5639 ms overlapping gunzip 1463 ms, parse 6067 ms, sort 0 ms, write 0 ms, index 1191 ms: 11 candidates, 105543 repo-hours, 1244 releases; waiting 438 ms; commit 0 ms)
2026-11-08T11:40:38Z [load_day 2025-04-29] 2025-04-29 hour 7: 244112 events in 0 files, snapshot none (task 10315 ms: download 6627 ms overlapping gunzip 1572 ms, parse 6882 ms, sort 0 ms, write 0 ms, index 1067 ms: 7 candidates, 102719 repo-hours, 1134 releases; waiting 511 ms; commit 0 ms)
2026-11-08T11:40:47Z [load_day 2025-04-29] 2025-04-29 hour 8: 252722 events in 0 files, snapshot none (task 9846 ms: download 6196 ms overlapping gunzip 1524 ms, parse 6169 ms, sort 0 ms, write 0 ms, index 1338 ms: 5 candidates, 109608 repo-hours, 1384 releases; waiting 560 ms; commit 0 ms)
2026-11-08T11:40:49Z [load_day 2025-04-29] 2025-04-29 hour 9: 253487 events in 0 files, snapshot none (task 10480 ms: download 7092 ms overlapping gunzip 1619 ms, parse 6884 ms, sort 0 ms, write 0 ms, index 1186 ms: 7 candidates, 109748 repo-hours, 1321 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:40:56Z [load_day 2025-04-29] 2025-04-29 hour 10: 242295 events in 0 files, snapshot none (task 8836 ms: download 5609 ms overlapping gunzip 1395 ms, parse 5602 ms, sort 0 ms, write 0 ms, index 1087 ms: 3 candidates, 103506 repo-hours, 1306 releases; waiting 468 ms; commit 0 ms)
2026-11-08T11:40:59Z [load_day 2025-04-29] 2025-04-29 hour 11: 246112 events in 0 files, snapshot none (task 8563 ms: download 5635 ms overlapping gunzip 1337 ms, parse 5692 ms, sort 0 ms, write 0 ms, index 744 ms: 6 candidates, 101108 repo-hours, 1272 releases; waiting 147 ms; commit 0 ms)
2026-11-08T11:41:06Z [load_day 2025-04-29] 2025-04-29 hour 12: 277200 events in 0 files, snapshot none (task 8997 ms: download 5827 ms overlapping gunzip 1344 ms, parse 5850 ms, sort 0 ms, write 0 ms, index 1196 ms: 10 candidates, 142573 repo-hours, 1466 releases; waiting 293 ms; commit 0 ms)
2026-11-08T11:41:09Z [load_day 2025-04-29] 2025-04-29 hour 13: 273941 events in 0 files, snapshot none (task 10048 ms: download 7031 ms overlapping gunzip 1451 ms, parse 6093 ms, sort 0 ms, write 0 ms, index 1143 ms: 12 candidates, 135008 repo-hours, 1338 releases; waiting 1115 ms; commit 0 ms)
2026-11-08T11:41:18Z [load_day 2025-04-29] 2025-04-29 hour 14: 265745 events in 0 files, snapshot none (task 11774 ms: download 8047 ms overlapping gunzip 1946 ms, parse 7809 ms, sort 0 ms, write 0 ms, index 1166 ms: 9 candidates, 116187 repo-hours, 1343 releases; waiting 550 ms; commit 0 ms)
2026-11-08T11:41:23Z [load_day 2025-04-29] 2025-04-29 hour 15: 271976 events in 0 files, snapshot none (task 12767 ms: download 8447 ms overlapping gunzip 1888 ms, parse 7710 ms, sort 0 ms, write 0 ms, index 2160 ms: 7 candidates, 119181 repo-hours, 1855 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:41:30Z [load_day 2025-04-29] 2025-04-29 hour 16: 255402 events in 0 files, snapshot none (task 11102 ms: download 7818 ms overlapping gunzip 1741 ms, parse 7311 ms, sort 0 ms, write 0 ms, index 1138 ms: 16 candidates, 111461 repo-hours, 1452 releases; waiting 561 ms; commit 0 ms)
2026-11-08T11:41:34Z [load_day 2025-04-29] 2025-04-29 hour 17: 251888 events in 0 files, snapshot none (task 10340 ms: download 5786 ms overlapping gunzip 1572 ms, parse 6634 ms, sort 0 ms, write 0 ms, index 1290 ms: 10 candidates, 104379 repo-hours, 1249 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:41:41Z [load_day 2025-04-29] 2025-04-29 hour 18: 252745 events in 0 files, snapshot none (task 10682 ms: download 6394 ms overlapping gunzip 1656 ms, parse 6951 ms, sort 0 ms, write 0 ms, index 1248 ms: 10 candidates, 113302 repo-hours, 1245 releases; waiting 533 ms; commit 0 ms)
2026-11-08T11:41:44Z [load_day 2025-04-29] 2025-04-29 hour 19: 237443 events in 0 files, snapshot none (task 9920 ms: download 6709 ms overlapping gunzip 1498 ms, parse 6651 ms, sort 0 ms, write 0 ms, index 939 ms: 3 candidates, 93507 repo-hours, 1189 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:41:51Z [load_day 2025-04-29] 2025-04-29 hour 20: 231527 events in 0 files, snapshot none (task 8766 ms: download 5585 ms overlapping gunzip 1274 ms, parse 5771 ms, sort 0 ms, write 0 ms, index 1065 ms: 11 candidates, 93213 repo-hours, 1375 releases; waiting 298 ms; commit 0 ms)
2026-11-08T11:41:54Z [load_day 2025-04-29] 2025-04-29 hour 21: 222515 events in 0 files, snapshot none (task 9611 ms: download 6185 ms overlapping gunzip 1546 ms, parse 6230 ms, sort 0 ms, write 0 ms, index 1034 ms: 14 candidates, 85949 repo-hours, 1374 releases; waiting 475 ms; commit 0 ms)
2026-11-08T11:42:00Z [load_day 2025-04-29] 2025-04-29 hour 22: 204375 events in 0 files, snapshot none (task 8441 ms: download 5055 ms overlapping gunzip 1302 ms, parse 5490 ms, sort 0 ms, write 0 ms, index 795 ms: 4 candidates, 77206 repo-hours, 1296 releases; waiting 502 ms; commit 0 ms)
2026-11-08T11:42:02Z [load_day 2025-04-29] 2025-04-29 hour 23: 193361 events in 0 files, snapshot none (task 7420 ms: download 4475 ms overlapping gunzip 1072 ms, parse 4939 ms, sort 0 ms, write 0 ms, index 625 ms: 2 candidates, 72705 repo-hours, 1006 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:42:14Z [load_day 2025-04-29] 2025-04-29: repo_hour merged from 24 files to 1 (2474972 rows, 11335 ms)
2026-11-08T11:42:16Z [load_day 2025-04-29] 2025-04-29: index committed in 14093 ms (24 + 1 + 24 files)
2026-11-08T11:42:16Z [load_day 2025-04-29] 2025-04-29: 5715881 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:42:16Z [load_day 2025-04-29] attempt 1 succeeded