orcaLog in

Runs · run 3811

load_day 2025-04-21, attempt 1 succeeded

Host
73ccef5e07c2:291333
Started
2026-11-08T11:31:30Z
Ended
2026-11-08T11:33:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
798 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
207.6 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3811/load_day/2025-04-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:31:30Z [load_day 2025-04-21] attempt 1 started
2026-11-08T11:31:31Z [load_day 2025-04-21] 2025-04-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:31:39Z [load_day 2025-04-21] 2025-04-21 hour 0: 185289 events in 0 files, snapshot none (task 7489 ms: download 5053 ms overlapping gunzip 1154 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 627 ms: 8 candidates, 83502 repo-hours, 1650 releases; waiting 539 ms; commit 0 ms)
2026-11-08T11:31:40Z [load_day 2025-04-21] 2025-04-21 hour 1: 223273 events in 0 files, snapshot none (task 8365 ms: download 5546 ms overlapping gunzip 1322 ms, parse 5278 ms, sort 0 ms, write 0 ms, index 802 ms: 4 candidates, 120045 repo-hours, 1096 releases; waiting 666 ms; commit 0 ms)
2026-11-08T11:31:48Z [load_day 2025-04-21] 2025-04-21 hour 2: 204767 events in 0 files, snapshot none (task 8242 ms: download 5331 ms overlapping gunzip 1299 ms, parse 5312 ms, sort 0 ms, write 0 ms, index 787 ms: 7 candidates, 85269 repo-hours, 1107 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:31:49Z [load_day 2025-04-21] 2025-04-21 hour 3: 206937 events in 0 files, snapshot none (task 8510 ms: download 5872 ms overlapping gunzip 1425 ms, parse 5638 ms, sort 0 ms, write 0 ms, index 743 ms: 8 candidates, 87132 repo-hours, 3046 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:31:56Z [load_day 2025-04-21] 2025-04-21 hour 4: 190209 events in 0 files, snapshot none (task 7730 ms: download 4810 ms overlapping gunzip 1251 ms, parse 4979 ms, sort 0 ms, write 0 ms, index 608 ms: 4 candidates, 72564 repo-hours, 955 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:31:58Z [load_day 2025-04-21] 2025-04-21 hour 5: 203098 events in 0 files, snapshot none (task 8164 ms: download 5740 ms overlapping gunzip 1290 ms, parse 5488 ms, sort 0 ms, write 0 ms, index 706 ms: 6 candidates, 80178 repo-hours, 959 releases; waiting 450 ms; commit 0 ms)
2026-11-08T11:32:05Z [load_day 2025-04-21] 2025-04-21 hour 6: 226529 events in 0 files, snapshot none (task 8751 ms: download 5871 ms overlapping gunzip 1342 ms, parse 5544 ms, sort 0 ms, write 0 ms, index 945 ms: 8 candidates, 100959 repo-hours, 1292 releases; waiting 593 ms; commit 0 ms)
2026-11-08T11:32:07Z [load_day 2025-04-21] 2025-04-21 hour 7: 227017 events in 0 files, snapshot none (task 8700 ms: download 5780 ms overlapping gunzip 1446 ms, parse 5655 ms, sort 0 ms, write 0 ms, index 799 ms: 9 candidates, 89523 repo-hours, 986 releases; waiting 483 ms; commit 0 ms)
2026-11-08T11:32:14Z [load_day 2025-04-21] 2025-04-21 hour 8: 225797 events in 0 files, snapshot none (task 7571 ms: download 4804 ms overlapping gunzip 1195 ms, parse 4731 ms, sort 0 ms, write 0 ms, index 730 ms: 7 candidates, 94494 repo-hours, 1312 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:32:15Z [load_day 2025-04-21] 2025-04-21 hour 9: 238410 events in 0 files, snapshot none (task 7555 ms: download 5030 ms overlapping gunzip 1234 ms, parse 4794 ms, sort 0 ms, write 0 ms, index 743 ms: 15 candidates, 98985 repo-hours, 1354 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:32:21Z [load_day 2025-04-21] 2025-04-21 hour 10: 230189 events in 0 files, snapshot none (task 7183 ms: download 4640 ms overlapping gunzip 1147 ms, parse 4497 ms, sort 0 ms, write 0 ms, index 676 ms: 13 candidates, 94123 repo-hours, 1039 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:32:23Z [load_day 2025-04-21] 2025-04-21 hour 11: 229548 events in 0 files, snapshot none (task 7108 ms: download 4506 ms overlapping gunzip 1122 ms, parse 4424 ms, sort 0 ms, write 0 ms, index 713 ms: 15 candidates, 90474 repo-hours, 1154 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:32:31Z [load_day 2025-04-21] 2025-04-21 hour 12: 266128 events in 0 files, snapshot none (task 9289 ms: download 5781 ms overlapping gunzip 1497 ms, parse 6205 ms, sort 0 ms, write 0 ms, index 1098 ms: 17 candidates, 133914 repo-hours, 1273 releases; waiting 271 ms; commit 0 ms)
2026-11-08T11:32:34Z [load_day 2025-04-21] 2025-04-21 hour 13: 260821 events in 0 files, snapshot none (task 10399 ms: download 7557 ms overlapping gunzip 1675 ms, parse 6878 ms, sort 0 ms, write 0 ms, index 1032 ms: 11 candidates, 121320 repo-hours, 1206 releases; waiting 485 ms; commit 0 ms)
2026-11-08T11:32:42Z [load_day 2025-04-21] 2025-04-21 hour 14: 259456 events in 0 files, snapshot none (task 10406 ms: download 7592 ms overlapping gunzip 1664 ms, parse 7047 ms, sort 0 ms, write 0 ms, index 838 ms: 10 candidates, 106344 repo-hours, 1449 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:32:46Z [load_day 2025-04-21] 2025-04-21 hour 15: 270278 events in 0 files, snapshot none (task 11328 ms: download 7151 ms overlapping gunzip 1774 ms, parse 7182 ms, sort 0 ms, write 0 ms, index 1540 ms: 8 candidates, 112688 repo-hours, 1479 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:32:56Z [load_day 2025-04-21] 2025-04-21 hour 16: 258480 events in 0 files, snapshot none (task 12926 ms: download 9147 ms overlapping gunzip 2235 ms, parse 8953 ms, sort 0 ms, write 0 ms, index 1002 ms: 12 candidates, 106676 repo-hours, 1171 releases; waiting 467 ms; commit 0 ms)
2026-11-08T11:32:58Z [load_day 2025-04-21] 2025-04-21 hour 17: 257898 events in 0 files, snapshot none (task 11308 ms: download 8479 ms overlapping gunzip 1898 ms, parse 7719 ms, sort 0 ms, write 0 ms, index 898 ms: 14 candidates, 103154 repo-hours, 1265 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:33:11Z [load_day 2025-04-21] 2025-04-21 hour 18: 264255 events in 0 files, snapshot none (task 14430 ms: download 11826 ms overlapping gunzip 1703 ms, parse 7314 ms, sort 0 ms, write 0 ms, index 774 ms: 10 candidates, 115778 repo-hours, 1351 releases; waiting 4304 ms; commit 0 ms)
2026-11-08T11:33:11Z [load_day 2025-04-21] 2025-04-21 hour 19: 245843 events in 0 files, snapshot none (task 10290 ms: download 6924 ms overlapping gunzip 1711 ms, parse 6860 ms, sort 0 ms, write 0 ms, index 899 ms: 6 candidates, 95039 repo-hours, 1242 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:33:22Z [load_day 2025-04-21] 2025-04-21 hour 20: 237439 events in 0 files, snapshot none (task 10747 ms: download 8113 ms overlapping gunzip 1789 ms, parse 7302 ms, sort 0 ms, write 0 ms, index 770 ms: 11 candidates, 93765 repo-hours, 1300 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:33:22Z [load_day 2025-04-21] 2025-04-21 hour 21: 228455 events in 0 files, snapshot none (task 10349 ms: download 7882 ms overlapping gunzip 1652 ms, parse 7241 ms, sort 0 ms, write 0 ms, index 649 ms: 9 candidates, 89553 repo-hours, 1296 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:33:31Z [load_day 2025-04-21] 2025-04-21 hour 22: 208120 events in 0 files, snapshot none (task 8776 ms: download 6397 ms overlapping gunzip 1522 ms, parse 5890 ms, sort 0 ms, write 0 ms, index 586 ms: 21 candidates, 77579 repo-hours, 1278 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:33:31Z [load_day 2025-04-21] 2025-04-21 hour 23: 195298 events in 0 files, snapshot none (task 9215 ms: download 6613 ms overlapping gunzip 1535 ms, parse 5884 ms, sort 0 ms, write 0 ms, index 530 ms: 9 candidates, 72403 repo-hours, 1264 releases; waiting 977 ms; commit 0 ms)
2026-11-08T11:33:42Z [load_day 2025-04-21] 2025-04-21: repo_hour merged from 24 files to 1 (2325461 rows, 10684 ms)
2026-11-08T11:33:45Z [load_day 2025-04-21] 2025-04-21: index committed in 13161 ms (24 + 1 + 24 files)
2026-11-08T11:33:45Z [load_day 2025-04-21] 2025-04-21: 5543534 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:33:45Z [load_day 2025-04-21] attempt 1 succeeded