orcaLog in

Runs · run 3717

load_day 2025-03-26, attempt 1 succeeded

Host
73ccef5e07c2:277531
Started
2026-11-08T11:03:12Z
Ended
2026-11-08T11:05:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
870 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
211.7 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3717/load_day/2025-03-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:03:12Z [load_day 2025-03-26] attempt 1 started
2026-11-08T11:03:13Z [load_day 2025-03-26] 2025-03-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:03:22Z [load_day 2025-03-26] 2025-03-26 hour 0: 207466 events in 0 files, snapshot none (task 8887 ms: download 5579 ms overlapping gunzip 1341 ms, parse 5858 ms, sort 0 ms, write 0 ms, index 880 ms: 5 candidates, 98216 repo-hours, 1341 releases; waiting 539 ms; commit 0 ms)
2026-11-08T11:03:22Z [load_day 2025-03-26] 2025-03-26 hour 1: 234942 events in 0 files, snapshot none (task 8542 ms: download 5089 ms overlapping gunzip 1201 ms, parse 5438 ms, sort 0 ms, write 0 ms, index 1187 ms: 4 candidates, 127964 repo-hours, 1039 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:03:32Z [load_day 2025-03-26] 2025-03-26 hour 2: 207478 events in 0 files, snapshot none (task 9078 ms: download 5543 ms overlapping gunzip 1413 ms, parse 5984 ms, sort 0 ms, write 0 ms, index 979 ms: 3 candidates, 91088 repo-hours, 959 releases; waiting 441 ms; commit 0 ms)
2026-11-08T11:03:32Z [load_day 2025-03-26] 2025-03-26 hour 3: 219047 events in 0 files, snapshot none (task 7948 ms: download 4236 ms overlapping gunzip 1119 ms, parse 5159 ms, sort 0 ms, write 0 ms, index 944 ms: 1 candidates, 91331 repo-hours, 3567 releases; waiting 516 ms; commit 0 ms)
2026-11-08T11:03:40Z [load_day 2025-03-26] 2025-03-26 hour 4: 199346 events in 0 files, snapshot none (task 8135 ms: download 5185 ms overlapping gunzip 1118 ms, parse 4513 ms, sort 0 ms, write 0 ms, index 922 ms: 7 candidates, 76770 repo-hours, 839 releases; waiting 1249 ms; commit 0 ms)
2026-11-08T11:03:40Z [load_day 2025-03-26] 2025-03-26 hour 5: 210090 events in 0 files, snapshot none (task 8147 ms: download 4997 ms overlapping gunzip 1170 ms, parse 5252 ms, sort 0 ms, write 0 ms, index 964 ms: 2 candidates, 82319 repo-hours, 1027 releases; waiting 440 ms; commit 0 ms)
2026-11-08T11:03:51Z [load_day 2025-03-26] 2025-03-26 hour 6: 235762 events in 0 files, snapshot none (task 10183 ms: download 6889 ms overlapping gunzip 1692 ms, parse 6842 ms, sort 0 ms, write 0 ms, index 928 ms: 2 candidates, 104902 repo-hours, 1179 releases; waiting 483 ms; commit 0 ms)
2026-11-08T11:03:51Z [load_day 2025-03-26] 2025-03-26 hour 7: 234324 events in 0 files, snapshot none (task 10246 ms: download 7172 ms overlapping gunzip 1708 ms, parse 6937 ms, sort 0 ms, write 0 ms, index 805 ms: 4 candidates, 94661 repo-hours, 1133 releases; waiting 448 ms; commit 0 ms)
2026-11-08T11:04:03Z [load_day 2025-03-26] 2025-03-26 hour 8: 250311 events in 0 files, snapshot none (task 12239 ms: download 8209 ms overlapping gunzip 1984 ms, parse 8316 ms, sort 0 ms, write 0 ms, index 1092 ms: 4 candidates, 106596 repo-hours, 1185 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:04:04Z [load_day 2025-03-26] 2025-03-26 hour 9: 261817 events in 0 files, snapshot none (task 12271 ms: download 8906 ms overlapping gunzip 2069 ms, parse 8404 ms, sort 0 ms, write 0 ms, index 972 ms: 3 candidates, 112924 repo-hours, 1423 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:04:15Z [load_day 2025-03-26] 2025-03-26 hour 10: 259109 events in 0 files, snapshot none (task 11501 ms: download 8321 ms overlapping gunzip 1770 ms, parse 7949 ms, sort 0 ms, write 0 ms, index 894 ms: 5 candidates, 108560 repo-hours, 1277 releases; waiting 560 ms; commit 0 ms)
2026-11-08T11:04:15Z [load_day 2025-03-26] 2025-03-26 hour 11: 249962 events in 0 files, snapshot none (task 10979 ms: download 7965 ms overlapping gunzip 1760 ms, parse 7619 ms, sort 0 ms, write 0 ms, index 855 ms: 5 candidates, 101690 repo-hours, 1370 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:04:28Z [load_day 2025-03-26] 2025-03-26 hour 12: 281484 events in 0 files, snapshot none (task 12011 ms: download 8565 ms overlapping gunzip 1893 ms, parse 8093 ms, sort 0 ms, write 0 ms, index 1239 ms: 8 candidates, 144679 repo-hours, 1477 releases; waiting 515 ms; commit 0 ms)
2026-11-08T11:04:28Z [load_day 2025-03-26] 2025-03-26 hour 13: 277359 events in 0 files, snapshot none (task 11954 ms: download 8706 ms overlapping gunzip 1964 ms, parse 8405 ms, sort 0 ms, write 0 ms, index 983 ms: 19 candidates, 132534 repo-hours, 1305 releases; waiting 307 ms; commit 0 ms)
2026-11-08T11:04:41Z [load_day 2025-03-26] 2025-03-26 hour 14: 278049 events in 0 files, snapshot none (task 12450 ms: download 9536 ms overlapping gunzip 2080 ms, parse 8926 ms, sort 0 ms, write 0 ms, index 883 ms: 11 candidates, 120240 repo-hours, 1606 releases; waiting 309 ms; commit 0 ms)
2026-11-08T11:04:41Z [load_day 2025-03-26] 2025-03-26 hour 15: 276911 events in 0 files, snapshot none (task 12885 ms: download 9982 ms overlapping gunzip 2062 ms, parse 8956 ms, sort 0 ms, write 0 ms, index 1027 ms: 16 candidates, 123813 repo-hours, 1619 releases; waiting 528 ms; commit 0 ms)
2026-11-08T11:04:50Z [load_day 2025-03-26] 2025-03-26 hour 16: 268725 events in 0 files, snapshot none (task 8998 ms: download 6403 ms overlapping gunzip 1411 ms, parse 6005 ms, sort 0 ms, write 0 ms, index 814 ms: 9 candidates, 116643 repo-hours, 1706 releases; waiting 537 ms; commit 0 ms)
2026-11-08T11:04:50Z [load_day 2025-03-26] 2025-03-26 hour 17: 259960 events in 0 files, snapshot none (task 8240 ms: download 5577 ms overlapping gunzip 1325 ms, parse 5553 ms, sort 0 ms, write 0 ms, index 863 ms: 14 candidates, 108148 repo-hours, 1333 releases; waiting 255 ms; commit 0 ms)
2026-11-08T11:05:00Z [load_day 2025-03-26] 2025-03-26 hour 18: 259471 events in 0 files, snapshot none (task 9679 ms: download 5561 ms overlapping gunzip 1496 ms, parse 6459 ms, sort 0 ms, write 0 ms, index 952 ms: 7 candidates, 117168 repo-hours, 1426 releases; waiting 364 ms; commit 0 ms)
2026-11-08T11:05:00Z [load_day 2025-03-26] 2025-03-26 hour 19: 242920 events in 0 files, snapshot none (task 8828 ms: download 5180 ms overlapping gunzip 1410 ms, parse 5655 ms, sort 0 ms, write 0 ms, index 1005 ms: 7 candidates, 95527 repo-hours, 1254 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:05:11Z [load_day 2025-03-26] 2025-03-26 hour 20: 231487 events in 0 files, snapshot none (task 9726 ms: download 6495 ms overlapping gunzip 1583 ms, parse 6600 ms, sort 0 ms, write 0 ms, index 788 ms: 7 candidates, 94132 repo-hours, 1239 releases; waiting 519 ms; commit 0 ms)
2026-11-08T11:05:11Z [load_day 2025-03-26] 2025-03-26 hour 21: 230420 events in 0 files, snapshot none (task 9942 ms: download 7239 ms overlapping gunzip 1485 ms, parse 6458 ms, sort 0 ms, write 0 ms, index 653 ms: 11 candidates, 91256 repo-hours, 1456 releases; waiting 1006 ms; commit 0 ms)
2026-11-08T11:05:20Z [load_day 2025-03-26] 2025-03-26 hour 22: 215253 events in 0 files, snapshot none (task 9019 ms: download 6331 ms overlapping gunzip 1479 ms, parse 5982 ms, sort 0 ms, write 0 ms, index 619 ms: 12 candidates, 81744 repo-hours, 1236 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:05:20Z [load_day 2025-03-26] 2025-03-26 hour 23: 203092 events in 0 files, snapshot none (task 8656 ms: download 5815 ms overlapping gunzip 1418 ms, parse 6069 ms, sort 0 ms, write 0 ms, index 597 ms: 0 candidates, 75717 repo-hours, 1200 releases; waiting 259 ms; commit 0 ms)
2026-11-08T11:05:31Z [load_day 2025-03-26] 2025-03-26: repo_hour merged from 24 files to 1 (2498622 rows, 11257 ms)
2026-11-08T11:05:35Z [load_day 2025-03-26] 2025-03-26: index committed in 14544 ms (23 + 1 + 24 files)
2026-11-08T11:05:35Z [load_day 2025-03-26] 2025-03-26: 5794785 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:05:35Z [load_day 2025-03-26] attempt 1 succeeded