orcaLog in

Runs · run 3088

load_day 2024-10-16, attempt 1 succeeded

Host
73ccef5e07c2:192851
Started
2026-11-08T08:22:01Z
Ended
2026-11-08T08:23:51Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
765 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
167.4 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3088/load_day/2024-10-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:22:01Z [load_day 2024-10-16] attempt 1 started
2026-11-08T08:22:02Z [load_day 2024-10-16] 2024-10-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:22:09Z [load_day 2024-10-16] 2024-10-16 hour 0: 187841 events in 0 files, snapshot none (task 6402 ms: download 3973 ms overlapping gunzip 975 ms, parse 3556 ms, sort 0 ms, write 0 ms, index 1012 ms: 5 candidates, 89496 repo-hours, 1074 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:22:09Z [load_day 2024-10-16] 2024-10-16 hour 1: 207657 events in 0 files, snapshot none (task 6261 ms: download 3064 ms overlapping gunzip 921 ms, parse 3752 ms, sort 0 ms, write 0 ms, index 1026 ms: 14 candidates, 107013 repo-hours, 822 releases; waiting 284 ms; commit 0 ms)
2026-11-08T08:22:15Z [load_day 2024-10-16] 2024-10-16 hour 2: 183014 events in 0 files, snapshot none (task 6213 ms: download 3392 ms overlapping gunzip 930 ms, parse 3534 ms, sort 0 ms, write 0 ms, index 937 ms: 12 candidates, 81218 repo-hours, 804 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:22:16Z [load_day 2024-10-16] 2024-10-16 hour 3: 197178 events in 0 files, snapshot none (task 6530 ms: download 3109 ms overlapping gunzip 941 ms, parse 3773 ms, sort 0 ms, write 0 ms, index 940 ms: 8 candidates, 78762 repo-hours, 4020 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:22:22Z [load_day 2024-10-16] 2024-10-16 hour 4: 180512 events in 0 files, snapshot none (task 5846 ms: download 3394 ms overlapping gunzip 906 ms, parse 3562 ms, sort 0 ms, write 0 ms, index 497 ms: 2 candidates, 66596 repo-hours, 635 releases; waiting 545 ms; commit 0 ms)
2026-11-08T08:22:23Z [load_day 2024-10-16] 2024-10-16 hour 5: 197201 events in 0 files, snapshot none (task 6574 ms: download 4176 ms overlapping gunzip 1106 ms, parse 4114 ms, sort 0 ms, write 0 ms, index 577 ms: 3 candidates, 73387 repo-hours, 965 releases; waiting 456 ms; commit 0 ms)
2026-11-08T08:22:30Z [load_day 2024-10-16] 2024-10-16 hour 6: 227635 events in 0 files, snapshot none (task 7799 ms: download 5032 ms overlapping gunzip 1364 ms, parse 4993 ms, sort 0 ms, write 0 ms, index 807 ms: 3 candidates, 97161 repo-hours, 1011 releases; waiting 340 ms; commit 0 ms)
2026-11-08T08:22:31Z [load_day 2024-10-16] 2024-10-16 hour 7: 231528 events in 0 files, snapshot none (task 7632 ms: download 5273 ms overlapping gunzip 1223 ms, parse 4862 ms, sort 0 ms, write 0 ms, index 671 ms: 4 candidates, 90375 repo-hours, 1254 releases; waiting 542 ms; commit 0 ms)
2026-11-08T08:22:41Z [load_day 2024-10-16] 2024-10-16 hour 8: 245844 events in 0 files, snapshot none (task 10456 ms: download 6992 ms overlapping gunzip 1678 ms, parse 6530 ms, sort 0 ms, write 0 ms, index 1154 ms: 12 candidates, 101996 repo-hours, 1326 releases; waiting 587 ms; commit 0 ms)
2026-11-08T08:22:42Z [load_day 2024-10-16] 2024-10-16 hour 9: 252811 events in 0 files, snapshot none (task 9906 ms: download 6271 ms overlapping gunzip 1678 ms, parse 6095 ms, sort 0 ms, write 0 ms, index 1269 ms: 13 candidates, 104234 repo-hours, 1393 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:22:51Z [load_day 2024-10-16] 2024-10-16 hour 10: 237785 events in 0 files, snapshot none (task 9091 ms: download 6042 ms overlapping gunzip 1529 ms, parse 5587 ms, sort 0 ms, write 0 ms, index 1127 ms: 3 candidates, 95850 repo-hours, 1202 releases; waiting 487 ms; commit 0 ms)
2026-11-08T08:22:51Z [load_day 2024-10-16] 2024-10-16 hour 11: 236438 events in 0 files, snapshot none (task 8941 ms: download 5564 ms overlapping gunzip 1504 ms, parse 5698 ms, sort 0 ms, write 0 ms, index 884 ms: 10 candidates, 92699 repo-hours, 1268 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:22:59Z [load_day 2024-10-16] 2024-10-16 hour 12: 272975 events in 0 files, snapshot none (task 7401 ms: download 4629 ms overlapping gunzip 1140 ms, parse 4442 ms, sort 0 ms, write 0 ms, index 963 ms: 8 candidates, 138872 repo-hours, 1461 releases; waiting 541 ms; commit 0 ms)
2026-11-08T08:23:00Z [load_day 2024-10-16] 2024-10-16 hour 13: 264000 events in 0 files, snapshot none (task 7249 ms: download 4759 ms overlapping gunzip 1174 ms, parse 4464 ms, sort 0 ms, write 0 ms, index 835 ms: 7 candidates, 119468 repo-hours, 1302 releases; waiting 496 ms; commit 0 ms)
2026-11-08T08:23:07Z [load_day 2024-10-16] 2024-10-16 hour 14: 274512 events in 0 files, snapshot none (task 7378 ms: download 4847 ms overlapping gunzip 1203 ms, parse 4588 ms, sort 0 ms, write 0 ms, index 817 ms: 11 candidates, 116022 repo-hours, 1274 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:23:07Z [load_day 2024-10-16] 2024-10-16 hour 15: 262277 events in 0 files, snapshot none (task 7393 ms: download 4907 ms overlapping gunzip 1198 ms, parse 4403 ms, sort 0 ms, write 0 ms, index 852 ms: 14 candidates, 112473 repo-hours, 1437 releases; waiting 680 ms; commit 0 ms)
2026-11-08T08:23:15Z [load_day 2024-10-16] 2024-10-16 hour 16: 252831 events in 0 files, snapshot none (task 8167 ms: download 5426 ms overlapping gunzip 1333 ms, parse 5111 ms, sort 0 ms, write 0 ms, index 810 ms: 15 candidates, 103785 repo-hours, 1203 releases; waiting 606 ms; commit 0 ms)
2026-11-08T08:23:15Z [load_day 2024-10-16] 2024-10-16 hour 17: 242501 events in 0 files, snapshot none (task 7200 ms: download 4632 ms overlapping gunzip 1181 ms, parse 4720 ms, sort 0 ms, write 0 ms, index 844 ms: 12 candidates, 95236 repo-hours, 1105 releases; waiting 246 ms; commit 0 ms)
2026-11-08T08:23:23Z [load_day 2024-10-16] 2024-10-16 hour 18: 241988 events in 0 files, snapshot none (task 7743 ms: download 5233 ms overlapping gunzip 1357 ms, parse 4872 ms, sort 0 ms, write 0 ms, index 728 ms: 8 candidates, 105435 repo-hours, 1165 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:23:24Z [load_day 2024-10-16] 2024-10-16 hour 19: 223465 events in 0 files, snapshot none (task 7892 ms: download 5525 ms overlapping gunzip 1276 ms, parse 5066 ms, sort 0 ms, write 0 ms, index 657 ms: 18 candidates, 83586 repo-hours, 1127 releases; waiting 575 ms; commit 0 ms)
2026-11-08T08:23:31Z [load_day 2024-10-16] 2024-10-16 hour 20: 223450 events in 0 files, snapshot none (task 7678 ms: download 4641 ms overlapping gunzip 1189 ms, parse 4372 ms, sort 0 ms, write 0 ms, index 1241 ms: 9 candidates, 83850 repo-hours, 1005 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:23:32Z [load_day 2024-10-16] 2024-10-16 hour 21: 214656 events in 0 files, snapshot none (task 7607 ms: download 4746 ms overlapping gunzip 1180 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 1189 ms: 12 candidates, 82261 repo-hours, 1163 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:23:38Z [load_day 2024-10-16] 2024-10-16 hour 22: 190785 events in 0 files, snapshot none (task 5831 ms: download 3476 ms overlapping gunzip 945 ms, parse 3597 ms, sort 0 ms, write 0 ms, index 572 ms: 8 candidates, 68657 repo-hours, 1214 releases; waiting 476 ms; commit 0 ms)
2026-11-08T08:23:38Z [load_day 2024-10-16] 2024-10-16 hour 23: 182521 events in 0 files, snapshot none (task 6092 ms: download 3835 ms overlapping gunzip 933 ms, parse 3894 ms, sort 0 ms, write 0 ms, index 465 ms: 7 candidates, 64259 repo-hours, 1000 releases; waiting 478 ms; commit 0 ms)
2026-11-08T08:23:48Z [load_day 2024-10-16] 2024-10-16: repo_hour merged from 24 files to 1 (2252691 rows, 10030 ms)
2026-11-08T08:23:51Z [load_day 2024-10-16] 2024-10-16: index committed in 12389 ms (24 + 1 + 24 files)
2026-11-08T08:23:51Z [load_day 2024-10-16] 2024-10-16: 5431405 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:23:51Z [load_day 2024-10-16] attempt 1 succeeded