orcaLog in

Runs · run 3604

load_day 2025-02-25, attempt 1 succeeded

Host
73ccef5e07c2:261252
Started
2026-11-08T10:31:38Z
Ended
2026-11-08T10:33:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
885 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
209.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3604/load_day/2025-02-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:31:38Z [load_day 2025-02-25] attempt 1 started
2026-11-08T10:31:39Z [load_day 2025-02-25] 2025-02-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:31:49Z [load_day 2025-02-25] 2025-02-25 hour 0: 216470 events in 0 files, snapshot none (task 9572 ms: download 6445 ms overlapping gunzip 1524 ms, parse 6358 ms, sort 0 ms, write 0 ms, index 895 ms: 11 candidates, 102024 repo-hours, 1281 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:31:49Z [load_day 2025-02-25] 2025-02-25 hour 1: 224484 events in 0 files, snapshot none (task 9701 ms: download 6401 ms overlapping gunzip 1565 ms, parse 6328 ms, sort 0 ms, write 0 ms, index 1034 ms: 10 candidates, 122275 repo-hours, 996 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:31:59Z [load_day 2025-02-25] 2025-02-25 hour 2: 211532 events in 0 files, snapshot none (task 9461 ms: download 5489 ms overlapping gunzip 1451 ms, parse 6091 ms, sort 0 ms, write 0 ms, index 1168 ms: 7 candidates, 93988 repo-hours, 940 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:31:59Z [load_day 2025-02-25] 2025-02-25 hour 3: 231321 events in 0 files, snapshot none (task 10104 ms: download 6165 ms overlapping gunzip 1576 ms, parse 6548 ms, sort 0 ms, write 0 ms, index 1101 ms: 6 candidates, 94332 repo-hours, 3940 releases; waiting 527 ms; commit 0 ms)
2026-11-08T10:32:07Z [load_day 2025-02-25] 2025-02-25 hour 4: 213762 events in 0 files, snapshot none (task 7834 ms: download 5131 ms overlapping gunzip 1160 ms, parse 5078 ms, sort 0 ms, write 0 ms, index 744 ms: 6 candidates, 78603 repo-hours, 797 releases; waiting 448 ms; commit 0 ms)
2026-11-08T10:32:08Z [load_day 2025-02-25] 2025-02-25 hour 5: 221621 events in 0 files, snapshot none (task 8217 ms: download 5275 ms overlapping gunzip 1336 ms, parse 5464 ms, sort 0 ms, write 0 ms, index 937 ms: 6 candidates, 84446 repo-hours, 793 releases; waiting 177 ms; commit 0 ms)
2026-11-08T10:32:17Z [load_day 2025-02-25] 2025-02-25 hour 6: 246080 events in 0 files, snapshot none (task 9625 ms: download 5991 ms overlapping gunzip 1340 ms, parse 6370 ms, sort 0 ms, write 0 ms, index 1131 ms: 8 candidates, 107256 repo-hours, 1117 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:32:19Z [load_day 2025-02-25] 2025-02-25 hour 7: 242490 events in 0 files, snapshot none (task 9991 ms: download 7268 ms overlapping gunzip 1604 ms, parse 6829 ms, sort 0 ms, write 0 ms, index 773 ms: 8 candidates, 95531 repo-hours, 1120 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:32:29Z [load_day 2025-02-25] 2025-02-25 hour 8: 258054 events in 0 files, snapshot none (task 11213 ms: download 8005 ms overlapping gunzip 1829 ms, parse 7793 ms, sort 0 ms, write 0 ms, index 811 ms: 5 candidates, 105782 repo-hours, 1128 releases; waiting 512 ms; commit 0 ms)
2026-11-08T10:32:30Z [load_day 2025-02-25] 2025-02-25 hour 9: 268573 events in 0 files, snapshot none (task 10557 ms: download 7803 ms overlapping gunzip 1799 ms, parse 7191 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 112289 repo-hours, 1324 releases; waiting 479 ms; commit 0 ms)
2026-11-08T10:32:40Z [load_day 2025-02-25] 2025-02-25 hour 10: 259338 events in 0 files, snapshot none (task 10894 ms: download 7797 ms overlapping gunzip 1691 ms, parse 7284 ms, sort 0 ms, write 0 ms, index 901 ms: 10 candidates, 107819 repo-hours, 1265 releases; waiting 723 ms; commit 0 ms)
2026-11-08T10:32:41Z [load_day 2025-02-25] 2025-02-25 hour 11: 255628 events in 0 files, snapshot none (task 10246 ms: download 7626 ms overlapping gunzip 1627 ms, parse 7101 ms, sort 0 ms, write 0 ms, index 787 ms: 11 candidates, 103329 repo-hours, 1254 releases; waiting 469 ms; commit 0 ms)
2026-11-08T10:32:49Z [load_day 2025-02-25] 2025-02-25 hour 12: 288404 events in 0 files, snapshot none (task 8462 ms: download 5477 ms overlapping gunzip 1247 ms, parse 5202 ms, sort 0 ms, write 0 ms, index 1027 ms: 12 candidates, 145983 repo-hours, 1558 releases; waiting 642 ms; commit 0 ms)
2026-11-08T10:32:50Z [load_day 2025-02-25] 2025-02-25 hour 13: 277340 events in 0 files, snapshot none (task 8805 ms: download 6041 ms overlapping gunzip 1325 ms, parse 5750 ms, sort 0 ms, write 0 ms, index 924 ms: 9 candidates, 130160 repo-hours, 1295 releases; waiting 528 ms; commit 0 ms)
2026-11-08T10:32:58Z [load_day 2025-02-25] 2025-02-25 hour 14: 245587 events in 0 files, snapshot none (task 8210 ms: download 5584 ms overlapping gunzip 1320 ms, parse 5364 ms, sort 0 ms, write 0 ms, index 800 ms: 15 candidates, 109249 repo-hours, 1323 releases; waiting 508 ms; commit 0 ms)
2026-11-08T10:33:00Z [load_day 2025-02-25] 2025-02-25 hour 15: 241322 events in 0 files, snapshot none (task 7966 ms: download 4963 ms overlapping gunzip 1178 ms, parse 4839 ms, sort 0 ms, write 0 ms, index 1147 ms: 17 candidates, 112937 repo-hours, 1442 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:33:07Z [load_day 2025-02-25] 2025-02-25 hour 16: 232255 events in 0 files, snapshot none (task 9115 ms: download 6346 ms overlapping gunzip 1442 ms, parse 5978 ms, sort 0 ms, write 0 ms, index 945 ms: 13 candidates, 106661 repo-hours, 1092 releases; waiting 478 ms; commit 0 ms)
2026-11-08T10:33:12Z [load_day 2025-02-25] 2025-02-25 hour 17: 264188 events in 0 files, snapshot none (task 11398 ms: download 7351 ms overlapping gunzip 1670 ms, parse 7053 ms, sort 0 ms, write 0 ms, index 1571 ms: 7 candidates, 109359 repo-hours, 1167 releases; waiting 784 ms; commit 0 ms)
2026-11-08T10:33:20Z [load_day 2025-02-25] 2025-02-25 hour 18: 267292 events in 0 files, snapshot none (task 12265 ms: download 7325 ms overlapping gunzip 1870 ms, parse 8186 ms, sort 0 ms, write 0 ms, index 1403 ms: 12 candidates, 120306 repo-hours, 1386 releases; waiting 498 ms; commit 0 ms)
2026-11-08T10:33:22Z [load_day 2025-02-25] 2025-02-25 hour 19: 247987 events in 0 files, snapshot none (task 9815 ms: download 6589 ms overlapping gunzip 1681 ms, parse 6773 ms, sort 0 ms, write 0 ms, index 919 ms: 8 candidates, 98652 repo-hours, 1205 releases; waiting 173 ms; commit 0 ms)
2026-11-08T10:33:31Z [load_day 2025-02-25] 2025-02-25 hour 20: 237212 events in 0 files, snapshot none (task 9885 ms: download 5982 ms overlapping gunzip 1516 ms, parse 6544 ms, sort 0 ms, write 0 ms, index 1050 ms: 9 candidates, 95549 repo-hours, 1246 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:33:33Z [load_day 2025-02-25] 2025-02-25 hour 21: 235224 events in 0 files, snapshot none (task 10110 ms: download 7359 ms overlapping gunzip 1611 ms, parse 6893 ms, sort 0 ms, write 0 ms, index 848 ms: 12 candidates, 94222 repo-hours, 1265 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:33:40Z [load_day 2025-02-25] 2025-02-25 hour 22: 223067 events in 0 files, snapshot none (task 8781 ms: download 5291 ms overlapping gunzip 1427 ms, parse 5768 ms, sort 0 ms, write 0 ms, index 933 ms: 27 candidates, 84604 repo-hours, 1375 releases; waiting 346 ms; commit 0 ms)
2026-11-08T10:33:42Z [load_day 2025-02-25] 2025-02-25 hour 23: 207682 events in 0 files, snapshot none (task 8380 ms: download 5899 ms overlapping gunzip 1370 ms, parse 5723 ms, sort 0 ms, write 0 ms, index 574 ms: 17 candidates, 77224 repo-hours, 1056 releases; waiting 422 ms; commit 0 ms)
2026-11-08T10:33:53Z [load_day 2025-02-25] 2025-02-25: repo_hour merged from 24 files to 1 (2492580 rows, 10716 ms)
2026-11-08T10:33:55Z [load_day 2025-02-25] 2025-02-25: index committed in 13450 ms (24 + 1 + 24 files)
2026-11-08T10:33:55Z [load_day 2025-02-25] 2025-02-25: 5816913 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:33:55Z [load_day 2025-02-25] attempt 1 succeeded