orcaLog in

Runs · run 3461

load_day 2025-01-21, attempt 1 succeeded

Host
73ccef5e07c2:241282
Started
2026-11-08T09:55:22Z
Ended
2026-11-08T09:57:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
892 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
203.4 s, up to 3.5 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3461/load_day/2025-01-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:55:22Z [load_day 2025-01-21] attempt 1 started
2026-11-08T09:55:23Z [load_day 2025-01-21] 2025-01-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:55:32Z [load_day 2025-01-21] 2025-01-21 hour 0: 199271 events in 0 files, snapshot none (task 8717 ms: download 5085 ms overlapping gunzip 1366 ms, parse 5601 ms, sort 0 ms, write 0 ms, index 917 ms: 6 candidates, 96027 repo-hours, 1203 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:55:32Z [load_day 2025-01-21] 2025-01-21 hour 1: 213070 events in 0 files, snapshot none (task 8567 ms: download 5273 ms overlapping gunzip 1268 ms, parse 5441 ms, sort 0 ms, write 0 ms, index 1038 ms: 9 candidates, 112254 repo-hours, 874 releases; waiting 515 ms; commit 0 ms)
2026-11-08T09:55:40Z [load_day 2025-01-21] 2025-01-21 hour 2: 183695 events in 0 files, snapshot none (task 7311 ms: download 3829 ms overlapping gunzip 1079 ms, parse 4488 ms, sort 0 ms, write 0 ms, index 871 ms: 8 candidates, 79149 repo-hours, 892 releases; waiting 586 ms; commit 0 ms)
2026-11-08T09:55:40Z [load_day 2025-01-21] 2025-01-21 hour 3: 192927 events in 0 files, snapshot none (task 7550 ms: download 4529 ms overlapping gunzip 1117 ms, parse 4714 ms, sort 0 ms, write 0 ms, index 841 ms: 7 candidates, 77629 repo-hours, 3746 releases; waiting 637 ms; commit 0 ms)
2026-11-08T09:55:47Z [load_day 2025-01-21] 2025-01-21 hour 4: 180250 events in 0 files, snapshot none (task 6439 ms: download 3880 ms overlapping gunzip 991 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 565 ms: 7 candidates, 67170 repo-hours, 708 releases; waiting 535 ms; commit 0 ms)
2026-11-08T09:55:47Z [load_day 2025-01-21] 2025-01-21 hour 5: 195283 events in 0 files, snapshot none (task 6713 ms: download 4359 ms overlapping gunzip 1013 ms, parse 4041 ms, sort 0 ms, write 0 ms, index 538 ms: 4 candidates, 73657 repo-hours, 762 releases; waiting 900 ms; commit 0 ms)
2026-11-08T09:55:57Z [load_day 2025-01-21] 2025-01-21 hour 6: 218989 events in 0 files, snapshot none (task 9804 ms: download 6341 ms overlapping gunzip 1477 ms, parse 6533 ms, sort 0 ms, write 0 ms, index 982 ms: 8 candidates, 96267 repo-hours, 975 releases; waiting 543 ms; commit 0 ms)
2026-11-08T09:55:57Z [load_day 2025-01-21] 2025-01-21 hour 7: 216008 events in 0 files, snapshot none (task 9112 ms: download 5961 ms overlapping gunzip 1427 ms, parse 6145 ms, sort 0 ms, write 0 ms, index 740 ms: 7 candidates, 83766 repo-hours, 877 releases; waiting 494 ms; commit 0 ms)
2026-11-08T09:56:08Z [load_day 2025-01-21] 2025-01-21 hour 8: 233478 events in 0 files, snapshot none (task 10584 ms: download 7588 ms overlapping gunzip 1683 ms, parse 7240 ms, sort 0 ms, write 0 ms, index 738 ms: 8 candidates, 95008 repo-hours, 1162 releases; waiting 601 ms; commit 0 ms)
2026-11-08T09:56:08Z [load_day 2025-01-21] 2025-01-21 hour 9: 249771 events in 0 files, snapshot none (task 10366 ms: download 7338 ms overlapping gunzip 1650 ms, parse 7031 ms, sort 0 ms, write 0 ms, index 733 ms: 8 candidates, 104395 repo-hours, 1442 releases; waiting 471 ms; commit 0 ms)
2026-11-08T09:56:19Z [load_day 2025-01-21] 2025-01-21 hour 10: 239181 events in 0 files, snapshot none (task 10346 ms: download 7203 ms overlapping gunzip 1642 ms, parse 7042 ms, sort 0 ms, write 0 ms, index 798 ms: 10 candidates, 96937 repo-hours, 1251 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:56:19Z [load_day 2025-01-21] 2025-01-21 hour 11: 233799 events in 0 files, snapshot none (task 10223 ms: download 7230 ms overlapping gunzip 1570 ms, parse 6721 ms, sort 0 ms, write 0 ms, index 720 ms: 4 candidates, 91341 repo-hours, 1398 releases; waiting 943 ms; commit 0 ms)
2026-11-08T09:56:30Z [load_day 2025-01-21] 2025-01-21 hour 12: 277488 events in 0 files, snapshot none (task 11274 ms: download 7865 ms overlapping gunzip 1809 ms, parse 7593 ms, sort 0 ms, write 0 ms, index 1079 ms: 8 candidates, 135497 repo-hours, 1260 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:56:30Z [load_day 2025-01-21] 2025-01-21 hour 13: 270743 events in 0 files, snapshot none (task 10893 ms: download 7975 ms overlapping gunzip 1738 ms, parse 7413 ms, sort 0 ms, write 0 ms, index 991 ms: 11 candidates, 116625 repo-hours, 1267 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:56:39Z [load_day 2025-01-21] 2025-01-21 hour 14: 262055 events in 0 files, snapshot none (task 8369 ms: download 5744 ms overlapping gunzip 1292 ms, parse 5486 ms, sort 0 ms, write 0 ms, index 845 ms: 4 candidates, 106409 repo-hours, 1329 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:56:39Z [load_day 2025-01-21] 2025-01-21 hour 15: 266095 events in 0 files, snapshot none (task 8429 ms: download 5758 ms overlapping gunzip 1338 ms, parse 5711 ms, sort 0 ms, write 0 ms, index 877 ms: 6 candidates, 114001 repo-hours, 1506 releases; waiting 261 ms; commit 0 ms)
2026-11-08T09:56:48Z [load_day 2025-01-21] 2025-01-21 hour 16: 257690 events in 0 files, snapshot none (task 8556 ms: download 5452 ms overlapping gunzip 1314 ms, parse 5332 ms, sort 0 ms, write 0 ms, index 1168 ms: 7 candidates, 108063 repo-hours, 1301 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:56:48Z [load_day 2025-01-21] 2025-01-21 hour 17: 251320 events in 0 files, snapshot none (task 8376 ms: download 5466 ms overlapping gunzip 1298 ms, parse 5317 ms, sort 0 ms, write 0 ms, index 963 ms: 8 candidates, 102024 repo-hours, 1062 releases; waiting 522 ms; commit 0 ms)
2026-11-08T09:56:59Z [load_day 2025-01-21] 2025-01-21 hour 18: 255774 events in 0 files, snapshot none (task 9944 ms: download 7101 ms overlapping gunzip 1616 ms, parse 6590 ms, sort 0 ms, write 0 ms, index 942 ms: 8 candidates, 113168 repo-hours, 1284 releases; waiting 542 ms; commit 0 ms)
2026-11-08T09:56:59Z [load_day 2025-01-21] 2025-01-21 hour 19: 232203 events in 0 files, snapshot none (task 8983 ms: download 6557 ms overlapping gunzip 1443 ms, parse 6367 ms, sort 0 ms, write 0 ms, index 673 ms: 10 candidates, 89327 repo-hours, 1074 releases; waiting 271 ms; commit 0 ms)
2026-11-08T09:57:09Z [load_day 2025-01-21] 2025-01-21 hour 20: 231296 events in 0 files, snapshot none (task 9724 ms: download 6521 ms overlapping gunzip 1618 ms, parse 6423 ms, sort 0 ms, write 0 ms, index 1146 ms: 7 candidates, 91270 repo-hours, 1064 releases; waiting 291 ms; commit 0 ms)
2026-11-08T09:57:09Z [load_day 2025-01-21] 2025-01-21 hour 21: 222256 events in 0 files, snapshot none (task 9999 ms: download 6897 ms overlapping gunzip 1630 ms, parse 6708 ms, sort 0 ms, write 0 ms, index 752 ms: 8 candidates, 87409 repo-hours, 1217 releases; waiting 548 ms; commit 0 ms)
2026-11-08T09:57:18Z [load_day 2025-01-21] 2025-01-21 hour 22: 206175 events in 0 files, snapshot none (task 8771 ms: download 5527 ms overlapping gunzip 1333 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 714 ms: 12 candidates, 77327 repo-hours, 1314 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:57:18Z [load_day 2025-01-21] 2025-01-21 hour 23: 194562 events in 0 files, snapshot none (task 8489 ms: download 5151 ms overlapping gunzip 1312 ms, parse 5468 ms, sort 0 ms, write 0 ms, index 801 ms: 11 candidates, 69496 repo-hours, 1041 releases; waiting 662 ms; commit 0 ms)
2026-11-08T09:57:28Z [load_day 2025-01-21] 2025-01-21: repo_hour merged from 24 files to 1 (2284216 rows, 10014 ms)
2026-11-08T09:57:31Z [load_day 2025-01-21] 2025-01-21: index committed in 12327 ms (24 + 1 + 24 files)
2026-11-08T09:57:31Z [load_day 2025-01-21] 2025-01-21: 5483379 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:57:31Z [load_day 2025-01-21] attempt 1 succeeded