orcaLog in

Runs · run 4479

load_day 2025-10-06, attempt 1 succeeded

Host
73ccef5e07c2:391213
Started
2026-11-08T14:09:24Z
Ended
2026-11-08T14:11:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
751 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
175.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4479/load_day/2025-10-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:09:24Z [load_day 2025-10-06] attempt 1 started
2026-11-08T14:09:25Z [load_day 2025-10-06] 2025-10-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:09:32Z [load_day 2025-10-06] 2025-10-06 hour 0: 148667 events in 0 files, snapshot none (task 6871 ms: download 4369 ms overlapping gunzip 1090 ms, parse 4030 ms, sort 0 ms, write 0 ms, index 689 ms: 25 candidates, 71572 repo-hours, 922 releases; waiting 733 ms; commit 0 ms)
2026-11-08T14:09:32Z [load_day 2025-10-06] 2025-10-06 hour 1: 160256 events in 0 files, snapshot none (task 6224 ms: download 4019 ms overlapping gunzip 944 ms, parse 3708 ms, sort 0 ms, write 0 ms, index 797 ms: 33 candidates, 90418 repo-hours, 663 releases; waiting 478 ms; commit 0 ms)
2026-11-08T14:09:39Z [load_day 2025-10-06] 2025-10-06 hour 2: 149221 events in 0 files, snapshot none (task 6553 ms: download 3465 ms overlapping gunzip 1101 ms, parse 4027 ms, sort 0 ms, write 0 ms, index 772 ms: 20 candidates, 69054 repo-hours, 627 releases; waiting 321 ms; commit 0 ms)
2026-11-08T14:09:40Z [load_day 2025-10-06] 2025-10-06 hour 3: 152978 events in 0 files, snapshot none (task 6654 ms: download 3510 ms overlapping gunzip 1098 ms, parse 4017 ms, sort 0 ms, write 0 ms, index 706 ms: 15 candidates, 62339 repo-hours, 1860 releases; waiting 498 ms; commit 0 ms)
2026-11-08T14:09:48Z [load_day 2025-10-06] 2025-10-06 hour 4: 157566 events in 0 files, snapshot none (task 8093 ms: download 5654 ms overlapping gunzip 1323 ms, parse 4773 ms, sort 0 ms, write 0 ms, index 487 ms: 34 candidates, 63173 repo-hours, 577 releases; waiting 1138 ms; commit 0 ms)
2026-11-08T14:09:48Z [load_day 2025-10-06] 2025-10-06 hour 5: 154147 events in 0 files, snapshot none (task 7562 ms: download 4251 ms overlapping gunzip 1202 ms, parse 4440 ms, sort 0 ms, write 0 ms, index 900 ms: 32 candidates, 65177 repo-hours, 593 releases; waiting 717 ms; commit 0 ms)
2026-11-08T14:09:57Z [load_day 2025-10-06] 2025-10-06 hour 6: 167562 events in 0 files, snapshot none (task 7202 ms: download 4856 ms overlapping gunzip 1105 ms, parse 3980 ms, sort 0 ms, write 0 ms, index 579 ms: 25 candidates, 78893 repo-hours, 692 releases; waiting 1178 ms; commit 0 ms)
2026-11-08T14:09:57Z [load_day 2025-10-06] 2025-10-06 hour 7: 160072 events in 0 files, snapshot none (task 6849 ms: download 4383 ms overlapping gunzip 1129 ms, parse 4258 ms, sort 0 ms, write 0 ms, index 554 ms: 13 candidates, 73247 repo-hours, 764 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:10:07Z [load_day 2025-10-06] 2025-10-06 hour 8: 165313 events in 0 files, snapshot none (task 9332 ms: download 6366 ms overlapping gunzip 1343 ms, parse 5002 ms, sort 0 ms, write 0 ms, index 727 ms: 24 candidates, 79497 repo-hours, 746 releases; waiting 1914 ms; commit 0 ms)
2026-11-08T14:10:07Z [load_day 2025-10-06] 2025-10-06 hour 9: 167723 events in 0 files, snapshot none (task 8732 ms: download 5457 ms overlapping gunzip 1365 ms, parse 5011 ms, sort 0 ms, write 0 ms, index 1094 ms: 16 candidates, 78543 repo-hours, 800 releases; waiting 969 ms; commit 0 ms)
2026-11-08T14:10:16Z [load_day 2025-10-06] 2025-10-06 hour 10: 171303 events in 0 files, snapshot none (task 8103 ms: download 5643 ms overlapping gunzip 1373 ms, parse 5249 ms, sort 0 ms, write 0 ms, index 639 ms: 21 candidates, 81292 repo-hours, 723 releases; waiting 530 ms; commit 0 ms)
2026-11-08T14:10:16Z [load_day 2025-10-06] 2025-10-06 hour 11: 163613 events in 0 files, snapshot none (task 7546 ms: download 4863 ms overlapping gunzip 1254 ms, parse 4725 ms, sort 0 ms, write 0 ms, index 606 ms: 15 candidates, 76053 repo-hours, 770 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:10:23Z [load_day 2025-10-06] 2025-10-06 hour 12: 166432 events in 0 files, snapshot none (task 6819 ms: download 4075 ms overlapping gunzip 1108 ms, parse 4424 ms, sort 0 ms, write 0 ms, index 847 ms: 12 candidates, 96005 repo-hours, 746 releases; waiting 226 ms; commit 0 ms)
2026-11-08T14:10:24Z [load_day 2025-10-06] 2025-10-06 hour 13: 171455 events in 0 files, snapshot none (task 8339 ms: download 5797 ms overlapping gunzip 1395 ms, parse 5077 ms, sort 0 ms, write 0 ms, index 745 ms: 16 candidates, 94476 repo-hours, 683 releases; waiting 774 ms; commit 0 ms)
2026-11-08T14:10:33Z [load_day 2025-10-06] 2025-10-06 hour 14: 168460 events in 0 files, snapshot none (task 9548 ms: download 6702 ms overlapping gunzip 1630 ms, parse 6039 ms, sort 0 ms, write 0 ms, index 659 ms: 22 candidates, 87294 repo-hours, 749 releases; waiting 869 ms; commit 0 ms)
2026-11-08T14:10:33Z [load_day 2025-10-06] 2025-10-06 hour 15: 168794 events in 0 files, snapshot none (task 8448 ms: download 5780 ms overlapping gunzip 1430 ms, parse 5350 ms, sort 0 ms, write 0 ms, index 668 ms: 24 candidates, 86460 repo-hours, 845 releases; waiting 526 ms; commit 0 ms)
2026-11-08T14:10:42Z [load_day 2025-10-06] 2025-10-06 hour 16: 166479 events in 0 files, snapshot none (task 9066 ms: download 6419 ms overlapping gunzip 1393 ms, parse 5214 ms, sort 0 ms, write 0 ms, index 704 ms: 27 candidates, 86014 repo-hours, 787 releases; waiting 1516 ms; commit 0 ms)
2026-11-08T14:10:43Z [load_day 2025-10-06] 2025-10-06 hour 17: 167233 events in 0 files, snapshot none (task 9313 ms: download 6798 ms overlapping gunzip 1357 ms, parse 5357 ms, sort 0 ms, write 0 ms, index 662 ms: 21 candidates, 82496 repo-hours, 814 releases; waiting 1610 ms; commit 0 ms)
2026-11-08T14:10:51Z [load_day 2025-10-06] 2025-10-06 hour 18: 167184 events in 0 files, snapshot none (task 8183 ms: download 5401 ms overlapping gunzip 1451 ms, parse 5540 ms, sort 0 ms, write 0 ms, index 653 ms: 18 candidates, 86194 repo-hours, 876 releases; waiting 131 ms; commit 0 ms)
2026-11-08T14:10:52Z [load_day 2025-10-06] 2025-10-06 hour 19: 167222 events in 0 files, snapshot none (task 8329 ms: download 5963 ms overlapping gunzip 1391 ms, parse 5612 ms, sort 0 ms, write 0 ms, index 588 ms: 16 candidates, 78485 repo-hours, 773 releases; waiting 465 ms; commit 0 ms)
2026-11-08T14:11:01Z [load_day 2025-10-06] 2025-10-06 hour 20: 165794 events in 0 files, snapshot none (task 8887 ms: download 6054 ms overlapping gunzip 1518 ms, parse 5782 ms, sort 0 ms, write 0 ms, index 688 ms: 25 candidates, 78211 repo-hours, 823 releases; waiting 564 ms; commit 0 ms)
2026-11-08T14:11:02Z [load_day 2025-10-06] 2025-10-06 hour 21: 166306 events in 0 files, snapshot none (task 8841 ms: download 6291 ms overlapping gunzip 1568 ms, parse 5892 ms, sort 0 ms, write 0 ms, index 546 ms: 21 candidates, 74110 repo-hours, 902 releases; waiting 491 ms; commit 0 ms)
2026-11-08T14:11:11Z [load_day 2025-10-06] 2025-10-06 hour 22: 155039 events in 0 files, snapshot none (task 8802 ms: download 6381 ms overlapping gunzip 1597 ms, parse 5557 ms, sort 0 ms, write 0 ms, index 598 ms: 10 candidates, 66416 repo-hours, 755 releases; waiting 706 ms; commit 0 ms)
2026-11-08T14:11:11Z [load_day 2025-10-06] 2025-10-06 hour 23: 153734 events in 0 files, snapshot none (task 8424 ms: download 5972 ms overlapping gunzip 1446 ms, parse 5601 ms, sort 0 ms, write 0 ms, index 467 ms: 15 candidates, 62988 repo-hours, 660 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:11:19Z [load_day 2025-10-06] 2025-10-06: repo_hour merged from 24 files to 1 (1868407 rows, 8410 ms)
2026-11-08T14:11:22Z [load_day 2025-10-06] 2025-10-06: index committed in 11297 ms (24 + 1 + 24 files)
2026-11-08T14:11:22Z [load_day 2025-10-06] 2025-10-06: 3902553 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:11:22Z [load_day 2025-10-06] attempt 1 succeeded