orcaLog in

Runs · run 3101

load_day 2024-10-19, attempt 1 succeeded

Host
73ccef5e07c2:194624
Started
2026-11-08T08:24:56Z
Ended
2026-11-08T08:26:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
670 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
118.1 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3101/load_day/2024-10-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:24:56Z [load_day 2024-10-19] attempt 1 started
2026-11-08T08:24:57Z [load_day 2024-10-19] 2024-10-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:25:03Z [load_day 2024-10-19] 2024-10-19 hour 0: 165665 events in 0 files, snapshot none (task 5578 ms: download 2539 ms overlapping gunzip 798 ms, parse 3380 ms, sort 0 ms, write 0 ms, index 594 ms: 3 candidates, 79659 repo-hours, 1038 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:25:03Z [load_day 2024-10-19] 2024-10-19 hour 1: 179209 events in 0 files, snapshot none (task 5496 ms: download 2643 ms overlapping gunzip 806 ms, parse 3209 ms, sort 0 ms, write 0 ms, index 705 ms: 3 candidates, 91884 repo-hours, 834 releases; waiting 467 ms; commit 0 ms)
2026-11-08T08:25:09Z [load_day 2024-10-19] 2024-10-19 hour 2: 150451 events in 0 files, snapshot none (task 5245 ms: download 2109 ms overlapping gunzip 773 ms, parse 3096 ms, sort 0 ms, write 0 ms, index 579 ms: 5 candidates, 64921 repo-hours, 727 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:25:09Z [load_day 2024-10-19] 2024-10-19 hour 3: 172034 events in 0 files, snapshot none (task 5598 ms: download 2697 ms overlapping gunzip 850 ms, parse 3465 ms, sort 0 ms, write 0 ms, index 497 ms: 5 candidates, 63228 repo-hours, 3882 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:25:15Z [load_day 2024-10-19] 2024-10-19 hour 4: 157683 events in 0 files, snapshot none (task 6056 ms: download 2529 ms overlapping gunzip 867 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 943 ms: 7 candidates, 55027 repo-hours, 574 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:25:16Z [load_day 2024-10-19] 2024-10-19 hour 5: 166628 events in 0 files, snapshot none (task 6038 ms: download 2569 ms overlapping gunzip 918 ms, parse 3680 ms, sort 0 ms, write 0 ms, index 941 ms: 3 candidates, 57710 repo-hours, 690 releases; waiting 251 ms; commit 0 ms)
2026-11-08T08:25:21Z [load_day 2024-10-19] 2024-10-19 hour 6: 187268 events in 0 files, snapshot none (task 5566 ms: download 2976 ms overlapping gunzip 834 ms, parse 3294 ms, sort 0 ms, write 0 ms, index 605 ms: 5 candidates, 74967 repo-hours, 966 releases; waiting 545 ms; commit 0 ms)
2026-11-08T08:25:21Z [load_day 2024-10-19] 2024-10-19 hour 7: 179686 events in 0 files, snapshot none (task 5338 ms: download 2854 ms overlapping gunzip 772 ms, parse 3248 ms, sort 0 ms, write 0 ms, index 520 ms: 1 candidates, 61991 repo-hours, 872 releases; waiting 508 ms; commit 0 ms)
2026-11-08T08:25:27Z [load_day 2024-10-19] 2024-10-19 hour 8: 180825 events in 0 files, snapshot none (task 5282 ms: download 2867 ms overlapping gunzip 806 ms, parse 3212 ms, sort 0 ms, write 0 ms, index 473 ms: 3 candidates, 65163 repo-hours, 837 releases; waiting 478 ms; commit 0 ms)
2026-11-08T08:25:27Z [load_day 2024-10-19] 2024-10-19 hour 9: 195375 events in 0 files, snapshot none (task 5074 ms: download 2710 ms overlapping gunzip 827 ms, parse 3275 ms, sort 0 ms, write 0 ms, index 533 ms: 2 candidates, 71058 repo-hours, 1031 releases; waiting 204 ms; commit 0 ms)
2026-11-08T08:25:32Z [load_day 2024-10-19] 2024-10-19 hour 10: 189852 events in 0 files, snapshot none (task 5061 ms: download 2785 ms overlapping gunzip 838 ms, parse 3071 ms, sort 0 ms, write 0 ms, index 539 ms: 8 candidates, 70485 repo-hours, 805 releases; waiting 410 ms; commit 0 ms)
2026-11-08T08:25:32Z [load_day 2024-10-19] 2024-10-19 hour 11: 189714 events in 0 files, snapshot none (task 4736 ms: download 2476 ms overlapping gunzip 768 ms, parse 2993 ms, sort 0 ms, write 0 ms, index 458 ms: 5 candidates, 64225 repo-hours, 745 releases; waiting 300 ms; commit 0 ms)
2026-11-08T08:25:38Z [load_day 2024-10-19] 2024-10-19 hour 12: 235653 events in 0 files, snapshot none (task 5011 ms: download 2430 ms overlapping gunzip 650 ms, parse 2879 ms, sort 0 ms, write 0 ms, index 733 ms: 7 candidates, 112909 repo-hours, 848 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:25:38Z [load_day 2024-10-19] 2024-10-19 hour 13: 218403 events in 0 files, snapshot none (task 4888 ms: download 2525 ms overlapping gunzip 681 ms, parse 2853 ms, sort 0 ms, write 0 ms, index 647 ms: 9 candidates, 92036 repo-hours, 914 releases; waiting 418 ms; commit 0 ms)
2026-11-08T08:25:43Z [load_day 2024-10-19] 2024-10-19 hour 14: 204736 events in 0 files, snapshot none (task 4802 ms: download 2661 ms overlapping gunzip 668 ms, parse 2638 ms, sort 0 ms, write 0 ms, index 687 ms: 6 candidates, 74219 repo-hours, 830 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:25:44Z [load_day 2024-10-19] 2024-10-19 hour 15: 222344 events in 0 files, snapshot none (task 5136 ms: download 2422 ms overlapping gunzip 762 ms, parse 2978 ms, sort 0 ms, write 0 ms, index 911 ms: 3 candidates, 86449 repo-hours, 1117 releases; waiting 224 ms; commit 0 ms)
2026-11-08T08:25:49Z [load_day 2024-10-19] 2024-10-19 hour 16: 218553 events in 0 files, snapshot none (task 5555 ms: download 2445 ms overlapping gunzip 696 ms, parse 2937 ms, sort 0 ms, write 0 ms, index 978 ms: 2 candidates, 86906 repo-hours, 862 releases; waiting 569 ms; commit 0 ms)
2026-11-08T08:25:50Z [load_day 2024-10-19] 2024-10-19 hour 17: 215589 events in 0 files, snapshot none (task 5534 ms: download 2851 ms overlapping gunzip 713 ms, parse 3068 ms, sort 0 ms, write 0 ms, index 922 ms: 5 candidates, 86777 repo-hours, 764 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:25:56Z [load_day 2024-10-19] 2024-10-19 hour 18: 220847 events in 0 files, snapshot none (task 6547 ms: download 3816 ms overlapping gunzip 961 ms, parse 4096 ms, sort 0 ms, write 0 ms, index 643 ms: 1 candidates, 87304 repo-hours, 897 releases; waiting 540 ms; commit 0 ms)
2026-11-08T08:25:56Z [load_day 2024-10-19] 2024-10-19 hour 19: 198868 events in 0 files, snapshot none (task 5113 ms: download 2408 ms overlapping gunzip 771 ms, parse 3146 ms, sort 0 ms, write 0 ms, index 563 ms: 4 candidates, 68046 repo-hours, 818 releases; waiting 367 ms; commit 0 ms)
2026-11-08T08:26:03Z [load_day 2024-10-19] 2024-10-19 hour 20: 175551 events in 0 files, snapshot none (task 5860 ms: download 3283 ms overlapping gunzip 828 ms, parse 3510 ms, sort 0 ms, write 0 ms, index 603 ms: 6 candidates, 60672 repo-hours, 751 releases; waiting 559 ms; commit 0 ms)
2026-11-08T08:26:03Z [load_day 2024-10-19] 2024-10-19 hour 21: 176869 events in 0 files, snapshot none (task 5850 ms: download 2845 ms overlapping gunzip 849 ms, parse 3563 ms, sort 0 ms, write 0 ms, index 627 ms: 1 candidates, 60652 repo-hours, 916 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:26:09Z [load_day 2024-10-19] 2024-10-19 hour 22: 153942 events in 0 files, snapshot none (task 6091 ms: download 3368 ms overlapping gunzip 979 ms, parse 3957 ms, sort 0 ms, write 0 ms, index 384 ms: 3 candidates, 50352 repo-hours, 1056 releases; waiting 548 ms; commit 0 ms)
2026-11-08T08:26:09Z [load_day 2024-10-19] 2024-10-19 hour 23: 149384 events in 0 files, snapshot none (task 5018 ms: download 2698 ms overlapping gunzip 801 ms, parse 3185 ms, sort 0 ms, write 0 ms, index 472 ms: 3 candidates, 46790 repo-hours, 702 releases; waiting 231 ms; commit 0 ms)
2026-11-08T08:26:17Z [load_day 2024-10-19] 2024-10-19: repo_hour merged from 24 files to 1 (1733430 rows, 7637 ms)
2026-11-08T08:26:21Z [load_day 2024-10-19] 2024-10-19: index committed in 11276 ms (24 + 1 + 24 files)
2026-11-08T08:26:21Z [load_day 2024-10-19] 2024-10-19: 4505129 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:26:21Z [load_day 2024-10-19] attempt 1 succeeded