orcaLog in

Runs · run 4686

load_day 2025-12-06, attempt 1 succeeded

Host
73ccef5e07c2:413326
Started
2026-11-08T14:40:42Z
Ended
2026-11-08T14:41:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
654 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
66.5 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4686/load_day/2025-12-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:40:42Z [load_day 2025-12-06] attempt 1 started
2026-11-08T14:40:43Z [load_day 2025-12-06] 2025-12-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:40:47Z [load_day 2025-12-06] 2025-12-06 hour 0: 143150 events in 0 files, snapshot none (task 3731 ms: download 2177 ms overlapping gunzip 549 ms, parse 1778 ms, sort 0 ms, write 0 ms, index 580 ms: 7 candidates, 72086 repo-hours, 981 releases; waiting 506 ms; commit 0 ms)
2026-11-08T14:40:48Z [load_day 2025-12-06] 2025-12-06 hour 1: 147807 events in 0 files, snapshot none (task 3991 ms: download 2473 ms overlapping gunzip 476 ms, parse 1508 ms, sort 0 ms, write 0 ms, index 658 ms: 11 candidates, 88210 repo-hours, 867 releases; waiting 1000 ms; commit 0 ms)
2026-11-08T14:40:51Z [load_day 2025-12-06] 2025-12-06 hour 2: 137828 events in 0 files, snapshot none (task 3223 ms: download 1964 ms overlapping gunzip 388 ms, parse 1143 ms, sort 0 ms, write 0 ms, index 459 ms: 5 candidates, 64030 repo-hours, 744 releases; waiting 856 ms; commit 0 ms)
2026-11-08T14:40:52Z [load_day 2025-12-06] 2025-12-06 hour 3: 142889 events in 0 files, snapshot none (task 3880 ms: download 2846 ms overlapping gunzip 422 ms, parse 1278 ms, sort 0 ms, write 0 ms, index 599 ms: 7 candidates, 65376 repo-hours, 1693 releases; waiting 1260 ms; commit 0 ms)
2026-11-08T14:40:55Z [load_day 2025-12-06] 2025-12-06 hour 4: 143784 events in 0 files, snapshot none (task 3049 ms: download 2068 ms overlapping gunzip 369 ms, parse 1199 ms, sort 0 ms, write 0 ms, index 504 ms: 7 candidates, 61266 repo-hours, 597 releases; waiting 674 ms; commit 0 ms)
2026-11-08T14:40:55Z [load_day 2025-12-06] 2025-12-06 hour 5: 143217 events in 0 files, snapshot none (task 2971 ms: download 2093 ms overlapping gunzip 380 ms, parse 1215 ms, sort 0 ms, write 0 ms, index 430 ms: 6 candidates, 61093 repo-hours, 723 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:40:58Z [load_day 2025-12-06] 2025-12-06 hour 6: 144663 events in 0 files, snapshot none (task 2850 ms: download 1836 ms overlapping gunzip 335 ms, parse 1055 ms, sort 0 ms, write 0 ms, index 583 ms: 11 candidates, 69678 repo-hours, 738 releases; waiting 585 ms; commit 0 ms)
2026-11-08T14:40:59Z [load_day 2025-12-06] 2025-12-06 hour 7: 140478 events in 0 files, snapshot none (task 2995 ms: download 2116 ms overlapping gunzip 320 ms, parse 1065 ms, sort 0 ms, write 0 ms, index 451 ms: 5 candidates, 60617 repo-hours, 1161 releases; waiting 884 ms; commit 0 ms)
2026-11-08T14:41:02Z [load_day 2025-12-06] 2025-12-06 hour 8: 145529 events in 0 files, snapshot none (task 3314 ms: download 2271 ms overlapping gunzip 367 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 466 ms: 4 candidates, 64892 repo-hours, 659 releases; waiting 1044 ms; commit 0 ms)
2026-11-08T14:41:02Z [load_day 2025-12-06] 2025-12-06 hour 9: 142857 events in 0 files, snapshot none (task 3040 ms: download 2157 ms overlapping gunzip 352 ms, parse 1121 ms, sort 0 ms, write 0 ms, index 511 ms: 2 candidates, 63032 repo-hours, 772 releases; waiting 780 ms; commit 0 ms)
2026-11-08T14:41:06Z [load_day 2025-12-06] 2025-12-06 hour 10: 142288 events in 0 files, snapshot none (task 4072 ms: download 2591 ms overlapping gunzip 413 ms, parse 1358 ms, sort 0 ms, write 0 ms, index 827 ms: 5 candidates, 66168 repo-hours, 851 releases; waiting 1076 ms; commit 0 ms)
2026-11-08T14:41:07Z [load_day 2025-12-06] 2025-12-06 hour 11: 148975 events in 0 files, snapshot none (task 3795 ms: download 2266 ms overlapping gunzip 475 ms, parse 1416 ms, sort 0 ms, write 0 ms, index 670 ms: 2 candidates, 65797 repo-hours, 915 releases; waiting 852 ms; commit 0 ms)
2026-11-08T14:41:11Z [load_day 2025-12-06] 2025-12-06 hour 12: 156174 events in 0 files, snapshot none (task 4314 ms: download 1893 ms overlapping gunzip 588 ms, parse 1988 ms, sort 0 ms, write 0 ms, index 907 ms: 7 candidates, 91964 repo-hours, 628 releases; waiting 504 ms; commit 0 ms)
2026-11-08T14:41:11Z [load_day 2025-12-06] 2025-12-06 hour 13: 154181 events in 0 files, snapshot none (task 4106 ms: download 2219 ms overlapping gunzip 552 ms, parse 1771 ms, sort 0 ms, write 0 ms, index 934 ms: 3 candidates, 82186 repo-hours, 651 releases; waiting 542 ms; commit 0 ms)
2026-11-08T14:41:16Z [load_day 2025-12-06] 2025-12-06 hour 14: 148469 events in 0 files, snapshot none (task 4316 ms: download 2642 ms overlapping gunzip 658 ms, parse 1767 ms, sort 0 ms, write 0 ms, index 708 ms: 3 candidates, 68654 repo-hours, 716 releases; waiting 775 ms; commit 0 ms)
2026-11-08T14:41:16Z [load_day 2025-12-06] 2025-12-06 hour 15: 151038 events in 0 files, snapshot none (task 4121 ms: download 1887 ms overlapping gunzip 644 ms, parse 2041 ms, sort 0 ms, write 0 ms, index 759 ms: 6 candidates, 71580 repo-hours, 711 releases; waiting 406 ms; commit 0 ms)
2026-11-08T14:41:21Z [load_day 2025-12-06] 2025-12-06 hour 16: 149932 events in 0 files, snapshot none (task 4119 ms: download 1855 ms overlapping gunzip 750 ms, parse 2246 ms, sort 0 ms, write 0 ms, index 565 ms: 13 candidates, 73506 repo-hours, 696 releases; waiting 295 ms; commit 0 ms)
2026-11-08T14:41:21Z [load_day 2025-12-06] 2025-12-06 hour 17: 151245 events in 0 files, snapshot none (task 4331 ms: download 2525 ms overlapping gunzip 689 ms, parse 2049 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 69737 repo-hours, 646 releases; waiting 606 ms; commit 0 ms)
2026-11-08T14:41:25Z [load_day 2025-12-06] 2025-12-06 hour 18: 150784 events in 0 files, snapshot none (task 3256 ms: download 1979 ms overlapping gunzip 506 ms, parse 1660 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 75346 repo-hours, 844 releases; waiting 232 ms; commit 0 ms)
2026-11-08T14:41:25Z [load_day 2025-12-06] 2025-12-06 hour 19: 145099 events in 0 files, snapshot none (task 2958 ms: download 1705 ms overlapping gunzip 500 ms, parse 1397 ms, sort 0 ms, write 0 ms, index 462 ms: 7 candidates, 62006 repo-hours, 668 releases; waiting 280 ms; commit 0 ms)
2026-11-08T14:41:29Z [load_day 2025-12-06] 2025-12-06 hour 20: 148921 events in 0 files, snapshot none (task 3791 ms: download 2550 ms overlapping gunzip 463 ms, parse 1467 ms, sort 0 ms, write 0 ms, index 467 ms: 5 candidates, 63996 repo-hours, 876 releases; waiting 1023 ms; commit 0 ms)
2026-11-08T14:41:29Z [load_day 2025-12-06] 2025-12-06 hour 21: 146654 events in 0 files, snapshot none (task 3210 ms: download 2091 ms overlapping gunzip 424 ms, parse 1396 ms, sort 0 ms, write 0 ms, index 518 ms: 10 candidates, 62744 repo-hours, 875 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:41:33Z [load_day 2025-12-06] 2025-12-06 hour 22: 144058 events in 0 files, snapshot none (task 3087 ms: download 2023 ms overlapping gunzip 350 ms, parse 1222 ms, sort 0 ms, write 0 ms, index 552 ms: 8 candidates, 60770 repo-hours, 965 releases; waiting 627 ms; commit 0 ms)
2026-11-08T14:41:33Z [load_day 2025-12-06] 2025-12-06 hour 23: 141777 events in 0 files, snapshot none (task 3214 ms: download 2387 ms overlapping gunzip 374 ms, parse 1259 ms, sort 0 ms, write 0 ms, index 445 ms: 5 candidates, 57928 repo-hours, 860 releases; waiting 867 ms; commit 0 ms)
2026-11-08T14:41:40Z [load_day 2025-12-06] 2025-12-06: repo_hour merged from 24 files to 1 (1642662 rows, 7587 ms)
2026-11-08T14:41:43Z [load_day 2025-12-06] 2025-12-06: index committed in 10605 ms (24 + 1 + 24 files)
2026-11-08T14:41:43Z [load_day 2025-12-06] 2025-12-06: 3511797 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:41:43Z [load_day 2025-12-06] attempt 1 succeeded