orcaLog in

Runs · run 4697

load_day 2025-12-09, attempt 1 succeeded

Host
73ccef5e07c2:414393
Started
2026-11-08T14:42:02Z
Ended
2026-11-08T14:43:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
741 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
75.2 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4697/load_day/2025-12-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:42:02Z [load_day 2025-12-09] attempt 1 started
2026-11-08T14:42:03Z [load_day 2025-12-09] 2025-12-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:42:07Z [load_day 2025-12-09] 2025-12-09 hour 0: 149541 events in 0 files, snapshot none (task 4079 ms: download 2371 ms overlapping gunzip 585 ms, parse 1936 ms, sort 0 ms, write 0 ms, index 577 ms: 7 candidates, 76332 repo-hours, 1513 releases; waiting 604 ms; commit 0 ms)
2026-11-08T14:42:07Z [load_day 2025-12-09] 2025-12-09 hour 1: 154946 events in 0 files, snapshot none (task 3978 ms: download 2104 ms overlapping gunzip 569 ms, parse 1832 ms, sort 0 ms, write 0 ms, index 731 ms: 7 candidates, 92744 repo-hours, 1189 releases; waiting 487 ms; commit 0 ms)
2026-11-08T14:42:12Z [load_day 2025-12-09] 2025-12-09 hour 2: 143985 events in 0 files, snapshot none (task 3933 ms: download 2203 ms overlapping gunzip 562 ms, parse 1741 ms, sort 0 ms, write 0 ms, index 761 ms: 9 candidates, 74089 repo-hours, 1255 releases; waiting 546 ms; commit 0 ms)
2026-11-08T14:42:12Z [load_day 2025-12-09] 2025-12-09 hour 3: 147835 events in 0 files, snapshot none (task 4263 ms: download 2300 ms overlapping gunzip 633 ms, parse 1937 ms, sort 0 ms, write 0 ms, index 666 ms: 3 candidates, 74283 repo-hours, 2137 releases; waiting 668 ms; commit 0 ms)
2026-11-08T14:42:16Z [load_day 2025-12-09] 2025-12-09 hour 4: 149007 events in 0 files, snapshot none (task 3774 ms: download 1847 ms overlapping gunzip 572 ms, parse 1600 ms, sort 0 ms, write 0 ms, index 732 ms: 11 candidates, 70251 repo-hours, 1412 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:42:17Z [load_day 2025-12-09] 2025-12-09 hour 5: 145237 events in 0 files, snapshot none (task 3856 ms: download 2415 ms overlapping gunzip 585 ms, parse 1799 ms, sort 0 ms, write 0 ms, index 611 ms: 3 candidates, 69822 repo-hours, 1219 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:42:20Z [load_day 2025-12-09] 2025-12-09 hour 6: 147862 events in 0 files, snapshot none (task 3765 ms: download 2179 ms overlapping gunzip 468 ms, parse 1441 ms, sort 0 ms, write 0 ms, index 897 ms: 7 candidates, 77756 repo-hours, 1304 releases; waiting 573 ms; commit 0 ms)
2026-11-08T14:42:22Z [load_day 2025-12-09] 2025-12-09 hour 7: 148499 events in 0 files, snapshot none (task 4566 ms: download 3171 ms overlapping gunzip 551 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 560 ms: 8 candidates, 74227 repo-hours, 1297 releases; waiting 1536 ms; commit 0 ms)
2026-11-08T14:42:25Z [load_day 2025-12-09] 2025-12-09 hour 8: 149049 events in 0 files, snapshot none (task 3939 ms: download 2568 ms overlapping gunzip 574 ms, parse 1706 ms, sort 0 ms, write 0 ms, index 733 ms: 5 candidates, 77798 repo-hours, 1151 releases; waiting 576 ms; commit 0 ms)
2026-11-08T14:42:27Z [load_day 2025-12-09] 2025-12-09 hour 9: 147393 events in 0 files, snapshot none (task 4579 ms: download 3424 ms overlapping gunzip 530 ms, parse 1551 ms, sort 0 ms, write 0 ms, index 595 ms: 5 candidates, 77501 repo-hours, 1132 releases; waiting 1523 ms; commit 0 ms)
2026-11-08T14:42:29Z [load_day 2025-12-09] 2025-12-09 hour 10: 149485 events in 0 files, snapshot none (task 4020 ms: download 2782 ms overlapping gunzip 478 ms, parse 1422 ms, sort 0 ms, write 0 ms, index 691 ms: 8 candidates, 78121 repo-hours, 977 releases; waiting 1043 ms; commit 0 ms)
2026-11-08T14:42:31Z [load_day 2025-12-09] 2025-12-09 hour 11: 149756 events in 0 files, snapshot none (task 3436 ms: download 2314 ms overlapping gunzip 511 ms, parse 1380 ms, sort 0 ms, write 0 ms, index 561 ms: 8 candidates, 76341 repo-hours, 1117 releases; waiting 569 ms; commit 0 ms)
2026-11-08T14:42:34Z [load_day 2025-12-09] 2025-12-09 hour 12: 158017 events in 0 files, snapshot none (task 4034 ms: download 2538 ms overlapping gunzip 440 ms, parse 1310 ms, sort 0 ms, write 0 ms, index 775 ms: 9 candidates, 95771 repo-hours, 582 releases; waiting 953 ms; commit 0 ms)
2026-11-08T14:42:35Z [load_day 2025-12-09] 2025-12-09 hour 13: 158194 events in 0 files, snapshot none (task 3377 ms: download 1954 ms overlapping gunzip 380 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 665 ms: 7 candidates, 89936 repo-hours, 412 releases; waiting 827 ms; commit 0 ms)
2026-11-08T14:42:39Z [load_day 2025-12-09] 2025-12-09 hour 14: 145555 events in 0 files, snapshot none (task 4237 ms: download 2515 ms overlapping gunzip 620 ms, parse 1832 ms, sort 0 ms, write 0 ms, index 601 ms: 7 candidates, 79245 repo-hours, 732 releases; waiting 715 ms; commit 0 ms)
2026-11-08T14:42:39Z [load_day 2025-12-09] 2025-12-09 hour 15: 148518 events in 0 files, snapshot none (task 3660 ms: download 1949 ms overlapping gunzip 547 ms, parse 1588 ms, sort 0 ms, write 0 ms, index 672 ms: 3 candidates, 80773 repo-hours, 816 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:42:43Z [load_day 2025-12-09] 2025-12-09 hour 16: 144085 events in 0 files, snapshot none (task 3724 ms: download 2654 ms overlapping gunzip 452 ms, parse 1226 ms, sort 0 ms, write 0 ms, index 571 ms: 13 candidates, 78049 repo-hours, 1037 releases; waiting 1162 ms; commit 0 ms)
2026-11-08T14:42:43Z [load_day 2025-12-09] 2025-12-09 hour 17: 146569 events in 0 files, snapshot none (task 3666 ms: download 2522 ms overlapping gunzip 405 ms, parse 1229 ms, sort 0 ms, write 0 ms, index 664 ms: 5 candidates, 76791 repo-hours, 1200 releases; waiting 1058 ms; commit 0 ms)
2026-11-08T14:42:47Z [load_day 2025-12-09] 2025-12-09 hour 18: 151555 events in 0 files, snapshot none (task 3083 ms: download 1972 ms overlapping gunzip 389 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 646 ms: 5 candidates, 81889 repo-hours, 1085 releases; waiting 593 ms; commit 0 ms)
2026-11-08T14:42:47Z [load_day 2025-12-09] 2025-12-09 hour 19: 146336 events in 0 files, snapshot none (task 3373 ms: download 2284 ms overlapping gunzip 464 ms, parse 1376 ms, sort 0 ms, write 0 ms, index 575 ms: 7 candidates, 72131 repo-hours, 1292 releases; waiting 639 ms; commit 0 ms)
2026-11-08T14:42:51Z [load_day 2025-12-09] 2025-12-09 hour 20: 145273 events in 0 files, snapshot none (task 3703 ms: download 2616 ms overlapping gunzip 416 ms, parse 1288 ms, sort 0 ms, write 0 ms, index 632 ms: 6 candidates, 72066 repo-hours, 1288 releases; waiting 1048 ms; commit 0 ms)
2026-11-08T14:42:51Z [load_day 2025-12-09] 2025-12-09 hour 21: 144426 events in 0 files, snapshot none (task 3619 ms: download 2477 ms overlapping gunzip 428 ms, parse 1257 ms, sort 0 ms, write 0 ms, index 659 ms: 4 candidates, 70819 repo-hours, 1319 releases; waiting 943 ms; commit 0 ms)
2026-11-08T14:42:56Z [load_day 2025-12-09] 2025-12-09 hour 22: 146426 events in 0 files, snapshot none (task 4121 ms: download 2235 ms overlapping gunzip 623 ms, parse 1868 ms, sort 0 ms, write 0 ms, index 726 ms: 11 candidates, 71477 repo-hours, 1384 releases; waiting 579 ms; commit 0 ms)
2026-11-08T14:42:56Z [load_day 2025-12-09] 2025-12-09 hour 23: 146682 events in 0 files, snapshot none (task 3771 ms: download 2524 ms overlapping gunzip 530 ms, parse 1841 ms, sort 0 ms, write 0 ms, index 521 ms: 6 candidates, 63687 repo-hours, 1394 releases; waiting 611 ms; commit 0 ms)
2026-11-08T14:43:04Z [load_day 2025-12-09] 2025-12-09: repo_hour merged from 24 files to 1 (1851899 rows, 8376 ms)
2026-11-08T14:43:07Z [load_day 2025-12-09] 2025-12-09: index committed in 11609 ms (24 + 1 + 24 files)
2026-11-08T14:43:07Z [load_day 2025-12-09] 2025-12-09: 3564231 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:43:07Z [load_day 2025-12-09] attempt 1 succeeded