orcaLog in

Runs · run 4643

load_day 2025-11-22, attempt 1 succeeded

Host
73ccef5e07c2:407913
Started
2026-11-08T14:33:08Z
Ended
2026-11-08T14:34:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
651 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
64.9 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4643/load_day/2025-11-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:33:08Z [load_day 2025-11-22] attempt 1 started
2026-11-08T14:33:08Z [load_day 2025-11-22] 2025-11-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:33:13Z [load_day 2025-11-22] 2025-11-22 hour 0: 142995 events in 0 files, snapshot none (task 3720 ms: download 2757 ms overlapping gunzip 377 ms, parse 1164 ms, sort 0 ms, write 0 ms, index 563 ms: 11 candidates, 73096 repo-hours, 882 releases; waiting 1345 ms; commit 0 ms)
2026-11-08T14:33:13Z [load_day 2025-11-22] 2025-11-22 hour 1: 150256 events in 0 files, snapshot none (task 2917 ms: download 1808 ms overlapping gunzip 323 ms, parse 1131 ms, sort 0 ms, write 0 ms, index 658 ms: 10 candidates, 88495 repo-hours, 661 releases; waiting 505 ms; commit 0 ms)
2026-11-08T14:33:16Z [load_day 2025-11-22] 2025-11-22 hour 2: 139125 events in 0 files, snapshot none (task 3149 ms: download 1955 ms overlapping gunzip 339 ms, parse 1087 ms, sort 0 ms, write 0 ms, index 550 ms: 9 candidates, 63357 repo-hours, 646 releases; waiting 760 ms; commit 0 ms)
2026-11-08T14:33:17Z [load_day 2025-11-22] 2025-11-22 hour 3: 143691 events in 0 files, snapshot none (task 3691 ms: download 2191 ms overlapping gunzip 316 ms, parse 1052 ms, sort 0 ms, write 0 ms, index 520 ms: 3 candidates, 66519 repo-hours, 1699 releases; waiting 986 ms; commit 0 ms)
2026-11-08T14:33:21Z [load_day 2025-11-22] 2025-11-22 hour 4: 141780 events in 0 files, snapshot none (task 4036 ms: download 2938 ms overlapping gunzip 392 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 444 ms: 6 candidates, 62321 repo-hours, 553 releases; waiting 1551 ms; commit 0 ms)
2026-11-08T14:33:21Z [load_day 2025-11-22] 2025-11-22 hour 5: 141213 events in 0 files, snapshot none (task 3259 ms: download 2104 ms overlapping gunzip 424 ms, parse 1386 ms, sort 0 ms, write 0 ms, index 559 ms: 4 candidates, 60179 repo-hours, 513 releases; waiting 595 ms; commit 0 ms)
2026-11-08T14:33:24Z [load_day 2025-11-22] 2025-11-22 hour 6: 139599 events in 0 files, snapshot none (task 3205 ms: download 2077 ms overlapping gunzip 375 ms, parse 1225 ms, sort 0 ms, write 0 ms, index 664 ms: 7 candidates, 66756 repo-hours, 796 releases; waiting 571 ms; commit 0 ms)
2026-11-08T14:33:25Z [load_day 2025-11-22] 2025-11-22 hour 7: 141640 events in 0 files, snapshot none (task 3406 ms: download 2228 ms overlapping gunzip 451 ms, parse 1536 ms, sort 0 ms, write 0 ms, index 498 ms: 11 candidates, 62864 repo-hours, 511 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:33:28Z [load_day 2025-11-22] 2025-11-22 hour 8: 143811 events in 0 files, snapshot none (task 3552 ms: download 1864 ms overlapping gunzip 415 ms, parse 1413 ms, sort 0 ms, write 0 ms, index 771 ms: 3 candidates, 66249 repo-hours, 469 releases; waiting 550 ms; commit 0 ms)
2026-11-08T14:33:29Z [load_day 2025-11-22] 2025-11-22 hour 9: 143858 events in 0 files, snapshot none (task 3310 ms: download 1726 ms overlapping gunzip 412 ms, parse 1450 ms, sort 0 ms, write 0 ms, index 551 ms: 3 candidates, 66005 repo-hours, 540 releases; waiting 591 ms; commit 0 ms)
2026-11-08T14:33:32Z [load_day 2025-11-22] 2025-11-22 hour 10: 143616 events in 0 files, snapshot none (task 3281 ms: download 1843 ms overlapping gunzip 406 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 65475 repo-hours, 489 releases; waiting 642 ms; commit 0 ms)
2026-11-08T14:33:32Z [load_day 2025-11-22] 2025-11-22 hour 11: 145648 events in 0 files, snapshot none (task 3025 ms: download 1670 ms overlapping gunzip 383 ms, parse 1277 ms, sort 0 ms, write 0 ms, index 654 ms: 6 candidates, 65156 repo-hours, 480 releases; waiting 378 ms; commit 0 ms)
2026-11-08T14:33:36Z [load_day 2025-11-22] 2025-11-22 hour 12: 161208 events in 0 files, snapshot none (task 3536 ms: download 2046 ms overlapping gunzip 418 ms, parse 1332 ms, sort 0 ms, write 0 ms, index 849 ms: 4 candidates, 94978 repo-hours, 481 releases; waiting 624 ms; commit 0 ms)
2026-11-08T14:33:36Z [load_day 2025-11-22] 2025-11-22 hour 13: 154505 events in 0 files, snapshot none (task 3770 ms: download 2422 ms overlapping gunzip 438 ms, parse 1522 ms, sort 0 ms, write 0 ms, index 620 ms: 6 candidates, 83183 repo-hours, 464 releases; waiting 849 ms; commit 0 ms)
2026-11-08T14:33:40Z [load_day 2025-11-22] 2025-11-22 hour 14: 151994 events in 0 files, snapshot none (task 3948 ms: download 2194 ms overlapping gunzip 548 ms, parse 1875 ms, sort 0 ms, write 0 ms, index 543 ms: 7 candidates, 69812 repo-hours, 571 releases; waiting 529 ms; commit 0 ms)
2026-11-08T14:33:41Z [load_day 2025-11-22] 2025-11-22 hour 15: 148798 events in 0 files, snapshot none (task 3639 ms: download 2012 ms overlapping gunzip 499 ms, parse 1726 ms, sort 0 ms, write 0 ms, index 635 ms: 5 candidates, 69925 repo-hours, 745 releases; waiting 502 ms; commit 0 ms)
2026-11-08T14:33:45Z [load_day 2025-11-22] 2025-11-22 hour 16: 147774 events in 0 files, snapshot none (task 3546 ms: download 2285 ms overlapping gunzip 468 ms, parse 1549 ms, sort 0 ms, write 0 ms, index 554 ms: 4 candidates, 71599 repo-hours, 611 releases; waiting 622 ms; commit 0 ms)
2026-11-08T14:33:45Z [load_day 2025-11-22] 2025-11-22 hour 17: 148493 events in 0 files, snapshot none (task 3405 ms: download 2286 ms overlapping gunzip 447 ms, parse 1435 ms, sort 0 ms, write 0 ms, index 585 ms: 3 candidates, 70707 repo-hours, 580 releases; waiting 626 ms; commit 0 ms)
2026-11-08T14:33:49Z [load_day 2025-11-22] 2025-11-22 hour 18: 150657 events in 0 files, snapshot none (task 3741 ms: download 1870 ms overlapping gunzip 570 ms, parse 1757 ms, sort 0 ms, write 0 ms, index 579 ms: 6 candidates, 76779 repo-hours, 644 releases; waiting 509 ms; commit 0 ms)
2026-11-08T14:33:49Z [load_day 2025-11-22] 2025-11-22 hour 19: 145111 events in 0 files, snapshot none (task 3644 ms: download 2287 ms overlapping gunzip 416 ms, parse 1400 ms, sort 0 ms, write 0 ms, index 576 ms: 10 candidates, 63672 repo-hours, 615 releases; waiting 664 ms; commit 0 ms)
2026-11-08T14:33:54Z [load_day 2025-11-22] 2025-11-22 hour 20: 144014 events in 0 files, snapshot none (task 3920 ms: download 2660 ms overlapping gunzip 339 ms, parse 1107 ms, sort 0 ms, write 0 ms, index 477 ms: 7 candidates, 64663 repo-hours, 582 releases; waiting 1682 ms; commit 0 ms)
2026-11-08T14:33:54Z [load_day 2025-11-22] 2025-11-22 hour 21: 144961 events in 0 files, snapshot none (task 3149 ms: download 1868 ms overlapping gunzip 364 ms, parse 1143 ms, sort 0 ms, write 0 ms, index 511 ms: 2 candidates, 64005 repo-hours, 594 releases; waiting 761 ms; commit 0 ms)
2026-11-08T14:33:57Z [load_day 2025-11-22] 2025-11-22 hour 22: 141268 events in 0 files, snapshot none (task 2688 ms: download 1750 ms overlapping gunzip 342 ms, parse 1116 ms, sort 0 ms, write 0 ms, index 479 ms: 3 candidates, 61981 repo-hours, 697 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:33:57Z [load_day 2025-11-22] 2025-11-22 hour 23: 140594 events in 0 files, snapshot none (task 2580 ms: download 1715 ms overlapping gunzip 390 ms, parse 1183 ms, sort 0 ms, write 0 ms, index 431 ms: 3 candidates, 59620 repo-hours, 633 releases; waiting 306 ms; commit 0 ms)
2026-11-08T14:34:05Z [load_day 2025-11-22] 2025-11-22: repo_hour merged from 24 files to 1 (1657396 rows, 7362 ms)
2026-11-08T14:34:08Z [load_day 2025-11-22] 2025-11-22: index committed in 10194 ms (24 + 1 + 24 files)
2026-11-08T14:34:08Z [load_day 2025-11-22] 2025-11-22: 3496609 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:34:08Z [load_day 2025-11-22] attempt 1 succeeded