orcaLog in

Runs · run 1886

load_day 2023-12-22, attempt 1 succeeded

Host
73ccef5e07c2:11885
Started
2026-11-08T03:51:46Z
Ended
2026-11-08T03:53:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
623 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
134.5 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1886/load_day/2023-12-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:51:46Z [load_day 2023-12-22] attempt 1 started
2026-11-08T03:51:47Z [load_day 2023-12-22] 2023-12-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:51:54Z [load_day 2023-12-22] 2023-12-22 hour 0: 161566 events in 0 files, snapshot none (task 5909 ms: download 2823 ms overlapping gunzip 806 ms, parse 3340 ms, sort 0 ms, write 0 ms, index 927 ms: 6 candidates, 79900 repo-hours, 1055 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:51:54Z [load_day 2023-12-22] 2023-12-22 hour 1: 162869 events in 0 files, snapshot none (task 5563 ms: download 2517 ms overlapping gunzip 746 ms, parse 3154 ms, sort 0 ms, write 0 ms, index 874 ms: 8 candidates, 84999 repo-hours, 792 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:52:00Z [load_day 2023-12-22] 2023-12-22 hour 2: 138280 events in 0 files, snapshot none (task 5763 ms: download 3160 ms overlapping gunzip 898 ms, parse 3622 ms, sort 0 ms, write 0 ms, index 394 ms: 12 candidates, 56328 repo-hours, 705 releases; waiting 513 ms; commit 0 ms)
2026-11-08T03:52:00Z [load_day 2023-12-22] 2023-12-22 hour 3: 138152 events in 0 files, snapshot none (task 5341 ms: download 4207 ms overlapping gunzip 803 ms, parse 3132 ms, sort 0 ms, write 0 ms, index 377 ms: 7 candidates, 53765 repo-hours, 825 releases; waiting 768 ms; commit 0 ms)
2026-11-08T03:52:06Z [load_day 2023-12-22] 2023-12-22 hour 4: 130045 events in 0 files, snapshot none (task 5426 ms: download 2816 ms overlapping gunzip 840 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 379 ms: 7 candidates, 49713 repo-hours, 647 releases; waiting 564 ms; commit 0 ms)
2026-11-08T03:52:06Z [load_day 2023-12-22] 2023-12-22 hour 5: 141109 events in 0 files, snapshot none (task 5762 ms: download 3185 ms overlapping gunzip 929 ms, parse 3651 ms, sort 0 ms, write 0 ms, index 380 ms: 5 candidates, 54062 repo-hours, 639 releases; waiting 520 ms; commit 0 ms)
2026-11-08T03:52:12Z [load_day 2023-12-22] 2023-12-22 hour 6: 160781 events in 0 files, snapshot none (task 5361 ms: download 2387 ms overlapping gunzip 740 ms, parse 3163 ms, sort 0 ms, write 0 ms, index 683 ms: 4 candidates, 67480 repo-hours, 818 releases; waiting 478 ms; commit 0 ms)
2026-11-08T03:52:12Z [load_day 2023-12-22] 2023-12-22 hour 7: 161034 events in 0 files, snapshot none (task 5334 ms: download 2401 ms overlapping gunzip 792 ms, parse 3241 ms, sort 0 ms, write 0 ms, index 574 ms: 8 candidates, 65126 repo-hours, 794 releases; waiting 463 ms; commit 0 ms)
2026-11-08T03:52:19Z [load_day 2023-12-22] 2023-12-22 hour 8: 172074 events in 0 files, snapshot none (task 6510 ms: download 3477 ms overlapping gunzip 912 ms, parse 3825 ms, sort 0 ms, write 0 ms, index 964 ms: 2 candidates, 72521 repo-hours, 925 releases; waiting 510 ms; commit 0 ms)
2026-11-08T03:52:20Z [load_day 2023-12-22] 2023-12-22 hour 9: 180266 events in 0 files, snapshot none (task 7561 ms: download 4753 ms overlapping gunzip 1226 ms, parse 5085 ms, sort 0 ms, write 0 ms, index 572 ms: 3 candidates, 75296 repo-hours, 1269 releases; waiting 393 ms; commit 0 ms)
2026-11-08T03:52:26Z [load_day 2023-12-22] 2023-12-22 hour 10: 178510 events in 0 files, snapshot none (task 7040 ms: download 4101 ms overlapping gunzip 1079 ms, parse 4404 ms, sort 0 ms, write 0 ms, index 646 ms: 4 candidates, 73175 repo-hours, 1852 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:52:27Z [load_day 2023-12-22] 2023-12-22 hour 11: 170199 events in 0 files, snapshot none (task 6558 ms: download 4027 ms overlapping gunzip 1022 ms, parse 4094 ms, sort 0 ms, write 0 ms, index 514 ms: 3 candidates, 66451 repo-hours, 998 releases; waiting 551 ms; commit 0 ms)
2026-11-08T03:52:33Z [load_day 2023-12-22] 2023-12-22 hour 12: 230058 events in 0 files, snapshot none (task 6283 ms: download 3635 ms overlapping gunzip 812 ms, parse 3729 ms, sort 0 ms, write 0 ms, index 685 ms: 10 candidates, 98250 repo-hours, 1050 releases; waiting 592 ms; commit 0 ms)
2026-11-08T03:52:34Z [load_day 2023-12-22] 2023-12-22 hour 13: 201349 events in 0 files, snapshot none (task 6131 ms: download 3697 ms overlapping gunzip 874 ms, parse 3857 ms, sort 0 ms, write 0 ms, index 624 ms: 8 candidates, 92722 repo-hours, 1042 releases; waiting 483 ms; commit 0 ms)
2026-11-08T03:52:40Z [load_day 2023-12-22] 2023-12-22 hour 14: 188579 events in 0 files, snapshot none (task 6711 ms: download 4955 ms overlapping gunzip 875 ms, parse 3581 ms, sort 0 ms, write 0 ms, index 633 ms: 7 candidates, 77050 repo-hours, 1115 releases; waiting 1287 ms; commit 0 ms)
2026-11-08T03:52:40Z [load_day 2023-12-22] 2023-12-22 hour 15: 191649 events in 0 files, snapshot none (task 5867 ms: download 3355 ms overlapping gunzip 867 ms, parse 3572 ms, sort 0 ms, write 0 ms, index 623 ms: 9 candidates, 78239 repo-hours, 1245 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:52:47Z [load_day 2023-12-22] 2023-12-22 hour 16: 186992 events in 0 files, snapshot none (task 6869 ms: download 4381 ms overlapping gunzip 1003 ms, parse 4340 ms, sort 0 ms, write 0 ms, index 594 ms: 9 candidates, 74221 repo-hours, 1040 releases; waiting 618 ms; commit 0 ms)
2026-11-08T03:52:47Z [load_day 2023-12-22] 2023-12-22 hour 17: 170767 events in 0 files, snapshot none (task 6412 ms: download 4075 ms overlapping gunzip 984 ms, parse 4154 ms, sort 0 ms, write 0 ms, index 490 ms: 5 candidates, 66526 repo-hours, 977 releases; waiting 510 ms; commit 0 ms)
2026-11-08T03:52:54Z [load_day 2023-12-22] 2023-12-22 hour 18: 168424 events in 0 files, snapshot none (task 5660 ms: download 2924 ms overlapping gunzip 804 ms, parse 3384 ms, sort 0 ms, write 0 ms, index 646 ms: 6 candidates, 70109 repo-hours, 947 releases; waiting 549 ms; commit 0 ms)
2026-11-08T03:52:54Z [load_day 2023-12-22] 2023-12-22 hour 19: 145867 events in 0 files, snapshot none (task 5817 ms: download 3300 ms overlapping gunzip 803 ms, parse 3492 ms, sort 0 ms, write 0 ms, index 541 ms: 6 candidates, 57491 repo-hours, 1644 releases; waiting 493 ms; commit 0 ms)
2026-11-08T03:52:59Z [load_day 2023-12-22] 2023-12-22 hour 20: 142281 events in 0 files, snapshot none (task 5042 ms: download 2713 ms overlapping gunzip 749 ms, parse 3158 ms, sort 0 ms, write 0 ms, index 406 ms: 5 candidates, 54969 repo-hours, 801 releases; waiting 501 ms; commit 0 ms)
2026-11-08T03:52:59Z [load_day 2023-12-22] 2023-12-22 hour 21: 136126 events in 0 files, snapshot none (task 5355 ms: download 3095 ms overlapping gunzip 800 ms, parse 3157 ms, sort 0 ms, write 0 ms, index 391 ms: 9 candidates, 50234 repo-hours, 871 releases; waiting 656 ms; commit 0 ms)
2026-11-08T03:53:04Z [load_day 2023-12-22] 2023-12-22 hour 22: 121843 events in 0 files, snapshot none (task 4671 ms: download 2595 ms overlapping gunzip 697 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 336 ms: 12 candidates, 46473 repo-hours, 883 releases; waiting 534 ms; commit 0 ms)
2026-11-08T03:53:04Z [load_day 2023-12-22] 2023-12-22 hour 23: 108244 events in 0 files, snapshot none (task 4300 ms: download 2326 ms overlapping gunzip 622 ms, parse 2519 ms, sort 0 ms, write 0 ms, index 332 ms: 10 candidates, 42650 repo-hours, 662 releases; waiting 498 ms; commit 0 ms)
2026-11-08T03:53:11Z [load_day 2023-12-22] 2023-12-22: repo_hour merged from 24 files to 1 (1607750 rows, 7015 ms)
2026-11-08T03:53:13Z [load_day 2023-12-22] 2023-12-22: index committed in 9319 ms (24 + 1 + 24 files)
2026-11-08T03:53:13Z [load_day 2023-12-22] 2023-12-22: 3887064 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:53:13Z [load_day 2023-12-22] attempt 1 succeeded