orcaLog in

Runs · run 1860

load_day 2023-12-15, attempt 1 succeeded

Host
73ccef5e07c2:9888
Started
2026-11-08T03:46:37Z
Ended
2026-11-08T03:48:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
712 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
151.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1860/load_day/2023-12-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:46:37Z [load_day 2023-12-15] attempt 1 started
2026-11-08T03:46:38Z [load_day 2023-12-15] 2023-12-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:46:44Z [load_day 2023-12-15] 2023-12-15 hour 0: 167269 events in 0 files, snapshot none (task 5340 ms: download 2997 ms overlapping gunzip 752 ms, parse 3152 ms, sort 0 ms, write 0 ms, index 562 ms: 6 candidates, 84177 repo-hours, 1081 releases; waiting 514 ms; commit 0 ms)
2026-11-08T03:46:44Z [load_day 2023-12-15] 2023-12-15 hour 1: 167329 events in 0 files, snapshot none (task 4704 ms: download 2303 ms overlapping gunzip 688 ms, parse 2856 ms, sort 0 ms, write 0 ms, index 606 ms: 11 candidates, 93211 repo-hours, 936 releases; waiting 272 ms; commit 0 ms)
2026-11-08T03:46:51Z [load_day 2023-12-15] 2023-12-15 hour 2: 154825 events in 0 files, snapshot none (task 6118 ms: download 3300 ms overlapping gunzip 893 ms, parse 3774 ms, sort 0 ms, write 0 ms, index 657 ms: 10 candidates, 74072 repo-hours, 770 releases; waiting 529 ms; commit 0 ms)
2026-11-08T03:46:51Z [load_day 2023-12-15] 2023-12-15 hour 3: 142491 events in 0 files, snapshot none (task 5829 ms: download 2616 ms overlapping gunzip 836 ms, parse 3626 ms, sort 0 ms, write 0 ms, index 550 ms: 7 candidates, 61141 repo-hours, 943 releases; waiting 522 ms; commit 0 ms)
2026-11-08T03:46:56Z [load_day 2023-12-15] 2023-12-15 hour 4: 132215 events in 0 files, snapshot none (task 4634 ms: download 2106 ms overlapping gunzip 684 ms, parse 2757 ms, sort 0 ms, write 0 ms, index 394 ms: 2 candidates, 55806 repo-hours, 634 releases; waiting 243 ms; commit 0 ms)
2026-11-08T03:46:57Z [load_day 2023-12-15] 2023-12-15 hour 5: 151617 events in 0 files, snapshot none (task 5835 ms: download 3138 ms overlapping gunzip 922 ms, parse 3474 ms, sort 0 ms, write 0 ms, index 571 ms: 10 candidates, 74121 repo-hours, 751 releases; waiting 551 ms; commit 0 ms)
2026-11-08T03:47:02Z [load_day 2023-12-15] 2023-12-15 hour 6: 157673 events in 0 files, snapshot none (task 6260 ms: download 3343 ms overlapping gunzip 942 ms, parse 3693 ms, sort 0 ms, write 0 ms, index 565 ms: 8 candidates, 73565 repo-hours, 896 releases; waiting 710 ms; commit 0 ms)
2026-11-08T03:47:04Z [load_day 2023-12-15] 2023-12-15 hour 7: 161274 events in 0 files, snapshot none (task 6018 ms: download 4755 ms overlapping gunzip 948 ms, parse 3742 ms, sort 0 ms, write 0 ms, index 555 ms: 8 candidates, 71272 repo-hours, 956 releases; waiting 538 ms; commit 0 ms)
2026-11-08T03:47:10Z [load_day 2023-12-15] 2023-12-15 hour 8: 187713 events in 0 files, snapshot none (task 6840 ms: download 3723 ms overlapping gunzip 985 ms, parse 4057 ms, sort 0 ms, write 0 ms, index 1013 ms: 12 candidates, 88669 repo-hours, 1112 releases; waiting 479 ms; commit 0 ms)
2026-11-08T03:47:12Z [load_day 2023-12-15] 2023-12-15 hour 9: 191454 events in 0 files, snapshot none (task 7358 ms: download 4626 ms overlapping gunzip 1092 ms, parse 4566 ms, sort 0 ms, write 0 ms, index 824 ms: 7 candidates, 83846 repo-hours, 1277 releases; waiting 549 ms; commit 0 ms)
2026-11-08T03:47:18Z [load_day 2023-12-15] 2023-12-15 hour 10: 189412 events in 0 files, snapshot none (task 7136 ms: download 4086 ms overlapping gunzip 1248 ms, parse 5041 ms, sort 0 ms, write 0 ms, index 628 ms: 9 candidates, 81939 repo-hours, 1182 releases; waiting 21 ms; commit 0 ms)
2026-11-08T03:47:19Z [load_day 2023-12-15] 2023-12-15 hour 11: 184693 events in 0 files, snapshot none (task 6619 ms: download 4062 ms overlapping gunzip 1095 ms, parse 4575 ms, sort 0 ms, write 0 ms, index 748 ms: 5 candidates, 81742 repo-hours, 1260 releases; waiting 9 ms; commit 0 ms)
2026-11-08T03:47:26Z [load_day 2023-12-15] 2023-12-15 hour 12: 228690 events in 0 files, snapshot none (task 7768 ms: download 5079 ms overlapping gunzip 1201 ms, parse 5536 ms, sort 0 ms, write 0 ms, index 821 ms: 10 candidates, 106666 repo-hours, 1115 releases; waiting 17 ms; commit 0 ms)
2026-11-08T03:47:27Z [load_day 2023-12-15] 2023-12-15 hour 13: 208066 events in 0 files, snapshot none (task 7654 ms: download 4615 ms overlapping gunzip 1191 ms, parse 4984 ms, sort 0 ms, write 0 ms, index 1245 ms: 7 candidates, 100725 repo-hours, 1208 releases; waiting 17 ms; commit 0 ms)
2026-11-08T03:47:34Z [load_day 2023-12-15] 2023-12-15 hour 14: 209689 events in 0 files, snapshot none (task 7274 ms: download 4258 ms overlapping gunzip 1234 ms, parse 5129 ms, sort 0 ms, write 0 ms, index 686 ms: 9 candidates, 94584 repo-hours, 1259 releases; waiting 6 ms; commit 0 ms)
2026-11-08T03:47:35Z [load_day 2023-12-15] 2023-12-15 hour 15: 201941 events in 0 files, snapshot none (task 7772 ms: download 5044 ms overlapping gunzip 1223 ms, parse 4974 ms, sort 0 ms, write 0 ms, index 810 ms: 9 candidates, 88370 repo-hours, 1319 releases; waiting 477 ms; commit 0 ms)
2026-11-08T03:47:41Z [load_day 2023-12-15] 2023-12-15 hour 16: 189344 events in 0 files, snapshot none (task 7339 ms: download 4872 ms overlapping gunzip 1177 ms, parse 5345 ms, sort 0 ms, write 0 ms, index 596 ms: 8 candidates, 84331 repo-hours, 1175 releases; waiting 10 ms; commit 0 ms)
2026-11-08T03:47:42Z [load_day 2023-12-15] 2023-12-15 hour 17: 187688 events in 0 files, snapshot none (task 6168 ms: download 3772 ms overlapping gunzip 1041 ms, parse 4332 ms, sort 0 ms, write 0 ms, index 601 ms: 9 candidates, 85610 repo-hours, 1229 releases; waiting 11 ms; commit 0 ms)
2026-11-08T03:47:48Z [load_day 2023-12-15] 2023-12-15 hour 18: 179223 events in 0 files, snapshot none (task 6685 ms: download 4255 ms overlapping gunzip 1061 ms, parse 4294 ms, sort 0 ms, write 0 ms, index 582 ms: 8 candidates, 80181 repo-hours, 1150 releases; waiting 480 ms; commit 0 ms)
2026-11-08T03:47:48Z [load_day 2023-12-15] 2023-12-15 hour 19: 164374 events in 0 files, snapshot none (task 5747 ms: download 3492 ms overlapping gunzip 969 ms, parse 4046 ms, sort 0 ms, write 0 ms, index 514 ms: 6 candidates, 67904 repo-hours, 945 releases; waiting 30 ms; commit 0 ms)
2026-11-08T03:47:54Z [load_day 2023-12-15] 2023-12-15 hour 20: 159962 events in 0 files, snapshot none (task 5288 ms: download 3049 ms overlapping gunzip 879 ms, parse 3717 ms, sort 0 ms, write 0 ms, index 504 ms: 7 candidates, 72172 repo-hours, 1004 releases; waiting 0 ms; commit 0 ms)
2026-11-08T03:47:54Z [load_day 2023-12-15] 2023-12-15 hour 21: 142841 events in 0 files, snapshot none (task 4807 ms: download 2770 ms overlapping gunzip 843 ms, parse 3387 ms, sort 0 ms, write 0 ms, index 385 ms: 6 candidates, 59199 repo-hours, 1342 releases; waiting 8 ms; commit 0 ms)
2026-11-08T03:47:58Z [load_day 2023-12-15] 2023-12-15 hour 22: 130322 events in 0 files, snapshot none (task 3940 ms: download 1890 ms overlapping gunzip 667 ms, parse 2669 ms, sort 0 ms, write 0 ms, index 410 ms: 4 candidates, 54313 repo-hours, 991 releases; waiting 13 ms; commit 0 ms)
2026-11-08T03:47:58Z [load_day 2023-12-15] 2023-12-15 hour 23: 114667 events in 0 files, snapshot none (task 3735 ms: download 1783 ms overlapping gunzip 634 ms, parse 2547 ms, sort 0 ms, write 0 ms, index 343 ms: 3 candidates, 48665 repo-hours, 911 releases; waiting 23 ms; commit 0 ms)
2026-11-08T03:48:07Z [load_day 2023-12-15] 2023-12-15: repo_hour merged from 24 files to 1 (1866281 rows, 8234 ms)
2026-11-08T03:48:09Z [load_day 2023-12-15] 2023-12-15: index committed in 10704 ms (24 + 1 + 24 files)
2026-11-08T03:48:09Z [load_day 2023-12-15] 2023-12-15: 4104772 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:48:09Z [load_day 2023-12-15] attempt 1 succeeded