orcaLog in

Runs · run 1664

load_day 2023-10-25, attempt 1 succeeded

Host
3c2b29713ce8:479058
Started
2026-11-08T02:08:34Z
Ended
2026-11-08T02:13:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1664/load_day/2023-10-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:08:34Z [load_day 2023-10-25] attempt 1 started
2026-11-08T02:08:36Z [load_day 2023-10-25] 2023-10-25: 2 hours in flight, about 1200 MB
2026-11-08T02:09:01Z [load_day 2023-10-25] 2023-10-25 hour 0: 168557 events in 4 files, snapshot 3013018948776059657 (task 17285 ms: download 7781 ms overlapping gunzip 1078 ms, parse 5065 ms, sort 144 ms, write 9393 ms, index 705 ms: 15 candidates, 88764 repo-hours, 1106 releases; waiting 539 ms; commit 2236 ms)
2026-11-08T02:09:04Z [load_day 2023-10-25] 2023-10-25 hour 1: 171269 events in 4 files, snapshot 7720326562536891908 (task 17004 ms: download 7263 ms overlapping gunzip 1046 ms, parse 4803 ms, sort 143 ms, write 9540 ms, index 707 ms: 27 candidates, 93023 repo-hours, 834 releases; waiting 505 ms; commit 3073 ms)
2026-11-08T02:09:17Z [load_day 2023-10-25] 2023-10-25 hour 2: 143057 events in 3 files, snapshot 801676006319317088 (task 14222 ms: download 6448 ms overlapping gunzip 909 ms, parse 3633 ms, sort 101 ms, write 8295 ms, index 447 ms: 17 candidates, 63158 repo-hours, 739 releases; waiting 535 ms; commit 2669 ms)
2026-11-08T02:09:22Z [load_day 2023-10-25] 2023-10-25 hour 3: 140011 events in 3 files, snapshot 3988589796945663230 (task 13471 ms: download 6320 ms overlapping gunzip 841 ms, parse 3665 ms, sort 94 ms, write 7665 ms, index 446 ms: 13 candidates, 61063 repo-hours, 863 releases; waiting 513 ms; commit 5417 ms)
2026-11-08T02:09:31Z [load_day 2023-10-25] 2023-10-25 hour 4: 135550 events in 3 files, snapshot 6150942955557322499 (task 13730 ms: download 6325 ms overlapping gunzip 837 ms, parse 3659 ms, sort 97 ms, write 7895 ms, index 392 ms: 11 candidates, 56546 repo-hours, 697 releases; waiting 566 ms; commit 2649 ms)
2026-11-08T02:09:35Z [load_day 2023-10-25] 2023-10-25 hour 5: 148529 events in 3 files, snapshot 5399805417071417145 (task 14665 ms: download 6195 ms overlapping gunzip 904 ms, parse 3895 ms, sort 87 ms, write 8341 ms, index 695 ms: 19 candidates, 64038 repo-hours, 724 releases; waiting 497 ms; commit 2188 ms)
2026-11-08T02:09:47Z [load_day 2023-10-25] 2023-10-25 hour 6: 177792 events in 4 files, snapshot 8672160845089567782 (task 15027 ms: download 8565 ms overlapping gunzip 892 ms, parse 4115 ms, sort 154 ms, write 8498 ms, index 543 ms: 16 candidates, 81681 repo-hours, 965 releases; waiting 543 ms; commit 2311 ms)
2026-11-08T02:09:52Z [load_day 2023-10-25] 2023-10-25 hour 7: 188816 events in 4 files, snapshot 3928353050718725436 (task 16230 ms: download 9356 ms overlapping gunzip 1090 ms, parse 4480 ms, sort 119 ms, write 9229 ms, index 511 ms: 11 candidates, 82128 repo-hours, 1101 releases; waiting 528 ms; commit 2209 ms)
2026-11-08T02:10:09Z [load_day 2023-10-25] 2023-10-25 hour 8: 196669 events in 4 files, snapshot 7875733609614105009 (task 20118 ms: download 9408 ms overlapping gunzip 1037 ms, parse 4421 ms, sort 187 ms, write 13034 ms, index 579 ms: 12 candidates, 87278 repo-hours, 1091 releases; waiting 436 ms; commit 2830 ms)
2026-11-08T02:10:17Z [load_day 2023-10-25] 2023-10-25 hour 9: 200743 events in 5 files, snapshot 7099514407303533776 (task 21330 ms: download 11792 ms overlapping gunzip 1285 ms, parse 5475 ms, sort 172 ms, write 13045 ms, index 581 ms: 12 candidates, 89331 repo-hours, 1254 releases; waiting 508 ms; commit 4367 ms)
2026-11-08T02:10:32Z [load_day 2023-10-25] 2023-10-25 hour 10: 195940 events in 4 files, snapshot 2172522800415966209 (task 21057 ms: download 12172 ms overlapping gunzip 1207 ms, parse 5143 ms, sort 160 ms, write 12834 ms, index 931 ms: 4 candidates, 86626 repo-hours, 1123 releases; waiting 511 ms; commit 3986 ms)
2026-11-08T02:10:37Z [load_day 2023-10-25] 2023-10-25 hour 11: 195155 events in 4 files, snapshot 7535033155875761339 (task 21198 ms: download 11787 ms overlapping gunzip 1242 ms, parse 5705 ms, sort 116 ms, write 12438 ms, index 931 ms: 13 candidates, 84541 repo-hours, 1118 releases; waiting 524 ms; commit 2300 ms)
2026-11-08T02:10:56Z [load_day 2023-10-25] 2023-10-25 hour 12: 250581 events in 6 files, snapshot 611821987402200906 (task 24167 ms: download 14935 ms overlapping gunzip 1468 ms, parse 6901 ms, sort 196 ms, write 14029 ms, index 779 ms: 15 candidates, 118121 repo-hours, 1200 releases; waiting 487 ms; commit 2804 ms)
2026-11-08T02:11:03Z [load_day 2023-10-25] 2023-10-25 hour 13: 233750 events in 5 files, snapshot 1185129342030148001 (task 23741 ms: download 14810 ms overlapping gunzip 1417 ms, parse 6460 ms, sort 237 ms, write 13938 ms, index 842 ms: 18 candidates, 116734 repo-hours, 1118 releases; waiting 501 ms; commit 3071 ms)
2026-11-08T02:11:22Z [load_day 2023-10-25] 2023-10-25 hour 14: 226330 events in 5 files, snapshot 7198081846785341283 (task 24633 ms: download 16743 ms overlapping gunzip 1489 ms, parse 6396 ms, sort 206 ms, write 15048 ms, index 698 ms: 9 candidates, 105329 repo-hours, 1231 releases; waiting 526 ms; commit 2899 ms)
2026-11-08T02:11:27Z [load_day 2023-10-25] 2023-10-25 hour 15: 203635 events in 5 files, snapshot 3351132713040467372 (task 23346 ms: download 12812 ms overlapping gunzip 1192 ms, parse 5153 ms, sort 121 ms, write 15365 ms, index 730 ms: 8 candidates, 95656 repo-hours, 1166 releases; waiting 509 ms; commit 2863 ms)
2026-11-08T02:11:46Z [load_day 2023-10-25] 2023-10-25 hour 16: 199523 events in 4 files, snapshot 6979161633644488555 (task 23279 ms: download 12642 ms overlapping gunzip 1401 ms, parse 6127 ms, sort 204 ms, write 13964 ms, index 752 ms: 7 candidates, 91628 repo-hours, 1041 releases; waiting 510 ms; commit 2687 ms)
2026-11-08T02:11:55Z [load_day 2023-10-25] 2023-10-25 hour 17: 201073 events in 5 files, snapshot 2827111389830707330 (task 23826 ms: download 13609 ms overlapping gunzip 1311 ms, parse 5879 ms, sort 213 ms, write 15026 ms, index 608 ms: 15 candidates, 89655 repo-hours, 971 releases; waiting 538 ms; commit 5778 ms)
2026-11-08T02:12:10Z [load_day 2023-10-25] 2023-10-25 hour 18: 204103 events in 5 files, snapshot 9075748073160034662 (task 23330 ms: download 12770 ms overlapping gunzip 1446 ms, parse 6741 ms, sort 276 ms, write 13335 ms, index 729 ms: 10 candidates, 95933 repo-hours, 1134 releases; waiting 492 ms; commit 2820 ms)
2026-11-08T02:12:15Z [load_day 2023-10-25] 2023-10-25 hour 19: 197137 events in 4 files, snapshot 2310195275888258672 (task 22676 ms: download 13793 ms overlapping gunzip 1643 ms, parse 7143 ms, sort 139 ms, write 12076 ms, index 821 ms: 10 candidates, 83543 repo-hours, 1059 releases; waiting 514 ms; commit 2970 ms)
2026-11-08T02:12:33Z [load_day 2023-10-25] 2023-10-25 hour 20: 184740 events in 4 files, snapshot 2036193934984440056 (task 21672 ms: download 11948 ms overlapping gunzip 1209 ms, parse 5507 ms, sort 247 ms, write 12943 ms, index 931 ms: 10 candidates, 79618 repo-hours, 1119 releases; waiting 501 ms; commit 2891 ms)
2026-11-08T02:12:38Z [load_day 2023-10-25] 2023-10-25 hour 21: 174294 events in 4 files, snapshot 1678085441233553340 (task 21443 ms: download 12288 ms overlapping gunzip 1077 ms, parse 4514 ms, sort 159 ms, write 14363 ms, index 753 ms: 15 candidates, 72138 repo-hours, 985 releases; waiting 214 ms; commit 3209 ms)
2026-11-08T02:12:54Z [load_day 2023-10-25] 2023-10-25 hour 22: 162688 events in 4 files, snapshot 8056898040801056873 (task 19680 ms: download 12506 ms overlapping gunzip 1472 ms, parse 6060 ms, sort 110 ms, write 10697 ms, index 496 ms: 9 candidates, 66000 repo-hours, 858 releases; waiting 548 ms; commit 2545 ms)
2026-11-08T02:12:56Z [load_day 2023-10-25] 2023-10-25 hour 23: 139889 events in 3 files, snapshot 5903536386301295825 (task 15421 ms: download 6491 ms overlapping gunzip 795 ms, parse 3560 ms, sort 92 ms, write 9743 ms, index 427 ms: 9 candidates, 58403 repo-hours, 752 releases; waiting 530 ms; commit 2419 ms)
2026-11-08T02:13:05Z [load_day 2023-10-25] 2023-10-25: repo_hour merged from 24 files to 1 (2010935 rows, 8835 ms)
2026-11-08T02:13:07Z [load_day 2023-10-25] 2023-10-25: index committed in 11310 ms (24 + 1 + 24 files)
2026-11-08T02:13:07Z [load_day 2023-10-25] 2023-10-25: 4439831 events in 24 hours
2026-11-08T02:13:07Z [load_day 2023-10-25] attempt 1 succeeded