orcaLog in

Runs · run 1339

load_day 2023-07-28, attempt 1 succeeded

Host
3c2b29713ce8:171301
Started
2026-11-07T23:22:54Z
Ended
2026-11-07T23:26:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1339/load_day/2023-07-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:22:54Z [load_day 2023-07-28] attempt 1 started
2026-11-07T23:22:55Z [load_day 2023-07-28] 2023-07-28: 2 hours in flight, about 1200 MB
2026-11-07T23:23:15Z [load_day 2023-07-28] 2023-07-28 hour 0: 146356 events in 3 files, snapshot 6357572914701586989 (task 14042 ms: download 6636 ms overlapping gunzip 995 ms, parse 4520 ms, sort 113 ms, write 7067 ms, index 519 ms: 4 candidates, 75045 repo-hours, 915 releases; waiting 529 ms; commit 4462 ms)
2026-11-07T23:23:18Z [load_day 2023-07-28] 2023-07-28 hour 1: 150680 events in 4 files, snapshot 4653020629115212325 (task 14010 ms: download 5694 ms overlapping gunzip 754 ms, parse 3774 ms, sort 187 ms, write 7757 ms, index 670 ms: 8 candidates, 83651 repo-hours, 739 releases; waiting 467 ms; commit 2518 ms)
2026-11-07T23:23:27Z [load_day 2023-07-28] 2023-07-28 hour 2: 137783 events in 3 files, snapshot 2902665945700968900 (task 12531 ms: download 5400 ms overlapping gunzip 709 ms, parse 3001 ms, sort 123 ms, write 7394 ms, index 438 ms: 11 candidates, 62147 repo-hours, 728 releases; waiting 544 ms; commit 2539 ms)
2026-11-07T23:23:32Z [load_day 2023-07-28] 2023-07-28 hour 3: 127214 events in 3 files, snapshot 5537426433555134133 (task 11564 ms: download 5117 ms overlapping gunzip 641 ms, parse 2695 ms, sort 74 ms, write 6814 ms, index 549 ms: 3 candidates, 55563 repo-hours, 809 releases; waiting 504 ms; commit 3579 ms)
2026-11-07T23:23:40Z [load_day 2023-07-28] 2023-07-28 hour 4: 120586 events in 3 files, snapshot 8682131431621502748 (task 12311 ms: download 4377 ms overlapping gunzip 777 ms, parse 3232 ms, sort 73 ms, write 6903 ms, index 513 ms: 9 candidates, 50682 repo-hours, 722 releases; waiting 524 ms; commit 2647 ms)
2026-11-07T23:23:46Z [load_day 2023-07-28] 2023-07-28 hour 5: 130273 events in 3 files, snapshot 3524070265855650722 (task 13655 ms: download 6148 ms overlapping gunzip 780 ms, parse 3370 ms, sort 142 ms, write 8376 ms, index 450 ms: 6 candidates, 56196 repo-hours, 861 releases; waiting 193 ms; commit 3499 ms)
2026-11-07T23:23:56Z [load_day 2023-07-28] 2023-07-28 hour 6: 161449 events in 4 files, snapshot 821329480468404779 (task 15270 ms: download 5844 ms overlapping gunzip 806 ms, parse 3813 ms, sort 121 ms, write 9032 ms, index 688 ms: 3 candidates, 73521 repo-hours, 1019 releases; waiting 510 ms; commit 2078 ms)
2026-11-07T23:24:11Z [load_day 2023-07-28] 2023-07-28 hour 7: 169989 events in 4 files, snapshot 6412180728698984584 (task 17675 ms: download 10338 ms overlapping gunzip 947 ms, parse 4367 ms, sort 138 ms, write 10864 ms, index 502 ms: 5 candidates, 74488 repo-hours, 914 releases; waiting 531 ms; commit 8538 ms)
2026-11-07T23:24:14Z [load_day 2023-07-28] 2023-07-28 hour 8: 177867 events in 4 files, snapshot 6570079537321271377 (task 17083 ms: download 9591 ms overlapping gunzip 967 ms, parse 4299 ms, sort 112 ms, write 10359 ms, index 552 ms: 10 candidates, 78659 repo-hours, 967 releases; waiting 369 ms; commit 1974 ms)
2026-11-07T23:24:24Z [load_day 2023-07-28] 2023-07-28 hour 9: 178366 events in 4 files, snapshot 5671143024427364152 (task 17467 ms: download 10070 ms overlapping gunzip 1039 ms, parse 4279 ms, sort 135 ms, write 10158 ms, index 995 ms: 7 candidates, 77809 repo-hours, 1167 releases; waiting 569 ms; commit 2600 ms)
2026-11-07T23:24:35Z [load_day 2023-07-28] 2023-07-28 hour 10: 175875 events in 4 files, snapshot 4033832629374010598 (task 18464 ms: download 11381 ms overlapping gunzip 1178 ms, parse 4795 ms, sort 128 ms, write 10831 ms, index 524 ms: 8 candidates, 74359 repo-hours, 995 releases; waiting 710 ms; commit 3690 ms)
2026-11-07T23:24:41Z [load_day 2023-07-28] 2023-07-28 hour 11: 167646 events in 4 files, snapshot 8698507936441246079 (task 16751 ms: download 9558 ms overlapping gunzip 962 ms, parse 4057 ms, sort 154 ms, write 10112 ms, index 622 ms: 3 candidates, 72403 repo-hours, 908 releases; waiting 522 ms; commit 2349 ms)
2026-11-07T23:24:58Z [load_day 2023-07-28] 2023-07-28 hour 12: 221224 events in 5 files, snapshot 6612589876151508770 (task 20977 ms: download 10505 ms overlapping gunzip 1195 ms, parse 5395 ms, sort 182 ms, write 12211 ms, index 1042 ms: 6 candidates, 104047 repo-hours, 993 releases; waiting 518 ms; commit 4776 ms)
2026-11-07T23:25:06Z [load_day 2023-07-28] 2023-07-28 hour 13: 198195 events in 4 files, snapshot 4300793260293251402 (task 21661 ms: download 14925 ms overlapping gunzip 1435 ms, parse 5936 ms, sort 170 ms, write 12611 ms, index 794 ms: 5 candidates, 97442 repo-hours, 968 releases; waiting 374 ms; commit 3969 ms)
2026-11-07T23:25:17Z [load_day 2023-07-28] 2023-07-28 hour 14: 162066 events in 4 files, snapshot 1461753162228609195 (task 20280 ms: download 12777 ms overlapping gunzip 1083 ms, parse 5116 ms, sort 161 ms, write 12355 ms, index 659 ms: 5 candidates, 76365 repo-hours, 1083 releases; waiting 513 ms; commit 2645 ms)
2026-11-07T23:25:25Z [load_day 2023-07-28] 2023-07-28 hour 15: 166624 events in 4 files, snapshot 1323644714042585557 (task 19307 ms: download 12261 ms overlapping gunzip 1365 ms, parse 5644 ms, sort 148 ms, write 10720 ms, index 904 ms: 7 candidates, 76756 repo-hours, 1297 releases; waiting 267 ms; commit 2536 ms)
2026-11-07T23:25:38Z [load_day 2023-07-28] 2023-07-28 hour 16: 179346 events in 4 files, snapshot 8138182897217041546 (task 19364 ms: download 10870 ms overlapping gunzip 1259 ms, parse 5080 ms, sort 233 ms, write 11191 ms, index 731 ms: 6 candidates, 78691 repo-hours, 1002 releases; waiting 514 ms; commit 2647 ms)
2026-11-07T23:25:45Z [load_day 2023-07-28] 2023-07-28 hour 17: 169126 events in 4 files, snapshot 3677796579508480695 (task 18638 ms: download 10942 ms overlapping gunzip 950 ms, parse 4201 ms, sort 151 ms, write 11453 ms, index 1008 ms: 10 candidates, 72072 repo-hours, 918 releases; waiting 545 ms; commit 2489 ms)
2026-11-07T23:25:57Z [load_day 2023-07-28] 2023-07-28 hour 18: 172359 events in 4 files, snapshot 446221855491249226 (task 18201 ms: download 10582 ms overlapping gunzip 1217 ms, parse 5241 ms, sort 146 ms, write 10233 ms, index 539 ms: 8 candidates, 75926 repo-hours, 1028 releases; waiting 517 ms; commit 2598 ms)
2026-11-07T23:26:04Z [load_day 2023-07-28] 2023-07-28 hour 19: 154762 events in 4 files, snapshot 1185968133005901448 (task 16853 ms: download 7001 ms overlapping gunzip 945 ms, parse 3909 ms, sort 118 ms, write 10244 ms, index 888 ms: 3 candidates, 63926 repo-hours, 1004 releases; waiting 501 ms; commit 3177 ms)
2026-11-07T23:26:15Z [load_day 2023-07-28] 2023-07-28 hour 20: 146201 events in 3 files, snapshot 5576008425316806351 (task 15666 ms: download 6065 ms overlapping gunzip 847 ms, parse 3689 ms, sort 106 ms, write 9654 ms, index 515 ms: 3 candidates, 61403 repo-hours, 938 releases; waiting 484 ms; commit 3184 ms)
2026-11-07T23:26:20Z [load_day 2023-07-28] 2023-07-28 hour 21: 130838 events in 3 files, snapshot 1448286565221307501 (task 14877 ms: download 6283 ms overlapping gunzip 942 ms, parse 4064 ms, sort 118 ms, write 8342 ms, index 602 ms: 2 candidates, 52943 repo-hours, 855 releases; waiting 492 ms; commit 2988 ms)
2026-11-07T23:26:28Z [load_day 2023-07-28] 2023-07-28 hour 22: 116120 events in 3 files, snapshot 8134874904210357037 (task 12411 ms: download 5485 ms overlapping gunzip 667 ms, parse 2947 ms, sort 117 ms, write 7485 ms, index 309 ms: 7 candidates, 46974 repo-hours, 825 releases; waiting 505 ms; commit 3667 ms)
2026-11-07T23:26:30Z [load_day 2023-07-28] 2023-07-28 hour 23: 104082 events in 3 files, snapshot 4731639388889641061 (task 9893 ms: download 2399 ms overlapping gunzip 568 ms, parse 2245 ms, sort 77 ms, write 5661 ms, index 492 ms: 5 candidates, 42562 repo-hours, 676 releases; waiting 566 ms; commit 1824 ms)
2026-11-07T23:26:38Z [load_day 2023-07-28] 2023-07-28: repo_hour merged from 24 files to 1 (1683630 rows, 7616 ms)
2026-11-07T23:26:40Z [load_day 2023-07-28] 2023-07-28: index committed in 9837 ms (24 + 1 + 24 files)
2026-11-07T23:26:40Z [load_day 2023-07-28] 2023-07-28: 3765027 events in 24 hours
2026-11-07T23:26:40Z [load_day 2023-07-28] attempt 1 succeeded