orcaLog in

Runs · run 849

load_day 2023-02-24, attempt 1 succeeded

Host
caf251265124:91198
Started
2026-11-07T16:04:55Z
Ended
2026-11-07T16:08:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/849/load_day/2023-02-24/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:04:55Z [load_day 2023-02-24] attempt 1 started
2026-11-07T16:04:57Z [load_day 2023-02-24] 2023-02-24: 2 hours in flight, about 1200 MB
2026-11-07T16:05:12Z [load_day 2023-02-24] 2023-02-24 hour 0: 163348 events in 4 files, snapshot 7360600489515523393 (task 13074 ms: download 5735 ms overlapping gunzip 796 ms, parse 3477 ms, sort 92 ms, write 7341 ms, index 488 ms: 5 candidates, 76698 repo-hours, 1046 releases; waiting 554 ms; commit 1288 ms)
2026-11-07T16:05:14Z [load_day 2023-02-24] 2023-02-24 hour 1: 160100 events in 4 files, snapshot 1785283490734399078 (task 12645 ms: download 5488 ms overlapping gunzip 700 ms, parse 3098 ms, sort 100 ms, write 6723 ms, index 569 ms: 12 candidates, 81575 repo-hours, 932 releases; waiting 1110 ms; commit 1322 ms)
2026-11-07T16:05:24Z [load_day 2023-02-24] 2023-02-24 hour 2: 146254 events in 3 files, snapshot 8654985462240451305 (task 10580 ms: download 4301 ms overlapping gunzip 641 ms, parse 2720 ms, sort 79 ms, write 5975 ms, index 458 ms: 13 candidates, 70235 repo-hours, 873 releases; waiting 353 ms; commit 1320 ms)
2026-11-07T16:05:25Z [load_day 2023-02-24] 2023-02-24 hour 3: 137121 events in 3 files, snapshot 5866840249288909669 (task 10398 ms: download 4627 ms overlapping gunzip 637 ms, parse 2780 ms, sort 75 ms, write 5579 ms, index 357 ms: 6 candidates, 58784 repo-hours, 892 releases; waiting 623 ms; commit 1328 ms)
2026-11-07T16:05:35Z [load_day 2023-02-24] 2023-02-24 hour 4: 129972 events in 3 files, snapshot 8958180070934143149 (task 10517 ms: download 4822 ms overlapping gunzip 630 ms, parse 2603 ms, sort 65 ms, write 5698 ms, index 356 ms: 2 candidates, 54357 repo-hours, 569 releases; waiting 685 ms; commit 1226 ms)
2026-11-07T16:05:36Z [load_day 2023-02-24] 2023-02-24 hour 5: 136639 events in 3 files, snapshot 5543545612143116843 (task 10292 ms: download 4424 ms overlapping gunzip 628 ms, parse 2672 ms, sort 79 ms, write 5600 ms, index 378 ms: 3 candidates, 57987 repo-hours, 733 releases; waiting 536 ms; commit 1249 ms)
2026-11-07T16:05:46Z [load_day 2023-02-24] 2023-02-24 hour 6: 144597 events in 3 files, snapshot 5421084263982135261 (task 10544 ms: download 4291 ms overlapping gunzip 616 ms, parse 2703 ms, sort 79 ms, write 5791 ms, index 445 ms: 9 candidates, 67135 repo-hours, 793 releases; waiting 570 ms; commit 1539 ms)
2026-11-07T16:05:50Z [load_day 2023-02-24] 2023-02-24 hour 7: 160866 events in 4 files, snapshot 8856318608776634488 (task 12909 ms: download 5700 ms overlapping gunzip 834 ms, parse 3487 ms, sort 93 ms, write 7223 ms, index 468 ms: 9 candidates, 69658 repo-hours, 757 releases; waiting 518 ms; commit 1828 ms)
2026-11-07T16:06:00Z [load_day 2023-02-24] 2023-02-24 hour 8: 168342 events in 4 files, snapshot 7135663515808873621 (task 13428 ms: download 7583 ms overlapping gunzip 773 ms, parse 3422 ms, sort 87 ms, write 7632 ms, index 534 ms: 8 candidates, 76447 repo-hours, 917 releases; waiting 611 ms; commit 1231 ms)
2026-11-07T16:06:09Z [load_day 2023-02-24] 2023-02-24 hour 9: 184185 events in 4 files, snapshot 2310026648029573254 (task 18309 ms: download 11952 ms overlapping gunzip 971 ms, parse 4167 ms, sort 111 ms, write 8604 ms, index 530 ms: 9 candidates, 80521 repo-hours, 1195 releases; waiting 3511 ms; commit 1308 ms)
2026-11-07T16:06:16Z [load_day 2023-02-24] 2023-02-24 hour 10: 184823 events in 4 files, snapshot 153375511641242851 (task 14917 ms: download 8395 ms overlapping gunzip 924 ms, parse 4030 ms, sort 96 ms, write 8595 ms, index 519 ms: 1 candidates, 79643 repo-hours, 1077 releases; waiting 403 ms; commit 1452 ms)
2026-11-07T16:06:25Z [load_day 2023-02-24] 2023-02-24 hour 11: 178591 events in 4 files, snapshot 9133770559797038 (task 15169 ms: download 9146 ms overlapping gunzip 974 ms, parse 4050 ms, sort 112 ms, write 8144 ms, index 493 ms: 9 candidates, 74983 repo-hours, 1017 releases; waiting 1047 ms; commit 1359 ms)
2026-11-07T16:06:33Z [load_day 2023-02-24] 2023-02-24 hour 12: 209029 events in 5 files, snapshot 7379219502895990438 (task 15408 ms: download 8319 ms overlapping gunzip 877 ms, parse 4048 ms, sort 113 ms, write 8609 ms, index 600 ms: 8 candidates, 102265 repo-hours, 1118 releases; waiting 872 ms; commit 1511 ms)
2026-11-07T16:06:42Z [load_day 2023-02-24] 2023-02-24 hour 13: 210383 events in 5 files, snapshot 823511493423414594 (task 15774 ms: download 8177 ms overlapping gunzip 949 ms, parse 4141 ms, sort 114 ms, write 9035 ms, index 631 ms: 6 candidates, 105515 repo-hours, 986 releases; waiting 620 ms; commit 1827 ms)
2026-11-07T16:06:50Z [load_day 2023-02-24] 2023-02-24 hour 14: 212340 events in 5 files, snapshot 5578882362026927585 (task 16052 ms: download 8387 ms overlapping gunzip 962 ms, parse 4225 ms, sort 116 ms, write 9038 ms, index 646 ms: 10 candidates, 106103 repo-hours, 1120 releases; waiting 720 ms; commit 1511 ms)
2026-11-07T16:06:58Z [load_day 2023-02-24] 2023-02-24 hour 15: 196799 events in 4 files, snapshot 5015389958573275245 (task 15870 ms: download 8689 ms overlapping gunzip 966 ms, parse 4245 ms, sort 110 ms, write 9129 ms, index 577 ms: 11 candidates, 89103 repo-hours, 1316 releases; waiting 518 ms; commit 1397 ms)
2026-11-07T16:07:08Z [load_day 2023-02-24] 2023-02-24 hour 16: 195553 events in 4 files, snapshot 2486289446583152950 (task 17502 ms: download 10184 ms overlapping gunzip 1047 ms, parse 4493 ms, sort 117 ms, write 9527 ms, index 584 ms: 8 candidates, 87954 repo-hours, 2356 releases; waiting 1357 ms; commit 1423 ms)
2026-11-07T16:07:17Z [load_day 2023-02-24] 2023-02-24 hour 17: 192570 events in 4 files, snapshot 2442608569249905087 (task 18199 ms: download 11477 ms overlapping gunzip 1008 ms, parse 4406 ms, sort 125 ms, write 8853 ms, index 537 ms: 7 candidates, 84923 repo-hours, 1869 releases; waiting 2962 ms; commit 1496 ms)
2026-11-07T16:07:24Z [load_day 2023-02-24] 2023-02-24 hour 18: 189723 events in 4 files, snapshot 7285598857106905997 (task 15216 ms: download 8584 ms overlapping gunzip 944 ms, parse 4111 ms, sort 126 ms, write 8587 ms, index 632 ms: 5 candidates, 87224 repo-hours, 1654 releases; waiting 520 ms; commit 1384 ms)
2026-11-07T16:07:32Z [load_day 2023-02-24] 2023-02-24 hour 19: 176612 events in 4 files, snapshot 1521654983370477179 (task 14649 ms: download 8703 ms overlapping gunzip 931 ms, parse 3947 ms, sort 118 ms, write 8307 ms, index 519 ms: 9 candidates, 73665 repo-hours, 2182 releases; waiting 539 ms; commit 1359 ms)
2026-11-07T16:07:39Z [load_day 2023-02-24] 2023-02-24 hour 20: 168631 events in 4 files, snapshot 2969739623138525230 (task 14468 ms: download 8640 ms overlapping gunzip 833 ms, parse 3629 ms, sort 114 ms, write 8094 ms, index 543 ms: 6 candidates, 71031 repo-hours, 2266 releases; waiting 930 ms; commit 1582 ms)
2026-11-07T16:07:46Z [load_day 2023-02-24] 2023-02-24 hour 21: 156543 events in 4 files, snapshot 2214591158977638528 (task 12746 ms: download 5336 ms overlapping gunzip 782 ms, parse 3401 ms, sort 97 ms, write 7210 ms, index 425 ms: 4 candidates, 64685 repo-hours, 2167 releases; waiting 516 ms; commit 1509 ms)
2026-11-07T16:07:52Z [load_day 2023-02-24] 2023-02-24 hour 22: 151861 events in 4 files, snapshot 6935284264265649839 (task 12274 ms: download 4989 ms overlapping gunzip 760 ms, parse 3379 ms, sort 94 ms, write 7028 ms, index 419 ms: 5 candidates, 61328 repo-hours, 2271 releases; waiting 268 ms; commit 1380 ms)
2026-11-07T16:07:59Z [load_day 2023-02-24] 2023-02-24 hour 23: 142294 events in 3 files, snapshot 2031255449424494513 (task 11636 ms: download 5220 ms overlapping gunzip 713 ms, parse 3115 ms, sort 98 ms, write 6451 ms, index 392 ms: 7 candidates, 61627 repo-hours, 1820 releases; waiting 543 ms; commit 1581 ms)
2026-11-07T16:08:06Z [load_day 2023-02-24] 2023-02-24: repo_hour merged from 24 files to 1 (1843446 rows, 7557 ms)
2026-11-07T16:08:08Z [load_day 2023-02-24] 2023-02-24: index committed in 9286 ms (24 + 1 + 24 files)
2026-11-07T16:08:08Z [load_day 2023-02-24] 2023-02-24: 4097176 events in 24 hours
2026-11-07T16:08:08Z [load_day 2023-02-24] attempt 1 succeeded