orcaLog in

Runs · run 1038

load_day 2023-04-28, attempt 1 succeeded

Host
caf251265124:315141
Started
2026-11-07T19:20:35Z
Ended
2026-11-07T19:23:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1038/load_day/2023-04-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:20:35Z [load_day 2023-04-28] attempt 1 started
2026-11-07T19:20:36Z [load_day 2023-04-28] 2023-04-28: 2 hours in flight, about 1200 MB
2026-11-07T19:20:50Z [load_day 2023-04-28] 2023-04-28 hour 0: 147650 events in 3 files, snapshot 1546656879200773194 (task 10731 ms: download 4661 ms overlapping gunzip 604 ms, parse 2755 ms, sort 95 ms, write 5937 ms, index 503 ms: 8 candidates, 75312 repo-hours, 1122 releases; waiting 526 ms; commit 1662 ms)
2026-11-07T19:20:51Z [load_day 2023-04-28] 2023-04-28 hour 1: 159231 events in 4 files, snapshot 6313740286654385395 (task 11123 ms: download 4604 ms overlapping gunzip 633 ms, parse 2893 ms, sort 89 ms, write 6111 ms, index 595 ms: 5 candidates, 88518 repo-hours, 1034 releases; waiting 502 ms; commit 1513 ms)
2026-11-07T19:21:02Z [load_day 2023-04-28] 2023-04-28 hour 2: 136793 events in 3 files, snapshot 7151405469192945958 (task 11542 ms: download 5330 ms overlapping gunzip 636 ms, parse 2802 ms, sort 89 ms, write 5849 ms, index 446 ms: 3 candidates, 64702 repo-hours, 981 releases; waiting 1443 ms; commit 1784 ms)
2026-11-07T19:21:04Z [load_day 2023-04-28] 2023-04-28 hour 3: 133225 events in 3 files, snapshot 6343967561043690361 (task 10758 ms: download 4350 ms overlapping gunzip 605 ms, parse 2748 ms, sort 90 ms, write 5889 ms, index 432 ms: 3 candidates, 58995 repo-hours, 1095 releases; waiting 525 ms; commit 1602 ms)
2026-11-07T19:21:12Z [load_day 2023-04-28] 2023-04-28 hour 4: 121490 events in 3 files, snapshot 2225076484666093919 (task 9264 ms: download 2608 ms overlapping gunzip 558 ms, parse 2343 ms, sort 90 ms, write 5042 ms, index 361 ms: 2 candidates, 52954 repo-hours, 818 releases; waiting 521 ms; commit 1555 ms)
2026-11-07T19:21:16Z [load_day 2023-04-28] 2023-04-28 hour 5: 134349 events in 3 files, snapshot 7712916701183693879 (task 10825 ms: download 4654 ms overlapping gunzip 634 ms, parse 2739 ms, sort 83 ms, write 5869 ms, index 410 ms: 4 candidates, 59292 repo-hours, 909 releases; waiting 749 ms; commit 1783 ms)
2026-11-07T19:21:25Z [load_day 2023-04-28] 2023-04-28 hour 6: 162303 events in 4 files, snapshot 2018240413405867008 (task 12249 ms: download 4929 ms overlapping gunzip 683 ms, parse 3039 ms, sort 93 ms, write 7022 ms, index 541 ms: 2 candidates, 77794 repo-hours, 1101 releases; waiting 521 ms; commit 1536 ms)
2026-11-07T19:21:30Z [load_day 2023-04-28] 2023-04-28 hour 7: 160455 events in 4 files, snapshot 7129666702967443703 (task 13346 ms: download 5695 ms overlapping gunzip 774 ms, parse 3408 ms, sort 92 ms, write 7400 ms, index 523 ms: 2 candidates, 74752 repo-hours, 1023 releases; waiting 850 ms; commit 1724 ms)
2026-11-07T19:21:40Z [load_day 2023-04-28] 2023-04-28 hour 8: 169948 events in 4 files, snapshot 8989716428243620274 (task 14113 ms: download 8062 ms overlapping gunzip 804 ms, parse 3579 ms, sort 94 ms, write 8227 ms, index 586 ms: 3 candidates, 79385 repo-hours, 1150 releases; waiting 522 ms; commit 1726 ms)
2026-11-07T19:21:45Z [load_day 2023-04-28] 2023-04-28 hour 9: 174079 events in 4 files, snapshot 4653245161123359944 (task 14479 ms: download 8308 ms overlapping gunzip 850 ms, parse 3740 ms, sort 99 ms, write 8302 ms, index 540 ms: 4 candidates, 80060 repo-hours, 1260 releases; waiting 645 ms; commit 1521 ms)
2026-11-07T19:21:57Z [load_day 2023-04-28] 2023-04-28 hour 10: 168467 events in 4 files, snapshot 447095042491095236 (task 16682 ms: download 7979 ms overlapping gunzip 806 ms, parse 3652 ms, sort 110 ms, write 9235 ms, index 2084 ms: 3 candidates, 75622 repo-hours, 1121 releases; waiting 520 ms; commit 1640 ms)
2026-11-07T19:21:59Z [load_day 2023-04-28] 2023-04-28 hour 11: 165687 events in 4 files, snapshot 50938712161850732 (task 12956 ms: download 7559 ms overlapping gunzip 797 ms, parse 3464 ms, sort 96 ms, write 7533 ms, index 506 ms: 4 candidates, 72014 repo-hours, 1177 releases; waiting 218 ms; commit 1749 ms)
2026-11-07T19:22:12Z [load_day 2023-04-28] 2023-04-28 hour 12: 208272 events in 5 files, snapshot 5935299667755925090 (task 14985 ms: download 7870 ms overlapping gunzip 821 ms, parse 3799 ms, sort 126 ms, write 8733 ms, index 658 ms: 6 candidates, 100033 repo-hours, 1067 releases; waiting 506 ms; commit 1555 ms)
2026-11-07T19:22:19Z [load_day 2023-04-28] 2023-04-28 hour 13: 194970 events in 4 files, snapshot 8352259291913175888 (task 15555 ms: download 8345 ms overlapping gunzip 890 ms, parse 3996 ms, sort 114 ms, write 9064 ms, index 688 ms: 2 candidates, 100378 repo-hours, 1212 releases; waiting 550 ms; commit 5314 ms)
2026-11-07T19:22:29Z [load_day 2023-04-28] 2023-04-28 hour 14: 187454 events in 4 files, snapshot 4405083563073840707 (task 15286 ms: download 8661 ms overlapping gunzip 934 ms, parse 4096 ms, sort 112 ms, write 8785 ms, index 566 ms: 3 candidates, 86731 repo-hours, 1297 releases; waiting 510 ms; commit 1669 ms)
2026-11-07T19:22:32Z [load_day 2023-04-28] 2023-04-28 hour 15: 175363 events in 4 files, snapshot 1212539340573905663 (task 15313 ms: download 9112 ms overlapping gunzip 863 ms, parse 3920 ms, sort 99 ms, write 8374 ms, index 534 ms: 4 candidates, 82559 repo-hours, 1206 releases; waiting 1125 ms; commit 2240 ms)
2026-11-07T19:22:44Z [load_day 2023-04-28] 2023-04-28 hour 16: 169787 events in 4 files, snapshot 7369275761289569853 (task 14234 ms: download 8371 ms overlapping gunzip 841 ms, parse 3755 ms, sort 98 ms, write 8035 ms, index 539 ms: 7 candidates, 78085 repo-hours, 1181 releases; waiting 698 ms; commit 1647 ms)
2026-11-07T19:22:46Z [load_day 2023-04-28] 2023-04-28 hour 17: 170801 events in 4 files, snapshot 7173265410992870381 (task 14127 ms: download 8200 ms overlapping gunzip 816 ms, parse 3564 ms, sort 111 ms, write 8306 ms, index 502 ms: 5 candidates, 74522 repo-hours, 1034 releases; waiting 518 ms; commit 1713 ms)
2026-11-07T19:22:58Z [load_day 2023-04-28] 2023-04-28 hour 18: 172063 events in 4 files, snapshot 1436349178081508359 (task 13368 ms: download 7595 ms overlapping gunzip 781 ms, parse 3455 ms, sort 107 ms, write 7643 ms, index 554 ms: 3 candidates, 78282 repo-hours, 1074 releases; waiting 514 ms; commit 1681 ms)
2026-11-07T19:23:00Z [load_day 2023-04-28] 2023-04-28 hour 19: 165835 events in 4 files, snapshot 5714143128105113952 (task 12908 ms: download 7453 ms overlapping gunzip 809 ms, parse 3534 ms, sort 134 ms, write 7413 ms, index 478 ms: 5 candidates, 70760 repo-hours, 1070 releases; waiting 245 ms; commit 1728 ms)
2026-11-07T19:23:11Z [load_day 2023-04-28] 2023-04-28 hour 20: 161116 events in 4 files, snapshot 8084004072869950565 (task 12962 ms: download 5185 ms overlapping gunzip 742 ms, parse 3247 ms, sort 108 ms, write 7369 ms, index 517 ms: 6 candidates, 66108 repo-hours, 925 releases; waiting 657 ms; commit 1647 ms)
2026-11-07T19:23:13Z [load_day 2023-04-28] 2023-04-28 hour 21: 153284 events in 4 files, snapshot 4265539033041415391 (task 12058 ms: download 4919 ms overlapping gunzip 711 ms, parse 3081 ms, sort 119 ms, write 6925 ms, index 396 ms: 4 candidates, 58652 repo-hours, 1057 releases; waiting 507 ms; commit 1718 ms)
2026-11-07T19:23:22Z [load_day 2023-04-28] 2023-04-28 hour 22: 127789 events in 3 files, snapshot 8929104450403307673 (task 9952 ms: download 4282 ms overlapping gunzip 595 ms, parse 2603 ms, sort 82 ms, write 5570 ms, index 349 ms: 3 candidates, 52123 repo-hours, 874 releases; waiting 434 ms; commit 1724 ms)
2026-11-07T19:23:25Z [load_day 2023-04-28] 2023-04-28 hour 23: 117523 events in 3 files, snapshot 310460868053579515 (task 10345 ms: download 3520 ms overlapping gunzip 544 ms, parse 2345 ms, sort 73 ms, write 4886 ms, index 330 ms: 3 candidates, 48886 repo-hours, 799 releases; waiting 1842 ms; commit 1624 ms)
2026-11-07T19:23:32Z [load_day 2023-04-28] 2023-04-28: repo_hour merged from 24 files to 1 (1756519 rows, 7325 ms)
2026-11-07T19:23:34Z [load_day 2023-04-28] 2023-04-28: index committed in 9275 ms (24 + 1 + 24 files)
2026-11-07T19:23:34Z [load_day 2023-04-28] 2023-04-28: 3837934 events in 24 hours
2026-11-07T19:23:34Z [load_day 2023-04-28] attempt 1 succeeded