orcaLog in

Runs · run 864

load_day 2023-03-01, attempt 1 succeeded

Host
caf251265124:109064
Started
2026-11-07T16:20:07Z
Ended
2026-11-07T16:24:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/864/load_day/2023-03-01/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:20:07Z [load_day 2023-03-01] attempt 1 started
2026-11-07T16:20:09Z [load_day 2023-03-01] 2023-03-01: 2 hours in flight, about 1200 MB
2026-11-07T16:20:25Z [load_day 2023-03-01] 2023-03-01 hour 0: 157362 events in 4 files, snapshot 4162044936361677458 (task 13601 ms: download 6191 ms overlapping gunzip 870 ms, parse 3741 ms, sort 97 ms, write 7581 ms, index 480 ms: 4 candidates, 73278 repo-hours, 917 releases; waiting 508 ms; commit 1528 ms)
2026-11-07T16:20:27Z [load_day 2023-03-01] 2023-03-01 hour 1: 176565 events in 4 files, snapshot 1434350515118045736 (task 14747 ms: download 8854 ms overlapping gunzip 959 ms, parse 3907 ms, sort 103 ms, write 8346 ms, index 583 ms: 7 candidates, 87100 repo-hours, 1084 releases; waiting 540 ms; commit 1297 ms)
2026-11-07T16:20:41Z [load_day 2023-03-01] 2023-03-01 hour 2: 158856 events in 4 files, snapshot 1835393072776156850 (task 14652 ms: download 9041 ms overlapping gunzip 978 ms, parse 3801 ms, sort 105 ms, write 8241 ms, index 499 ms: 7 candidates, 72210 repo-hours, 814 releases; waiting 679 ms; commit 1417 ms)
2026-11-07T16:20:42Z [load_day 2023-03-01] 2023-03-01 hour 3: 149208 events in 3 files, snapshot 8308472678623518607 (task 13341 ms: download 8402 ms overlapping gunzip 909 ms, parse 3515 ms, sort 95 ms, write 7467 ms, index 442 ms: 7 candidates, 62102 repo-hours, 869 releases; waiting 570 ms; commit 1605 ms)
2026-11-07T16:20:56Z [load_day 2023-03-01] 2023-03-01 hour 4: 145422 events in 3 files, snapshot 1560961752163360362 (task 13831 ms: download 6883 ms overlapping gunzip 993 ms, parse 3813 ms, sort 103 ms, write 8019 ms, index 395 ms: 5 candidates, 57011 repo-hours, 605 releases; waiting 214 ms; commit 1713 ms)
2026-11-07T16:20:57Z [load_day 2023-03-01] 2023-03-01 hour 5: 151730 events in 4 files, snapshot 825687754057100805 (task 13585 ms: download 6172 ms overlapping gunzip 934 ms, parse 3623 ms, sort 110 ms, write 7779 ms, index 405 ms: 1 candidates, 61528 repo-hours, 729 releases; waiting 417 ms; commit 1480 ms)
2026-11-07T16:21:10Z [load_day 2023-03-01] 2023-03-01 hour 6: 166871 events in 4 files, snapshot 303867250130722731 (task 13625 ms: download 8044 ms overlapping gunzip 916 ms, parse 3597 ms, sort 104 ms, write 7986 ms, index 480 ms: 2 candidates, 72571 repo-hours, 840 releases; waiting 229 ms; commit 1302 ms)
2026-11-07T16:21:14Z [load_day 2023-03-01] 2023-03-01 hour 7: 172386 events in 4 files, snapshot 6109788845148057229 (task 16209 ms: download 10112 ms overlapping gunzip 1000 ms, parse 4062 ms, sort 110 ms, write 8705 ms, index 483 ms: 3 candidates, 72715 repo-hours, 828 releases; waiting 1498 ms; commit 1579 ms)
2026-11-07T16:21:27Z [load_day 2023-03-01] 2023-03-01 hour 8: 189163 events in 4 files, snapshot 640220729893552693 (task 16769 ms: download 9775 ms overlapping gunzip 1090 ms, parse 4443 ms, sort 125 ms, write 9713 ms, index 508 ms: 5 candidates, 80555 repo-hours, 1059 releases; waiting 567 ms; commit 1460 ms)
2026-11-07T16:21:32Z [load_day 2023-03-01] 2023-03-01 hour 9: 201670 events in 5 files, snapshot 6050124124489220851 (task 17380 ms: download 9794 ms overlapping gunzip 1113 ms, parse 4631 ms, sort 130 ms, write 10359 ms, index 594 ms: 4 candidates, 84496 repo-hours, 1124 releases; waiting 202 ms; commit 1481 ms)
2026-11-07T16:21:46Z [load_day 2023-03-01] 2023-03-01 hour 10: 201332 events in 5 files, snapshot 1047421805271048321 (task 17673 ms: download 10059 ms overlapping gunzip 1121 ms, parse 4650 ms, sort 141 ms, write 10096 ms, index 603 ms: 4 candidates, 85569 repo-hours, 1140 releases; waiting 735 ms; commit 1657 ms)
2026-11-07T16:21:50Z [load_day 2023-03-01] 2023-03-01 hour 11: 197484 events in 4 files, snapshot 8981768167894791668 (task 17375 ms: download 9588 ms overlapping gunzip 1087 ms, parse 4613 ms, sort 153 ms, write 10299 ms, index 572 ms: 1 candidates, 81084 repo-hours, 929 releases; waiting 353 ms; commit 1510 ms)
2026-11-07T16:22:05Z [load_day 2023-03-01] 2023-03-01 hour 12: 229702 events in 5 files, snapshot 8866437557708485720 (task 17944 ms: download 11589 ms overlapping gunzip 1161 ms, parse 4890 ms, sort 134 ms, write 10743 ms, index 708 ms: 4 candidates, 109704 repo-hours, 1042 releases; waiting 85 ms; commit 1608 ms)
2026-11-07T16:22:11Z [load_day 2023-03-01] 2023-03-01 hour 13: 234768 events in 5 files, snapshot 8591604620025694652 (task 19637 ms: download 11464 ms overlapping gunzip 1115 ms, parse 4758 ms, sort 145 ms, write 11021 ms, index 1755 ms: 5 candidates, 120890 repo-hours, 1011 releases; waiting 527 ms; commit 1512 ms)
2026-11-07T16:22:25Z [load_day 2023-03-01] 2023-03-01 hour 14: 227123 events in 5 files, snapshot 9124426091110757077 (task 19984 ms: download 13311 ms overlapping gunzip 1240 ms, parse 5094 ms, sort 138 ms, write 11986 ms, index 677 ms: 6 candidates, 101708 repo-hours, 1139 releases; waiting 496 ms; commit 1340 ms)
2026-11-07T16:22:31Z [load_day 2023-03-01] 2023-03-01 hour 15: 232542 events in 5 files, snapshot 5239948165266256511 (task 19989 ms: download 13001 ms overlapping gunzip 1240 ms, parse 5191 ms, sort 140 ms, write 11942 ms, index 701 ms: 8 candidates, 111040 repo-hours, 1267 releases; waiting 415 ms; commit 1390 ms)
2026-11-07T16:22:51Z [load_day 2023-03-01] 2023-03-01 hour 16: 225309 events in 5 files, snapshot 5613254453486643063 (task 25110 ms: download 18561 ms overlapping gunzip 1353 ms, parse 5619 ms, sort 169 ms, write 11825 ms, index 686 ms: 8 candidates, 101787 repo-hours, 1036 releases; waiting 5125 ms; commit 1412 ms)
2026-11-07T16:22:52Z [load_day 2023-03-01] 2023-03-01 hour 17: 213711 events in 5 files, snapshot 4911836194742770182 (task 18468 ms: download 12746 ms overlapping gunzip 1171 ms, parse 4830 ms, sort 133 ms, write 10814 ms, index 606 ms: 7 candidates, 92021 repo-hours, 1053 releases; waiting 609 ms; commit 1294 ms)
2026-11-07T16:23:11Z [load_day 2023-03-01] 2023-03-01 hour 18: 209530 events in 5 files, snapshot 1599475341041273131 (task 18314 ms: download 12735 ms overlapping gunzip 1140 ms, parse 4719 ms, sort 134 ms, write 10648 ms, index 612 ms: 5 candidates, 90576 repo-hours, 1092 releases; waiting 768 ms; commit 1665 ms)
2026-11-07T16:23:15Z [load_day 2023-03-01] 2023-03-01 hour 19: 206276 events in 5 files, snapshot 3086304032034791374 (task 18773 ms: download 10981 ms overlapping gunzip 1101 ms, parse 4644 ms, sort 150 ms, write 10465 ms, index 576 ms: 4 candidates, 86265 repo-hours, 1049 releases; waiting 1548 ms; commit 4730 ms)
2026-11-07T16:23:28Z [load_day 2023-03-01] 2023-03-01 hour 20: 204119 events in 5 files, snapshot 819995228798778183 (task 17137 ms: download 9749 ms overlapping gunzip 1082 ms, parse 4489 ms, sort 135 ms, write 9898 ms, index 577 ms: 8 candidates, 91648 repo-hours, 981 releases; waiting 560 ms; commit 1661 ms)
2026-11-07T16:23:30Z [load_day 2023-03-01] 2023-03-01 hour 21: 201428 events in 5 files, snapshot 7276374169835064158 (task 16439 ms: download 8997 ms overlapping gunzip 1059 ms, parse 4293 ms, sort 125 ms, write 9282 ms, index 589 ms: 3 candidates, 93783 repo-hours, 1017 releases; waiting 728 ms; commit 1502 ms)
2026-11-07T16:23:46Z [load_day 2023-03-01] 2023-03-01 hour 22: 181094 events in 4 files, snapshot 8888418411404566738 (task 17124 ms: download 10296 ms overlapping gunzip 1133 ms, parse 4511 ms, sort 114 ms, write 9328 ms, index 512 ms: 6 candidates, 72395 repo-hours, 906 releases; waiting 1077 ms; commit 1575 ms)
2026-11-07T16:23:49Z [load_day 2023-03-01] 2023-03-01 hour 23: 162287 events in 4 files, snapshot 2440829291426061041 (task 18625 ms: download 13306 ms overlapping gunzip 1007 ms, parse 4180 ms, sort 101 ms, write 8138 ms, index 437 ms: 3 candidates, 65219 repo-hours, 854 releases; waiting 4491 ms; commit 1528 ms)
2026-11-07T16:23:58Z [load_day 2023-03-01] 2023-03-01: repo_hour merged from 24 files to 1 (2027255 rows, 8260 ms)
2026-11-07T16:24:00Z [load_day 2023-03-01] 2023-03-01: index committed in 10487 ms (24 + 1 + 24 files)
2026-11-07T16:24:00Z [load_day 2023-03-01] 2023-03-01: 4595938 events in 24 hours
2026-11-07T16:24:00Z [load_day 2023-03-01] attempt 1 succeeded