orcaLog in

Runs · run 1667

load_day 2023-10-26, attempt 1 succeeded

Host
3c2b29713ce8:481425
Started
2026-11-08T02:09:51Z
Ended
2026-11-08T02:14:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1667/load_day/2023-10-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:09:51Z [load_day 2023-10-26] attempt 1 started
2026-11-08T02:09:53Z [load_day 2023-10-26] 2023-10-26: 2 hours in flight, about 1200 MB
2026-11-08T02:10:14Z [load_day 2023-10-26] 2023-10-26 hour 0: 172178 events in 4 files, snapshot 589015453324942814 (task 16815 ms: download 7827 ms overlapping gunzip 989 ms, parse 4723 ms, sort 120 ms, write 9459 ms, index 704 ms: 13 candidates, 90437 repo-hours, 951 releases; waiting 504 ms; commit 2345 ms)
2026-11-08T02:10:20Z [load_day 2023-10-26] 2023-10-26 hour 1: 172904 events in 4 files, snapshot 8354232241865171842 (task 16572 ms: download 6571 ms overlapping gunzip 941 ms, parse 4069 ms, sort 134 ms, write 9853 ms, index 706 ms: 12 candidates, 94034 repo-hours, 801 releases; waiting 515 ms; commit 5513 ms)
2026-11-08T02:10:30Z [load_day 2023-10-26] 2023-10-26 hour 2: 145149 events in 3 files, snapshot 6173455811415967549 (task 14508 ms: download 6575 ms overlapping gunzip 797 ms, parse 3474 ms, sort 89 ms, write 8933 ms, index 467 ms: 10 candidates, 64382 repo-hours, 808 releases; waiting 533 ms; commit 2478 ms)
2026-11-08T02:10:34Z [load_day 2023-10-26] 2023-10-26 hour 3: 148737 events in 3 files, snapshot 4409947629065625888 (task 14437 ms: download 6642 ms overlapping gunzip 877 ms, parse 4092 ms, sort 88 ms, write 8002 ms, index 612 ms: 8 candidates, 64043 repo-hours, 867 releases; waiting 479 ms; commit 4127 ms)
2026-11-08T02:10:45Z [load_day 2023-10-26] 2023-10-26 hour 4: 141579 events in 3 files, snapshot 4716193812308439538 (task 14115 ms: download 6105 ms overlapping gunzip 826 ms, parse 3393 ms, sort 131 ms, write 8329 ms, index 465 ms: 8 candidates, 58841 repo-hours, 650 releases; waiting 529 ms; commit 2539 ms)
2026-11-08T02:10:50Z [load_day 2023-10-26] 2023-10-26 hour 5: 152574 events in 4 files, snapshot 1804867736777415935 (task 15348 ms: download 6069 ms overlapping gunzip 861 ms, parse 3730 ms, sort 144 ms, write 9158 ms, index 523 ms: 13 candidates, 64461 repo-hours, 759 releases; waiting 618 ms; commit 2421 ms)
2026-11-08T02:11:05Z [load_day 2023-10-26] 2023-10-26 hour 6: 179946 events in 4 files, snapshot 1226726980635081477 (task 17816 ms: download 9840 ms overlapping gunzip 906 ms, parse 4152 ms, sort 119 ms, write 10973 ms, index 734 ms: 15 candidates, 82411 repo-hours, 923 releases; waiting 625 ms; commit 3831 ms)
2026-11-08T02:11:11Z [load_day 2023-10-26] 2023-10-26 hour 7: 188706 events in 4 files, snapshot 8722717367183340094 (task 19990 ms: download 11103 ms overlapping gunzip 1151 ms, parse 4934 ms, sort 183 ms, write 12257 ms, index 638 ms: 15 candidates, 82780 repo-hours, 1017 releases; waiting 480 ms; commit 3152 ms)
2026-11-08T02:11:29Z [load_day 2023-10-26] 2023-10-26 hour 8: 205203 events in 5 files, snapshot 8051842032185949524 (task 22449 ms: download 12429 ms overlapping gunzip 1347 ms, parse 5602 ms, sort 136 ms, write 13777 ms, index 789 ms: 18 candidates, 92577 repo-hours, 1093 releases; waiting 496 ms; commit 4309 ms)
2026-11-08T02:11:36Z [load_day 2023-10-26] 2023-10-26 hour 9: 209575 events in 5 files, snapshot 7339270352153625850 (task 22763 ms: download 11066 ms overlapping gunzip 1312 ms, parse 5704 ms, sort 145 ms, write 14919 ms, index 597 ms: 16 candidates, 92920 repo-hours, 1217 releases; waiting 25 ms; commit 3342 ms)
2026-11-08T02:11:51Z [load_day 2023-10-26] 2023-10-26 hour 10: 197401 events in 4 files, snapshot 506076551301283018 (task 23007 ms: download 13163 ms overlapping gunzip 1427 ms, parse 6308 ms, sort 184 ms, write 13621 ms, index 677 ms: 5 candidates, 86364 repo-hours, 1103 releases; waiting 538 ms; commit 2610 ms)
2026-11-08T02:11:58Z [load_day 2023-10-26] 2023-10-26 hour 11: 192611 events in 4 files, snapshot 1192869105305941514 (task 21640 ms: download 11324 ms overlapping gunzip 1230 ms, parse 5619 ms, sort 142 ms, write 12984 ms, index 914 ms: 12 candidates, 83725 repo-hours, 1097 releases; waiting 482 ms; commit 2897 ms)
2026-11-08T02:12:18Z [load_day 2023-10-26] 2023-10-26 hour 12: 250345 events in 6 files, snapshot 2920801948185260205 (task 24431 ms: download 15725 ms overlapping gunzip 1292 ms, parse 6091 ms, sort 170 ms, write 15325 ms, index 782 ms: 18 candidates, 117296 repo-hours, 1169 releases; waiting 509 ms; commit 3190 ms)
2026-11-08T02:12:23Z [load_day 2023-10-26] 2023-10-26 hour 13: 234809 events in 5 files, snapshot 1042601893136959906 (task 23858 ms: download 14953 ms overlapping gunzip 1406 ms, parse 6288 ms, sort 198 ms, write 15011 ms, index 883 ms: 4 candidates, 115161 repo-hours, 1249 releases; waiting 13 ms; commit 2892 ms)
2026-11-08T02:12:44Z [load_day 2023-10-26] 2023-10-26 hour 14: 227876 events in 5 files, snapshot 6460301369834872448 (task 25354 ms: download 16453 ms overlapping gunzip 1655 ms, parse 7196 ms, sort 258 ms, write 15222 ms, index 923 ms: 10 candidates, 102090 repo-hours, 1157 releases; waiting 24 ms; commit 2635 ms)
2026-11-08T02:12:49Z [load_day 2023-10-26] 2023-10-26 hour 15: 220592 events in 5 files, snapshot 261952315999893083 (task 25500 ms: download 16696 ms overlapping gunzip 1648 ms, parse 7822 ms, sort 173 ms, write 14804 ms, index 962 ms: 9 candidates, 99870 repo-hours, 1441 releases; waiting 23 ms; commit 2714 ms)
2026-11-08T02:13:05Z [load_day 2023-10-26] 2023-10-26 hour 16: 208021 events in 5 files, snapshot 5835268822351849841 (task 20543 ms: download 14495 ms overlapping gunzip 1279 ms, parse 5655 ms, sort 128 ms, write 12021 ms, index 658 ms: 8 candidates, 93112 repo-hours, 1264 releases; waiting 517 ms; commit 2519 ms)
2026-11-08T02:13:07Z [load_day 2023-10-26] 2023-10-26 hour 17: 197052 events in 4 files, snapshot 1445766158721194638 (task 17336 ms: download 9727 ms overlapping gunzip 1086 ms, parse 4633 ms, sort 150 ms, write 10694 ms, index 688 ms: 13 candidates, 86680 repo-hours, 1161 releases; waiting 12 ms; commit 2359 ms)
2026-11-08T02:13:26Z [load_day 2023-10-26] 2023-10-26 hour 18: 202960 events in 5 files, snapshot 4271668458563342347 (task 19206 ms: download 9479 ms overlapping gunzip 1221 ms, parse 5386 ms, sort 185 ms, write 11365 ms, index 966 ms: 14 candidates, 90816 repo-hours, 1136 releases; waiting 21 ms; commit 2779 ms)
2026-11-08T02:13:29Z [load_day 2023-10-26] 2023-10-26 hour 19: 185820 events in 4 files, snapshot 62416014872378908 (task 19342 ms: download 10680 ms overlapping gunzip 1073 ms, parse 4611 ms, sort 137 ms, write 12768 ms, index 663 ms: 9 candidates, 79573 repo-hours, 1017 releases; waiting 17 ms; commit 2757 ms)
2026-11-08T02:13:47Z [load_day 2023-10-26] 2023-10-26 hour 20: 177450 events in 4 files, snapshot 7559119114060256579 (task 18514 ms: download 11208 ms overlapping gunzip 1177 ms, parse 5168 ms, sort 157 ms, write 11342 ms, index 595 ms: 13 candidates, 76485 repo-hours, 941 releases; waiting 12 ms; commit 4056 ms)
2026-11-08T02:13:58Z [load_day 2023-10-26] 2023-10-26 hour 21: 163260 events in 4 files, snapshot 5372094441979799151 (task 18184 ms: download 11130 ms overlapping gunzip 1095 ms, parse 4789 ms, sort 139 ms, write 11231 ms, index 846 ms: 7 candidates, 67634 repo-hours, 1130 releases; waiting 23 ms; commit 11574 ms)
2026-11-08T02:14:03Z [load_day 2023-10-26] 2023-10-26 hour 22: 147188 events in 3 files, snapshot 4102646411650229262 (task 15929 ms: download 6518 ms overlapping gunzip 1005 ms, parse 4300 ms, sort 95 ms, write 9840 ms, index 593 ms: 9 candidates, 61695 repo-hours, 917 releases; waiting 28 ms; commit 2704 ms)
2026-11-08T02:14:05Z [load_day 2023-10-26] 2023-10-26 hour 23: 134326 events in 3 files, snapshot 1633518213822591927 (task 15171 ms: download 7196 ms overlapping gunzip 1056 ms, parse 4698 ms, sort 150 ms, write 8746 ms, index 383 ms: 7 candidates, 55961 repo-hours, 961 releases; waiting 22 ms; commit 2199 ms)
2026-11-08T02:14:14Z [load_day 2023-10-26] 2023-10-26: repo_hour merged from 24 files to 1 (2003348 rows, 8688 ms)
2026-11-08T02:14:16Z [load_day 2023-10-26] 2023-10-26: index committed in 11140 ms (24 + 1 + 24 files)
2026-11-08T02:14:16Z [load_day 2023-10-26] 2023-10-26: 4456262 events in 24 hours
2026-11-08T02:14:16Z [load_day 2023-10-26] attempt 1 succeeded