orcaLog in

Runs · run 1736

load_day 2023-11-14, attempt 1 succeeded

Host
3c2b29713ce8:552829
Started
2026-11-08T02:47:05Z
Ended
2026-11-08T02:51:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1736/load_day/2023-11-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:47:05Z [load_day 2023-11-14] attempt 1 started
2026-11-08T02:47:06Z [load_day 2023-11-14] 2023-11-14: 2 hours in flight, about 1200 MB
2026-11-08T02:47:30Z [load_day 2023-11-14] 2023-11-14 hour 0: 180611 events in 4 files, snapshot 4233417898891275185 (task 18932 ms: download 11220 ms overlapping gunzip 1031 ms, parse 4838 ms, sort 157 ms, write 11995 ms, index 696 ms: 6 candidates, 96567 repo-hours, 909 releases; waiting 16 ms; commit 2729 ms)
2026-11-08T02:47:32Z [load_day 2023-11-14] 2023-11-14 hour 1: 176712 events in 4 files, snapshot 4580292309647752973 (task 18503 ms: download 10992 ms overlapping gunzip 931 ms, parse 4380 ms, sort 147 ms, write 11577 ms, index 734 ms: 10 candidates, 96989 repo-hours, 813 releases; waiting 508 ms; commit 2821 ms)
2026-11-08T02:47:45Z [load_day 2023-11-14] 2023-11-14 hour 2: 150464 events in 4 files, snapshot 2788719886609796144 (task 13804 ms: download 5570 ms overlapping gunzip 924 ms, parse 3895 ms, sort 132 ms, write 8149 ms, index 491 ms: 5 candidates, 65371 repo-hours, 781 releases; waiting 21 ms; commit 2703 ms)
2026-11-08T02:47:48Z [load_day 2023-11-14] 2023-11-14 hour 3: 141012 events in 3 files, snapshot 8833796157389040996 (task 12322 ms: download 5013 ms overlapping gunzip 739 ms, parse 3277 ms, sort 84 ms, write 7587 ms, index 403 ms: 7 candidates, 61455 repo-hours, 857 releases; waiting 26 ms; commit 3021 ms)
2026-11-08T02:47:59Z [load_day 2023-11-14] 2023-11-14 hour 4: 139419 events in 3 files, snapshot 6741542036166792706 (task 12731 ms: download 4634 ms overlapping gunzip 745 ms, parse 3313 ms, sort 131 ms, write 7906 ms, index 422 ms: 2 candidates, 57238 repo-hours, 756 releases; waiting 16 ms; commit 2809 ms)
2026-11-08T02:48:03Z [load_day 2023-11-14] 2023-11-14 hour 5: 142833 events in 3 files, snapshot 4640793852282360630 (task 14504 ms: download 5819 ms overlapping gunzip 866 ms, parse 4033 ms, sort 117 ms, write 8451 ms, index 804 ms: 5 candidates, 60701 repo-hours, 699 releases; waiting 24 ms; commit 2983 ms)
2026-11-08T02:48:17Z [load_day 2023-11-14] 2023-11-14 hour 6: 162264 events in 4 files, snapshot 7268642892338126099 (task 17009 ms: download 6802 ms overlapping gunzip 1047 ms, parse 4675 ms, sort 150 ms, write 9701 ms, index 591 ms: 1 candidates, 74329 repo-hours, 975 releases; waiting 523 ms; commit 2768 ms)
2026-11-08T02:48:23Z [load_day 2023-11-14] 2023-11-14 hour 7: 172882 events in 4 files, snapshot 590416191602864852 (task 19048 ms: download 11310 ms overlapping gunzip 1106 ms, parse 4865 ms, sort 142 ms, write 11576 ms, index 548 ms: 5 candidates, 75938 repo-hours, 939 releases; waiting 535 ms; commit 2991 ms)
2026-11-08T02:48:40Z [load_day 2023-11-14] 2023-11-14 hour 8: 193996 events in 4 files, snapshot 1075219934525945375 (task 21444 ms: download 11893 ms overlapping gunzip 1198 ms, parse 5558 ms, sort 144 ms, write 13624 ms, index 712 ms: 8 candidates, 87942 repo-hours, 946 releases; waiting 20 ms; commit 2756 ms)
2026-11-08T02:48:47Z [load_day 2023-11-14] 2023-11-14 hour 9: 201029 events in 5 files, snapshot 5781502470762694216 (task 21293 ms: download 11282 ms overlapping gunzip 1141 ms, parse 5127 ms, sort 134 ms, write 13988 ms, index 662 ms: 2 candidates, 90728 repo-hours, 1270 releases; waiting 27 ms; commit 3854 ms)
2026-11-08T02:49:03Z [load_day 2023-11-14] 2023-11-14 hour 10: 201366 events in 5 files, snapshot 8844678895462406649 (task 21972 ms: download 12001 ms overlapping gunzip 1235 ms, parse 5697 ms, sort 192 ms, write 14002 ms, index 639 ms: 8 candidates, 89270 repo-hours, 1173 releases; waiting 16 ms; commit 3085 ms)
2026-11-08T02:49:09Z [load_day 2023-11-14] 2023-11-14 hour 11: 195255 events in 4 files, snapshot 6001148525747333891 (task 20747 ms: download 11726 ms overlapping gunzip 1323 ms, parse 6111 ms, sort 191 ms, write 12194 ms, index 713 ms: 7 candidates, 83140 repo-hours, 1153 releases; waiting 16 ms; commit 4288 ms)
2026-11-08T02:49:26Z [load_day 2023-11-14] 2023-11-14 hour 12: 243705 events in 5 files, snapshot 5663228719583128396 (task 21997 ms: download 13911 ms overlapping gunzip 1215 ms, parse 5474 ms, sort 207 ms, write 13909 ms, index 977 ms: 5 candidates, 115496 repo-hours, 1191 releases; waiting 18 ms; commit 2638 ms)
2026-11-08T02:49:32Z [load_day 2023-11-14] 2023-11-14 hour 13: 230029 events in 5 files, snapshot 4434625297369077435 (task 22922 ms: download 14993 ms overlapping gunzip 1388 ms, parse 6159 ms, sort 165 ms, write 14167 ms, index 806 ms: 10 candidates, 111869 repo-hours, 1235 releases; waiting 18 ms; commit 2441 ms)
2026-11-08T02:49:47Z [load_day 2023-11-14] 2023-11-14 hour 14: 226044 events in 5 files, snapshot 6864127049039056589 (task 20541 ms: download 13923 ms overlapping gunzip 1233 ms, parse 5361 ms, sort 128 ms, write 12945 ms, index 652 ms: 12 candidates, 100447 repo-hours, 1649 releases; waiting 15 ms; commit 2234 ms)
2026-11-08T02:49:52Z [load_day 2023-11-14] 2023-11-14 hour 15: 218027 events in 5 files, snapshot 7299466079178932562 (task 19401 ms: download 13242 ms overlapping gunzip 1272 ms, parse 5428 ms, sort 128 ms, write 11695 ms, index 657 ms: 9 candidates, 99233 repo-hours, 1342 releases; waiting 19 ms; commit 2292 ms)
2026-11-08T02:50:06Z [load_day 2023-11-14] 2023-11-14 hour 16: 147024 events in 3 files, snapshot 1770957638392696715 (task 17181 ms: download 5490 ms overlapping gunzip 939 ms, parse 3855 ms, sort 114 ms, write 11492 ms, index 572 ms: 7 candidates, 76726 repo-hours, 804 releases; waiting 20 ms; commit 2972 ms)
2026-11-08T02:50:13Z [load_day 2023-11-14] 2023-11-14 hour 17: 166216 events in 4 files, snapshot 4169145848541085855 (task 19207 ms: download 12039 ms overlapping gunzip 1099 ms, parse 4632 ms, sort 110 ms, write 12474 ms, index 675 ms: 3 candidates, 78450 repo-hours, 937 releases; waiting 21 ms; commit 2861 ms)
2026-11-08T02:50:28Z [load_day 2023-11-14] 2023-11-14 hour 18: 201235 events in 5 files, snapshot 8569582377948930744 (task 20872 ms: download 11229 ms overlapping gunzip 1299 ms, parse 5670 ms, sort 152 ms, write 12719 ms, index 802 ms: 14 candidates, 90968 repo-hours, 1076 releases; waiting 20 ms; commit 2790 ms)
2026-11-08T02:50:36Z [load_day 2023-11-14] 2023-11-14 hour 19: 177435 events in 4 files, snapshot 294831680337885353 (task 19622 ms: download 11312 ms overlapping gunzip 1257 ms, parse 5430 ms, sort 130 ms, write 11945 ms, index 631 ms: 12 candidates, 76896 repo-hours, 1344 releases; waiting 21 ms; commit 5122 ms)
2026-11-08T02:50:50Z [load_day 2023-11-14] 2023-11-14 hour 20: 191472 events in 4 files, snapshot 8490651835210023533 (task 20763 ms: download 11694 ms overlapping gunzip 1024 ms, parse 4735 ms, sort 211 ms, write 13796 ms, index 695 ms: 8 candidates, 79709 repo-hours, 1348 releases; waiting 17 ms; commit 3273 ms)
2026-11-08T02:50:57Z [load_day 2023-11-14] 2023-11-14 hour 21: 182339 events in 4 files, snapshot 2460902097833733110 (task 21710 ms: download 11569 ms overlapping gunzip 1608 ms, parse 6971 ms, sort 242 ms, write 12146 ms, index 530 ms: 11 candidates, 74180 repo-hours, 1408 releases; waiting 21 ms; commit 3088 ms)
2026-11-08T02:51:11Z [load_day 2023-11-14] 2023-11-14 hour 22: 172093 events in 4 files, snapshot 7224530616731576170 (task 20198 ms: download 12638 ms overlapping gunzip 1254 ms, parse 5758 ms, sort 170 ms, write 12156 ms, index 640 ms: 4 candidates, 69390 repo-hours, 1263 releases; waiting 17 ms; commit 3594 ms)
2026-11-08T02:51:14Z [load_day 2023-11-14] 2023-11-14 hour 23: 156687 events in 4 files, snapshot 6336127368529540941 (task 16369 ms: download 10470 ms overlapping gunzip 1052 ms, parse 4518 ms, sort 98 ms, write 9971 ms, index 495 ms: 5 candidates, 64617 repo-hours, 864 releases; waiting 25 ms; commit 2195 ms)
2026-11-08T02:51:22Z [load_day 2023-11-14] 2023-11-14: repo_hour merged from 24 files to 1 (1977649 rows, 8676 ms)
2026-11-08T02:51:25Z [load_day 2023-11-14] 2023-11-14: index committed in 11378 ms (24 + 1 + 24 files)
2026-11-08T02:51:25Z [load_day 2023-11-14] 2023-11-14: 4370149 events in 24 hours
2026-11-08T02:51:25Z [load_day 2023-11-14] attempt 1 succeeded