orcaLog in

Runs · run 1722

load_day 2023-11-10, attempt 1 succeeded

Host
3c2b29713ce8:540116
Started
2026-11-08T02:40:12Z
Ended
2026-11-08T02:44:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1722/load_day/2023-11-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:40:12Z [load_day 2023-11-10] attempt 1 started
2026-11-08T02:40:13Z [load_day 2023-11-10] 2023-11-10: 2 hours in flight, about 1200 MB
2026-11-08T02:40:35Z [load_day 2023-11-10] 2023-11-10 hour 0: 179343 events in 4 files, snapshot 9198467134025943975 (task 17253 ms: download 9714 ms overlapping gunzip 1105 ms, parse 5365 ms, sort 202 ms, write 9679 ms, index 683 ms: 5 candidates, 93144 repo-hours, 950 releases; waiting 16 ms; commit 2671 ms)
2026-11-08T02:40:38Z [load_day 2023-11-10] 2023-11-10 hour 1: 173008 events in 4 files, snapshot 8744846810386217431 (task 16714 ms: download 6465 ms overlapping gunzip 970 ms, parse 4597 ms, sort 115 ms, write 9489 ms, index 764 ms: 12 candidates, 96215 repo-hours, 859 releases; waiting 513 ms; commit 3180 ms)
2026-11-08T02:40:51Z [load_day 2023-11-10] 2023-11-10 hour 2: 141851 events in 3 files, snapshot 760856980258711975 (task 13054 ms: download 4853 ms overlapping gunzip 773 ms, parse 3346 ms, sort 89 ms, write 7907 ms, index 738 ms: 9 candidates, 63538 repo-hours, 756 releases; waiting 17 ms; commit 4257 ms)
2026-11-08T02:40:54Z [load_day 2023-11-10] 2023-11-10 hour 3: 135173 events in 3 files, snapshot 2632568482409751300 (task 12291 ms: download 5037 ms overlapping gunzip 715 ms, parse 3208 ms, sort 94 ms, write 7458 ms, index 593 ms: 9 candidates, 60071 repo-hours, 883 releases; waiting 22 ms; commit 2651 ms)
2026-11-08T02:41:05Z [load_day 2023-11-10] 2023-11-10 hour 4: 132761 events in 3 files, snapshot 4457260286634311627 (task 13877 ms: download 5685 ms overlapping gunzip 1020 ms, parse 3992 ms, sort 92 ms, write 8028 ms, index 521 ms: 7 candidates, 56984 repo-hours, 678 releases; waiting 22 ms; commit 3474 ms)
2026-11-08T02:41:09Z [load_day 2023-11-10] 2023-11-10 hour 5: 139811 events in 3 files, snapshot 4698103259376792734 (task 13459 ms: download 5166 ms overlapping gunzip 826 ms, parse 3594 ms, sort 87 ms, write 7914 ms, index 833 ms: 5 candidates, 59088 repo-hours, 658 releases; waiting 16 ms; commit 2931 ms)
2026-11-08T02:41:22Z [load_day 2023-11-10] 2023-11-10 hour 6: 156072 events in 4 files, snapshot 1022139337928888100 (task 15655 ms: download 6564 ms overlapping gunzip 1041 ms, parse 4472 ms, sort 99 ms, write 8506 ms, index 687 ms: 5 candidates, 71468 repo-hours, 814 releases; waiting 519 ms; commit 3373 ms)
2026-11-08T02:41:28Z [load_day 2023-11-10] 2023-11-10 hour 7: 162411 events in 4 files, snapshot 572791352225960924 (task 17346 ms: download 9694 ms overlapping gunzip 1008 ms, parse 4385 ms, sort 112 ms, write 10416 ms, index 634 ms: 6 candidates, 70238 repo-hours, 903 releases; waiting 500 ms; commit 3246 ms)
2026-11-08T02:41:44Z [load_day 2023-11-10] 2023-11-10 hour 8: 179551 events in 4 files, snapshot 1927683977451418193 (task 19415 ms: download 11481 ms overlapping gunzip 1096 ms, parse 4764 ms, sort 183 ms, write 12572 ms, index 547 ms: 8 candidates, 78924 repo-hours, 1116 releases; waiting 25 ms; commit 4504 ms)
2026-11-08T02:41:48Z [load_day 2023-11-10] 2023-11-10 hour 9: 194576 events in 4 files, snapshot 6676616424805604624 (task 19480 ms: download 11222 ms overlapping gunzip 1272 ms, parse 5662 ms, sort 126 ms, write 11590 ms, index 588 ms: 13 candidates, 83506 repo-hours, 1590 releases; waiting 23 ms; commit 3141 ms)
2026-11-08T02:42:00Z [load_day 2023-11-10] 2023-11-10 hour 10: 191044 events in 4 files, snapshot 6895144549829540990 (task 17138 ms: download 9473 ms overlapping gunzip 1079 ms, parse 4747 ms, sort 118 ms, write 10378 ms, index 570 ms: 9 candidates, 81235 repo-hours, 1473 releases; waiting 27 ms; commit 2607 ms)
2026-11-08T02:42:05Z [load_day 2023-11-10] 2023-11-10 hour 11: 181299 events in 4 files, snapshot 1702733401649737568 (task 15235 ms: download 8439 ms overlapping gunzip 936 ms, parse 4076 ms, sort 122 ms, write 9261 ms, index 613 ms: 10 candidates, 75911 repo-hours, 1276 releases; waiting 37 ms; commit 3462 ms)
2026-11-08T02:42:23Z [load_day 2023-11-10] 2023-11-10 hour 12: 236572 events in 5 files, snapshot 2505039182410043389 (task 18848 ms: download 12347 ms overlapping gunzip 1085 ms, parse 5286 ms, sort 170 ms, write 11277 ms, index 817 ms: 6 candidates, 107345 repo-hours, 1215 releases; waiting 22 ms; commit 5826 ms)
2026-11-08T02:42:29Z [load_day 2023-11-10] 2023-11-10 hour 13: 208707 events in 5 files, snapshot 5153739799527173380 (task 18763 ms: download 9417 ms overlapping gunzip 1157 ms, parse 5217 ms, sort 137 ms, write 10886 ms, index 1147 ms: 5 candidates, 101727 repo-hours, 1218 releases; waiting 29 ms; commit 5498 ms)
2026-11-08T02:42:44Z [load_day 2023-11-10] 2023-11-10 hour 14: 204318 events in 5 files, snapshot 5646536229972266698 (task 21921 ms: download 12674 ms overlapping gunzip 1483 ms, parse 6604 ms, sort 132 ms, write 12262 ms, index 669 ms: 6 candidates, 89777 repo-hours, 1267 releases; waiting 504 ms; commit 3012 ms)
2026-11-08T02:43:03Z [load_day 2023-11-10] 2023-11-10 hour 15: 204819 events in 5 files, snapshot 8318638136146469620 (task 22140 ms: download 12164 ms overlapping gunzip 1276 ms, parse 5881 ms, sort 222 ms, write 13544 ms, index 1006 ms: 5 candidates, 90407 repo-hours, 1413 releases; waiting 17 ms; commit 16978 ms)
2026-11-08T02:43:09Z [load_day 2023-11-10] 2023-11-10 hour 16: 201331 events in 5 files, snapshot 8233353895438735928 (task 18764 ms: download 11351 ms overlapping gunzip 1312 ms, parse 5454 ms, sort 137 ms, write 11040 ms, index 593 ms: 3 candidates, 89141 repo-hours, 1073 releases; waiting 17 ms; commit 5328 ms)
2026-11-08T02:43:24Z [load_day 2023-11-10] 2023-11-10 hour 17: 182913 events in 4 files, snapshot 4570417078021411040 (task 19688 ms: download 11257 ms overlapping gunzip 1025 ms, parse 4966 ms, sort 180 ms, write 12627 ms, index 671 ms: 7 candidates, 78900 repo-hours, 1429 releases; waiting 18 ms; commit 2481 ms)
2026-11-08T02:43:26Z [load_day 2023-11-10] 2023-11-10 hour 18: 184065 events in 4 files, snapshot 3476512065358119877 (task 18415 ms: download 10131 ms overlapping gunzip 1181 ms, parse 5355 ms, sort 113 ms, write 10947 ms, index 598 ms: 4 candidates, 81633 repo-hours, 1162 releases; waiting 26 ms; commit 2514 ms)
2026-11-08T02:43:42Z [load_day 2023-11-10] 2023-11-10 hour 19: 165298 events in 4 files, snapshot 7923633820949291009 (task 16640 ms: download 9909 ms overlapping gunzip 948 ms, parse 4460 ms, sort 106 ms, write 10225 ms, index 701 ms: 9 candidates, 69108 repo-hours, 989 releases; waiting 14 ms; commit 2614 ms)
2026-11-08T02:43:48Z [load_day 2023-11-10] 2023-11-10 hour 20: 158437 events in 4 files, snapshot 5638102589404165415 (task 15795 ms: download 6604 ms overlapping gunzip 963 ms, parse 4275 ms, sort 117 ms, write 9657 ms, index 525 ms: 13 candidates, 66673 repo-hours, 930 releases; waiting 30 ms; commit 6216 ms)
2026-11-08T02:44:00Z [load_day 2023-11-10] 2023-11-10 hour 21: 151309 events in 4 files, snapshot 8695682960487769980 (task 16896 ms: download 8347 ms overlapping gunzip 1129 ms, parse 4669 ms, sort 122 ms, write 9579 ms, index 616 ms: 5 candidates, 61211 repo-hours, 1035 releases; waiting 513 ms; commit 2883 ms)
2026-11-08T02:44:04Z [load_day 2023-11-10] 2023-11-10 hour 22: 138470 events in 3 files, snapshot 8310739194115665343 (task 15074 ms: download 7056 ms overlapping gunzip 962 ms, parse 4241 ms, sort 85 ms, write 8682 ms, index 871 ms: 8 candidates, 56329 repo-hours, 888 releases; waiting 24 ms; commit 4165 ms)
2026-11-08T02:44:13Z [load_day 2023-11-10] 2023-11-10 hour 23: 124666 events in 3 files, snapshot 8382029250251363697 (task 10363 ms: download 4646 ms overlapping gunzip 654 ms, parse 2851 ms, sort 79 ms, write 6209 ms, index 346 ms: 4 candidates, 51600 repo-hours, 822 releases; waiting 26 ms; commit 4324 ms)
2026-11-08T02:44:21Z [load_day 2023-11-10] 2023-11-10: repo_hour merged from 24 files to 1 (1834173 rows, 8143 ms)
2026-11-08T02:44:24Z [load_day 2023-11-10] 2023-11-10: index committed in 10733 ms (24 + 1 + 24 files)
2026-11-08T02:44:24Z [load_day 2023-11-10] 2023-11-10: 4127805 events in 24 hours
2026-11-08T02:44:24Z [load_day 2023-11-10] attempt 1 succeeded