orcaLog in

Runs · run 1466

load_day 2023-09-05, attempt 1 succeeded

Host
3c2b29713ce8:296572
Started
2026-11-08T00:31:59Z
Ended
2026-11-08T00:36:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1466/load_day/2023-09-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:31:59Z [load_day 2023-09-05] attempt 1 started
2026-11-08T00:32:00Z [load_day 2023-09-05] 2023-09-05: 2 hours in flight, about 1200 MB
2026-11-08T00:32:21Z [load_day 2023-09-05] 2023-09-05 hour 0: 173391 events in 4 files, snapshot 1285427927107169963 (task 15534 ms: download 6785 ms overlapping gunzip 892 ms, parse 3909 ms, sort 182 ms, write 8962 ms, index 753 ms: 8 candidates, 92482 repo-hours, 853 releases; waiting 491 ms; commit 3684 ms)
2026-11-08T00:32:24Z [load_day 2023-09-05] 2023-09-05 hour 1: 163497 events in 4 files, snapshot 3190454330022034776 (task 15314 ms: download 6277 ms overlapping gunzip 816 ms, parse 3695 ms, sort 174 ms, write 9084 ms, index 692 ms: 2 candidates, 89596 repo-hours, 709 releases; waiting 533 ms; commit 2540 ms)
2026-11-08T00:32:36Z [load_day 2023-09-05] 2023-09-05 hour 2: 146231 events in 3 files, snapshot 2251126051233647595 (task 14635 ms: download 5872 ms overlapping gunzip 843 ms, parse 3680 ms, sort 152 ms, write 8523 ms, index 528 ms: 6 candidates, 62406 repo-hours, 734 releases; waiting 524 ms; commit 2990 ms)
2026-11-08T00:32:39Z [load_day 2023-09-05] 2023-09-05 hour 3: 135599 events in 3 files, snapshot 8535199629099563081 (task 13144 ms: download 5453 ms overlapping gunzip 675 ms, parse 2947 ms, sort 149 ms, write 7983 ms, index 568 ms: 2 candidates, 58437 repo-hours, 787 releases; waiting 496 ms; commit 3056 ms)
2026-11-08T00:32:49Z [load_day 2023-09-05] 2023-09-05 hour 4: 116220 events in 3 files, snapshot 2709649566036508778 (task 11253 ms: download 5094 ms overlapping gunzip 624 ms, parse 2618 ms, sort 72 ms, write 6446 ms, index 656 ms: 7 candidates, 48692 repo-hours, 419 releases; waiting 525 ms; commit 2575 ms)
2026-11-08T00:32:55Z [load_day 2023-09-05] 2023-09-05 hour 5: 146365 events in 3 files, snapshot 7299504281078677718 (task 15383 ms: download 6289 ms overlapping gunzip 983 ms, parse 4080 ms, sort 100 ms, write 8890 ms, index 567 ms: 10 candidates, 62190 repo-hours, 786 releases; waiting 483 ms; commit 2295 ms)
2026-11-08T00:33:10Z [load_day 2023-09-05] 2023-09-05 hour 6: 174087 events in 4 files, snapshot 3692227100072231639 (task 18578 ms: download 10909 ms overlapping gunzip 1067 ms, parse 4506 ms, sort 110 ms, write 11206 ms, index 682 ms: 4 candidates, 79010 repo-hours, 958 releases; waiting 515 ms; commit 4243 ms)
2026-11-08T00:33:17Z [load_day 2023-09-05] 2023-09-05 hour 7: 171595 events in 4 files, snapshot 7367217970799409312 (task 20227 ms: download 11341 ms overlapping gunzip 1138 ms, parse 4704 ms, sort 140 ms, write 12574 ms, index 760 ms: 8 candidates, 76178 repo-hours, 1011 releases; waiting 526 ms; commit 2543 ms)
2026-11-08T00:33:32Z [load_day 2023-09-05] 2023-09-05 hour 8: 186921 events in 4 files, snapshot 191608903487765131 (task 20546 ms: download 12310 ms overlapping gunzip 1321 ms, parse 5764 ms, sort 137 ms, write 11891 ms, index 696 ms: 9 candidates, 83730 repo-hours, 1020 releases; waiting 512 ms; commit 4095 ms)
2026-11-08T00:33:40Z [load_day 2023-09-05] 2023-09-05 hour 9: 189344 events in 4 files, snapshot 3056232781661812535 (task 22057 ms: download 12313 ms overlapping gunzip 1293 ms, parse 5562 ms, sort 125 ms, write 13450 ms, index 841 ms: 7 candidates, 83359 repo-hours, 1118 releases; waiting 508 ms; commit 2364 ms)
2026-11-08T00:33:54Z [load_day 2023-09-05] 2023-09-05 hour 10: 185476 events in 4 files, snapshot 2539897918154573231 (task 20143 ms: download 12073 ms overlapping gunzip 1321 ms, parse 5808 ms, sort 149 ms, write 11351 ms, index 645 ms: 7 candidates, 80643 repo-hours, 950 releases; waiting 519 ms; commit 5546 ms)
2026-11-08T00:34:02Z [load_day 2023-09-05] 2023-09-05 hour 11: 189722 events in 4 files, snapshot 2723092220565424053 (task 20454 ms: download 11065 ms overlapping gunzip 1237 ms, parse 5273 ms, sort 164 ms, write 12239 ms, index 656 ms: 7 candidates, 79731 repo-hours, 1013 releases; waiting 549 ms; commit 2451 ms)
2026-11-08T00:34:14Z [load_day 2023-09-05] 2023-09-05 hour 12: 240272 events in 5 files, snapshot 312957643503899522 (task 22158 ms: download 14949 ms overlapping gunzip 1260 ms, parse 5925 ms, sort 186 ms, write 13068 ms, index 764 ms: 5 candidates, 113063 repo-hours, 1254 releases; waiting 492 ms; commit 2310 ms)
2026-11-08T00:34:21Z [load_day 2023-09-05] 2023-09-05 hour 13: 216296 events in 5 files, snapshot 766948908884337792 (task 18682 ms: download 12441 ms overlapping gunzip 1053 ms, parse 4713 ms, sort 175 ms, write 11236 ms, index 735 ms: 10 candidates, 107780 repo-hours, 1072 releases; waiting 512 ms; commit 2262 ms)
2026-11-08T00:34:35Z [load_day 2023-09-05] 2023-09-05 hour 14: 201433 events in 5 files, snapshot 1866619498874226156 (task 19094 ms: download 9536 ms overlapping gunzip 1205 ms, parse 5199 ms, sort 144 ms, write 10977 ms, index 752 ms: 7 candidates, 92525 repo-hours, 1060 releases; waiting 519 ms; commit 2736 ms)
2026-11-08T00:34:42Z [load_day 2023-09-05] 2023-09-05 hour 15: 180028 events in 4 files, snapshot 6020110439470294299 (task 19239 ms: download 10719 ms overlapping gunzip 1125 ms, parse 5160 ms, sort 169 ms, write 11321 ms, index 609 ms: 7 candidates, 86212 repo-hours, 1109 releases; waiting 521 ms; commit 2319 ms)
2026-11-08T00:34:49Z [load_day 2023-09-05] 2023-09-05 hour 16: 133532 events in 3 files, snapshot 3045761893126569478 (task 13089 ms: download 5894 ms overlapping gunzip 753 ms, parse 3129 ms, sort 118 ms, write 7823 ms, index 604 ms: 3 candidates, 65624 repo-hours, 693 releases; waiting 385 ms; commit 3253 ms)
2026-11-08T00:35:04Z [load_day 2023-09-05] 2023-09-05 hour 17: 195145 events in 4 files, snapshot 584769701736778348 (task 20750 ms: download 11562 ms overlapping gunzip 1128 ms, parse 5144 ms, sort 143 ms, write 12961 ms, index 634 ms: 5 candidates, 81990 repo-hours, 999 releases; waiting 362 ms; commit 2818 ms)
2026-11-08T00:35:10Z [load_day 2023-09-05] 2023-09-05 hour 18: 196808 events in 4 files, snapshot 5533278558338302133 (task 19790 ms: download 10310 ms overlapping gunzip 1285 ms, parse 5547 ms, sort 140 ms, write 11253 ms, index 845 ms: 8 candidates, 86801 repo-hours, 1142 releases; waiting 479 ms; commit 2675 ms)
2026-11-08T00:35:25Z [load_day 2023-09-05] 2023-09-05 hour 19: 181799 events in 4 files, snapshot 5068854755050795007 (task 19934 ms: download 11362 ms overlapping gunzip 961 ms, parse 4272 ms, sort 129 ms, write 12775 ms, index 692 ms: 8 candidates, 74582 repo-hours, 1215 releases; waiting 883 ms; commit 2648 ms)
2026-11-08T00:35:33Z [load_day 2023-09-05] 2023-09-05 hour 20: 177333 events in 4 files, snapshot 8798961727289828099 (task 18548 ms: download 10903 ms overlapping gunzip 933 ms, parse 4253 ms, sort 162 ms, write 11721 ms, index 644 ms: 10 candidates, 72806 repo-hours, 937 releases; waiting 499 ms; commit 6276 ms)
2026-11-08T00:35:43Z [load_day 2023-09-05] 2023-09-05 hour 21: 163221 events in 4 files, snapshot 1958972149536164227 (task 17402 ms: download 6827 ms overlapping gunzip 1001 ms, parse 4616 ms, sort 141 ms, write 10232 ms, index 589 ms: 13 candidates, 64355 repo-hours, 1002 releases; waiting 527 ms; commit 2828 ms)
2026-11-08T00:35:46Z [load_day 2023-09-05] 2023-09-05 hour 22: 146954 events in 3 files, snapshot 7060540965318512391 (task 16436 ms: download 7300 ms overlapping gunzip 1049 ms, parse 4562 ms, sort 99 ms, write 9363 ms, index 574 ms: 2 candidates, 57402 repo-hours, 827 releases; waiting 492 ms; commit 2114 ms)
2026-11-08T00:35:55Z [load_day 2023-09-05] 2023-09-05 hour 23: 136189 events in 3 files, snapshot 2036450954035615155 (task 10899 ms: download 4905 ms overlapping gunzip 737 ms, parse 3088 ms, sort 92 ms, write 5833 ms, index 378 ms: 1 candidates, 52956 repo-hours, 681 releases; waiting 498 ms; commit 2305 ms)
2026-11-08T00:36:03Z [load_day 2023-09-05] 2023-09-05: repo_hour merged from 24 files to 1 (1852550 rows, 8326 ms)
2026-11-08T00:36:05Z [load_day 2023-09-05] 2023-09-05: index committed in 10325 ms (24 + 1 + 24 files)
2026-11-08T00:36:05Z [load_day 2023-09-05] 2023-09-05: 4147458 events in 24 hours
2026-11-08T00:36:05Z [load_day 2023-09-05] attempt 1 succeeded