orcaLog in

Runs · run 1617

load_day 2023-10-12, attempt 1 succeeded

Host
3c2b29713ce8:429290
Started
2026-11-08T01:42:17Z
Ended
2026-11-08T01:46:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1617/load_day/2023-10-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T01:42:17Z [load_day 2023-10-12] attempt 1 started
2026-11-08T01:42:19Z [load_day 2023-10-12] 2023-10-12: 2 hours in flight, about 1200 MB
2026-11-08T01:42:41Z [load_day 2023-10-12] 2023-10-12 hour 0: 174076 events in 4 files, snapshot 610879195574028824 (task 17563 ms: download 8091 ms overlapping gunzip 1093 ms, parse 5312 ms, sort 149 ms, write 9556 ms, index 607 ms: 11 candidates, 93275 repo-hours, 977 releases; waiting 526 ms; commit 2358 ms)
2026-11-08T01:42:43Z [load_day 2023-10-12] 2023-10-12 hour 1: 166331 events in 4 files, snapshot 107940969717367546 (task 17021 ms: download 7221 ms overlapping gunzip 873 ms, parse 4220 ms, sort 185 ms, write 10249 ms, index 649 ms: 10 candidates, 93246 repo-hours, 817 releases; waiting 511 ms; commit 2737 ms)
2026-11-08T01:42:54Z [load_day 2023-10-12] 2023-10-12 hour 2: 137459 events in 3 files, snapshot 4939199429005425014 (task 12991 ms: download 5814 ms overlapping gunzip 783 ms, parse 3251 ms, sort 106 ms, write 7651 ms, index 419 ms: 6 candidates, 61787 repo-hours, 722 releases; waiting 499 ms; commit 2412 ms)
2026-11-08T01:42:58Z [load_day 2023-10-12] 2023-10-12 hour 3: 137341 events in 3 files, snapshot 1403075903958565301 (task 13091 ms: download 5053 ms overlapping gunzip 719 ms, parse 3218 ms, sort 89 ms, write 7698 ms, index 621 ms: 7 candidates, 61037 repo-hours, 896 releases; waiting 471 ms; commit 2893 ms)
2026-11-08T01:43:08Z [load_day 2023-10-12] 2023-10-12 hour 4: 137473 events in 3 files, snapshot 1325178140988443714 (task 12693 ms: download 5710 ms overlapping gunzip 778 ms, parse 3429 ms, sort 143 ms, write 7030 ms, index 469 ms: 8 candidates, 57532 repo-hours, 708 releases; waiting 542 ms; commit 2234 ms)
2026-11-08T01:43:13Z [load_day 2023-10-12] 2023-10-12 hour 5: 143710 events in 3 files, snapshot 1767473216607765245 (task 13329 ms: download 5786 ms overlapping gunzip 780 ms, parse 3479 ms, sort 136 ms, write 7542 ms, index 687 ms: 8 candidates, 61963 repo-hours, 711 releases; waiting 488 ms; commit 3686 ms)
2026-11-08T01:43:28Z [load_day 2023-10-12] 2023-10-12 hour 6: 174709 events in 4 files, snapshot 8740122033226587575 (task 18110 ms: download 10405 ms overlapping gunzip 1111 ms, parse 4966 ms, sort 148 ms, write 10280 ms, index 836 ms: 6 candidates, 80405 repo-hours, 918 releases; waiting 534 ms; commit 2527 ms)
2026-11-08T01:43:33Z [load_day 2023-10-12] 2023-10-12 hour 7: 182290 events in 4 files, snapshot 4855778244395389410 (task 20682 ms: download 12693 ms overlapping gunzip 1183 ms, parse 4998 ms, sort 146 ms, write 12946 ms, index 625 ms: 7 candidates, 80597 repo-hours, 1092 releases; waiting 519 ms; commit 2463 ms)
2026-11-08T01:43:50Z [load_day 2023-10-12] 2023-10-12 hour 8: 195896 events in 4 files, snapshot 614223794609656423 (task 21115 ms: download 11074 ms overlapping gunzip 1164 ms, parse 5392 ms, sort 168 ms, write 12931 ms, index 600 ms: 10 candidates, 86832 repo-hours, 1200 releases; waiting 547 ms; commit 2768 ms)
2026-11-08T01:43:58Z [load_day 2023-10-12] 2023-10-12 hour 9: 198546 events in 4 files, snapshot 3895318977737151748 (task 21181 ms: download 11788 ms overlapping gunzip 1246 ms, parse 5378 ms, sort 157 ms, write 12918 ms, index 619 ms: 6 candidates, 87074 repo-hours, 1277 releases; waiting 565 ms; commit 4806 ms)
2026-11-08T01:44:12Z [load_day 2023-10-12] 2023-10-12 hour 10: 192581 events in 4 files, snapshot 9165808179180941611 (task 20566 ms: download 11080 ms overlapping gunzip 1224 ms, parse 5559 ms, sort 164 ms, write 12313 ms, index 586 ms: 8 candidates, 84719 repo-hours, 1108 releases; waiting 505 ms; commit 2715 ms)
2026-11-08T01:44:18Z [load_day 2023-10-12] 2023-10-12 hour 11: 186744 events in 4 files, snapshot 5705259745896419538 (task 20370 ms: download 12024 ms overlapping gunzip 1226 ms, parse 5720 ms, sort 211 ms, write 11638 ms, index 681 ms: 6 candidates, 81368 repo-hours, 1120 releases; waiting 520 ms; commit 3771 ms)
2026-11-08T01:44:37Z [load_day 2023-10-12] 2023-10-12 hour 12: 240142 events in 5 files, snapshot 6161487291110848684 (task 23716 ms: download 15078 ms overlapping gunzip 1271 ms, parse 6139 ms, sort 178 ms, write 14323 ms, index 1031 ms: 19 candidates, 115540 repo-hours, 1146 releases; waiting 500 ms; commit 2539 ms)
2026-11-08T01:44:41Z [load_day 2023-10-12] 2023-10-12 hour 13: 219945 events in 5 files, snapshot 2332023491642785646 (task 21807 ms: download 15325 ms overlapping gunzip 1299 ms, parse 6084 ms, sort 170 ms, write 12598 ms, index 765 ms: 10 candidates, 108633 repo-hours, 1324 releases; waiting 529 ms; commit 3477 ms)
2026-11-08T01:44:57Z [load_day 2023-10-12] 2023-10-12 hour 14: 207699 events in 5 files, snapshot 2094284488015180003 (task 18470 ms: download 10158 ms overlapping gunzip 1067 ms, parse 4696 ms, sort 136 ms, write 10763 ms, index 680 ms: 9 candidates, 93907 repo-hours, 1269 releases; waiting 844 ms; commit 2777 ms)
2026-11-08T01:45:00Z [load_day 2023-10-12] 2023-10-12 hour 15: 190747 events in 4 files, snapshot 7369550946750673740 (task 17857 ms: download 9877 ms overlapping gunzip 968 ms, parse 4315 ms, sort 136 ms, write 10283 ms, index 983 ms: 9 candidates, 88228 repo-hours, 1104 releases; waiting 817 ms; commit 3264 ms)
2026-11-08T01:45:18Z [load_day 2023-10-12] 2023-10-12 hour 16: 191371 events in 4 files, snapshot 4323761718053787090 (task 21487 ms: download 12756 ms overlapping gunzip 1328 ms, parse 5758 ms, sort 136 ms, write 12557 ms, index 883 ms: 8 candidates, 85524 repo-hours, 1081 releases; waiting 510 ms; commit 2334 ms)
2026-11-08T01:45:21Z [load_day 2023-10-12] 2023-10-12 hour 17: 191932 events in 4 files, snapshot 2631937429649492035 (task 19405 ms: download 10662 ms overlapping gunzip 1201 ms, parse 5143 ms, sort 146 ms, write 11376 ms, index 684 ms: 7 candidates, 80964 repo-hours, 1162 releases; waiting 208 ms; commit 2240 ms)
2026-11-08T01:45:39Z [load_day 2023-10-12] 2023-10-12 hour 18: 194065 events in 4 files, snapshot 7749463299077211466 (task 19501 ms: download 10745 ms overlapping gunzip 1098 ms, parse 4953 ms, sort 148 ms, write 11699 ms, index 728 ms: 6 candidates, 86618 repo-hours, 1051 releases; waiting 551 ms; commit 2182 ms)
2026-11-08T01:45:44Z [load_day 2023-10-12] 2023-10-12 hour 19: 178458 events in 4 files, snapshot 7996328748357383534 (task 17826 ms: download 10656 ms overlapping gunzip 1102 ms, parse 4751 ms, sort 113 ms, write 10576 ms, index 507 ms: 10 candidates, 74425 repo-hours, 904 releases; waiting 504 ms; commit 5164 ms)
2026-11-08T01:46:01Z [load_day 2023-10-12] 2023-10-12 hour 20: 167924 events in 4 files, snapshot 8468100567731185734 (task 18555 ms: download 11543 ms overlapping gunzip 952 ms, parse 4469 ms, sort 126 ms, write 11647 ms, index 608 ms: 9 candidates, 72137 repo-hours, 975 releases; waiting 517 ms; commit 4585 ms)
2026-11-08T01:46:03Z [load_day 2023-10-12] 2023-10-12 hour 21: 156789 events in 4 files, snapshot 7412401605860499456 (task 16614 ms: download 7766 ms overlapping gunzip 1084 ms, parse 4730 ms, sort 159 ms, write 9259 ms, index 580 ms: 8 candidates, 66648 repo-hours, 1064 releases; waiting 504 ms; commit 2508 ms)
2026-11-08T01:46:16Z [load_day 2023-10-12] 2023-10-12 hour 22: 138213 events in 3 files, snapshot 2755876782838447284 (task 15725 ms: download 6826 ms overlapping gunzip 1068 ms, parse 4445 ms, sort 100 ms, write 8946 ms, index 428 ms: 1 candidates, 58044 repo-hours, 849 releases; waiting 475 ms; commit 2365 ms)
2026-11-08T01:46:18Z [load_day 2023-10-12] 2023-10-12 hour 23: 127520 events in 3 files, snapshot 2117978130088192648 (task 14161 ms: download 6796 ms overlapping gunzip 859 ms, parse 3748 ms, sort 115 ms, write 8377 ms, index 411 ms: 2 candidates, 52585 repo-hours, 809 releases; waiting 376 ms; commit 1971 ms)
2026-11-08T01:46:27Z [load_day 2023-10-12] 2023-10-12: repo_hour merged from 24 files to 1 (1913088 rows, 8559 ms)
2026-11-08T01:46:29Z [load_day 2023-10-12] 2023-10-12: index committed in 10718 ms (24 + 1 + 24 files)
2026-11-08T01:46:29Z [load_day 2023-10-12] 2023-10-12: 4231961 events in 24 hours
2026-11-08T01:46:29Z [load_day 2023-10-12] attempt 1 succeeded