orcaLog in

Runs · run 900

load_day 2023-03-13, attempt 1 succeeded

Host
caf251265124:155482
Started
2026-11-07T17:00:35Z
Ended
2026-11-07T17:04:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/900/load_day/2023-03-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:00:35Z [load_day 2023-03-13] attempt 1 started
2026-11-07T17:00:36Z [load_day 2023-03-13] 2023-03-13: 2 hours in flight, about 1200 MB
2026-11-07T17:00:48Z [load_day 2023-03-13] 2023-03-13 hour 0: 133039 events in 3 files, snapshot 8991567115977328800 (task 9046 ms: download 2417 ms overlapping gunzip 519 ms, parse 2327 ms, sort 73 ms, write 4816 ms, index 438 ms: 5 candidates, 66824 repo-hours, 867 releases; waiting 517 ms; commit 1239 ms)
2026-11-07T17:00:52Z [load_day 2023-03-13] 2023-03-13 hour 1: 163036 events in 4 files, snapshot 3999996373718406451 (task 13232 ms: download 7793 ms overlapping gunzip 855 ms, parse 3522 ms, sort 98 ms, write 6885 ms, index 502 ms: 5 candidates, 78471 repo-hours, 804 releases; waiting 915 ms; commit 1411 ms)
2026-11-07T17:01:01Z [load_day 2023-03-13] 2023-03-13 hour 2: 148575 events in 3 files, snapshot 8226797731204629195 (task 12632 ms: download 5310 ms overlapping gunzip 785 ms, parse 3206 ms, sort 101 ms, write 7199 ms, index 448 ms: 9 candidates, 68820 repo-hours, 717 releases; waiting 522 ms; commit 1559 ms)
2026-11-07T17:01:04Z [load_day 2023-03-13] 2023-03-13 hour 3: 138319 events in 3 files, snapshot 4568076899689770306 (task 11215 ms: download 5354 ms overlapping gunzip 680 ms, parse 2807 ms, sort 81 ms, write 6402 ms, index 368 ms: 4 candidates, 58386 repo-hours, 773 releases; waiting 540 ms; commit 1382 ms)
2026-11-07T17:01:13Z [load_day 2023-03-13] 2023-03-13 hour 4: 133526 events in 3 files, snapshot 7516906855724664532 (task 10915 ms: download 5234 ms overlapping gunzip 700 ms, parse 2881 ms, sort 81 ms, write 5785 ms, index 367 ms: 3 candidates, 54147 repo-hours, 627 releases; waiting 761 ms; commit 1378 ms)
2026-11-07T17:01:18Z [load_day 2023-03-13] 2023-03-13 hour 5: 150010 events in 4 files, snapshot 1923844284498756937 (task 12998 ms: download 6182 ms overlapping gunzip 830 ms, parse 3326 ms, sort 92 ms, write 7194 ms, index 398 ms: 1 candidates, 60965 repo-hours, 752 releases; waiting 826 ms; commit 1535 ms)
2026-11-07T17:01:26Z [load_day 2023-03-13] 2023-03-13 hour 6: 159616 events in 4 files, snapshot 659109441287470604 (task 12578 ms: download 5383 ms overlapping gunzip 768 ms, parse 3193 ms, sort 103 ms, write 7080 ms, index 489 ms: 6 candidates, 72494 repo-hours, 862 releases; waiting 552 ms; commit 1435 ms)
2026-11-07T17:01:35Z [load_day 2023-03-13] 2023-03-13 hour 7: 176401 events in 4 files, snapshot 1267205535946682741 (task 15930 ms: download 9945 ms overlapping gunzip 967 ms, parse 3986 ms, sort 117 ms, write 8175 ms, index 506 ms: 4 candidates, 76409 repo-hours, 867 releases; waiting 1770 ms; commit 1490 ms)
2026-11-07T17:01:43Z [load_day 2023-03-13] 2023-03-13 hour 8: 194122 events in 4 files, snapshot 228538528847068990 (task 16278 ms: download 9131 ms overlapping gunzip 1035 ms, parse 4357 ms, sort 115 ms, write 9411 ms, index 537 ms: 2 candidates, 85573 repo-hours, 987 releases; waiting 502 ms; commit 1460 ms)
2026-11-07T17:01:53Z [load_day 2023-03-13] 2023-03-13 hour 9: 204076 events in 5 files, snapshot 7601793037229585324 (task 17799 ms: download 10049 ms overlapping gunzip 1148 ms, parse 4733 ms, sort 137 ms, write 10257 ms, index 554 ms: 6 candidates, 87950 repo-hours, 1240 releases; waiting 642 ms; commit 1491 ms)
2026-11-07T17:02:03Z [load_day 2023-03-13] 2023-03-13 hour 10: 202735 events in 5 files, snapshot 8575551082015445844 (task 19462 ms: download 11787 ms overlapping gunzip 1175 ms, parse 4867 ms, sort 130 ms, write 10375 ms, index 617 ms: 4 candidates, 87268 repo-hours, 1047 releases; waiting 1958 ms; commit 1423 ms)
2026-11-07T17:02:12Z [load_day 2023-03-13] 2023-03-13 hour 11: 204508 events in 5 files, snapshot 3830735414629379664 (task 18203 ms: download 10462 ms overlapping gunzip 1108 ms, parse 4627 ms, sort 136 ms, write 10092 ms, index 608 ms: 6 candidates, 85794 repo-hours, 1129 releases; waiting 1134 ms; commit 1601 ms)
2026-11-07T17:02:23Z [load_day 2023-03-13] 2023-03-13 hour 12: 248319 events in 5 files, snapshot 7754443632629849487 (task 19067 ms: download 11767 ms overlapping gunzip 1119 ms, parse 4922 ms, sort 164 ms, write 10914 ms, index 809 ms: 4 candidates, 123923 repo-hours, 1082 releases; waiting 716 ms; commit 1458 ms)
2026-11-07T17:02:36Z [load_day 2023-03-13] 2023-03-13 hour 13: 242608 events in 5 files, snapshot 2369104635622873912 (task 23078 ms: download 15913 ms overlapping gunzip 1280 ms, parse 5511 ms, sort 172 ms, write 11683 ms, index 739 ms: 7 candidates, 117417 repo-hours, 1086 releases; waiting 3401 ms; commit 1714 ms)
2026-11-07T17:02:44Z [load_day 2023-03-13] 2023-03-13 hour 14: 233703 events in 5 files, snapshot 5698344451768530031 (task 19688 ms: download 12988 ms overlapping gunzip 1219 ms, parse 5170 ms, sort 151 ms, write 11547 ms, index 690 ms: 10 candidates, 103883 repo-hours, 1265 releases; waiting 525 ms; commit 1467 ms)
2026-11-07T17:02:58Z [load_day 2023-03-13] 2023-03-13 hour 15: 223787 events in 5 files, snapshot 8112169391804783122 (task 21187 ms: download 14963 ms overlapping gunzip 1195 ms, parse 5096 ms, sort 138 ms, write 11055 ms, index 616 ms: 5 candidates, 99068 repo-hours, 1244 releases; waiting 2740 ms; commit 1428 ms)
2026-11-07T17:03:04Z [load_day 2023-03-13] 2023-03-13 hour 16: 220484 events in 5 files, snapshot 4053810978888401406 (task 19456 ms: download 13237 ms overlapping gunzip 1163 ms, parse 5086 ms, sort 141 ms, write 11123 ms, index 677 ms: 9 candidates, 100592 repo-hours, 1034 releases; waiting 982 ms; commit 1427 ms)
2026-11-07T17:03:17Z [load_day 2023-03-13] 2023-03-13 hour 17: 210386 events in 5 files, snapshot 7567884892587287892 (task 17900 ms: download 12325 ms overlapping gunzip 1086 ms, parse 4711 ms, sort 126 ms, write 10450 ms, index 670 ms: 16 candidates, 91143 repo-hours, 891 releases; waiting 527 ms; commit 1641 ms)
2026-11-07T17:03:23Z [load_day 2023-03-13] 2023-03-13 hour 18: 209601 events in 5 files, snapshot 6886714533643862194 (task 18577 ms: download 10242 ms overlapping gunzip 1091 ms, parse 4639 ms, sort 123 ms, write 10232 ms, index 614 ms: 11 candidates, 92174 repo-hours, 995 releases; waiting 1161 ms; commit 1514 ms)
2026-11-07T17:03:34Z [load_day 2023-03-13] 2023-03-13 hour 19: 206090 events in 5 files, snapshot 240937901881493598 (task 16826 ms: download 9360 ms overlapping gunzip 1048 ms, parse 4442 ms, sort 134 ms, write 9730 ms, index 604 ms: 6 candidates, 84230 repo-hours, 941 releases; waiting 530 ms; commit 1517 ms)
2026-11-07T17:03:42Z [load_day 2023-03-13] 2023-03-13 hour 20: 214121 events in 5 files, snapshot 1106029688700197738 (task 18262 ms: download 12641 ms overlapping gunzip 1107 ms, parse 4730 ms, sort 139 ms, write 10155 ms, index 570 ms: 7 candidates, 87698 repo-hours, 903 releases; waiting 1220 ms; commit 1587 ms)
2026-11-07T17:03:53Z [load_day 2023-03-13] 2023-03-13 hour 21: 206794 events in 5 files, snapshot 4155297148842377258 (task 18112 ms: download 12683 ms overlapping gunzip 1193 ms, parse 4967 ms, sort 158 ms, write 10426 ms, index 531 ms: 10 candidates, 79370 repo-hours, 959 releases; waiting 525 ms; commit 1529 ms)
2026-11-07T17:03:59Z [load_day 2023-03-13] 2023-03-13 hour 22: 187430 events in 4 files, snapshot 497786042166131528 (task 16187 ms: download 9756 ms overlapping gunzip 1047 ms, parse 4262 ms, sort 127 ms, write 9070 ms, index 452 ms: 8 candidates, 70362 repo-hours, 858 releases; waiting 873 ms; commit 1492 ms)
2026-11-07T17:04:07Z [load_day 2023-03-13] 2023-03-13 hour 23: 172315 events in 4 files, snapshot 5147884208894382921 (task 13537 ms: download 8202 ms overlapping gunzip 863 ms, parse 3676 ms, sort 95 ms, write 7617 ms, index 439 ms: 4 candidates, 66344 repo-hours, 666 releases; waiting 537 ms; commit 1399 ms)
2026-11-07T17:04:16Z [load_day 2023-03-13] 2023-03-13: repo_hour merged from 24 files to 1 (1999305 rows, 8147 ms)
2026-11-07T17:04:17Z [load_day 2023-03-13] 2023-03-13: index committed in 9735 ms (24 + 1 + 24 files)
2026-11-07T17:04:17Z [load_day 2023-03-13] 2023-03-13: 4583601 events in 24 hours
2026-11-07T17:04:17Z [load_day 2023-03-13] attempt 1 succeeded