orcaLog in

Runs · run 870

load_day 2023-03-03, attempt 1 succeeded

Host
caf251265124:118246
Started
2026-11-07T16:27:48Z
Ended
2026-11-07T16:31:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/870/load_day/2023-03-03/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:27:48Z [load_day 2023-03-03] attempt 1 started
2026-11-07T16:27:49Z [load_day 2023-03-03] 2023-03-03: 2 hours in flight, about 1200 MB
2026-11-07T16:28:04Z [load_day 2023-03-03] 2023-03-03 hour 0: 129809 events in 3 files, snapshot 7870682514933182412 (task 11800 ms: download 5684 ms overlapping gunzip 781 ms, parse 3296 ms, sort 81 ms, write 6339 ms, index 390 ms: 7 candidates, 54524 repo-hours, 311 releases; waiting 575 ms; commit 1591 ms)
2026-11-07T16:28:05Z [load_day 2023-03-03] 2023-03-03 hour 1: 140225 events in 3 files, snapshot 5785577049996336402 (task 12509 ms: download 5912 ms overlapping gunzip 785 ms, parse 3268 ms, sort 82 ms, write 6709 ms, index 393 ms: 2 candidates, 61022 repo-hours, 559 releases; waiting 913 ms; commit 1440 ms)
2026-11-07T16:28:17Z [load_day 2023-03-03] 2023-03-03 hour 2: 161004 events in 4 files, snapshot 7766544074102327050 (task 12229 ms: download 5331 ms overlapping gunzip 741 ms, parse 3148 ms, sort 106 ms, write 6768 ms, index 535 ms: 8 candidates, 82267 repo-hours, 923 releases; waiting 614 ms; commit 1499 ms)
2026-11-07T16:28:19Z [load_day 2023-03-03] 2023-03-03 hour 3: 156396 events in 4 files, snapshot 2250790436044019760 (task 12835 ms: download 6128 ms overlapping gunzip 733 ms, parse 3080 ms, sort 99 ms, write 6555 ms, index 484 ms: 6 candidates, 77999 repo-hours, 904 releases; waiting 1574 ms; commit 1473 ms)
2026-11-07T16:28:32Z [load_day 2023-03-03] 2023-03-03 hour 4: 138056 events in 3 files, snapshot 4145281305612114491 (task 14070 ms: download 7542 ms overlapping gunzip 812 ms, parse 3327 ms, sort 83 ms, write 6632 ms, index 413 ms: 3 candidates, 61931 repo-hours, 831 releases; waiting 2471 ms; commit 1629 ms)
2026-11-07T16:28:33Z [load_day 2023-03-03] 2023-03-03 hour 5: 145166 events in 3 files, snapshot 6897430656477425926 (task 12018 ms: download 6059 ms overlapping gunzip 789 ms, parse 3266 ms, sort 106 ms, write 6546 ms, index 445 ms: 3 candidates, 62841 repo-hours, 921 releases; waiting 570 ms; commit 1509 ms)
2026-11-07T16:28:46Z [load_day 2023-03-03] 2023-03-03 hour 6: 165072 events in 4 files, snapshot 4558674212696200554 (task 13312 ms: download 7832 ms overlapping gunzip 824 ms, parse 3473 ms, sort 101 ms, write 7499 ms, index 524 ms: 9 candidates, 75087 repo-hours, 986 releases; waiting 585 ms; commit 1553 ms)
2026-11-07T16:28:57Z [load_day 2023-03-03] 2023-03-03 hour 7: 193809 events in 4 files, snapshot 2821088480982064561 (task 21933 ms: download 10033 ms overlapping gunzip 1076 ms, parse 4865 ms, sort 126 ms, write 10198 ms, index 4650 ms: 5 candidates, 87704 repo-hours, 1036 releases; waiting 647 ms; commit 2097 ms)
2026-11-07T16:29:09Z [load_day 2023-03-03] 2023-03-03 hour 8: 186306 events in 4 files, snapshot 2651851128289850580 (task 22686 ms: download 9766 ms overlapping gunzip 1007 ms, parse 4335 ms, sort 117 ms, write 15607 ms, index 553 ms: 2 candidates, 83373 repo-hours, 1226 releases; waiting 743 ms; commit 1469 ms)
2026-11-07T16:29:14Z [load_day 2023-03-03] 2023-03-03 hour 9: 197726 events in 4 files, snapshot 134950732490277397 (task 17059 ms: download 9514 ms overlapping gunzip 1062 ms, parse 4566 ms, sort 114 ms, write 9926 ms, index 572 ms: 4 candidates, 87942 repo-hours, 1448 releases; waiting 532 ms; commit 1351 ms)
2026-11-07T16:29:26Z [load_day 2023-03-03] 2023-03-03 hour 10: 192160 events in 4 files, snapshot 4455810109865559418 (task 16160 ms: download 9256 ms overlapping gunzip 1024 ms, parse 4443 ms, sort 124 ms, write 9202 ms, index 581 ms: 6 candidates, 84737 repo-hours, 1402 releases; waiting 318 ms; commit 1211 ms)
2026-11-07T16:29:31Z [load_day 2023-03-03] 2023-03-03 hour 11: 188589 events in 4 files, snapshot 5137011912135233912 (task 15743 ms: download 8985 ms overlapping gunzip 1029 ms, parse 4240 ms, sort 109 ms, write 8964 ms, index 549 ms: 3 candidates, 83484 repo-hours, 1340 releases; waiting 523 ms; commit 1406 ms)
2026-11-07T16:29:43Z [load_day 2023-03-03] 2023-03-03 hour 12: 216343 events in 5 files, snapshot 4960704020258586177 (task 16831 ms: download 9075 ms overlapping gunzip 1081 ms, parse 4643 ms, sort 160 ms, write 9210 ms, index 644 ms: 7 candidates, 105769 repo-hours, 1248 releases; waiting 480 ms; commit 1352 ms)
2026-11-07T16:29:52Z [load_day 2023-03-03] 2023-03-03 hour 13: 215196 events in 5 files, snapshot 431391483930189038 (task 16551 ms: download 8576 ms overlapping gunzip 1028 ms, parse 4288 ms, sort 127 ms, write 9926 ms, index 640 ms: 5 candidates, 110076 repo-hours, 1247 releases; waiting 229 ms; commit 5025 ms)
2026-11-07T16:30:02Z [load_day 2023-03-03] 2023-03-03 hour 14: 218020 events in 5 files, snapshot 7962845598727806795 (task 17825 ms: download 12006 ms overlapping gunzip 1081 ms, parse 4640 ms, sort 139 ms, write 10445 ms, index 659 ms: 4 candidates, 103897 repo-hours, 1355 releases; waiting 587 ms; commit 1407 ms)
2026-11-07T16:30:10Z [load_day 2023-03-03] 2023-03-03 hour 15: 217679 events in 5 files, snapshot 1194594532766661984 (task 17427 ms: download 9352 ms overlapping gunzip 1058 ms, parse 4537 ms, sort 151 ms, write 10132 ms, index 726 ms: 5 candidates, 110301 repo-hours, 1567 releases; waiting 540 ms; commit 1492 ms)
2026-11-07T16:30:20Z [load_day 2023-03-03] 2023-03-03 hour 16: 198423 events in 4 files, snapshot 6553365114282166043 (task 17212 ms: download 9786 ms overlapping gunzip 1046 ms, parse 4471 ms, sort 119 ms, write 9992 ms, index 576 ms: 8 candidates, 89252 repo-hours, 1214 releases; waiting 680 ms; commit 1383 ms)
2026-11-07T16:30:29Z [load_day 2023-03-03] 2023-03-03 hour 17: 191594 events in 4 files, snapshot 4074158604110413219 (task 18840 ms: download 11759 ms overlapping gunzip 1059 ms, parse 4419 ms, sort 130 ms, write 9373 ms, index 553 ms: 5 candidates, 84476 repo-hours, 1349 releases; waiting 2930 ms; commit 1324 ms)
2026-11-07T16:30:36Z [load_day 2023-03-03] 2023-03-03 hour 18: 184549 events in 4 files, snapshot 6850439871730862848 (task 15385 ms: download 8654 ms overlapping gunzip 926 ms, parse 3990 ms, sort 124 ms, write 8740 ms, index 652 ms: 5 candidates, 82657 repo-hours, 1359 releases; waiting 620 ms; commit 1482 ms)
2026-11-07T16:30:44Z [load_day 2023-03-03] 2023-03-03 hour 19: 170300 events in 4 files, snapshot 3205536762860792004 (task 14209 ms: download 8306 ms overlapping gunzip 858 ms, parse 3700 ms, sort 111 ms, write 8014 ms, index 614 ms: 2 candidates, 72498 repo-hours, 1229 releases; waiting 594 ms; commit 1853 ms)
2026-11-07T16:30:51Z [load_day 2023-03-03] 2023-03-03 hour 20: 171013 events in 4 files, snapshot 4266169773157842805 (task 14051 ms: download 8251 ms overlapping gunzip 889 ms, parse 3690 ms, sort 108 ms, write 7843 ms, index 501 ms: 6 candidates, 74139 repo-hours, 1229 releases; waiting 645 ms; commit 1357 ms)
2026-11-07T16:30:59Z [load_day 2023-03-03] 2023-03-03 hour 21: 169549 events in 4 files, snapshot 5917280999326869858 (task 12861 ms: download 7032 ms overlapping gunzip 776 ms, parse 3358 ms, sort 111 ms, write 7354 ms, index 503 ms: 4 candidates, 82944 repo-hours, 1154 releases; waiting 378 ms; commit 1673 ms)
2026-11-07T16:31:04Z [load_day 2023-03-03] 2023-03-03 hour 22: 147148 events in 3 files, snapshot 2630837306879954401 (task 11907 ms: download 5182 ms overlapping gunzip 702 ms, parse 3003 ms, sort 104 ms, write 6480 ms, index 426 ms: 3 candidates, 62687 repo-hours, 1194 releases; waiting 879 ms; commit 1521 ms)
2026-11-07T16:31:13Z [load_day 2023-03-03] 2023-03-03 hour 23: 158562 events in 4 files, snapshot 5777472028288303462 (task 13101 ms: download 6024 ms overlapping gunzip 844 ms, parse 3471 ms, sort 98 ms, write 7123 ms, index 475 ms: 3 candidates, 77318 repo-hours, 1030 releases; waiting 760 ms; commit 1582 ms)
2026-11-07T16:31:21Z [load_day 2023-03-03] 2023-03-03: repo_hour merged from 24 files to 1 (1958925 rows, 7944 ms)
2026-11-07T16:31:23Z [load_day 2023-03-03] 2023-03-03: index committed in 9794 ms (24 + 1 + 24 files)
2026-11-07T16:31:23Z [load_day 2023-03-03] 2023-03-03: 4252694 events in 24 hours
2026-11-07T16:31:23Z [load_day 2023-03-03] attempt 1 succeeded