orcaLog in

Runs · run 1140

load_day 2023-06-01, attempt 1 succeeded

Host
caf251265124:423214
Started
2026-11-07T20:56:33Z
Ended
2026-11-07T20:59:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1140/load_day/2023-06-01/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:56:33Z [load_day 2023-06-01] attempt 1 started
2026-11-07T20:56:35Z [load_day 2023-06-01] 2023-06-01: 2 hours in flight, about 1200 MB
2026-11-07T20:56:49Z [load_day 2023-06-01] 2023-06-01 hour 0: 142335 events in 3 files, snapshot 5954034860400965922 (task 11620 ms: download 5234 ms overlapping gunzip 717 ms, parse 3211 ms, sort 86 ms, write 6368 ms, index 524 ms: 5 candidates, 71229 repo-hours, 804 releases; waiting 511 ms; commit 1755 ms)
2026-11-07T20:56:51Z [load_day 2023-06-01] 2023-06-01 hour 1: 158121 events in 4 files, snapshot 2731809806219892168 (task 12750 ms: download 5535 ms overlapping gunzip 770 ms, parse 3475 ms, sort 92 ms, write 7048 ms, index 537 ms: 3 candidates, 85759 repo-hours, 942 releases; waiting 509 ms; commit 1738 ms)
2026-11-07T20:57:02Z [load_day 2023-06-01] 2023-06-01 hour 2: 149902 events in 3 files, snapshot 717820421604878833 (task 11537 ms: download 4814 ms overlapping gunzip 700 ms, parse 3063 ms, sort 82 ms, write 6377 ms, index 510 ms: 3 candidates, 78519 repo-hours, 1086 releases; waiting 457 ms; commit 1725 ms)
2026-11-07T20:57:03Z [load_day 2023-06-01] 2023-06-01 hour 3: 137607 events in 3 files, snapshot 5463618233193566421 (task 11544 ms: download 5359 ms overlapping gunzip 688 ms, parse 2935 ms, sort 81 ms, write 6230 ms, index 438 ms: 2 candidates, 61853 repo-hours, 926 releases; waiting 875 ms; commit 1710 ms)
2026-11-07T20:57:13Z [load_day 2023-06-01] 2023-06-01 hour 4: 123567 events in 3 files, snapshot 6493516079938332384 (task 10294 ms: download 4750 ms overlapping gunzip 611 ms, parse 2643 ms, sort 88 ms, write 5419 ms, index 362 ms: 5 candidates, 53434 repo-hours, 667 releases; waiting 877 ms; commit 1717 ms)
2026-11-07T20:57:16Z [load_day 2023-06-01] 2023-06-01 hour 5: 146499 events in 3 files, snapshot 8629547142269561782 (task 12034 ms: download 5257 ms overlapping gunzip 734 ms, parse 3197 ms, sort 97 ms, write 6770 ms, index 437 ms: 5 candidates, 64024 repo-hours, 905 releases; waiting 507 ms; commit 1696 ms)
2026-11-07T20:57:27Z [load_day 2023-06-01] 2023-06-01 hour 6: 168091 events in 4 files, snapshot 4648431270988508345 (task 13325 ms: download 7332 ms overlapping gunzip 801 ms, parse 3563 ms, sort 98 ms, write 7547 ms, index 551 ms: 4 candidates, 77877 repo-hours, 1174 releases; waiting 364 ms; commit 1709 ms)
2026-11-07T20:57:31Z [load_day 2023-06-01] 2023-06-01 hour 7: 166274 events in 4 files, snapshot 4084916698880814161 (task 14143 ms: download 8235 ms overlapping gunzip 841 ms, parse 3734 ms, sort 103 ms, write 8237 ms, index 512 ms: 8 candidates, 76838 repo-hours, 957 releases; waiting 497 ms; commit 1854 ms)
2026-11-07T20:57:43Z [load_day 2023-06-01] 2023-06-01 hour 8: 166586 events in 4 files, snapshot 3442928643459423390 (task 15237 ms: download 8831 ms overlapping gunzip 883 ms, parse 3841 ms, sort 99 ms, write 8782 ms, index 821 ms: 9 candidates, 79393 repo-hours, 973 releases; waiting 523 ms; commit 1857 ms)
2026-11-07T20:57:49Z [load_day 2023-06-01] 2023-06-01 hour 9: 181902 events in 4 files, snapshot 8662159864085576745 (task 17288 ms: download 9398 ms overlapping gunzip 1006 ms, parse 4400 ms, sort 121 ms, write 10342 ms, index 584 ms: 4 candidates, 83213 repo-hours, 1237 releases; waiting 530 ms; commit 1664 ms)
2026-11-07T20:58:00Z [load_day 2023-06-01] 2023-06-01 hour 10: 180274 events in 4 files, snapshot 2704086544566337907 (task 16397 ms: download 9806 ms overlapping gunzip 955 ms, parse 4269 ms, sort 104 ms, write 8854 ms, index 536 ms: 4 candidates, 81926 repo-hours, 1179 releases; waiting 1434 ms; commit 1679 ms)
2026-11-07T20:58:06Z [load_day 2023-06-01] 2023-06-01 hour 11: 179500 events in 4 files, snapshot 2537942233064300066 (task 15564 ms: download 8950 ms overlapping gunzip 956 ms, parse 4249 ms, sort 143 ms, write 8840 ms, index 511 ms: 7 candidates, 79891 repo-hours, 996 releases; waiting 517 ms; commit 1868 ms)
2026-11-07T20:58:16Z [load_day 2023-06-01] 2023-06-01 hour 12: 203414 events in 5 files, snapshot 8837789983407292101 (task 15030 ms: download 7560 ms overlapping gunzip 908 ms, parse 4031 ms, sort 118 ms, write 9079 ms, index 673 ms: 10 candidates, 104329 repo-hours, 1072 releases; waiting 32 ms; commit 1625 ms)
2026-11-07T20:58:23Z [load_day 2023-06-01] 2023-06-01 hour 13: 194371 events in 4 files, snapshot 7716765123132139509 (task 16201 ms: download 8762 ms overlapping gunzip 962 ms, parse 4343 ms, sort 121 ms, write 9296 ms, index 623 ms: 9 candidates, 100762 repo-hours, 1138 releases; waiting 504 ms; commit 1606 ms)
2026-11-07T20:58:36Z [load_day 2023-06-01] 2023-06-01 hour 14: 182619 events in 4 files, snapshot 6504962967447753515 (task 18954 ms: download 11962 ms overlapping gunzip 1070 ms, parse 4552 ms, sort 104 ms, write 9733 ms, index 602 ms: 3 candidates, 88377 repo-hours, 993 releases; waiting 2656 ms; commit 1700 ms)
2026-11-07T20:58:40Z [load_day 2023-06-01] 2023-06-01 hour 15: 173214 events in 4 files, snapshot 5653297528367586467 (task 15832 ms: download 9301 ms overlapping gunzip 968 ms, parse 4286 ms, sort 96 ms, write 9019 ms, index 661 ms: 5 candidates, 84466 repo-hours, 1020 releases; waiting 506 ms; commit 1766 ms)
2026-11-07T20:58:52Z [load_day 2023-06-01] 2023-06-01 hour 16: 177238 events in 4 files, snapshot 5595252778793422878 (task 15392 ms: download 8941 ms overlapping gunzip 925 ms, parse 4053 ms, sort 105 ms, write 8911 ms, index 550 ms: 7 candidates, 81780 repo-hours, 978 releases; waiting 504 ms; commit 1765 ms)
2026-11-07T20:58:56Z [load_day 2023-06-01] 2023-06-01 hour 17: 177424 events in 4 files, snapshot 8807833541928411944 (task 15488 ms: download 9082 ms overlapping gunzip 951 ms, parse 4289 ms, sort 108 ms, write 8805 ms, index 527 ms: 6 candidates, 79137 repo-hours, 893 releases; waiting 509 ms; commit 1647 ms)
2026-11-07T20:59:07Z [load_day 2023-06-01] 2023-06-01 hour 18: 167330 events in 4 files, snapshot 4350207845450068248 (task 14277 ms: download 8305 ms overlapping gunzip 872 ms, parse 3868 ms, sort 107 ms, write 8353 ms, index 537 ms: 15 candidates, 79488 repo-hours, 964 releases; waiting 284 ms; commit 1712 ms)
2026-11-07T20:59:11Z [load_day 2023-06-01] 2023-06-01 hour 19: 167832 events in 4 files, snapshot 1540787288599371003 (task 14373 ms: download 8609 ms overlapping gunzip 924 ms, parse 3995 ms, sort 106 ms, write 8084 ms, index 484 ms: 9 candidates, 72383 repo-hours, 932 releases; waiting 505 ms; commit 1788 ms)
2026-11-07T20:59:24Z [load_day 2023-06-01] 2023-06-01 hour 20: 165466 events in 4 files, snapshot 3863204433555661050 (task 16219 ms: download 10194 ms overlapping gunzip 987 ms, parse 4257 ms, sort 95 ms, write 8643 ms, index 498 ms: 8 candidates, 73648 repo-hours, 878 releases; waiting 1184 ms; commit 1691 ms)
2026-11-07T20:59:26Z [load_day 2023-06-01] 2023-06-01 hour 21: 154637 events in 4 files, snapshot 2320882624268276304 (task 13420 ms: download 5928 ms overlapping gunzip 825 ms, parse 3549 ms, sort 101 ms, write 7725 ms, index 456 ms: 4 candidates, 68382 repo-hours, 987 releases; waiting 530 ms; commit 1814 ms)
2026-11-07T20:59:37Z [load_day 2023-06-01] 2023-06-01 hour 22: 141318 events in 3 files, snapshot 5135405910757801797 (task 12428 ms: download 5799 ms overlapping gunzip 780 ms, parse 3322 ms, sort 85 ms, write 6885 ms, index 380 ms: 7 candidates, 58113 repo-hours, 828 releases; waiting 665 ms; commit 1520 ms)
2026-11-07T20:59:39Z [load_day 2023-06-01] 2023-06-01 hour 23: 127212 events in 3 files, snapshot 8370556123656809278 (task 10746 ms: download 4983 ms overlapping gunzip 673 ms, parse 2912 ms, sort 85 ms, write 5823 ms, index 335 ms: 0 candidates, 53671 repo-hours, 690 releases; waiting 532 ms; commit 1652 ms)
2026-11-07T20:59:46Z [load_day 2023-06-01] 2023-06-01: repo_hour merged from 24 files to 1 (1838492 rows, 7557 ms)
2026-11-07T20:59:48Z [load_day 2023-06-01] 2023-06-01: index committed in 9468 ms (23 + 1 + 24 files)
2026-11-07T20:59:48Z [load_day 2023-06-01] 2023-06-01: 3932733 events in 24 hours
2026-11-07T20:59:48Z [load_day 2023-06-01] attempt 1 succeeded