orcaLog in

Runs · run 879

load_day 2023-03-06, attempt 1 succeeded

Host
caf251265124:127712
Started
2026-11-07T16:36:21Z
Ended
2026-11-07T16:40:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/879/load_day/2023-03-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:36:21Z [load_day 2023-03-06] attempt 1 started
2026-11-07T16:36:23Z [load_day 2023-03-06] 2023-03-06: 2 hours in flight, about 1200 MB
2026-11-07T16:36:36Z [load_day 2023-03-06] 2023-03-06 hour 0: 139228 events in 3 files, snapshot 2592883739744952445 (task 10443 ms: download 4974 ms overlapping gunzip 600 ms, parse 2671 ms, sort 84 ms, write 5033 ms, index 436 ms: 5 candidates, 68943 repo-hours, 1131 releases; waiting 1281 ms; commit 1654 ms)
2026-11-07T16:36:38Z [load_day 2023-03-06] 2023-03-06 hour 1: 162807 events in 4 files, snapshot 3169440668804546852 (task 12449 ms: download 5180 ms overlapping gunzip 799 ms, parse 3281 ms, sort 103 ms, write 6805 ms, index 559 ms: 5 candidates, 80660 repo-hours, 1100 releases; waiting 556 ms; commit 1277 ms)
2026-11-07T16:36:52Z [load_day 2023-03-06] 2023-03-06 hour 2: 168331 events in 4 files, snapshot 1988619282833537462 (task 15732 ms: download 10241 ms overlapping gunzip 955 ms, parse 3879 ms, sort 112 ms, write 8050 ms, index 474 ms: 6 candidates, 74213 repo-hours, 984 releases; waiting 1802 ms; commit 1610 ms)
2026-11-07T16:36:54Z [load_day 2023-03-06] 2023-03-06 hour 3: 152128 events in 4 files, snapshot 1441919734442472901 (task 12074 ms: download 5407 ms overlapping gunzip 787 ms, parse 3191 ms, sort 104 ms, write 7080 ms, index 402 ms: 4 candidates, 60842 repo-hours, 1121 releases; waiting 219 ms; commit 1408 ms)
2026-11-07T16:37:05Z [load_day 2023-03-06] 2023-03-06 hour 4: 148544 events in 3 files, snapshot 4906819531188563625 (task 12601 ms: download 5983 ms overlapping gunzip 859 ms, parse 3490 ms, sort 102 ms, write 7201 ms, index 366 ms: 5 candidates, 56212 repo-hours, 878 releases; waiting 297 ms; commit 1337 ms)
2026-11-07T16:37:09Z [load_day 2023-03-06] 2023-03-06 hour 5: 164126 events in 4 files, snapshot 5627163272387305808 (task 14614 ms: download 9455 ms overlapping gunzip 984 ms, parse 4016 ms, sort 125 ms, write 8217 ms, index 405 ms: 3 candidates, 62369 repo-hours, 1032 releases; waiting 532 ms; commit 1465 ms)
2026-11-07T16:37:21Z [load_day 2023-03-06] 2023-03-06 hour 6: 174847 events in 4 files, snapshot 4267508834690542126 (task 14393 ms: download 8685 ms overlapping gunzip 1002 ms, parse 4168 ms, sort 123 ms, write 8004 ms, index 504 ms: 5 candidates, 73661 repo-hours, 1070 releases; waiting 236 ms; commit 1434 ms)
2026-11-07T16:37:29Z [load_day 2023-03-06] 2023-03-06 hour 7: 180006 events in 4 files, snapshot 7652750820312532846 (task 18891 ms: download 12522 ms overlapping gunzip 1112 ms, parse 4604 ms, sort 120 ms, write 8587 ms, index 518 ms: 8 candidates, 74901 repo-hours, 1005 releases; waiting 3671 ms; commit 1529 ms)
2026-11-07T16:37:40Z [load_day 2023-03-06] 2023-03-06 hour 8: 194265 events in 4 files, snapshot 6231628793339651571 (task 18838 ms: download 9883 ms overlapping gunzip 1124 ms, parse 4711 ms, sort 127 ms, write 11714 ms, index 547 ms: 6 candidates, 83663 repo-hours, 912 releases; waiting 260 ms; commit 1454 ms)
2026-11-07T16:37:49Z [load_day 2023-03-06] 2023-03-06 hour 9: 209517 events in 5 files, snapshot 8160148816547767784 (task 19048 ms: download 13505 ms overlapping gunzip 1199 ms, parse 5026 ms, sort 128 ms, write 11366 ms, index 563 ms: 6 candidates, 87296 repo-hours, 1027 releases; waiting 534 ms; commit 1495 ms)
2026-11-07T16:38:03Z [load_day 2023-03-06] 2023-03-06 hour 10: 211003 events in 5 files, snapshot 1055832714100832438 (task 21975 ms: download 13065 ms overlapping gunzip 1212 ms, parse 4995 ms, sort 129 ms, write 14086 ms, index 650 ms: 15 candidates, 91884 repo-hours, 1023 releases; waiting 576 ms; commit 1555 ms)
2026-11-07T16:38:07Z [load_day 2023-03-06] 2023-03-06 hour 11: 225754 events in 5 files, snapshot 7236282585874069872 (task 17258 ms: download 11171 ms overlapping gunzip 1070 ms, parse 4443 ms, sort 150 ms, write 10086 ms, index 699 ms: 5 candidates, 119306 repo-hours, 899 releases; waiting 522 ms; commit 1274 ms)
2026-11-07T16:38:26Z [load_day 2023-03-06] 2023-03-06 hour 12: 240899 events in 5 files, snapshot 1575848781750286661 (task 21427 ms: download 14772 ms overlapping gunzip 1308 ms, parse 5486 ms, sort 146 ms, write 11193 ms, index 710 ms: 5 candidates, 114838 repo-hours, 1105 releases; waiting 2270 ms; commit 1619 ms)
2026-11-07T16:38:32Z [load_day 2023-03-06] 2023-03-06 hour 13: 236596 events in 5 files, snapshot 8634448245557341179 (task 24660 ms: download 17804 ms overlapping gunzip 1334 ms, parse 5494 ms, sort 144 ms, write 11649 ms, index 689 ms: 3 candidates, 110702 repo-hours, 1085 releases; waiting 5035 ms; commit 1378 ms)
2026-11-07T16:38:53Z [load_day 2023-03-06] 2023-03-06 hour 14: 242833 events in 5 files, snapshot 6196848123951706448 (task 26427 ms: download 19238 ms overlapping gunzip 1527 ms, parse 6242 ms, sort 165 ms, write 12612 ms, index 692 ms: 4 candidates, 104054 repo-hours, 1124 releases; waiting 4906 ms; commit 1597 ms)
2026-11-07T16:38:54Z [load_day 2023-03-06] 2023-03-06 hour 15: 232392 events in 5 files, snapshot 4961484810862420283 (task 21128 ms: download 14145 ms overlapping gunzip 1330 ms, parse 5517 ms, sort 150 ms, write 12469 ms, index 705 ms: 3 candidates, 102675 repo-hours, 1247 releases; waiting 592 ms; commit 1370 ms)
2026-11-07T16:39:14Z [load_day 2023-03-06] 2023-03-06 hour 16: 225248 events in 5 files, snapshot 1714998203497015884 (task 20846 ms: download 14379 ms overlapping gunzip 1317 ms, parse 5601 ms, sort 139 ms, write 12244 ms, index 648 ms: 2 candidates, 98013 repo-hours, 974 releases; waiting 536 ms; commit 1483 ms)
2026-11-07T16:39:16Z [load_day 2023-03-06] 2023-03-06 hour 17: 213821 events in 5 files, snapshot 8999303122575566069 (task 19334 ms: download 13586 ms overlapping gunzip 1250 ms, parse 5086 ms, sort 149 ms, write 11393 ms, index 625 ms: 6 candidates, 88841 repo-hours, 960 releases; waiting 539 ms; commit 1712 ms)
2026-11-07T16:39:34Z [load_day 2023-03-06] 2023-03-06 hour 18: 213538 events in 5 files, snapshot 8822186151534252962 (task 19023 ms: download 13401 ms overlapping gunzip 1249 ms, parse 5163 ms, sort 143 ms, write 10953 ms, index 669 ms: 7 candidates, 90766 repo-hours, 1063 releases; waiting 534 ms; commit 1438 ms)
2026-11-07T16:39:36Z [load_day 2023-03-06] 2023-03-06 hour 19: 199907 events in 4 files, snapshot 5765130515973053301 (task 17901 ms: download 10502 ms overlapping gunzip 1150 ms, parse 4946 ms, sort 136 ms, write 10199 ms, index 548 ms: 3 candidates, 81335 repo-hours, 907 releases; waiting 543 ms; commit 1422 ms)
2026-11-07T16:39:54Z [load_day 2023-03-06] 2023-03-06 hour 20: 200288 events in 5 files, snapshot 1305540605107344025 (task 19568 ms: download 11530 ms overlapping gunzip 1257 ms, parse 5111 ms, sort 132 ms, write 10924 ms, index 522 ms: 4 candidates, 80097 repo-hours, 860 releases; waiting 1034 ms; commit 1469 ms)
2026-11-07T16:39:56Z [load_day 2023-03-06] 2023-03-06 hour 21: 177977 events in 4 files, snapshot 7962803863322625049 (task 16049 ms: download 9483 ms overlapping gunzip 939 ms, parse 4097 ms, sort 114 ms, write 8631 ms, index 516 ms: 5 candidates, 72986 repo-hours, 1037 releases; waiting 1151 ms; commit 1241 ms)
2026-11-07T16:40:13Z [load_day 2023-03-06] 2023-03-06 hour 22: 194876 events in 4 files, snapshot 5109622665550238452 (task 18157 ms: download 11086 ms overlapping gunzip 1310 ms, parse 5192 ms, sort 152 ms, write 10463 ms, index 534 ms: 8 candidates, 82950 repo-hours, 821 releases; waiting 208 ms; commit 1549 ms)
2026-11-07T16:40:15Z [load_day 2023-03-06] 2023-03-06 hour 23: 169458 events in 4 files, snapshot 2716047542946018352 (task 16964 ms: download 11000 ms overlapping gunzip 1077 ms, parse 4488 ms, sort 103 ms, write 9588 ms, index 433 ms: 3 candidates, 66243 repo-hours, 774 releases; waiting 979 ms; commit 1328 ms)
2026-11-07T16:40:23Z [load_day 2023-03-06] 2023-03-06: repo_hour merged from 24 files to 1 (2027450 rows, 8654 ms)
2026-11-07T16:40:25Z [load_day 2023-03-06] 2023-03-06: index committed in 10853 ms (24 + 1 + 24 files)
2026-11-07T16:40:25Z [load_day 2023-03-06] 2023-03-06: 4678389 events in 24 hours
2026-11-07T16:40:25Z [load_day 2023-03-06] attempt 1 succeeded