orcaLog in

Runs · run 837

load_day 2023-02-20, attempt 1 succeeded

Host
caf251265124:74262
Started
2026-11-07T15:51:00Z
Ended
2026-11-07T15:54:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/837/load_day/2023-02-20/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:51:00Z [load_day 2023-02-20] attempt 1 started
2026-11-07T15:51:02Z [load_day 2023-02-20] 2023-02-20: 2 hours in flight, about 1200 MB
2026-11-07T15:51:13Z [load_day 2023-02-20] 2023-02-20 hour 0: 123636 events in 3 files, snapshot 4974813215597948309 (task 8674 ms: download 2641 ms overlapping gunzip 494 ms, parse 2283 ms, sort 88 ms, write 4675 ms, index 389 ms: 7 candidates, 61207 repo-hours, 788 releases; waiting 474 ms; commit 1300 ms)
2026-11-07T15:51:16Z [load_day 2023-02-20] 2023-02-20 hour 1: 145245 events in 3 files, snapshot 5442719829653819376 (task 11424 ms: download 5056 ms overlapping gunzip 682 ms, parse 2897 ms, sort 88 ms, write 6125 ms, index 493 ms: 3 candidates, 74053 repo-hours, 1000 releases; waiting 784 ms; commit 1509 ms)
2026-11-07T15:51:27Z [load_day 2023-02-20] 2023-02-20 hour 2: 153061 events in 4 files, snapshot 6575525505938632929 (task 13217 ms: download 8175 ms overlapping gunzip 941 ms, parse 3703 ms, sort 98 ms, write 7308 ms, index 496 ms: 4 candidates, 67566 repo-hours, 727 releases; waiting 434 ms; commit 1426 ms)
2026-11-07T15:51:29Z [load_day 2023-02-20] 2023-02-20 hour 3: 145133 events in 3 files, snapshot 975105796178448733 (task 12499 ms: download 5711 ms overlapping gunzip 828 ms, parse 3344 ms, sort 84 ms, write 6890 ms, index 433 ms: 7 candidates, 57280 repo-hours, 900 releases; waiting 593 ms; commit 1409 ms)
2026-11-07T15:51:40Z [load_day 2023-02-20] 2023-02-20 hour 4: 135387 events in 3 files, snapshot 5883687788114652870 (task 11837 ms: download 5862 ms overlapping gunzip 796 ms, parse 3221 ms, sort 81 ms, write 6591 ms, index 340 ms: 1 candidates, 52798 repo-hours, 651 releases; waiting 516 ms; commit 1453 ms)
2026-11-07T15:51:43Z [load_day 2023-02-20] 2023-02-20 hour 5: 150326 events in 4 files, snapshot 1012756808300924365 (task 13094 ms: download 6293 ms overlapping gunzip 902 ms, parse 3733 ms, sort 90 ms, write 7085 ms, index 374 ms: 2 candidates, 59438 repo-hours, 817 releases; waiting 566 ms; commit 1401 ms)
2026-11-07T15:51:54Z [load_day 2023-02-20] 2023-02-20 hour 6: 161319 events in 4 files, snapshot 3672953777070891505 (task 13661 ms: download 6272 ms overlapping gunzip 889 ms, parse 3671 ms, sort 100 ms, write 7544 ms, index 497 ms: 6 candidates, 70194 repo-hours, 794 releases; waiting 613 ms; commit 1440 ms)
2026-11-07T15:52:00Z [load_day 2023-02-20] 2023-02-20 hour 7: 169651 events in 4 files, snapshot 7862868421247095033 (task 14468 ms: download 8836 ms overlapping gunzip 925 ms, parse 3853 ms, sort 110 ms, write 8022 ms, index 458 ms: 4 candidates, 71424 repo-hours, 839 releases; waiting 734 ms; commit 3390 ms)
2026-11-07T15:52:12Z [load_day 2023-02-20] 2023-02-20 hour 8: 187102 events in 4 files, snapshot 1570213495963431837 (task 17747 ms: download 11099 ms overlapping gunzip 1048 ms, parse 4403 ms, sort 113 ms, write 10889 ms, index 531 ms: 5 candidates, 81247 repo-hours, 985 releases; waiting 434 ms; commit 1323 ms)
2026-11-07T15:52:19Z [load_day 2023-02-20] 2023-02-20 hour 9: 196936 events in 4 files, snapshot 951877623486666388 (task 19457 ms: download 11601 ms overlapping gunzip 1125 ms, parse 4707 ms, sort 133 ms, write 11689 ms, index 1200 ms: 5 candidates, 84324 repo-hours, 1193 releases; waiting 244 ms; commit 2298 ms)
2026-11-07T15:52:32Z [load_day 2023-02-20] 2023-02-20 hour 10: 193999 events in 4 files, snapshot 2738183623169605903 (task 19578 ms: download 11706 ms overlapping gunzip 1184 ms, parse 4887 ms, sort 113 ms, write 11139 ms, index 612 ms: 8 candidates, 83942 repo-hours, 1019 releases; waiting 980 ms; commit 1316 ms)
2026-11-07T15:52:36Z [load_day 2023-02-20] 2023-02-20 hour 11: 196832 events in 4 files, snapshot 1488192724759417266 (task 16630 ms: download 9948 ms overlapping gunzip 1104 ms, parse 4574 ms, sort 130 ms, write 9592 ms, index 563 ms: 3 candidates, 81064 repo-hours, 1024 releases; waiting 375 ms; commit 1431 ms)
2026-11-07T15:52:52Z [load_day 2023-02-20] 2023-02-20 hour 12: 229447 events in 5 files, snapshot 1449107198147973473 (task 18365 ms: download 12428 ms overlapping gunzip 1212 ms, parse 5047 ms, sort 142 ms, write 10457 ms, index 667 ms: 9 candidates, 108477 repo-hours, 1027 releases; waiting 558 ms; commit 1509 ms)
2026-11-07T15:52:54Z [load_day 2023-02-20] 2023-02-20 hour 13: 218813 events in 5 files, snapshot 3668126046361299334 (task 16617 ms: download 10908 ms overlapping gunzip 1047 ms, parse 4408 ms, sort 131 ms, write 9898 ms, index 646 ms: 6 candidates, 108014 repo-hours, 1017 releases; waiting 195 ms; commit 1517 ms)
2026-11-07T15:53:11Z [load_day 2023-02-20] 2023-02-20 hour 14: 219514 events in 5 files, snapshot 5757332511768596578 (task 18980 ms: download 13109 ms overlapping gunzip 1219 ms, parse 5188 ms, sort 139 ms, write 10980 ms, index 632 ms: 9 candidates, 96229 repo-hours, 1319 releases; waiting 524 ms; commit 1326 ms)
2026-11-07T15:53:14Z [load_day 2023-02-20] 2023-02-20 hour 15: 221886 events in 5 files, snapshot 4221205447806780756 (task 19480 ms: download 13341 ms overlapping gunzip 1186 ms, parse 5005 ms, sort 141 ms, write 10913 ms, index 756 ms: 7 candidates, 100621 repo-hours, 1354 releases; waiting 1035 ms; commit 1584 ms)
2026-11-07T15:53:30Z [load_day 2023-02-20] 2023-02-20 hour 16: 208206 events in 5 files, snapshot 5099436466277922674 (task 17920 ms: download 10170 ms overlapping gunzip 1141 ms, parse 4884 ms, sort 135 ms, write 10326 ms, index 627 ms: 9 candidates, 90263 repo-hours, 1112 releases; waiting 532 ms; commit 1418 ms)
2026-11-07T15:53:32Z [load_day 2023-02-20] 2023-02-20 hour 17: 197861 events in 4 files, snapshot 6837811870488153424 (task 16835 ms: download 9915 ms overlapping gunzip 1049 ms, parse 4516 ms, sort 127 ms, write 9696 ms, index 586 ms: 4 candidates, 82714 repo-hours, 924 releases; waiting 551 ms; commit 1384 ms)
2026-11-07T15:53:49Z [load_day 2023-02-20] 2023-02-20 hour 18: 205729 events in 5 files, snapshot 5523898566791036151 (task 18466 ms: download 11340 ms overlapping gunzip 1020 ms, parse 4304 ms, sort 127 ms, write 9010 ms, index 613 ms: 6 candidates, 100860 repo-hours, 947 releases; waiting 3075 ms; commit 1700 ms)
2026-11-07T15:53:51Z [load_day 2023-02-20] 2023-02-20 hour 19: 182166 events in 4 files, snapshot 6374045098054128251 (task 14789 ms: download 8646 ms overlapping gunzip 936 ms, parse 3953 ms, sort 99 ms, write 8477 ms, index 540 ms: 3 candidates, 76291 repo-hours, 994 releases; waiting 509 ms; commit 1375 ms)
2026-11-07T15:54:05Z [load_day 2023-02-20] 2023-02-20 hour 20: 179544 events in 4 files, snapshot 1091915468524463530 (task 14810 ms: download 8968 ms overlapping gunzip 964 ms, parse 4057 ms, sort 108 ms, write 8437 ms, index 481 ms: 8 candidates, 74680 repo-hours, 879 releases; waiting 469 ms; commit 1454 ms)
2026-11-07T15:54:06Z [load_day 2023-02-20] 2023-02-20 hour 21: 170098 events in 4 files, snapshot 8028793574146509035 (task 14080 ms: download 8590 ms overlapping gunzip 960 ms, parse 3928 ms, sort 101 ms, write 8157 ms, index 471 ms: 7 candidates, 67664 repo-hours, 950 releases; waiting 220 ms; commit 1388 ms)
2026-11-07T15:54:20Z [load_day 2023-02-20] 2023-02-20 hour 22: 163863 events in 4 files, snapshot 2230762307606470731 (task 14305 ms: download 9120 ms overlapping gunzip 1023 ms, parse 4071 ms, sort 95 ms, write 8032 ms, index 379 ms: 3 candidates, 62772 repo-hours, 850 releases; waiting 418 ms; commit 1515 ms)
2026-11-07T15:54:22Z [load_day 2023-02-20] 2023-02-20 hour 23: 144851 events in 3 files, snapshot 5791926382930526595 (task 12072 ms: download 5737 ms overlapping gunzip 785 ms, parse 3277 ms, sort 84 ms, write 6682 ms, index 371 ms: 5 candidates, 57854 repo-hours, 731 releases; waiting 580 ms; commit 1534 ms)
2026-11-07T15:54:29Z [load_day 2023-02-20] 2023-02-20: repo_hour merged from 24 files to 1 (1870976 rows, 7686 ms)
2026-11-07T15:54:31Z [load_day 2023-02-20] 2023-02-20: index committed in 9757 ms (24 + 1 + 24 files)
2026-11-07T15:54:31Z [load_day 2023-02-20] 2023-02-20: 4300605 events in 24 hours
2026-11-07T15:54:31Z [load_day 2023-02-20] attempt 1 succeeded