orcaLog in

Runs · run 732

load_day 2023-01-16, attempt 1 succeeded

Host
d3d1748bf284:8389
Started
2026-11-07T13:45:41Z
Ended
2026-11-07T13:49:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/732/load_day/2023-01-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:45:41Z [load_day 2023-01-16] attempt 1 started
2026-11-07T13:45:42Z [load_day 2023-01-16] 2023-01-16: 2 hours in flight, about 1200 MB
2026-11-07T13:45:55Z [load_day 2023-01-16] 2023-01-16 hour 0: 136935 events in 3 files, snapshot 1598007787368225057 (task 10258 ms: download 4703 ms overlapping gunzip 671 ms, parse 2829 ms, sort 73 ms, write 5471 ms, index 400 ms: 8 candidates, 63137 repo-hours, 804 releases; waiting 519 ms; commit 1319 ms)
2026-11-07T13:45:57Z [load_day 2023-01-16] 2023-01-16 hour 1: 147621 events in 3 files, snapshot 180322234389327049 (task 12836 ms: download 8105 ms overlapping gunzip 892 ms, parse 3568 ms, sort 95 ms, write 6886 ms, index 532 ms: 3 candidates, 70218 repo-hours, 666 releases; waiting 524 ms; commit 1230 ms)
2026-11-07T13:46:11Z [load_day 2023-01-16] 2023-01-16 hour 2: 150578 events in 4 files, snapshot 1956187859757855059 (task 15519 ms: download 10849 ms overlapping gunzip 1083 ms, parse 4074 ms, sort 86 ms, write 8924 ms, index 370 ms: 8 candidates, 59621 repo-hours, 646 releases; waiting 666 ms; commit 1259 ms)
2026-11-07T13:46:13Z [load_day 2023-01-16] 2023-01-16 hour 3: 146925 events in 3 files, snapshot 5699938003454837852 (task 12359 ms: download 6272 ms overlapping gunzip 891 ms, parse 3470 ms, sort 87 ms, write 6725 ms, index 314 ms: 1 candidates, 50039 repo-hours, 728 releases; waiting 571 ms; commit 1287 ms)
2026-11-07T13:46:27Z [load_day 2023-01-16] 2023-01-16 hour 4: 150135 events in 4 files, snapshot 8375029712539673608 (task 14382 ms: download 7783 ms overlapping gunzip 1003 ms, parse 3901 ms, sort 86 ms, write 8209 ms, index 311 ms: 7 candidates, 48708 repo-hours, 537 releases; waiting 549 ms; commit 1314 ms)
2026-11-07T13:46:28Z [load_day 2023-01-16] 2023-01-16 hour 5: 146399 events in 3 files, snapshot 6184996511903797541 (task 12094 ms: download 6066 ms overlapping gunzip 855 ms, parse 3400 ms, sort 97 ms, write 6847 ms, index 351 ms: 1 candidates, 51228 repo-hours, 643 releases; waiting 190 ms; commit 1194 ms)
2026-11-07T13:46:41Z [load_day 2023-01-16] 2023-01-16 hour 6: 159580 events in 4 files, snapshot 74976121164576739 (task 13548 ms: download 6744 ms overlapping gunzip 943 ms, parse 3804 ms, sort 108 ms, write 7378 ms, index 394 ms: 6 candidates, 62269 repo-hours, 757 releases; waiting 572 ms; commit 1317 ms)
2026-11-07T13:46:43Z [load_day 2023-01-16] 2023-01-16 hour 7: 172021 events in 4 files, snapshot 3646079487250656140 (task 13915 ms: download 8816 ms overlapping gunzip 971 ms, parse 3885 ms, sort 91 ms, write 7791 ms, index 396 ms: 4 candidates, 64022 repo-hours, 731 releases; waiting 523 ms; commit 1475 ms)
2026-11-07T13:46:58Z [load_day 2023-01-16] 2023-01-16 hour 8: 185426 events in 4 files, snapshot 7596916524835622041 (task 16709 ms: download 10486 ms overlapping gunzip 1113 ms, parse 4519 ms, sort 104 ms, write 9631 ms, index 469 ms: 5 candidates, 72820 repo-hours, 882 releases; waiting 521 ms; commit 1376 ms)
2026-11-07T13:47:01Z [load_day 2023-01-16] 2023-01-16 hour 9: 198351 events in 4 files, snapshot 4199737310319848735 (task 17565 ms: download 10452 ms overlapping gunzip 1207 ms, parse 4867 ms, sort 114 ms, write 10123 ms, index 489 ms: 6 candidates, 78167 repo-hours, 1067 releases; waiting 311 ms; commit 1241 ms)
2026-11-07T13:47:19Z [load_day 2023-01-16] 2023-01-16 hour 10: 197878 events in 4 files, snapshot 8470043643668996019 (task 19512 ms: download 12231 ms overlapping gunzip 1224 ms, parse 5003 ms, sort 134 ms, write 10532 ms, index 505 ms: 6 candidates, 77180 repo-hours, 915 releases; waiting 1649 ms; commit 1295 ms)
2026-11-07T13:47:20Z [load_day 2023-01-16] 2023-01-16 hour 11: 190200 events in 4 files, snapshot 5406722460465991476 (task 17558 ms: download 11012 ms overlapping gunzip 1181 ms, parse 4747 ms, sort 105 ms, write 9792 ms, index 477 ms: 2 candidates, 75133 repo-hours, 915 releases; waiting 937 ms; commit 1252 ms)
2026-11-07T13:47:38Z [load_day 2023-01-16] 2023-01-16 hour 12: 210755 events in 5 files, snapshot 4265130720602416239 (task 18163 ms: download 10732 ms overlapping gunzip 1120 ms, parse 4674 ms, sort 117 ms, write 10129 ms, index 693 ms: 3 candidates, 98973 repo-hours, 962 releases; waiting 1116 ms; commit 1452 ms)
2026-11-07T13:47:39Z [load_day 2023-01-16] 2023-01-16 hour 13: 210393 events in 5 files, snapshot 8078806424016266607 (task 17735 ms: download 10451 ms overlapping gunzip 1187 ms, parse 4840 ms, sort 127 ms, write 10169 ms, index 573 ms: 9 candidates, 94806 repo-hours, 942 releases; waiting 528 ms; commit 1290 ms)
2026-11-07T13:47:56Z [load_day 2023-01-16] 2023-01-16 hour 14: 196780 events in 4 files, snapshot 7365816779135342219 (task 17672 ms: download 10582 ms overlapping gunzip 1132 ms, parse 4689 ms, sort 116 ms, write 10106 ms, index 562 ms: 5 candidates, 84204 repo-hours, 1244 releases; waiting 670 ms; commit 1236 ms)
2026-11-07T13:47:57Z [load_day 2023-01-16] 2023-01-16 hour 15: 191774 events in 4 files, snapshot 4257671088926767325 (task 16025 ms: download 8807 ms overlapping gunzip 1010 ms, parse 4245 ms, sort 116 ms, write 9308 ms, index 551 ms: 2 candidates, 84601 repo-hours, 1212 releases; waiting 213 ms; commit 1431 ms)
2026-11-07T13:48:15Z [load_day 2023-01-16] 2023-01-16 hour 16: 199491 events in 4 files, snapshot 2706861715117052761 (task 17600 ms: download 11123 ms overlapping gunzip 1135 ms, parse 4640 ms, sort 109 ms, write 10152 ms, index 544 ms: 5 candidates, 83891 repo-hours, 946 releases; waiting 683 ms; commit 2073 ms)
2026-11-07T13:48:16Z [load_day 2023-01-16] 2023-01-16 hour 17: 184478 events in 4 files, snapshot 4592126508346503220 (task 15262 ms: download 9371 ms overlapping gunzip 1039 ms, parse 4370 ms, sort 85 ms, write 8363 ms, index 509 ms: 2 candidates, 77090 repo-hours, 829 releases; waiting 596 ms; commit 1254 ms)
2026-11-07T13:48:32Z [load_day 2023-01-16] 2023-01-16 hour 18: 192158 events in 4 files, snapshot 4607743059354646083 (task 15666 ms: download 9561 ms overlapping gunzip 1006 ms, parse 4187 ms, sort 98 ms, write 8936 ms, index 525 ms: 6 candidates, 78216 repo-hours, 960 releases; waiting 540 ms; commit 1429 ms)
2026-11-07T13:48:33Z [load_day 2023-01-16] 2023-01-16 hour 19: 188556 events in 4 files, snapshot 7042151961115776586 (task 15203 ms: download 9366 ms overlapping gunzip 1034 ms, parse 4234 ms, sort 102 ms, write 8548 ms, index 467 ms: 6 candidates, 71365 repo-hours, 798 releases; waiting 509 ms; commit 1446 ms)
2026-11-07T13:48:47Z [load_day 2023-01-16] 2023-01-16 hour 20: 185012 events in 4 files, snapshot 2943490540595003383 (task 15031 ms: download 9372 ms overlapping gunzip 998 ms, parse 4070 ms, sort 84 ms, write 8488 ms, index 514 ms: 13 candidates, 68948 repo-hours, 883 releases; waiting 519 ms; commit 1098 ms)
2026-11-07T13:48:51Z [load_day 2023-01-16] 2023-01-16 hour 21: 187493 events in 4 files, snapshot 464745114556728989 (task 16381 ms: download 10171 ms overlapping gunzip 1243 ms, parse 4722 ms, sort 113 ms, write 9045 ms, index 445 ms: 7 candidates, 64912 repo-hours, 895 releases; waiting 545 ms; commit 1601 ms)
2026-11-07T13:49:02Z [load_day 2023-01-16] 2023-01-16 hour 22: 159573 events in 4 files, snapshot 796506411890134071 (task 13682 ms: download 6671 ms overlapping gunzip 892 ms, parse 3579 ms, sort 88 ms, write 7552 ms, index 401 ms: 2 candidates, 57579 repo-hours, 880 releases; waiting 805 ms; commit 1243 ms)
2026-11-07T13:49:03Z [load_day 2023-01-16] 2023-01-16 hour 23: 150327 events in 4 files, snapshot 5912404770563568999 (task 12170 ms: download 5883 ms overlapping gunzip 856 ms, parse 3440 ms, sort 91 ms, write 6968 ms, index 345 ms: 7 candidates, 54369 repo-hours, 704 releases; waiting 237 ms; commit 1115 ms)
2026-11-07T13:49:10Z [load_day 2023-01-16] 2023-01-16: repo_hour merged from 24 files to 1 (1691496 rows, 7317 ms)
2026-11-07T13:49:12Z [load_day 2023-01-16] 2023-01-16: index committed in 9267 ms (24 + 1 + 24 files)
2026-11-07T13:49:12Z [load_day 2023-01-16] 2023-01-16: 4238839 events in 24 hours
2026-11-07T13:49:12Z [load_day 2023-01-16] attempt 1 succeeded