orcaLog in

Runs · run 1083

load_day 2023-05-13, attempt 1 succeeded

Host
caf251265124:364870
Started
2026-11-07T20:04:22Z
Ended
2026-11-07T20:06:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1083/load_day/2023-05-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:04:22Z [load_day 2023-05-13] attempt 1 started
2026-11-07T20:04:23Z [load_day 2023-05-13] 2023-05-13: 2 hours in flight, about 1200 MB
2026-11-07T20:04:35Z [load_day 2023-05-13] 2023-05-13 hour 0: 127159 events in 3 files, snapshot 1367774124004646622 (task 8682 ms: download 2315 ms overlapping gunzip 466 ms, parse 2210 ms, sort 71 ms, write 4566 ms, index 459 ms: 10 candidates, 70472 repo-hours, 907 releases; waiting 514 ms; commit 1566 ms)
2026-11-07T20:04:36Z [load_day 2023-05-13] 2023-05-13 hour 1: 123341 events in 3 files, snapshot 5073767367500721820 (task 8118 ms: download 1738 ms overlapping gunzip 444 ms, parse 2163 ms, sort 76 ms, write 4352 ms, index 475 ms: 11 candidates, 71542 repo-hours, 685 releases; waiting 254 ms; commit 1657 ms)
2026-11-07T20:04:42Z [load_day 2023-05-13] 2023-05-13 hour 2: 95332 events in 2 files, snapshot 1289256260795923964 (task 6633 ms: download 1667 ms overlapping gunzip 375 ms, parse 1683 ms, sort 53 ms, write 3427 ms, index 318 ms: 5 candidates, 42969 repo-hours, 568 releases; waiting 508 ms; commit 1817 ms)
2026-11-07T20:04:44Z [load_day 2023-05-13] 2023-05-13 hour 3: 95073 events in 2 files, snapshot 8764055007827527151 (task 6032 ms: download 1101 ms overlapping gunzip 341 ms, parse 1568 ms, sort 59 ms, write 3278 ms, index 284 ms: 3 candidates, 40747 repo-hours, 713 releases; waiting 218 ms; commit 1922 ms)
2026-11-07T20:04:50Z [load_day 2023-05-13] 2023-05-13 hour 4: 95571 events in 2 files, snapshot 1333977125200566250 (task 6429 ms: download 1524 ms overlapping gunzip 349 ms, parse 1593 ms, sort 65 ms, write 3314 ms, index 276 ms: 7 candidates, 39739 repo-hours, 447 releases; waiting 512 ms; commit 1784 ms)
2026-11-07T20:04:51Z [load_day 2023-05-13] 2023-05-13 hour 5: 98612 events in 2 files, snapshot 352805883294617932 (task 6483 ms: download 1667 ms overlapping gunzip 347 ms, parse 1634 ms, sort 64 ms, write 3267 ms, index 314 ms: 13 candidates, 42338 repo-hours, 597 releases; waiting 505 ms; commit 1661 ms)
2026-11-07T20:04:58Z [load_day 2023-05-13] 2023-05-13 hour 6: 110965 events in 3 files, snapshot 7873224170498937827 (task 7489 ms: download 3033 ms overlapping gunzip 406 ms, parse 1799 ms, sort 77 ms, write 3941 ms, index 330 ms: 5 candidates, 51512 repo-hours, 675 releases; waiting 676 ms; commit 1820 ms)
2026-11-07T20:05:00Z [load_day 2023-05-13] 2023-05-13 hour 7: 108032 events in 3 files, snapshot 2918737923056094035 (task 6941 ms: download 1411 ms overlapping gunzip 405 ms, parse 1828 ms, sort 74 ms, write 3821 ms, index 353 ms: 11 candidates, 47356 repo-hours, 606 releases; waiting 163 ms; commit 1845 ms)
2026-11-07T20:05:10Z [load_day 2023-05-13] 2023-05-13 hour 8: 117007 events in 3 files, snapshot 860139888579750638 (task 9396 ms: download 1946 ms overlapping gunzip 437 ms, parse 1986 ms, sort 73 ms, write 4992 ms, index 1018 ms: 5 candidates, 53456 repo-hours, 664 releases; waiting 525 ms; commit 3337 ms)
2026-11-07T20:05:12Z [load_day 2023-05-13] 2023-05-13 hour 9: 119325 events in 3 files, snapshot 5659169103725850459 (task 8830 ms: download 2423 ms overlapping gunzip 410 ms, parse 1892 ms, sort 71 ms, write 5406 ms, index 348 ms: 5 candidates, 53211 repo-hours, 772 releases; waiting 398 ms; commit 1824 ms)
2026-11-07T20:05:18Z [load_day 2023-05-13] 2023-05-13 hour 10: 121317 events in 3 files, snapshot 7952462372308749565 (task 7583 ms: download 1686 ms overlapping gunzip 400 ms, parse 1833 ms, sort 61 ms, write 4447 ms, index 357 ms: 12 candidates, 56497 repo-hours, 549 releases; waiting 215 ms; commit 1688 ms)
2026-11-07T20:05:21Z [load_day 2023-05-13] 2023-05-13 hour 11: 119964 events in 3 files, snapshot 6799050747410970662 (task 7876 ms: download 2630 ms overlapping gunzip 419 ms, parse 1943 ms, sort 64 ms, write 4239 ms, index 351 ms: 13 candidates, 52254 repo-hours, 628 releases; waiting 516 ms; commit 1945 ms)
2026-11-07T20:05:29Z [load_day 2023-05-13] 2023-05-13 hour 12: 190092 events in 4 files, snapshot 8846773204693434064 (task 10240 ms: download 3527 ms overlapping gunzip 532 ms, parse 2639 ms, sort 113 ms, write 5626 ms, index 523 ms: 10 candidates, 82821 repo-hours, 756 releases; waiting 525 ms; commit 1609 ms)
2026-11-07T20:05:31Z [load_day 2023-05-13] 2023-05-13 hour 13: 153189 events in 4 files, snapshot 7937304881724600277 (task 9129 ms: download 3069 ms overlapping gunzip 487 ms, parse 2304 ms, sort 91 ms, write 4917 ms, index 504 ms: 8 candidates, 80981 repo-hours, 748 releases; waiting 500 ms; commit 1689 ms)
2026-11-07T20:05:39Z [load_day 2023-05-13] 2023-05-13 hour 14: 142073 events in 3 files, snapshot 361857044703279162 (task 9093 ms: download 3560 ms overlapping gunzip 522 ms, parse 2324 ms, sort 85 ms, write 5021 ms, index 424 ms: 13 candidates, 64543 repo-hours, 816 releases; waiting 491 ms; commit 1741 ms)
2026-11-07T20:05:41Z [load_day 2023-05-13] 2023-05-13 hour 15: 141601 events in 3 files, snapshot 6915341262623870571 (task 9573 ms: download 4022 ms overlapping gunzip 506 ms, parse 2294 ms, sort 84 ms, write 4908 ms, index 425 ms: 3 candidates, 64390 repo-hours, 902 releases; waiting 1098 ms; commit 1957 ms)
2026-11-07T20:05:49Z [load_day 2023-05-13] 2023-05-13 hour 16: 135843 events in 3 files, snapshot 3937307366788196977 (task 9159 ms: download 3725 ms overlapping gunzip 511 ms, parse 2264 ms, sort 90 ms, write 5025 ms, index 424 ms: 10 candidates, 62072 repo-hours, 708 releases; waiting 579 ms; commit 1667 ms)
2026-11-07T20:05:51Z [load_day 2023-05-13] 2023-05-13 hour 17: 138686 events in 3 files, snapshot 3554533943758351155 (task 8153 ms: download 1648 ms overlapping gunzip 476 ms, parse 2128 ms, sort 81 ms, write 4479 ms, index 428 ms: 6 candidates, 65456 repo-hours, 648 releases; waiting 241 ms; commit 1818 ms)
2026-11-07T20:05:58Z [load_day 2023-05-13] 2023-05-13 hour 18: 137724 events in 3 files, snapshot 4652016785993598241 (task 8379 ms: download 2234 ms overlapping gunzip 453 ms, parse 2100 ms, sort 83 ms, write 4466 ms, index 445 ms: 8 candidates, 67082 repo-hours, 803 releases; waiting 512 ms; commit 1785 ms)
2026-11-07T20:06:00Z [load_day 2023-05-13] 2023-05-13 hour 19: 133176 events in 3 files, snapshot 2425816428859124735 (task 8034 ms: download 2261 ms overlapping gunzip 412 ms, parse 1933 ms, sort 89 ms, write 4243 ms, index 459 ms: 8 candidates, 67766 repo-hours, 690 releases; waiting 494 ms; commit 1921 ms)
2026-11-07T20:06:07Z [load_day 2023-05-13] 2023-05-13 hour 20: 122789 events in 3 files, snapshot 1794335962931975181 (task 7589 ms: download 2271 ms overlapping gunzip 450 ms, parse 1995 ms, sort 93 ms, write 3867 ms, index 394 ms: 13 candidates, 59022 repo-hours, 663 releases; waiting 500 ms; commit 2153 ms)
2026-11-07T20:06:09Z [load_day 2023-05-13] 2023-05-13 hour 21: 101614 events in 3 files, snapshot 6434544182793186995 (task 6418 ms: download 1720 ms overlapping gunzip 353 ms, parse 1607 ms, sort 70 ms, write 3263 ms, index 294 ms: 4 candidates, 42791 repo-hours, 677 releases; waiting 509 ms; commit 1756 ms)
2026-11-07T20:06:14Z [load_day 2023-05-13] 2023-05-13 hour 22: 104290 events in 3 files, snapshot 4104802278415022780 (task 6886 ms: download 2087 ms overlapping gunzip 335 ms, parse 1569 ms, sort 65 ms, write 3131 ms, index 314 ms: 5 candidates, 51041 repo-hours, 590 releases; waiting 1177 ms; commit 1714 ms)
2026-11-07T20:06:16Z [load_day 2023-05-13] 2023-05-13 hour 23: 107382 events in 3 files, snapshot 7248967815475119698 (task 6093 ms: download 1648 ms overlapping gunzip 323 ms, parse 1600 ms, sort 80 ms, write 2898 ms, index 334 ms: 4 candidates, 58826 repo-hours, 519 releases; waiting 606 ms; commit 1658 ms)
2026-11-07T20:06:22Z [load_day 2023-05-13] 2023-05-13: repo_hour merged from 24 files to 1 (1388884 rows, 5718 ms)
2026-11-07T20:06:24Z [load_day 2023-05-13] 2023-05-13: index committed in 7839 ms (24 + 1 + 24 files)
2026-11-07T20:06:24Z [load_day 2023-05-13] 2023-05-13: 2940157 events in 24 hours
2026-11-07T20:06:24Z [load_day 2023-05-13] attempt 1 succeeded