orcaLog in

Runs · run 1256

load_day 2023-07-01, attempt 1 succeeded

Host
3c2b29713ce8:77639
Started
2026-11-07T22:31:41Z
Ended
2026-11-07T22:35:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1256/load_day/2023-07-01/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:31:41Z [load_day 2023-07-01] attempt 1 started
2026-11-07T22:31:42Z [load_day 2023-07-01] 2023-07-01: 1 hours in flight, about 750 MB
2026-11-07T22:31:53Z [load_day 2023-07-01] 2023-07-01 hour 0: 113120 events in 3 files, snapshot 7413698459990828275 (task 7784 ms: download 2028 ms overlapping gunzip 526 ms, parse 2339 ms, sort 72 ms, write 3938 ms, index 355 ms: 4 candidates, 55848 repo-hours, 799 releases; waiting 239 ms; commit 1937 ms)
2026-11-07T22:32:02Z [load_day 2023-07-01] 2023-07-01 hour 1: 124418 events in 3 files, snapshot 5192391140481806222 (task 7793 ms: download 3289 ms overlapping gunzip 513 ms, parse 2216 ms, sort 71 ms, write 3769 ms, index 450 ms: 3 candidates, 71150 repo-hours, 786 releases; waiting 508 ms; commit 1878 ms)
2026-11-07T22:32:11Z [load_day 2023-07-01] 2023-07-01 hour 2: 110206 events in 3 files, snapshot 8115808623991021999 (task 8021 ms: download 2608 ms overlapping gunzip 568 ms, parse 2316 ms, sort 64 ms, write 3858 ms, index 323 ms: 2 candidates, 53706 repo-hours, 729 releases; waiting 542 ms; commit 1832 ms)
2026-11-07T22:32:19Z [load_day 2023-07-01] 2023-07-01 hour 3: 100273 events in 3 files, snapshot 9027715887995140425 (task 7030 ms: download 2061 ms overlapping gunzip 496 ms, parse 2056 ms, sort 76 ms, write 3305 ms, index 292 ms: 6 candidates, 44676 repo-hours, 737 releases; waiting 499 ms; commit 1870 ms)
2026-11-07T22:32:27Z [load_day 2023-07-01] 2023-07-01 hour 4: 99214 events in 2 files, snapshot 473264317046656421 (task 6871 ms: download 1855 ms overlapping gunzip 478 ms, parse 1989 ms, sort 59 ms, write 3276 ms, index 291 ms: 3 candidates, 43316 repo-hours, 494 releases; waiting 506 ms; commit 1745 ms)
2026-11-07T22:32:35Z [load_day 2023-07-01] 2023-07-01 hour 5: 103781 events in 3 files, snapshot 3383000858753066241 (task 6794 ms: download 1987 ms overlapping gunzip 466 ms, parse 1969 ms, sort 62 ms, write 3351 ms, index 286 ms: 7 candidates, 45644 repo-hours, 643 releases; waiting 404 ms; commit 2231 ms)
2026-11-07T22:32:43Z [load_day 2023-07-01] 2023-07-01 hour 6: 116307 events in 3 files, snapshot 4318968571119171196 (task 7685 ms: download 2897 ms overlapping gunzip 481 ms, parse 2064 ms, sort 64 ms, write 3751 ms, index 321 ms: 2 candidates, 52713 repo-hours, 656 releases; waiting 730 ms; commit 1969 ms)
2026-11-07T22:32:52Z [load_day 2023-07-01] 2023-07-01 hour 7: 114672 events in 3 files, snapshot 252060075103599222 (task 7632 ms: download 3261 ms overlapping gunzip 530 ms, parse 2182 ms, sort 61 ms, write 3841 ms, index 324 ms: 1 candidates, 48980 repo-hours, 575 releases; waiting 398 ms; commit 2052 ms)
2026-11-07T22:33:01Z [load_day 2023-07-01] 2023-07-01 hour 8: 122350 events in 3 files, snapshot 6948573474564174321 (task 8111 ms: download 3626 ms overlapping gunzip 535 ms, parse 2262 ms, sort 85 ms, write 4047 ms, index 340 ms: 3 candidates, 53337 repo-hours, 570 releases; waiting 548 ms; commit 2004 ms)
2026-11-07T22:33:09Z [load_day 2023-07-01] 2023-07-01 hour 9: 121774 events in 3 files, snapshot 8115181653032067256 (task 7648 ms: download 1952 ms overlapping gunzip 497 ms, parse 2120 ms, sort 97 ms, write 3817 ms, index 326 ms: 5 candidates, 51992 repo-hours, 761 releases; waiting 509 ms; commit 1766 ms)
2026-11-07T22:33:18Z [load_day 2023-07-01] 2023-07-01 hour 10: 122115 events in 3 files, snapshot 640830458027333411 (task 7691 ms: download 3271 ms overlapping gunzip 525 ms, parse 2226 ms, sort 69 ms, write 3783 ms, index 326 ms: 1 candidates, 52914 repo-hours, 690 releases; waiting 501 ms; commit 2089 ms)
2026-11-07T22:33:27Z [load_day 2023-07-01] 2023-07-01 hour 11: 128060 events in 3 files, snapshot 6264479408541792826 (task 8300 ms: download 3457 ms overlapping gunzip 567 ms, parse 2363 ms, sort 77 ms, write 4124 ms, index 347 ms: 3 candidates, 54793 repo-hours, 656 releases; waiting 509 ms; commit 1830 ms)
2026-11-07T22:33:37Z [load_day 2023-07-01] 2023-07-01 hour 12: 173735 events in 4 files, snapshot 2360455971216150313 (task 9095 ms: download 3471 ms overlapping gunzip 565 ms, parse 2588 ms, sort 87 ms, write 4524 ms, index 511 ms: 6 candidates, 83856 repo-hours, 777 releases; waiting 526 ms; commit 1852 ms)
2026-11-07T22:33:46Z [load_day 2023-07-01] 2023-07-01 hour 13: 153428 events in 4 files, snapshot 789248084718527385 (task 8661 ms: download 3295 ms overlapping gunzip 542 ms, parse 2394 ms, sort 79 ms, write 4321 ms, index 505 ms: 4 candidates, 80747 repo-hours, 838 releases; waiting 494 ms; commit 1830 ms)
2026-11-07T22:33:56Z [load_day 2023-07-01] 2023-07-01 hour 14: 141904 events in 3 files, snapshot 6253970653650589711 (task 8626 ms: download 3619 ms overlapping gunzip 570 ms, parse 2445 ms, sort 80 ms, write 4329 ms, index 405 ms: 5 candidates, 64602 repo-hours, 853 releases; waiting 509 ms; commit 1784 ms)
2026-11-07T22:34:05Z [load_day 2023-07-01] 2023-07-01 hour 15: 139443 events in 3 files, snapshot 9035111968558709866 (task 8450 ms: download 3515 ms overlapping gunzip 564 ms, parse 2426 ms, sort 87 ms, write 4194 ms, index 381 ms: 5 candidates, 60463 repo-hours, 901 releases; waiting 514 ms; commit 1989 ms)
2026-11-07T22:34:14Z [load_day 2023-07-01] 2023-07-01 hour 16: 136057 events in 3 files, snapshot 7688944775029603147 (task 8571 ms: download 3717 ms overlapping gunzip 558 ms, parse 2447 ms, sort 89 ms, write 4083 ms, index 386 ms: 3 candidates, 58975 repo-hours, 792 releases; waiting 673 ms; commit 1655 ms)
2026-11-07T22:34:24Z [load_day 2023-07-01] 2023-07-01 hour 17: 129166 events in 3 files, snapshot 297008943120847900 (task 8443 ms: download 3914 ms overlapping gunzip 521 ms, parse 2254 ms, sort 69 ms, write 3743 ms, index 332 ms: 7 candidates, 54275 repo-hours, 1024 releases; waiting 1169 ms; commit 1882 ms)
2026-11-07T22:34:32Z [load_day 2023-07-01] 2023-07-01 hour 18: 130294 events in 3 files, snapshot 4443087019539145918 (task 8061 ms: download 3396 ms overlapping gunzip 526 ms, parse 2303 ms, sort 88 ms, write 3960 ms, index 363 ms: 4 candidates, 58544 repo-hours, 707 releases; waiting 531 ms; commit 1694 ms)
2026-11-07T22:34:40Z [load_day 2023-07-01] 2023-07-01 hour 19: 112326 events in 3 files, snapshot 8606826557747830192 (task 6988 ms: download 2316 ms overlapping gunzip 467 ms, parse 2002 ms, sort 66 ms, write 3348 ms, index 304 ms: 3 candidates, 46998 repo-hours, 693 releases; waiting 522 ms; commit 1891 ms)
2026-11-07T22:34:48Z [load_day 2023-07-01] 2023-07-01 hour 20: 113048 events in 3 files, snapshot 2236932990264369103 (task 6928 ms: download 1926 ms overlapping gunzip 476 ms, parse 2019 ms, sort 61 ms, write 3277 ms, index 298 ms: 1 candidates, 46168 repo-hours, 625 releases; waiting 515 ms; commit 1967 ms)
2026-11-07T22:34:55Z [load_day 2023-07-01] 2023-07-01 hour 21: 97703 events in 2 files, snapshot 7793527350234154397 (task 6740 ms: download 2611 ms overlapping gunzip 424 ms, parse 1797 ms, sort 65 ms, write 3100 ms, index 276 ms: 3 candidates, 40455 repo-hours, 626 releases; waiting 724 ms; commit 1820 ms)
2026-11-07T22:35:02Z [load_day 2023-07-01] 2023-07-01 hour 22: 91737 events in 2 files, snapshot 4684366134094957722 (task 5859 ms: download 1740 ms overlapping gunzip 394 ms, parse 1689 ms, sort 60 ms, write 2697 ms, index 278 ms: 3 candidates, 38024 repo-hours, 620 releases; waiting 462 ms; commit 1854 ms)
2026-11-07T22:35:08Z [load_day 2023-07-01] 2023-07-01 hour 23: 86297 events in 2 files, snapshot 2453805733852084980 (task 5490 ms: download 1641 ms overlapping gunzip 342 ms, parse 1481 ms, sort 49 ms, write 2524 ms, index 253 ms: 1 candidates, 36357 repo-hours, 480 releases; waiting 504 ms; commit 1757 ms)
2026-11-07T22:35:14Z [load_day 2023-07-01] 2023-07-01: repo_hour merged from 24 files to 1 (1298533 rows, 5736 ms)
2026-11-07T22:35:16Z [load_day 2023-07-01] 2023-07-01: index committed in 7431 ms (24 + 1 + 24 files)
2026-11-07T22:35:16Z [load_day 2023-07-01] 2023-07-01: 2881428 events in 24 hours
2026-11-07T22:35:16Z [load_day 2023-07-01] attempt 1 succeeded