orcaLog in

Runs · run 1298

load_day 2023-07-15, attempt 1 succeeded

Host
3c2b29713ce8:127372
Started
2026-11-07T22:59:00Z
Ended
2026-11-07T23:01:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1298/load_day/2023-07-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:59:00Z [load_day 2023-07-15] attempt 1 started
2026-11-07T22:59:01Z [load_day 2023-07-15] 2023-07-15: 2 hours in flight, about 1200 MB
2026-11-07T22:59:19Z [load_day 2023-07-15] 2023-07-15 hour 0: 125412 events in 3 files, snapshot 6645392654182065690 (task 14125 ms: download 7254 ms overlapping gunzip 968 ms, parse 4183 ms, sort 94 ms, write 7559 ms, index 505 ms: 9 candidates, 56752 repo-hours, 767 releases; waiting 521 ms; commit 2094 ms)
2026-11-07T22:59:21Z [load_day 2023-07-15] 2023-07-15 hour 1: 137852 events in 3 files, snapshot 6570218608995798742 (task 15399 ms: download 7009 ms overlapping gunzip 1000 ms, parse 4561 ms, sort 186 ms, write 8245 ms, index 555 ms: 4 candidates, 70510 repo-hours, 821 releases; waiting 512 ms; commit 2119 ms)
2026-11-07T22:59:32Z [load_day 2023-07-15] 2023-07-15 hour 2: 106439 events in 3 files, snapshot 886730482719102808 (task 9827 ms: download 2516 ms overlapping gunzip 529 ms, parse 2286 ms, sort 59 ms, write 5770 ms, index 364 ms: 4 candidates, 48708 repo-hours, 541 releases; waiting 505 ms; commit 4078 ms)
2026-11-07T22:59:34Z [load_day 2023-07-15] 2023-07-15 hour 3: 99512 events in 2 files, snapshot 403319676848996058 (task 8885 ms: download 2295 ms overlapping gunzip 554 ms, parse 2368 ms, sort 56 ms, write 4788 ms, index 301 ms: 1 candidates, 40652 repo-hours, 792 releases; waiting 508 ms; commit 2166 ms)
2026-11-07T22:59:41Z [load_day 2023-07-15] 2023-07-15 hour 4: 99690 events in 2 files, snapshot 5014287329655911056 (task 9952 ms: download 2566 ms overlapping gunzip 624 ms, parse 2750 ms, sort 98 ms, write 5408 ms, index 291 ms: 0 candidates, 39914 repo-hours, 473 releases; waiting 502 ms; commit 2457 ms)
2026-11-07T22:59:45Z [load_day 2023-07-15] 2023-07-15 hour 5: 105426 events in 3 files, snapshot 4074134946621750470 (task 10323 ms: download 2644 ms overlapping gunzip 590 ms, parse 2571 ms, sort 111 ms, write 5914 ms, index 317 ms: 1 candidates, 42503 repo-hours, 603 releases; waiting 483 ms; commit 1959 ms)
2026-11-07T22:59:53Z [load_day 2023-07-15] 2023-07-15 hour 6: 115025 events in 3 files, snapshot 4390190814400932276 (task 10324 ms: download 2217 ms overlapping gunzip 604 ms, parse 2605 ms, sort 62 ms, write 5745 ms, index 418 ms: 4 candidates, 50232 repo-hours, 730 releases; waiting 505 ms; commit 2172 ms)
2026-11-07T22:59:57Z [load_day 2023-07-15] 2023-07-15 hour 7: 113941 events in 3 files, snapshot 4858676800625759107 (task 11024 ms: download 2269 ms overlapping gunzip 680 ms, parse 2841 ms, sort 73 ms, write 6169 ms, index 429 ms: 2 candidates, 46793 repo-hours, 518 releases; waiting 512 ms; commit 2160 ms)
2026-11-07T23:00:06Z [load_day 2023-07-15] 2023-07-15 hour 8: 121934 events in 3 files, snapshot 3664181407990430651 (task 11607 ms: download 2784 ms overlapping gunzip 712 ms, parse 3247 ms, sort 146 ms, write 6031 ms, index 422 ms: 2 candidates, 54536 repo-hours, 571 releases; waiting 716 ms; commit 2566 ms)
2026-11-07T23:00:12Z [load_day 2023-07-15] 2023-07-15 hour 9: 120024 events in 3 files, snapshot 8663344176672570660 (task 10929 ms: download 4565 ms overlapping gunzip 608 ms, parse 2714 ms, sort 119 ms, write 6655 ms, index 358 ms: 2 candidates, 48339 repo-hours, 723 releases; waiting 183 ms; commit 4519 ms)
2026-11-07T23:00:18Z [load_day 2023-07-15] 2023-07-15 hour 10: 118459 events in 3 files, snapshot 8954481175084428090 (task 10399 ms: download 1389 ms overlapping gunzip 756 ms, parse 3148 ms, sort 88 ms, write 5791 ms, index 381 ms: 2 candidates, 50245 repo-hours, 559 releases; waiting 20 ms; commit 3159 ms)
2026-11-07T23:00:22Z [load_day 2023-07-15] 2023-07-15 hour 11: 120443 events in 3 files, snapshot 4273516919285172030 (task 10938 ms: download 1587 ms overlapping gunzip 680 ms, parse 3131 ms, sort 101 ms, write 6439 ms, index 372 ms: 3 candidates, 49609 repo-hours, 654 releases; waiting 18 ms; commit 2739 ms)
2026-11-07T23:00:34Z [load_day 2023-07-15] 2023-07-15 hour 12: 176989 events in 4 files, snapshot 8817325905080789535 (task 13293 ms: download 5493 ms overlapping gunzip 903 ms, parse 4189 ms, sort 105 ms, write 7207 ms, index 664 ms: 4 candidates, 81200 repo-hours, 806 releases; waiting 19 ms; commit 4807 ms)
2026-11-07T23:00:38Z [load_day 2023-07-15] 2023-07-15 hour 13: 155431 events in 4 files, snapshot 2259887925729369605 (task 11944 ms: download 4360 ms overlapping gunzip 656 ms, parse 2966 ms, sort 91 ms, write 6948 ms, index 1056 ms: 5 candidates, 77646 repo-hours, 688 releases; waiting 14 ms; commit 4097 ms)
2026-11-07T23:00:47Z [load_day 2023-07-15] 2023-07-15 hour 14: 135893 events in 3 files, snapshot 6802773737285112383 (task 11327 ms: download 1341 ms overlapping gunzip 637 ms, parse 2867 ms, sort 102 ms, write 7099 ms, index 382 ms: 4 candidates, 58177 repo-hours, 652 releases; waiting 28 ms; commit 2198 ms)
2026-11-07T23:00:50Z [load_day 2023-07-15] 2023-07-15 hour 15: 138221 events in 3 files, snapshot 585164643240421068 (task 12267 ms: download 5138 ms overlapping gunzip 863 ms, parse 3795 ms, sort 131 ms, write 6818 ms, index 419 ms: 3 candidates, 61293 repo-hours, 851 releases; waiting 24 ms; commit 2247 ms)
2026-11-07T23:00:58Z [load_day 2023-07-15] 2023-07-15 hour 16: 135858 events in 3 files, snapshot 1370637334232153075 (task 10123 ms: download 1470 ms overlapping gunzip 605 ms, parse 2667 ms, sort 106 ms, write 6033 ms, index 499 ms: 5 candidates, 61298 repo-hours, 739 releases; waiting 18 ms; commit 2357 ms)
2026-11-07T23:01:01Z [load_day 2023-07-15] 2023-07-15 hour 17: 129716 events in 3 files, snapshot 8345250071255097537 (task 10219 ms: download 1005 ms overlapping gunzip 548 ms, parse 2486 ms, sort 83 ms, write 6368 ms, index 517 ms: 6 candidates, 54788 repo-hours, 712 releases; waiting 26 ms; commit 2257 ms)
2026-11-07T23:01:09Z [load_day 2023-07-15] 2023-07-15 hour 18: 128946 events in 3 files, snapshot 4082004441424797690 (task 9630 ms: download 1414 ms overlapping gunzip 562 ms, parse 2653 ms, sort 119 ms, write 5555 ms, index 518 ms: 5 candidates, 58281 repo-hours, 801 releases; waiting 34 ms; commit 2351 ms)
2026-11-07T23:01:13Z [load_day 2023-07-15] 2023-07-15 hour 19: 112394 events in 3 files, snapshot 3086354940275525393 (task 8115 ms: download 1069 ms overlapping gunzip 455 ms, parse 2113 ms, sort 71 ms, write 4920 ms, index 314 ms: 5 candidates, 45985 repo-hours, 723 releases; waiting 18 ms; commit 4212 ms)
2026-11-07T23:01:18Z [load_day 2023-07-15] 2023-07-15 hour 20: 106384 events in 3 files, snapshot 8827620855633176066 (task 8048 ms: download 858 ms overlapping gunzip 463 ms, parse 2029 ms, sort 67 ms, write 4838 ms, index 453 ms: 5 candidates, 44942 repo-hours, 679 releases; waiting 16 ms; commit 2253 ms)
2026-11-07T23:01:20Z [load_day 2023-07-15] 2023-07-15 hour 21: 98327 events in 2 files, snapshot 8748821903754299544 (task 7806 ms: download 1099 ms overlapping gunzip 427 ms, parse 2030 ms, sort 56 ms, write 4568 ms, index 494 ms: 5 candidates, 40035 repo-hours, 762 releases; waiting 26 ms; commit 2019 ms)
2026-11-07T23:01:25Z [load_day 2023-07-15] 2023-07-15 hour 22: 90157 events in 2 files, snapshot 7136577020137298312 (task 6327 ms: download 653 ms overlapping gunzip 408 ms, parse 1937 ms, sort 54 ms, write 3453 ms, index 252 ms: 11 candidates, 36767 repo-hours, 681 releases; waiting 20 ms; commit 2370 ms)
2026-11-07T23:01:31Z [load_day 2023-07-15] 2023-07-15 hour 23: 84190 events in 2 files, snapshot 2587197367920327015 (task 5827 ms: download 1641 ms overlapping gunzip 334 ms, parse 1578 ms, sort 53 ms, write 2912 ms, index 235 ms: 4 candidates, 35072 repo-hours, 530 releases; waiting 490 ms; commit 5792 ms)
2026-11-07T23:01:37Z [load_day 2023-07-15] 2023-07-15: repo_hour merged from 24 files to 1 (1254277 rows, 5498 ms)
2026-11-07T23:01:39Z [load_day 2023-07-15] 2023-07-15: index committed in 7316 ms (23 + 1 + 24 files)
2026-11-07T23:01:39Z [load_day 2023-07-15] 2023-07-15: 2876663 events in 24 hours
2026-11-07T23:01:39Z [load_day 2023-07-15] attempt 1 succeeded