orcaLog in

Runs · run 1384

load_day 2023-08-12, attempt 1 succeeded

Host
3c2b29713ce8:219366
Started
2026-11-07T23:49:23Z
Ended
2026-11-07T23:52:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1384/load_day/2023-08-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:49:23Z [load_day 2023-08-12] attempt 1 started
2026-11-07T23:49:25Z [load_day 2023-08-12] 2023-08-12: 2 hours in flight, about 1200 MB
2026-11-07T23:49:40Z [load_day 2023-08-12] 2023-08-12 hour 0: 141110 events in 3 files, snapshot 7372501618145344868 (task 11594 ms: download 2619 ms overlapping gunzip 688 ms, parse 3140 ms, sort 100 ms, write 6126 ms, index 505 ms: 9 candidates, 76742 repo-hours, 917 releases; waiting 767 ms; commit 2298 ms)
2026-11-07T23:49:43Z [load_day 2023-08-12] 2023-08-12 hour 1: 128235 events in 3 files, snapshot 441632603970452672 (task 10809 ms: download 2560 ms overlapping gunzip 619 ms, parse 2791 ms, sort 127 ms, write 5819 ms, index 648 ms: 3 candidates, 71056 repo-hours, 703 releases; waiting 508 ms; commit 2493 ms)
2026-11-07T23:49:50Z [load_day 2023-08-12] 2023-08-12 hour 2: 102264 events in 3 files, snapshot 2286611616609428695 (task 8512 ms: download 2187 ms overlapping gunzip 474 ms, parse 1921 ms, sort 74 ms, write 4858 ms, index 323 ms: 0 candidates, 42238 repo-hours, 527 releases; waiting 524 ms; commit 2235 ms)
2026-11-07T23:49:52Z [load_day 2023-08-12] 2023-08-12 hour 3: 100579 events in 3 files, snapshot 1026244856709586671 (task 8494 ms: download 1977 ms overlapping gunzip 479 ms, parse 2184 ms, sort 69 ms, write 4477 ms, index 367 ms: 1 candidates, 40667 repo-hours, 730 releases; waiting 457 ms; commit 2611 ms)
2026-11-07T23:50:00Z [load_day 2023-08-12] 2023-08-12 hour 4: 100617 events in 3 files, snapshot 3901813154358399945 (task 8665 ms: download 1662 ms overlapping gunzip 531 ms, parse 2276 ms, sort 67 ms, write 4543 ms, index 425 ms: 0 candidates, 41100 repo-hours, 511 releases; waiting 523 ms; commit 2391 ms)
2026-11-07T23:50:05Z [load_day 2023-08-12] 2023-08-12 hour 5: 106232 events in 3 files, snapshot 1039526703055681151 (task 8196 ms: download 1923 ms overlapping gunzip 496 ms, parse 2131 ms, sort 68 ms, write 4346 ms, index 350 ms: 0 candidates, 43714 repo-hours, 621 releases; waiting 479 ms; commit 4989 ms)
2026-11-07T23:50:11Z [load_day 2023-08-12] 2023-08-12 hour 6: 117924 events in 3 files, snapshot 6737240729784188557 (task 10098 ms: download 1634 ms overlapping gunzip 638 ms, parse 2937 ms, sort 121 ms, write 5264 ms, index 547 ms: 1 candidates, 51256 repo-hours, 666 releases; waiting 371 ms; commit 2444 ms)
2026-11-07T23:50:14Z [load_day 2023-08-12] 2023-08-12 hour 7: 112904 events in 3 files, snapshot 3067128851989434236 (task 10333 ms: download 2276 ms overlapping gunzip 539 ms, parse 2527 ms, sort 113 ms, write 5666 ms, index 571 ms: 1 candidates, 46460 repo-hours, 601 releases; waiting 525 ms; commit 2538 ms)
2026-11-07T23:50:24Z [load_day 2023-08-12] 2023-08-12 hour 8: 118652 events in 3 files, snapshot 1187091901908949981 (task 9531 ms: download 2221 ms overlapping gunzip 461 ms, parse 2159 ms, sort 138 ms, write 5659 ms, index 351 ms: 4 candidates, 50145 repo-hours, 691 releases; waiting 492 ms; commit 4930 ms)
2026-11-07T23:50:27Z [load_day 2023-08-12] 2023-08-12 hour 9: 120351 events in 3 files, snapshot 4048118644568516447 (task 9793 ms: download 3036 ms overlapping gunzip 456 ms, parse 2056 ms, sort 67 ms, write 5239 ms, index 403 ms: 1 candidates, 50421 repo-hours, 749 releases; waiting 1048 ms; commit 2591 ms)
2026-11-07T23:50:33Z [load_day 2023-08-12] 2023-08-12 hour 10: 121071 events in 3 files, snapshot 6054743315137961042 (task 9620 ms: download 2620 ms overlapping gunzip 560 ms, parse 2583 ms, sort 82 ms, write 5160 ms, index 347 ms: 3 candidates, 50928 repo-hours, 716 releases; waiting 531 ms; commit 2576 ms)
2026-11-07T23:50:39Z [load_day 2023-08-12] 2023-08-12 hour 11: 120814 events in 3 files, snapshot 5035045914391257758 (task 9861 ms: download 1847 ms overlapping gunzip 584 ms, parse 2492 ms, sort 122 ms, write 5572 ms, index 318 ms: 4 candidates, 48132 repo-hours, 677 releases; waiting 500 ms; commit 3545 ms)
2026-11-07T23:50:47Z [load_day 2023-08-12] 2023-08-12 hour 12: 200997 events in 5 files, snapshot 8967638056326833640 (task 13054 ms: download 3712 ms overlapping gunzip 634 ms, parse 3302 ms, sort 196 ms, write 7285 ms, index 772 ms: 7 candidates, 82381 repo-hours, 731 releases; waiting 508 ms; commit 2066 ms)
2026-11-07T23:50:50Z [load_day 2023-08-12] 2023-08-12 hour 13: 151186 events in 4 files, snapshot 8391821220331676942 (task 11839 ms: download 4135 ms overlapping gunzip 579 ms, parse 2734 ms, sort 93 ms, write 6802 ms, index 854 ms: 3 candidates, 75111 repo-hours, 783 releases; waiting 497 ms; commit 2305 ms)
2026-11-07T23:50:58Z [load_day 2023-08-12] 2023-08-12 hour 14: 137342 events in 3 files, snapshot 5544395949710247778 (task 10539 ms: download 2295 ms overlapping gunzip 506 ms, parse 2253 ms, sort 134 ms, write 6358 ms, index 460 ms: 3 candidates, 58176 repo-hours, 728 releases; waiting 526 ms; commit 2229 ms)
2026-11-07T23:51:04Z [load_day 2023-08-12] 2023-08-12 hour 15: 139130 events in 3 files, snapshot 6663802401313611338 (task 11459 ms: download 3401 ms overlapping gunzip 662 ms, parse 2896 ms, sort 113 ms, write 6375 ms, index 526 ms: 5 candidates, 60580 repo-hours, 829 releases; waiting 560 ms; commit 3631 ms)
2026-11-07T23:51:11Z [load_day 2023-08-12] 2023-08-12 hour 16: 135482 events in 3 files, snapshot 7715524031125563414 (task 11203 ms: download 2264 ms overlapping gunzip 594 ms, parse 2657 ms, sort 172 ms, write 6556 ms, index 419 ms: 2 candidates, 57862 repo-hours, 731 releases; waiting 509 ms; commit 2413 ms)
2026-11-07T23:51:16Z [load_day 2023-08-12] 2023-08-12 hour 17: 129083 events in 3 files, snapshot 4224557798919229514 (task 10637 ms: download 1987 ms overlapping gunzip 713 ms, parse 3129 ms, sort 84 ms, write 5401 ms, index 543 ms: 5 candidates, 52300 repo-hours, 723 releases; waiting 466 ms; commit 3518 ms)
2026-11-07T23:51:24Z [load_day 2023-08-12] 2023-08-12 hour 18: 132230 events in 3 files, snapshot 2055313338957067912 (task 10260 ms: download 1971 ms overlapping gunzip 548 ms, parse 2455 ms, sort 205 ms, write 5780 ms, index 506 ms: 3 candidates, 58833 repo-hours, 793 releases; waiting 458 ms; commit 3808 ms)
2026-11-07T23:51:26Z [load_day 2023-08-12] 2023-08-12 hour 19: 118679 events in 3 files, snapshot 9106995228774063358 (task 10165 ms: download 2378 ms overlapping gunzip 665 ms, parse 2791 ms, sort 83 ms, write 5509 ms, index 437 ms: 3 candidates, 47939 repo-hours, 669 releases; waiting 302 ms; commit 2109 ms)
2026-11-07T23:51:34Z [load_day 2023-08-12] 2023-08-12 hour 20: 114217 events in 3 files, snapshot 2676205225655804340 (task 8926 ms: download 1716 ms overlapping gunzip 581 ms, parse 2536 ms, sort 150 ms, write 4605 ms, index 469 ms: 2 candidates, 47817 repo-hours, 692 releases; waiting 236 ms; commit 3453 ms)
2026-11-07T23:51:45Z [load_day 2023-08-12] 2023-08-12 hour 21: 102314 events in 3 files, snapshot 8004830860640995833 (task 8471 ms: download 1873 ms overlapping gunzip 463 ms, parse 2286 ms, sort 100 ms, write 4495 ms, index 358 ms: 2 candidates, 41199 repo-hours, 719 releases; waiting 463 ms; commit 11381 ms)
2026-11-07T23:51:49Z [load_day 2023-08-12] 2023-08-12 hour 22: 94945 events in 2 files, snapshot 7438477812413712009 (task 8287 ms: download 2113 ms overlapping gunzip 423 ms, parse 1955 ms, sort 88 ms, write 4696 ms, index 270 ms: 2 candidates, 36971 repo-hours, 632 releases; waiting 552 ms; commit 3680 ms)
2026-11-07T23:51:52Z [load_day 2023-08-12] 2023-08-12 hour 23: 90345 events in 2 files, snapshot 8959324448867154752 (task 7084 ms: download 1959 ms overlapping gunzip 399 ms, parse 1803 ms, sort 52 ms, write 3898 ms, index 278 ms: 1 candidates, 36398 repo-hours, 504 releases; waiting 368 ms; commit 3225 ms)
2026-11-07T23:51:58Z [load_day 2023-08-12] 2023-08-12: repo_hour merged from 24 files to 1 (1268426 rows, 5790 ms)
2026-11-07T23:52:00Z [load_day 2023-08-12] 2023-08-12: index committed in 7409 ms (21 + 1 + 24 files)
2026-11-07T23:52:00Z [load_day 2023-08-12] 2023-08-12: 2936703 events in 24 hours
2026-11-07T23:52:00Z [load_day 2023-08-12] attempt 1 succeeded