orcaLog in

Runs · run 1020

load_day 2023-04-22, attempt 1 succeeded

Host
caf251265124:295816
Started
2026-11-07T19:03:08Z
Ended
2026-11-07T19:05:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1020/load_day/2023-04-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:03:08Z [load_day 2023-04-22] attempt 1 started
2026-11-07T19:03:10Z [load_day 2023-04-22] 2023-04-22: 2 hours in flight, about 1200 MB
2026-11-07T19:03:21Z [load_day 2023-04-22] 2023-04-22 hour 0: 127847 events in 3 files, snapshot 3439671073326515015 (task 9202 ms: download 1921 ms overlapping gunzip 540 ms, parse 2427 ms, sort 71 ms, write 5127 ms, index 433 ms: 4 candidates, 65580 repo-hours, 910 releases; waiting 242 ms; commit 1478 ms)
2026-11-07T19:03:23Z [load_day 2023-04-22] 2023-04-22 hour 1: 125797 events in 3 files, snapshot 5610163353588573402 (task 8657 ms: download 2423 ms overlapping gunzip 467 ms, parse 2119 ms, sort 75 ms, write 4530 ms, index 487 ms: 3 candidates, 70854 repo-hours, 726 releases; waiting 654 ms; commit 1744 ms)
2026-11-07T19:03:31Z [load_day 2023-04-22] 2023-04-22 hour 2: 107749 events in 3 files, snapshot 1123170321535198126 (task 8272 ms: download 2301 ms overlapping gunzip 514 ms, parse 2031 ms, sort 65 ms, write 4550 ms, index 299 ms: 0 candidates, 46146 repo-hours, 731 releases; waiting 516 ms; commit 1607 ms)
2026-11-07T19:03:32Z [load_day 2023-04-22] 2023-04-22 hour 3: 103971 events in 3 files, snapshot 4102376624586419987 (task 8208 ms: download 2754 ms overlapping gunzip 500 ms, parse 2121 ms, sort 78 ms, write 4176 ms, index 315 ms: 3 candidates, 43068 repo-hours, 721 releases; waiting 729 ms; commit 1782 ms)
2026-11-07T19:03:40Z [load_day 2023-04-22] 2023-04-22 hour 4: 101347 events in 3 files, snapshot 349662118273943507 (task 8047 ms: download 2703 ms overlapping gunzip 447 ms, parse 1876 ms, sort 65 ms, write 4168 ms, index 289 ms: 4 candidates, 42017 repo-hours, 576 releases; waiting 930 ms; commit 1639 ms)
2026-11-07T19:03:41Z [load_day 2023-04-22] 2023-04-22 hour 5: 107515 events in 3 files, snapshot 115042851975203642 (task 8055 ms: download 2081 ms overlapping gunzip 474 ms, parse 2035 ms, sort 68 ms, write 4308 ms, index 331 ms: 1 candidates, 44940 repo-hours, 681 releases; waiting 526 ms; commit 1609 ms)
2026-11-07T19:03:49Z [load_day 2023-04-22] 2023-04-22 hour 6: 118727 events in 3 files, snapshot 4169880877524866382 (task 8394 ms: download 2202 ms overlapping gunzip 538 ms, parse 2157 ms, sort 75 ms, write 4431 ms, index 363 ms: 8 candidates, 53027 repo-hours, 646 releases; waiting 521 ms; commit 1578 ms)
2026-11-07T19:03:50Z [load_day 2023-04-22] 2023-04-22 hour 7: 115156 events in 3 files, snapshot 8131345371598143313 (task 8239 ms: download 1969 ms overlapping gunzip 477 ms, parse 2017 ms, sort 66 ms, write 4481 ms, index 339 ms: 10 candidates, 47881 repo-hours, 554 releases; waiting 380 ms; commit 1651 ms)
2026-11-07T19:03:58Z [load_day 2023-04-22] 2023-04-22 hour 8: 118965 events in 3 files, snapshot 6057154403250770281 (task 8377 ms: download 2327 ms overlapping gunzip 459 ms, parse 1994 ms, sort 71 ms, write 4616 ms, index 331 ms: 2 candidates, 51861 repo-hours, 596 releases; waiting 584 ms; commit 1746 ms)
2026-11-07T19:04:01Z [load_day 2023-04-22] 2023-04-22 hour 9: 123286 events in 3 files, snapshot 4670941506678020853 (task 8312 ms: download 2220 ms overlapping gunzip 484 ms, parse 2075 ms, sort 74 ms, write 4560 ms, index 329 ms: 2 candidates, 51770 repo-hours, 832 releases; waiting 530 ms; commit 2714 ms)
2026-11-07T19:04:07Z [load_day 2023-04-22] 2023-04-22 hour 10: 126246 events in 3 files, snapshot 5342135481066210522 (task 8318 ms: download 1903 ms overlapping gunzip 486 ms, parse 2120 ms, sort 78 ms, write 4450 ms, index 379 ms: 1 candidates, 55223 repo-hours, 732 releases; waiting 496 ms; commit 1770 ms)
2026-11-07T19:04:11Z [load_day 2023-04-22] 2023-04-22 hour 11: 124249 events in 3 files, snapshot 6491547354672475899 (task 8878 ms: download 2856 ms overlapping gunzip 479 ms, parse 2070 ms, sort 71 ms, write 4195 ms, index 346 ms: 1 candidates, 53370 repo-hours, 705 releases; waiting 1356 ms; commit 1644 ms)
2026-11-07T19:04:18Z [load_day 2023-04-22] 2023-04-22 hour 12: 192634 events in 4 files, snapshot 725930997362917031 (task 10788 ms: download 3850 ms overlapping gunzip 598 ms, parse 2746 ms, sort 111 ms, write 5723 ms, index 533 ms: 7 candidates, 83247 repo-hours, 767 releases; waiting 664 ms; commit 1580 ms)
2026-11-07T19:04:22Z [load_day 2023-04-22] 2023-04-22 hour 13: 158670 events in 4 files, snapshot 6927966907241564618 (task 10216 ms: download 3584 ms overlapping gunzip 572 ms, parse 2553 ms, sort 100 ms, write 5673 ms, index 520 ms: 3 candidates, 78726 repo-hours, 727 releases; waiting 506 ms; commit 1610 ms)
2026-11-07T19:04:29Z [load_day 2023-04-22] 2023-04-22 hour 14: 145262 events in 3 files, snapshot 2922062244069148071 (task 9754 ms: download 3788 ms overlapping gunzip 554 ms, parse 2406 ms, sort 88 ms, write 5390 ms, index 457 ms: 7 candidates, 64148 repo-hours, 747 releases; waiting 526 ms; commit 1814 ms)
2026-11-07T19:04:32Z [load_day 2023-04-22] 2023-04-22 hour 15: 145043 events in 3 files, snapshot 1098722338461613757 (task 9566 ms: download 3715 ms overlapping gunzip 613 ms, parse 2617 ms, sort 128 ms, write 5195 ms, index 473 ms: 7 candidates, 64400 repo-hours, 946 releases; waiting 272 ms; commit 1659 ms)
2026-11-07T19:04:40Z [load_day 2023-04-22] 2023-04-22 hour 16: 141654 events in 3 files, snapshot 7292356074217800596 (task 9981 ms: download 3964 ms overlapping gunzip 547 ms, parse 2409 ms, sort 88 ms, write 5394 ms, index 411 ms: 3 candidates, 62114 repo-hours, 871 releases; waiting 736 ms; commit 1606 ms)
2026-11-07T19:04:42Z [load_day 2023-04-22] 2023-04-22 hour 17: 133569 events in 3 files, snapshot 8333557711610117089 (task 8818 ms: download 3542 ms overlapping gunzip 510 ms, parse 2208 ms, sort 92 ms, write 4777 ms, index 385 ms: 3 candidates, 56978 repo-hours, 789 releases; waiting 543 ms; commit 1704 ms)
2026-11-07T19:04:50Z [load_day 2023-04-22] 2023-04-22 hour 18: 138237 events in 3 files, snapshot 8147351472810412604 (task 9118 ms: download 3658 ms overlapping gunzip 491 ms, parse 2234 ms, sort 90 ms, write 4963 ms, index 420 ms: 2 candidates, 64226 repo-hours, 843 releases; waiting 581 ms; commit 1876 ms)
2026-11-07T19:04:52Z [load_day 2023-04-22] 2023-04-22 hour 19: 125224 events in 3 files, snapshot 4101186827402405365 (task 8415 ms: download 2963 ms overlapping gunzip 469 ms, parse 2127 ms, sort 76 ms, write 4423 ms, index 352 ms: 5 candidates, 51552 repo-hours, 787 releases; waiting 712 ms; commit 1682 ms)
2026-11-07T19:04:59Z [load_day 2023-04-22] 2023-04-22 hour 20: 120224 events in 3 files, snapshot 5372976550807312268 (task 8135 ms: download 2508 ms overlapping gunzip 438 ms, parse 1977 ms, sort 68 ms, write 4391 ms, index 370 ms: 5 candidates, 51376 repo-hours, 766 releases; waiting 515 ms; commit 1603 ms)
2026-11-07T19:05:01Z [load_day 2023-04-22] 2023-04-22 hour 21: 110464 events in 3 files, snapshot 8901042367054813753 (task 7055 ms: download 2039 ms overlapping gunzip 410 ms, parse 1851 ms, sort 65 ms, write 3894 ms, index 312 ms: 3 candidates, 45938 repo-hours, 826 releases; waiting 265 ms; commit 1681 ms)
2026-11-07T19:05:07Z [load_day 2023-04-22] 2023-04-22 hour 22: 103059 events in 3 files, snapshot 3481460410472735045 (task 7169 ms: download 1922 ms overlapping gunzip 423 ms, parse 1856 ms, sort 80 ms, write 3788 ms, index 302 ms: 0 candidates, 42903 repo-hours, 797 releases; waiting 434 ms; commit 1623 ms)
2026-11-07T19:05:09Z [load_day 2023-04-22] 2023-04-22 hour 23: 94914 events in 2 files, snapshot 3759905897698915837 (task 6691 ms: download 1965 ms overlapping gunzip 364 ms, parse 1686 ms, sort 64 ms, write 3439 ms, index 331 ms: 14 candidates, 39669 repo-hours, 745 releases; waiting 509 ms; commit 1769 ms)
2026-11-07T19:05:15Z [load_day 2023-04-22] 2023-04-22: repo_hour merged from 24 files to 1 (1331014 rows, 5963 ms)
2026-11-07T19:05:16Z [load_day 2023-04-22] 2023-04-22: index committed in 7697 ms (22 + 1 + 24 files)
2026-11-07T19:05:16Z [load_day 2023-04-22] 2023-04-22: 3009809 events in 24 hours
2026-11-07T19:05:16Z [load_day 2023-04-22] attempt 1 succeeded