orcaLog in

Runs · run 1062

load_day 2023-05-06, attempt 1 succeeded

Host
caf251265124:341180
Started
2026-11-07T19:43:37Z
Ended
2026-11-07T19:46:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1062/load_day/2023-05-06/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:43:37Z [load_day 2023-05-06] attempt 1 started
2026-11-07T19:43:39Z [load_day 2023-05-06] 2023-05-06: 2 hours in flight, about 1200 MB
2026-11-07T19:43:52Z [load_day 2023-05-06] 2023-05-06 hour 0: 137002 events in 3 files, snapshot 4034621993820825258 (task 10244 ms: download 4669 ms overlapping gunzip 607 ms, parse 2596 ms, sort 75 ms, write 5472 ms, index 457 ms: 15 candidates, 71686 repo-hours, 928 releases; waiting 717 ms; commit 1604 ms)
2026-11-07T19:43:53Z [load_day 2023-05-06] 2023-05-06 hour 1: 145473 events in 3 files, snapshot 5423909903060667860 (task 10369 ms: download 4292 ms overlapping gunzip 584 ms, parse 2584 ms, sort 83 ms, write 5823 ms, index 504 ms: 7 candidates, 80187 repo-hours, 775 releases; waiting 489 ms; commit 1633 ms)
2026-11-07T19:44:02Z [load_day 2023-05-06] 2023-05-06 hour 2: 124743 events in 3 files, snapshot 4611008702824216165 (task 9441 ms: download 4138 ms overlapping gunzip 574 ms, parse 2293 ms, sort 77 ms, write 5321 ms, index 350 ms: 7 candidates, 54344 repo-hours, 695 releases; waiting 533 ms; commit 1668 ms)
2026-11-07T19:44:04Z [load_day 2023-05-06] 2023-05-06 hour 3: 118213 events in 3 files, snapshot 7362640712665850295 (task 8995 ms: download 2509 ms overlapping gunzip 569 ms, parse 2318 ms, sort 75 ms, write 4848 ms, index 324 ms: 5 candidates, 50476 repo-hours, 791 releases; waiting 519 ms; commit 1709 ms)
2026-11-07T19:44:11Z [load_day 2023-05-06] 2023-05-06 hour 4: 108966 events in 3 files, snapshot 420241288941151241 (task 7863 ms: download 1889 ms overlapping gunzip 489 ms, parse 2098 ms, sort 80 ms, write 4308 ms, index 302 ms: 5 candidates, 44695 repo-hours, 548 releases; waiting 292 ms; commit 1865 ms)
2026-11-07T19:44:14Z [load_day 2023-05-06] 2023-05-06 hour 5: 117144 events in 3 files, snapshot 7713922069996762186 (task 9360 ms: download 2740 ms overlapping gunzip 544 ms, parse 2340 ms, sort 70 ms, write 4699 ms, index 327 ms: 3 candidates, 49542 repo-hours, 614 releases; waiting 1104 ms; commit 2100 ms)
2026-11-07T19:44:21Z [load_day 2023-05-06] 2023-05-06 hour 6: 130410 events in 3 files, snapshot 4180452485427846503 (task 9382 ms: download 3549 ms overlapping gunzip 570 ms, parse 2414 ms, sort 78 ms, write 5316 ms, index 401 ms: 6 candidates, 59629 repo-hours, 684 releases; waiting 350 ms; commit 1739 ms)
2026-11-07T19:44:25Z [load_day 2023-05-06] 2023-05-06 hour 7: 133051 events in 3 files, snapshot 106084618787984000 (task 9742 ms: download 3919 ms overlapping gunzip 568 ms, parse 2409 ms, sort 85 ms, write 5475 ms, index 376 ms: 7 candidates, 59639 repo-hours, 621 releases; waiting 517 ms; commit 1846 ms)
2026-11-07T19:44:32Z [load_day 2023-05-06] 2023-05-06 hour 8: 135371 events in 3 files, snapshot 6854661444530190131 (task 9806 ms: download 4052 ms overlapping gunzip 597 ms, parse 2523 ms, sort 82 ms, write 5413 ms, index 407 ms: 9 candidates, 61511 repo-hours, 632 releases; waiting 507 ms; commit 1657 ms)
2026-11-07T19:44:37Z [load_day 2023-05-06] 2023-05-06 hour 9: 137541 events in 3 files, snapshot 7114617918288286769 (task 11366 ms: download 5415 ms overlapping gunzip 639 ms, parse 2671 ms, sort 75 ms, write 5436 ms, index 391 ms: 8 candidates, 61440 repo-hours, 845 releases; waiting 1837 ms; commit 1642 ms)
2026-11-07T19:44:42Z [load_day 2023-05-06] 2023-05-06 hour 10: 132949 events in 3 files, snapshot 913200936139190202 (task 9498 ms: download 3762 ms overlapping gunzip 572 ms, parse 2439 ms, sort 88 ms, write 5179 ms, index 372 ms: 12 candidates, 58680 repo-hours, 617 releases; waiting 527 ms; commit 1704 ms)
2026-11-07T19:44:48Z [load_day 2023-05-06] 2023-05-06 hour 11: 128442 events in 3 files, snapshot 191126884032584189 (task 9785 ms: download 4082 ms overlapping gunzip 577 ms, parse 2431 ms, sort 73 ms, write 5322 ms, index 382 ms: 9 candidates, 54468 repo-hours, 702 releases; waiting 713 ms; commit 1731 ms)
2026-11-07T19:44:55Z [load_day 2023-05-06] 2023-05-06 hour 12: 198670 events in 4 files, snapshot 6122133296348286829 (task 11840 ms: download 4269 ms overlapping gunzip 653 ms, parse 2988 ms, sort 111 ms, write 6674 ms, index 538 ms: 14 candidates, 85925 repo-hours, 770 releases; waiting 516 ms; commit 1575 ms)
2026-11-07T19:45:01Z [load_day 2023-05-06] 2023-05-06 hour 13: 161706 events in 4 files, snapshot 8915970560826814173 (task 11227 ms: download 4158 ms overlapping gunzip 646 ms, parse 2861 ms, sort 94 ms, write 6196 ms, index 553 ms: 9 candidates, 81790 repo-hours, 728 releases; waiting 541 ms; commit 2331 ms)
2026-11-07T19:45:07Z [load_day 2023-05-06] 2023-05-06 hour 14: 152294 events in 4 files, snapshot 1556140254955046317 (task 11172 ms: download 4362 ms overlapping gunzip 657 ms, parse 2795 ms, sort 92 ms, write 6268 ms, index 482 ms: 14 candidates, 66698 repo-hours, 736 releases; waiting 527 ms; commit 1787 ms)
2026-11-07T19:45:12Z [load_day 2023-05-06] 2023-05-06 hour 15: 150330 events in 4 files, snapshot 2171569737579433326 (task 11239 ms: download 4550 ms overlapping gunzip 650 ms, parse 2839 ms, sort 94 ms, write 6296 ms, index 466 ms: 7 candidates, 65884 repo-hours, 901 releases; waiting 616 ms; commit 1582 ms)
2026-11-07T19:45:18Z [load_day 2023-05-06] 2023-05-06 hour 16: 152130 events in 4 files, snapshot 1803368823657088231 (task 10727 ms: download 4365 ms overlapping gunzip 609 ms, parse 2648 ms, sort 102 ms, write 6070 ms, index 412 ms: 7 candidates, 63329 repo-hours, 720 releases; waiting 555 ms; commit 1743 ms)
2026-11-07T19:45:26Z [load_day 2023-05-06] 2023-05-06 hour 17: 147620 events in 3 files, snapshot 9151657723640067870 (task 11695 ms: download 5633 ms overlapping gunzip 588 ms, parse 2632 ms, sort 100 ms, write 5339 ms, index 418 ms: 7 candidates, 63260 repo-hours, 795 releases; waiting 2292 ms; commit 3125 ms)
2026-11-07T19:45:30Z [load_day 2023-05-06] 2023-05-06 hour 18: 144922 events in 3 files, snapshot 1423364545140633520 (task 11147 ms: download 3928 ms overlapping gunzip 577 ms, parse 2527 ms, sort 86 ms, write 6532 ms, index 426 ms: 8 candidates, 64026 repo-hours, 769 releases; waiting 730 ms; commit 1671 ms)
2026-11-07T19:45:40Z [load_day 2023-05-06] 2023-05-06 hour 19: 130924 events in 3 files, snapshot 5090402001511275963 (task 9261 ms: download 3832 ms overlapping gunzip 593 ms, parse 2494 ms, sort 69 ms, write 4982 ms, index 333 ms: 6 candidates, 53681 repo-hours, 730 releases; waiting 513 ms; commit 5098 ms)
2026-11-07T19:45:42Z [load_day 2023-05-06] 2023-05-06 hour 20: 125933 events in 3 files, snapshot 8505909647193850903 (task 10167 ms: download 4700 ms overlapping gunzip 581 ms, parse 2440 ms, sort 73 ms, write 5063 ms, index 357 ms: 9 candidates, 51862 repo-hours, 698 releases; waiting 1365 ms; commit 1782 ms)
2026-11-07T19:45:46Z [load_day 2023-05-06] 2023-05-06 hour 21: 114940 events in 3 files, snapshot 1510755158917431432 (task 9122 ms: download 2556 ms overlapping gunzip 531 ms, parse 2265 ms, sort 65 ms, write 4951 ms, index 298 ms: 13 candidates, 45989 repo-hours, 725 releases; waiting 648 ms; commit 1578 ms)
2026-11-07T19:45:50Z [load_day 2023-05-06] 2023-05-06 hour 22: 105172 events in 3 files, snapshot 47760719661015791 (task 7632 ms: download 2061 ms overlapping gunzip 468 ms, parse 1898 ms, sort 64 ms, write 4364 ms, index 283 ms: 6 candidates, 41263 repo-hours, 593 releases; waiting 218 ms; commit 1577 ms)
2026-11-07T19:45:54Z [load_day 2023-05-06] 2023-05-06 hour 23: 99269 events in 2 files, snapshot 2958015823963098703 (task 7164 ms: download 1702 ms overlapping gunzip 460 ms, parse 1903 ms, sort 61 ms, write 3944 ms, index 312 ms: 5 candidates, 39796 repo-hours, 581 releases; waiting 233 ms; commit 1777 ms)
2026-11-07T19:46:00Z [load_day 2023-05-06] 2023-05-06: repo_hour merged from 24 files to 1 (1429800 rows, 6086 ms)
2026-11-07T19:46:02Z [load_day 2023-05-06] 2023-05-06: index committed in 7729 ms (24 + 1 + 24 files)
2026-11-07T19:46:02Z [load_day 2023-05-06] 2023-05-06: 3233215 events in 24 hours
2026-11-07T19:46:02Z [load_day 2023-05-06] attempt 1 succeeded