orcaLog in

Runs · run 960

load_day 2023-04-02, attempt 1 succeeded

Host
caf251265124:226072
Started
2026-11-07T18:02:25Z
Ended
2026-11-07T18:04:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/960/load_day/2023-04-02/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:02:25Z [load_day 2023-04-02] attempt 1 started
2026-11-07T18:02:27Z [load_day 2023-04-02] 2023-04-02: 2 hours in flight, about 1200 MB
2026-11-07T18:02:40Z [load_day 2023-04-02] 2023-04-02 hour 0: 121060 events in 3 files, snapshot 4028572420784854970 (task 9767 ms: download 2885 ms overlapping gunzip 530 ms, parse 2380 ms, sort 77 ms, write 4543 ms, index 407 ms: 5 candidates, 61556 repo-hours, 1169 releases; waiting 1534 ms; commit 1533 ms)
2026-11-07T18:02:41Z [load_day 2023-04-02] 2023-04-02 hour 1: 124158 events in 3 files, snapshot 3830783463926261081 (task 8182 ms: download 2072 ms overlapping gunzip 418 ms, parse 2008 ms, sort 75 ms, write 4399 ms, index 503 ms: 4 candidates, 71342 repo-hours, 825 releases; waiting 506 ms; commit 1391 ms)
2026-11-07T18:02:47Z [load_day 2023-04-02] 2023-04-02 hour 2: 100314 events in 3 files, snapshot 1376125675217316179 (task 6481 ms: download 1613 ms overlapping gunzip 362 ms, parse 1590 ms, sort 67 ms, write 3426 ms, index 290 ms: 3 candidates, 44493 repo-hours, 638 releases; waiting 418 ms; commit 1470 ms)
2026-11-07T18:02:49Z [load_day 2023-04-02] 2023-04-02 hour 3: 99657 events in 2 files, snapshot 5660274686947824014 (task 6423 ms: download 1980 ms overlapping gunzip 353 ms, parse 1614 ms, sort 60 ms, write 3323 ms, index 276 ms: 4 candidates, 41862 repo-hours, 724 releases; waiting 433 ms; commit 1698 ms)
2026-11-07T18:02:55Z [load_day 2023-04-02] 2023-04-02 hour 4: 98711 events in 2 files, snapshot 7091674202941806483 (task 6833 ms: download 2109 ms overlapping gunzip 385 ms, parse 1747 ms, sort 76 ms, write 3397 ms, index 344 ms: 1 candidates, 41832 repo-hours, 528 releases; waiting 515 ms; commit 1592 ms)
2026-11-07T18:02:56Z [load_day 2023-04-02] 2023-04-02 hour 5: 102411 events in 3 files, snapshot 6406989992688278412 (task 6710 ms: download 2320 ms overlapping gunzip 365 ms, parse 1634 ms, sort 57 ms, write 3482 ms, index 313 ms: 0 candidates, 43895 repo-hours, 673 releases; waiting 574 ms; commit 1623 ms)
2026-11-07T18:03:03Z [load_day 2023-04-02] 2023-04-02 hour 6: 113827 events in 3 files, snapshot 3065028558054049857 (task 7375 ms: download 1866 ms overlapping gunzip 409 ms, parse 1825 ms, sort 67 ms, write 3914 ms, index 341 ms: 4 candidates, 51342 repo-hours, 616 releases; waiting 504 ms; commit 1629 ms)
2026-11-07T18:03:05Z [load_day 2023-04-02] 2023-04-02 hour 7: 115254 events in 3 files, snapshot 4751878821223538651 (task 7916 ms: download 3011 ms overlapping gunzip 422 ms, parse 1911 ms, sort 77 ms, write 4192 ms, index 335 ms: 2 candidates, 49943 repo-hours, 506 releases; waiting 611 ms; commit 1701 ms)
2026-11-07T18:03:12Z [load_day 2023-04-02] 2023-04-02 hour 8: 125036 events in 3 files, snapshot 7868979983178807067 (task 8428 ms: download 2407 ms overlapping gunzip 490 ms, parse 2182 ms, sort 76 ms, write 4427 ms, index 344 ms: 4 candidates, 54070 repo-hours, 641 releases; waiting 518 ms; commit 1362 ms)
2026-11-07T18:03:14Z [load_day 2023-04-02] 2023-04-02 hour 9: 128469 events in 3 files, snapshot 5528461314836500806 (task 8286 ms: download 2605 ms overlapping gunzip 458 ms, parse 2096 ms, sort 72 ms, write 4632 ms, index 358 ms: 4 candidates, 55068 repo-hours, 719 releases; waiting 365 ms; commit 1366 ms)
2026-11-07T18:03:21Z [load_day 2023-04-02] 2023-04-02 hour 10: 132762 events in 3 files, snapshot 6400350475529350714 (task 8625 ms: download 2699 ms overlapping gunzip 481 ms, parse 2195 ms, sort 75 ms, write 4702 ms, index 356 ms: 0 candidates, 58033 repo-hours, 743 releases; waiting 522 ms; commit 1347 ms)
2026-11-07T18:03:24Z [load_day 2023-04-02] 2023-04-02 hour 11: 131781 events in 3 files, snapshot 9048272272205972021 (task 8484 ms: download 2589 ms overlapping gunzip 465 ms, parse 2106 ms, sort 75 ms, write 4481 ms, index 381 ms: 6 candidates, 58081 repo-hours, 718 releases; waiting 621 ms; commit 1734 ms)
2026-11-07T18:03:33Z [load_day 2023-04-02] 2023-04-02 hour 12: 200210 events in 5 files, snapshot 1857882876092659832 (task 11074 ms: download 3834 ms overlapping gunzip 579 ms, parse 2817 ms, sort 126 ms, write 6101 ms, index 545 ms: 7 candidates, 89889 repo-hours, 814 releases; waiting 544 ms; commit 1708 ms)
2026-11-07T18:03:34Z [load_day 2023-04-02] 2023-04-02 hour 13: 170953 events in 4 files, snapshot 7275258120000936904 (task 10236 ms: download 3395 ms overlapping gunzip 548 ms, parse 2567 ms, sort 108 ms, write 5799 ms, index 566 ms: 10 candidates, 86521 repo-hours, 782 releases; waiting 371 ms; commit 1489 ms)
2026-11-07T18:03:44Z [load_day 2023-04-02] 2023-04-02 hour 14: 161293 events in 4 files, snapshot 1493443878521589803 (task 10605 ms: download 3861 ms overlapping gunzip 592 ms, parse 2688 ms, sort 111 ms, write 5794 ms, index 516 ms: 1 candidates, 71759 repo-hours, 849 releases; waiting 580 ms; commit 1507 ms)
2026-11-07T18:03:46Z [load_day 2023-04-02] 2023-04-02 hour 15: 162687 events in 4 files, snapshot 2787046276325890406 (task 10935 ms: download 4128 ms overlapping gunzip 594 ms, parse 2753 ms, sort 94 ms, write 5921 ms, index 527 ms: 3 candidates, 72997 repo-hours, 951 releases; waiting 605 ms; commit 1711 ms)
2026-11-07T18:03:55Z [load_day 2023-04-02] 2023-04-02 hour 16: 155895 events in 4 files, snapshot 5468132234051336429 (task 10501 ms: download 4001 ms overlapping gunzip 595 ms, parse 2692 ms, sort 113 ms, write 5839 ms, index 491 ms: 5 candidates, 69813 repo-hours, 870 releases; waiting 471 ms; commit 1554 ms)
2026-11-07T18:03:57Z [load_day 2023-04-02] 2023-04-02 hour 17: 148902 events in 3 files, snapshot 1993678897807301724 (task 9774 ms: download 3628 ms overlapping gunzip 534 ms, parse 2434 ms, sort 102 ms, write 5368 ms, index 444 ms: 6 candidates, 64198 repo-hours, 708 releases; waiting 566 ms; commit 1597 ms)
2026-11-07T18:04:07Z [load_day 2023-04-02] 2023-04-02 hour 18: 154635 events in 4 files, snapshot 2706517786484841827 (task 10304 ms: download 3974 ms overlapping gunzip 610 ms, parse 2639 ms, sort 97 ms, write 5618 ms, index 487 ms: 2 candidates, 69848 repo-hours, 840 releases; waiting 584 ms; commit 1657 ms)
2026-11-07T18:04:08Z [load_day 2023-04-02] 2023-04-02 hour 19: 139202 events in 3 files, snapshot 577404536013686604 (task 9260 ms: download 3451 ms overlapping gunzip 536 ms, parse 2423 ms, sort 85 ms, write 4988 ms, index 439 ms: 4 candidates, 58908 repo-hours, 833 releases; waiting 514 ms; commit 1636 ms)
2026-11-07T18:04:16Z [load_day 2023-04-02] 2023-04-02 hour 20: 138971 events in 3 files, snapshot 1644803014503628830 (task 9287 ms: download 3690 ms overlapping gunzip 507 ms, parse 2309 ms, sort 93 ms, write 5019 ms, index 419 ms: 3 candidates, 58864 repo-hours, 779 releases; waiting 627 ms; commit 1556 ms)
2026-11-07T18:04:18Z [load_day 2023-04-02] 2023-04-02 hour 21: 127803 events in 3 files, snapshot 2917168757606538812 (task 8345 ms: download 1951 ms overlapping gunzip 456 ms, parse 2143 ms, sort 86 ms, write 4625 ms, index 366 ms: 2 candidates, 52410 repo-hours, 836 releases; waiting 285 ms; commit 1803 ms)
2026-11-07T18:04:25Z [load_day 2023-04-02] 2023-04-02 hour 22: 115512 events in 3 files, snapshot 1477420581495038580 (task 7648 ms: download 1987 ms overlapping gunzip 421 ms, parse 1894 ms, sort 76 ms, write 4017 ms, index 330 ms: 1 candidates, 48233 repo-hours, 669 releases; waiting 576 ms; commit 1529 ms)
2026-11-07T18:04:27Z [load_day 2023-04-02] 2023-04-02 hour 23: 110065 events in 3 files, snapshot 5022540971139709086 (task 7693 ms: download 2448 ms overlapping gunzip 409 ms, parse 1901 ms, sort 68 ms, write 4025 ms, index 340 ms: 1 candidates, 46650 repo-hours, 610 releases; waiting 529 ms; commit 1659 ms)
2026-11-07T18:04:33Z [load_day 2023-04-02] 2023-04-02: repo_hour merged from 24 files to 1 (1421607 rows, 6161 ms)
2026-11-07T18:04:35Z [load_day 2023-04-02] 2023-04-02: index committed in 7996 ms (22 + 1 + 24 files)
2026-11-07T18:04:35Z [load_day 2023-04-02] 2023-04-02: 3179568 events in 24 hours
2026-11-07T18:04:35Z [load_day 2023-04-02] attempt 1 succeeded