orcaLog in

Runs · run 993

load_day 2023-04-13, attempt 1 succeeded

Host
caf251265124:264560
Started
2026-11-07T18:35:46Z
Ended
2026-11-07T18:38:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/993/load_day/2023-04-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:35:46Z [load_day 2023-04-13] attempt 1 started
2026-11-07T18:35:47Z [load_day 2023-04-13] 2023-04-13: 2 hours in flight, about 1200 MB
2026-11-07T18:36:02Z [load_day 2023-04-13] 2023-04-13 hour 0: 163017 events in 4 files, snapshot 7909769543789463562 (task 11791 ms: download 4989 ms overlapping gunzip 677 ms, parse 3076 ms, sort 105 ms, write 6491 ms, index 543 ms: 6 candidates, 82549 repo-hours, 921 releases; waiting 506 ms; commit 1774 ms)
2026-11-07T18:36:04Z [load_day 2023-04-13] 2023-04-13 hour 1: 171061 events in 4 files, snapshot 8297300152133632934 (task 11772 ms: download 4906 ms overlapping gunzip 751 ms, parse 3273 ms, sort 110 ms, write 6474 ms, index 569 ms: 10 candidates, 92257 repo-hours, 840 releases; waiting 392 ms; commit 1701 ms)
2026-11-07T18:36:14Z [load_day 2023-04-13] 2023-04-13 hour 2: 152327 events in 4 files, snapshot 2186444981348235744 (task 11562 ms: download 4576 ms overlapping gunzip 655 ms, parse 2784 ms, sort 93 ms, write 6770 ms, index 453 ms: 3 candidates, 68919 repo-hours, 800 releases; waiting 524 ms; commit 1628 ms)
2026-11-07T18:36:16Z [load_day 2023-04-13] 2023-04-13 hour 3: 143404 events in 3 files, snapshot 1483301367419218146 (task 10325 ms: download 4073 ms overlapping gunzip 659 ms, parse 2786 ms, sort 99 ms, write 5809 ms, index 498 ms: 5 candidates, 63548 repo-hours, 882 releases; waiting 247 ms; commit 1453 ms)
2026-11-07T18:36:24Z [load_day 2023-04-13] 2023-04-13 hour 4: 132630 events in 3 files, snapshot 8748374297026412285 (task 9145 ms: download 3791 ms overlapping gunzip 557 ms, parse 2391 ms, sort 74 ms, write 5026 ms, index 343 ms: 0 candidates, 57155 repo-hours, 600 releases; waiting 521 ms; commit 1471 ms)
2026-11-07T18:36:27Z [load_day 2023-04-13] 2023-04-13 hour 5: 145964 events in 3 files, snapshot 2420219421451220810 (task 10744 ms: download 4492 ms overlapping gunzip 638 ms, parse 2801 ms, sort 81 ms, write 5893 ms, index 479 ms: 5 candidates, 65072 repo-hours, 712 releases; waiting 584 ms; commit 1549 ms)
2026-11-07T18:36:38Z [load_day 2023-04-13] 2023-04-13 hour 6: 174329 events in 4 files, snapshot 2474339719844660884 (task 12716 ms: download 7067 ms overlapping gunzip 773 ms, parse 3327 ms, sort 93 ms, write 7209 ms, index 527 ms: 7 candidates, 81440 repo-hours, 1013 releases; waiting 520 ms; commit 1588 ms)
2026-11-07T18:36:42Z [load_day 2023-04-13] 2023-04-13 hour 7: 172380 events in 4 files, snapshot 1554407025668044649 (task 13757 ms: download 7915 ms overlapping gunzip 818 ms, parse 3599 ms, sort 101 ms, write 7871 ms, index 529 ms: 5 candidates, 80575 repo-hours, 960 releases; waiting 571 ms; commit 1604 ms)
2026-11-07T18:36:53Z [load_day 2023-04-13] 2023-04-13 hour 8: 175187 events in 4 files, snapshot 3504072420311082115 (task 14416 ms: download 8462 ms overlapping gunzip 851 ms, parse 3753 ms, sort 112 ms, write 8367 ms, index 542 ms: 6 candidates, 83570 repo-hours, 1001 releases; waiting 532 ms; commit 1455 ms)
2026-11-07T18:36:57Z [load_day 2023-04-13] 2023-04-13 hour 9: 177203 events in 4 files, snapshot 4524271239514295770 (task 14592 ms: download 8433 ms overlapping gunzip 875 ms, parse 3815 ms, sort 103 ms, write 8160 ms, index 658 ms: 1 candidates, 83245 repo-hours, 1116 releases; waiting 702 ms; commit 1579 ms)
2026-11-07T18:37:08Z [load_day 2023-04-13] 2023-04-13 hour 10: 168972 events in 4 files, snapshot 8033004633383026666 (task 14678 ms: download 8842 ms overlapping gunzip 827 ms, parse 3624 ms, sort 94 ms, write 8002 ms, index 545 ms: 6 candidates, 77537 repo-hours, 948 releases; waiting 1316 ms; commit 1651 ms)
2026-11-07T18:37:12Z [load_day 2023-04-13] 2023-04-13 hour 11: 168798 events in 4 files, snapshot 3248643827375079715 (task 13942 ms: download 7885 ms overlapping gunzip 840 ms, parse 3600 ms, sort 114 ms, write 7975 ms, index 572 ms: 6 candidates, 77087 repo-hours, 887 releases; waiting 559 ms; commit 1608 ms)
2026-11-07T18:37:24Z [load_day 2023-04-13] 2023-04-13 hour 12: 192507 events in 4 files, snapshot 3807537179953093824 (task 14593 ms: download 8023 ms overlapping gunzip 808 ms, parse 3686 ms, sort 106 ms, write 8431 ms, index 648 ms: 7 candidates, 101857 repo-hours, 926 releases; waiting 656 ms; commit 1487 ms)
2026-11-07T18:37:28Z [load_day 2023-04-13] 2023-04-13 hour 13: 188183 events in 4 files, snapshot 2979262021542297124 (task 15059 ms: download 8271 ms overlapping gunzip 882 ms, parse 3925 ms, sort 115 ms, write 8666 ms, index 604 ms: 9 candidates, 98777 repo-hours, 896 releases; waiting 530 ms; commit 1493 ms)
2026-11-07T18:37:40Z [load_day 2023-04-13] 2023-04-13 hour 14: 186687 events in 4 files, snapshot 5869136142040966922 (task 15316 ms: download 8657 ms overlapping gunzip 912 ms, parse 3939 ms, sort 109 ms, write 8959 ms, index 603 ms: 2 candidates, 90904 repo-hours, 941 releases; waiting 518 ms; commit 1547 ms)
2026-11-07T18:37:45Z [load_day 2023-04-13] 2023-04-13 hour 15: 163557 events in 4 files, snapshot 7745615431304451246 (task 16044 ms: download 7931 ms overlapping gunzip 862 ms, parse 3674 ms, sort 100 ms, write 7934 ms, index 576 ms: 3 candidates, 85122 repo-hours, 958 releases; waiting 2602 ms; commit 1542 ms)
2026-11-07T18:37:55Z [load_day 2023-04-13] 2023-04-13 hour 16: 168166 events in 4 files, snapshot 2445237149457604988 (task 14542 ms: download 8731 ms overlapping gunzip 854 ms, parse 3666 ms, sort 98 ms, write 8388 ms, index 595 ms: 4 candidates, 81809 repo-hours, 925 releases; waiting 688 ms; commit 1633 ms)
2026-11-07T18:38:01Z [load_day 2023-04-13] 2023-04-13 hour 17: 183384 events in 4 files, snapshot 3025779623322991298 (task 15305 ms: download 8877 ms overlapping gunzip 930 ms, parse 4093 ms, sort 105 ms, write 8798 ms, index 543 ms: 1 candidates, 82410 repo-hours, 863 releases; waiting 542 ms; commit 1503 ms)
2026-11-07T18:38:10Z [load_day 2023-04-13] 2023-04-13 hour 18: 185297 events in 4 files, snapshot 3422164544213665540 (task 14625 ms: download 8134 ms overlapping gunzip 877 ms, parse 3891 ms, sort 113 ms, write 8640 ms, index 557 ms: 5 candidates, 84363 repo-hours, 971 releases; waiting 226 ms; commit 1422 ms)
2026-11-07T18:38:15Z [load_day 2023-04-13] 2023-04-13 hour 19: 158273 events in 4 files, snapshot 3770729699071120201 (task 12726 ms: download 5091 ms overlapping gunzip 726 ms, parse 3225 ms, sort 100 ms, write 7320 ms, index 523 ms: 3 candidates, 71152 repo-hours, 892 releases; waiting 513 ms; commit 1477 ms)
2026-11-07T18:38:25Z [load_day 2023-04-13] 2023-04-13 hour 20: 169536 events in 4 files, snapshot 4878165354153955817 (task 13704 ms: download 8232 ms overlapping gunzip 788 ms, parse 3490 ms, sort 96 ms, write 7644 ms, index 522 ms: 5 candidates, 74618 repo-hours, 887 releases; waiting 888 ms; commit 1592 ms)
2026-11-07T18:38:28Z [load_day 2023-04-13] 2023-04-13 hour 21: 159387 events in 4 files, snapshot 4413030434399340116 (task 12784 ms: download 5256 ms overlapping gunzip 748 ms, parse 3361 ms, sort 92 ms, write 7256 ms, index 566 ms: 6 candidates, 65860 repo-hours, 960 releases; waiting 492 ms; commit 1512 ms)
2026-11-07T18:38:38Z [load_day 2023-04-13] 2023-04-13 hour 22: 151405 events in 4 files, snapshot 7025025637688096527 (task 12174 ms: download 5344 ms overlapping gunzip 754 ms, parse 3252 ms, sort 107 ms, write 6757 ms, index 403 ms: 4 candidates, 60795 repo-hours, 772 releases; waiting 565 ms; commit 1600 ms)
2026-11-07T18:38:39Z [load_day 2023-04-13] 2023-04-13 hour 23: 137154 events in 3 files, snapshot 3349411255087581639 (task 10013 ms: download 4250 ms overlapping gunzip 593 ms, parse 2617 ms, sort 68 ms, write 5596 ms, index 383 ms: 3 candidates, 56480 repo-hours, 670 releases; waiting 517 ms; commit 1602 ms)
2026-11-07T18:38:47Z [load_day 2023-04-13] 2023-04-13: repo_hour merged from 24 files to 1 (1867101 rows, 7726 ms)
2026-11-07T18:38:49Z [load_day 2023-04-13] 2023-04-13: index committed in 9734 ms (23 + 1 + 24 files)
2026-11-07T18:38:49Z [load_day 2023-04-13] 2023-04-13: 3988808 events in 24 hours
2026-11-07T18:38:49Z [load_day 2023-04-13] attempt 1 succeeded