orcaLog in

Runs · run 1074

load_day 2023-05-10, attempt 1 succeeded

Host
caf251265124:354402
Started
2026-11-07T19:55:08Z
Ended
2026-11-07T19:58:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1074/load_day/2023-05-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:55:08Z [load_day 2023-05-10] attempt 1 started
2026-11-07T19:55:09Z [load_day 2023-05-10] 2023-05-10: 2 hours in flight, about 1200 MB
2026-11-07T19:55:23Z [load_day 2023-05-10] 2023-05-10 hour 0: 150559 events in 4 files, snapshot 6271438966344169039 (task 11336 ms: download 4865 ms overlapping gunzip 684 ms, parse 3201 ms, sort 96 ms, write 6109 ms, index 493 ms: 11 candidates, 79396 repo-hours, 909 releases; waiting 504 ms; commit 1665 ms)
2026-11-07T19:55:27Z [load_day 2023-05-10] 2023-05-10 hour 1: 191490 events in 4 files, snapshot 7153228272183360994 (task 14821 ms: download 8180 ms overlapping gunzip 946 ms, parse 4013 ms, sort 145 ms, write 8435 ms, index 585 ms: 10 candidates, 89920 repo-hours, 779 releases; waiting 371 ms; commit 1759 ms)
2026-11-07T19:55:36Z [load_day 2023-05-10] 2023-05-10 hour 2: 141713 events in 3 files, snapshot 7959197165617916131 (task 11389 ms: download 4914 ms overlapping gunzip 691 ms, parse 2912 ms, sort 81 ms, write 6405 ms, index 409 ms: 6 candidates, 64775 repo-hours, 702 releases; waiting 565 ms; commit 1601 ms)
2026-11-07T19:55:39Z [load_day 2023-05-10] 2023-05-10 hour 3: 136902 events in 3 files, snapshot 1768115563740304866 (task 11053 ms: download 4991 ms overlapping gunzip 713 ms, parse 2941 ms, sort 76 ms, write 5961 ms, index 390 ms: 6 candidates, 59755 repo-hours, 815 releases; waiting 685 ms; commit 1614 ms)
2026-11-07T19:55:48Z [load_day 2023-05-10] 2023-05-10 hour 4: 129997 events in 3 files, snapshot 846454241594866188 (task 10066 ms: download 4409 ms overlapping gunzip 694 ms, parse 2920 ms, sort 95 ms, write 5522 ms, index 376 ms: 13 candidates, 55342 repo-hours, 506 releases; waiting 184 ms; commit 3580 ms)
2026-11-07T19:55:51Z [load_day 2023-05-10] 2023-05-10 hour 5: 142062 events in 3 files, snapshot 2842749615067859538 (task 11718 ms: download 5271 ms overlapping gunzip 758 ms, parse 3150 ms, sort 88 ms, write 6538 ms, index 400 ms: 11 candidates, 61537 repo-hours, 770 releases; waiting 535 ms; commit 1588 ms)
2026-11-07T19:56:03Z [load_day 2023-05-10] 2023-05-10 hour 6: 169688 events in 4 files, snapshot 2520611836192181292 (task 14395 ms: download 8424 ms overlapping gunzip 881 ms, parse 3806 ms, sort 95 ms, write 8169 ms, index 550 ms: 12 candidates, 78436 repo-hours, 876 releases; waiting 583 ms; commit 1822 ms)
2026-11-07T19:56:05Z [load_day 2023-05-10] 2023-05-10 hour 7: 154133 events in 4 files, snapshot 4646753308355660758 (task 12871 ms: download 5187 ms overlapping gunzip 753 ms, parse 3383 ms, sort 97 ms, write 7477 ms, index 478 ms: 9 candidates, 73615 repo-hours, 896 releases; waiting 382 ms; commit 1549 ms)
2026-11-07T19:56:17Z [load_day 2023-05-10] 2023-05-10 hour 8: 159531 events in 4 files, snapshot 7093641933367405500 (task 14012 ms: download 6180 ms overlapping gunzip 804 ms, parse 3560 ms, sort 86 ms, write 7631 ms, index 511 ms: 10 candidates, 80329 repo-hours, 847 releases; waiting 1102 ms; commit 1568 ms)
2026-11-07T19:56:21Z [load_day 2023-05-10] 2023-05-10 hour 9: 173292 events in 4 files, snapshot 1615247357283442359 (task 14787 ms: download 8661 ms overlapping gunzip 857 ms, parse 3854 ms, sort 104 ms, write 8331 ms, index 560 ms: 8 candidates, 82543 repo-hours, 1146 releases; waiting 711 ms; commit 1764 ms)
2026-11-07T19:56:34Z [load_day 2023-05-10] 2023-05-10 hour 10: 166289 events in 4 files, snapshot 880852952526368518 (task 15443 ms: download 9890 ms overlapping gunzip 856 ms, parse 3791 ms, sort 92 ms, write 7883 ms, index 527 ms: 9 candidates, 79336 repo-hours, 951 releases; waiting 2005 ms; commit 1503 ms)
2026-11-07T19:56:35Z [load_day 2023-05-10] 2023-05-10 hour 11: 169403 events in 4 files, snapshot 1019450268729327570 (task 13826 ms: download 8199 ms overlapping gunzip 838 ms, parse 3652 ms, sort 91 ms, write 7907 ms, index 524 ms: 10 candidates, 79399 repo-hours, 908 releases; waiting 512 ms; commit 1669 ms)
2026-11-07T19:56:50Z [load_day 2023-05-10] 2023-05-10 hour 12: 193618 events in 4 files, snapshot 879089962757264314 (task 15038 ms: download 8229 ms overlapping gunzip 853 ms, parse 3860 ms, sort 105 ms, write 8541 ms, index 706 ms: 8 candidates, 104223 repo-hours, 1025 releases; waiting 605 ms; commit 1832 ms)
2026-11-07T19:56:52Z [load_day 2023-05-10] 2023-05-10 hour 13: 174530 events in 4 files, snapshot 3507449384153230828 (task 14645 ms: download 8371 ms overlapping gunzip 824 ms, parse 3697 ms, sort 108 ms, write 8540 ms, index 594 ms: 11 candidates, 94638 repo-hours, 937 releases; waiting 543 ms; commit 1727 ms)
2026-11-07T19:57:06Z [load_day 2023-05-10] 2023-05-10 hour 14: 168135 events in 4 files, snapshot 4510611293467130072 (task 15181 ms: download 9135 ms overlapping gunzip 860 ms, parse 3921 ms, sort 105 ms, write 8912 ms, index 577 ms: 13 candidates, 86804 repo-hours, 875 releases; waiting 511 ms; commit 1567 ms)
2026-11-07T19:57:07Z [load_day 2023-05-10] 2023-05-10 hour 15: 168506 events in 4 files, snapshot 5192293935838254595 (task 14615 ms: download 8367 ms overlapping gunzip 854 ms, parse 3755 ms, sort 99 ms, write 8613 ms, index 610 ms: 15 candidates, 85953 repo-hours, 991 releases; waiting 349 ms; commit 1527 ms)
2026-11-07T19:57:20Z [load_day 2023-05-10] 2023-05-10 hour 16: 161944 events in 4 files, snapshot 1357886794386658459 (task 13670 ms: download 5736 ms overlapping gunzip 800 ms, parse 3591 ms, sort 98 ms, write 7885 ms, index 555 ms: 14 candidates, 80210 repo-hours, 756 releases; waiting 507 ms; commit 1815 ms)
2026-11-07T19:57:23Z [load_day 2023-05-10] 2023-05-10 hour 17: 160131 events in 4 files, snapshot 7593892755594996149 (task 14381 ms: download 6289 ms overlapping gunzip 783 ms, parse 3522 ms, sort 88 ms, write 7767 ms, index 544 ms: 8 candidates, 77523 repo-hours, 675 releases; waiting 1066 ms; commit 1758 ms)
2026-11-07T19:57:35Z [load_day 2023-05-10] 2023-05-10 hour 18: 171526 events in 4 files, snapshot 1785739733563206501 (task 13643 ms: download 7966 ms overlapping gunzip 786 ms, parse 3494 ms, sort 110 ms, write 7872 ms, index 543 ms: 14 candidates, 86858 repo-hours, 845 releases; waiting 549 ms; commit 1598 ms)
2026-11-07T19:57:36Z [load_day 2023-05-10] 2023-05-10 hour 19: 159439 events in 4 files, snapshot 1537099645826248576 (task 13245 ms: download 5592 ms overlapping gunzip 773 ms, parse 3467 ms, sort 89 ms, write 7541 ms, index 475 ms: 10 candidates, 74589 repo-hours, 844 releases; waiting 516 ms; commit 1538 ms)
2026-11-07T19:57:49Z [load_day 2023-05-10] 2023-05-10 hour 20: 156749 events in 4 files, snapshot 5485438508749334608 (task 13730 ms: download 5794 ms overlapping gunzip 770 ms, parse 3478 ms, sort 97 ms, write 7424 ms, index 508 ms: 12 candidates, 72309 repo-hours, 834 releases; waiting 751 ms; commit 1906 ms)
2026-11-07T19:57:51Z [load_day 2023-05-10] 2023-05-10 hour 21: 148188 events in 3 files, snapshot 389706442239674514 (task 11831 ms: download 5020 ms overlapping gunzip 721 ms, parse 3200 ms, sort 96 ms, write 6700 ms, index 455 ms: 8 candidates, 67182 repo-hours, 947 releases; waiting 393 ms; commit 1671 ms)
2026-11-07T19:58:05Z [load_day 2023-05-10] 2023-05-10 hour 22: 132276 events in 3 files, snapshot 4023532344345555410 (task 11167 ms: download 5298 ms overlapping gunzip 680 ms, parse 2929 ms, sort 86 ms, write 5995 ms, index 360 ms: 9 candidates, 56770 repo-hours, 732 releases; waiting 798 ms; commit 5214 ms)
2026-11-07T19:58:06Z [load_day 2023-05-10] 2023-05-10 hour 23: 122149 events in 3 files, snapshot 3666014784446122674 (task 9528 ms: download 4173 ms overlapping gunzip 557 ms, parse 2533 ms, sort 67 ms, write 5177 ms, index 369 ms: 5 candidates, 53440 repo-hours, 596 releases; waiting 513 ms; commit 1756 ms)
2026-11-07T19:58:14Z [load_day 2023-05-10] 2023-05-10: repo_hour merged from 24 files to 1 (1824882 rows, 7554 ms)
2026-11-07T19:58:16Z [load_day 2023-05-10] 2023-05-10: index committed in 9566 ms (24 + 1 + 24 files)
2026-11-07T19:58:16Z [load_day 2023-05-10] 2023-05-10: 3802250 events in 24 hours
2026-11-07T19:58:16Z [load_day 2023-05-10] attempt 1 succeeded