orcaLog in

Runs · run 933

load_day 2023-03-24, attempt 1 succeeded

Host
caf251265124:195750
Started
2026-11-07T17:35:28Z
Ended
2026-11-07T17:38:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/933/load_day/2023-03-24/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:35:28Z [load_day 2023-03-24] attempt 1 started
2026-11-07T17:35:29Z [load_day 2023-03-24] 2023-03-24: 2 hours in flight, about 1200 MB
2026-11-07T17:35:46Z [load_day 2023-03-24] 2023-03-24 hour 0: 161895 events in 4 files, snapshot 3370432712233527667 (task 14074 ms: download 7039 ms overlapping gunzip 785 ms, parse 3430 ms, sort 94 ms, write 7116 ms, index 542 ms: 4 candidates, 78653 repo-hours, 928 releases; waiting 1655 ms; commit 1745 ms)
2026-11-07T17:35:48Z [load_day 2023-03-24] 2023-03-24 hour 1: 174728 events in 4 files, snapshot 3990730157471757830 (task 15465 ms: download 9828 ms overlapping gunzip 851 ms, parse 3647 ms, sort 99 ms, write 7720 ms, index 563 ms: 6 candidates, 91191 repo-hours, 820 releases; waiting 2293 ms; commit 1711 ms)
2026-11-07T17:35:58Z [load_day 2023-03-24] 2023-03-24 hour 2: 150338 events in 4 files, snapshot 4665615517823777788 (task 11320 ms: download 4757 ms overlapping gunzip 671 ms, parse 2826 ms, sort 92 ms, write 6212 ms, index 475 ms: 3 candidates, 67460 repo-hours, 920 releases; waiting 606 ms; commit 1691 ms)
2026-11-07T17:36:01Z [load_day 2023-03-24] 2023-03-24 hour 3: 144736 events in 3 files, snapshot 4491496735346698005 (task 11907 ms: download 5294 ms overlapping gunzip 710 ms, parse 2988 ms, sort 79 ms, write 6507 ms, index 399 ms: 5 candidates, 62887 repo-hours, 869 releases; waiting 870 ms; commit 1607 ms)
2026-11-07T17:36:10Z [load_day 2023-03-24] 2023-03-24 hour 4: 130792 events in 3 files, snapshot 7277389033054277199 (task 11051 ms: download 5812 ms overlapping gunzip 627 ms, parse 2618 ms, sort 78 ms, write 5204 ms, index 350 ms: 4 candidates, 54678 repo-hours, 702 releases; waiting 1888 ms; commit 1388 ms)
2026-11-07T17:36:15Z [load_day 2023-03-24] 2023-03-24 hour 5: 141287 events in 3 files, snapshot 2151798329117791073 (task 13545 ms: download 6748 ms overlapping gunzip 800 ms, parse 3350 ms, sort 90 ms, write 6431 ms, index 419 ms: 3 candidates, 61927 repo-hours, 966 releases; waiting 2155 ms; commit 1513 ms)
2026-11-07T17:36:23Z [load_day 2023-03-24] 2023-03-24 hour 6: 167301 events in 4 files, snapshot 2717946991169135235 (task 12484 ms: download 5090 ms overlapping gunzip 754 ms, parse 3195 ms, sort 112 ms, write 6867 ms, index 505 ms: 6 candidates, 80014 repo-hours, 840 releases; waiting 727 ms; commit 1476 ms)
2026-11-07T17:36:29Z [load_day 2023-03-24] 2023-03-24 hour 7: 169034 events in 4 files, snapshot 5000175187472326463 (task 14033 ms: download 8229 ms overlapping gunzip 859 ms, parse 3571 ms, sort 93 ms, write 8076 ms, index 493 ms: 3 candidates, 74404 repo-hours, 914 releases; waiting 638 ms; commit 1512 ms)
2026-11-07T17:36:39Z [load_day 2023-03-24] 2023-03-24 hour 8: 181553 events in 4 files, snapshot 1138969649857584783 (task 14697 ms: download 8146 ms overlapping gunzip 877 ms, parse 3762 ms, sort 122 ms, write 8480 ms, index 581 ms: 8 candidates, 81640 repo-hours, 1113 releases; waiting 528 ms; commit 1621 ms)
2026-11-07T17:36:46Z [load_day 2023-03-24] 2023-03-24 hour 9: 173599 events in 4 files, snapshot 7754140905831121648 (task 15277 ms: download 8945 ms overlapping gunzip 937 ms, parse 4007 ms, sort 109 ms, write 8799 ms, index 532 ms: 3 candidates, 81977 repo-hours, 1065 releases; waiting 585 ms; commit 1469 ms)
2026-11-07T17:36:54Z [load_day 2023-03-24] 2023-03-24 hour 10: 179976 events in 4 files, snapshot 5879388209481944030 (task 15393 ms: download 8870 ms overlapping gunzip 914 ms, parse 3979 ms, sort 110 ms, write 8984 ms, index 539 ms: 1 candidates, 81290 repo-hours, 1197 releases; waiting 528 ms; commit 1390 ms)
2026-11-07T17:37:03Z [load_day 2023-03-24] 2023-03-24 hour 11: 185995 events in 4 files, snapshot 3855998532066913245 (task 16349 ms: download 9408 ms overlapping gunzip 995 ms, parse 4207 ms, sort 97 ms, write 9271 ms, index 653 ms: 3 candidates, 83282 repo-hours, 1090 releases; waiting 799 ms; commit 1541 ms)
2026-11-07T17:37:10Z [load_day 2023-03-24] 2023-03-24 hour 12: 207759 events in 5 files, snapshot 8450169091029957432 (task 14640 ms: download 7635 ms overlapping gunzip 822 ms, parse 3650 ms, sort 128 ms, write 8537 ms, index 681 ms: 4 candidates, 109647 repo-hours, 1019 releases; waiting 503 ms; commit 1463 ms)
2026-11-07T17:37:21Z [load_day 2023-03-24] 2023-03-24 hour 13: 192415 events in 4 files, snapshot 1629259483708347885 (task 16802 ms: download 8975 ms overlapping gunzip 1047 ms, parse 4361 ms, sort 116 ms, write 9874 ms, index 638 ms: 10 candidates, 97378 repo-hours, 932 releases; waiting 425 ms; commit 1677 ms)
2026-11-07T17:37:29Z [load_day 2023-03-24] 2023-03-24 hour 14: 175769 events in 4 files, snapshot 3434283902348223807 (task 18037 ms: download 11538 ms overlapping gunzip 990 ms, parse 4266 ms, sort 119 ms, write 8875 ms, index 563 ms: 4 candidates, 84689 repo-hours, 1008 releases; waiting 2961 ms; commit 1499 ms)
2026-11-07T17:37:38Z [load_day 2023-03-24] 2023-03-24 hour 15: 187390 events in 4 files, snapshot 4497516471231845845 (task 16796 ms: download 9498 ms overlapping gunzip 1031 ms, parse 4422 ms, sort 121 ms, write 9623 ms, index 581 ms: 5 candidates, 89364 repo-hours, 1097 releases; waiting 507 ms; commit 1403 ms)
2026-11-07T17:37:45Z [load_day 2023-03-24] 2023-03-24 hour 16: 186114 events in 4 files, snapshot 6467525539396701720 (task 15310 ms: download 8556 ms overlapping gunzip 958 ms, parse 4143 ms, sort 107 ms, write 9034 ms, index 531 ms: 9 candidates, 87139 repo-hours, 1038 releases; waiting 230 ms; commit 1439 ms)
2026-11-07T17:37:55Z [load_day 2023-03-24] 2023-03-24 hour 17: 175023 events in 4 files, snapshot 6661851200045219637 (task 16009 ms: download 9588 ms overlapping gunzip 1005 ms, parse 4196 ms, sort 104 ms, write 9309 ms, index 535 ms: 4 candidates, 78084 repo-hours, 853 releases; waiting 568 ms; commit 1606 ms)
2026-11-07T17:38:03Z [load_day 2023-03-24] 2023-03-24 hour 18: 181171 events in 4 files, snapshot 84853717327544306 (task 17091 ms: download 9862 ms overlapping gunzip 1086 ms, parse 4432 ms, sort 118 ms, write 9943 ms, index 563 ms: 11 candidates, 80317 repo-hours, 1046 releases; waiting 602 ms; commit 1533 ms)
2026-11-07T17:38:12Z [load_day 2023-03-24] 2023-03-24 hour 19: 176684 events in 4 files, snapshot 402345032929616654 (task 16002 ms: download 9090 ms overlapping gunzip 1017 ms, parse 4072 ms, sort 117 ms, write 9438 ms, index 503 ms: 3 candidates, 78365 repo-hours, 873 releases; waiting 496 ms; commit 1574 ms)
2026-11-07T17:38:20Z [load_day 2023-03-24] 2023-03-24 hour 20: 168462 events in 4 files, snapshot 6126762846872469988 (task 15780 ms: download 9988 ms overlapping gunzip 1003 ms, parse 4108 ms, sort 112 ms, write 9211 ms, index 468 ms: 8 candidates, 69741 repo-hours, 811 releases; waiting 557 ms; commit 1608 ms)
2026-11-07T17:38:27Z [load_day 2023-03-24] 2023-03-24 hour 21: 163082 events in 4 files, snapshot 2930064623388331385 (task 15179 ms: download 8909 ms overlapping gunzip 968 ms, parse 3961 ms, sort 104 ms, write 8820 ms, index 446 ms: 9 candidates, 65424 repo-hours, 872 releases; waiting 549 ms; commit 1658 ms)
2026-11-07T17:38:42Z [load_day 2023-03-24] 2023-03-24 hour 22: 185048 events in 4 files, snapshot 7977636176099726971 (task 21468 ms: download 16682 ms overlapping gunzip 1523 ms, parse 5624 ms, sort 120 ms, write 12787 ms, index 518 ms: 12 candidates, 73643 repo-hours, 705 releases; waiting 562 ms; commit 1757 ms)
2026-11-07T17:38:49Z [load_day 2023-03-24] 2023-03-24 hour 23: 177370 events in 4 files, snapshot 7023836087625565060 (task 21113 ms: download 13261 ms overlapping gunzip 1543 ms, parse 5380 ms, sort 124 ms, write 12601 ms, index 482 ms: 10 candidates, 72584 repo-hours, 612 releases; waiting 626 ms; commit 1489 ms)
2026-11-07T17:38:57Z [load_day 2023-03-24] 2023-03-24: repo_hour merged from 24 files to 1 (1885778 rows, 7901 ms)
2026-11-07T17:38:59Z [load_day 2023-03-24] 2023-03-24: index committed in 9683 ms (24 + 1 + 24 files)
2026-11-07T17:38:59Z [load_day 2023-03-24] 2023-03-24: 4137521 events in 24 hours
2026-11-07T17:38:59Z [load_day 2023-03-24] attempt 1 succeeded