orcaLog in

Runs · run 891

load_day 2023-03-10, attempt 1 succeeded

Host
caf251265124:147614
Started
2026-11-07T16:52:57Z
Ended
2026-11-07T16:56:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/891/load_day/2023-03-10/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:52:57Z [load_day 2023-03-10] attempt 1 started
2026-11-07T16:52:58Z [load_day 2023-03-10] 2023-03-10: 2 hours in flight, about 1200 MB
2026-11-07T16:53:15Z [load_day 2023-03-10] 2023-03-10 hour 0: 169310 events in 4 files, snapshot 1296302327780747553 (task 14250 ms: download 5496 ms overlapping gunzip 760 ms, parse 3418 ms, sort 114 ms, write 7844 ms, index 1155 ms: 6 candidates, 76320 repo-hours, 975 releases; waiting 636 ms; commit 1430 ms)
2026-11-07T16:53:20Z [load_day 2023-03-10] 2023-03-10 hour 1: 176741 events in 4 files, snapshot 3957884599989235185 (task 14227 ms: download 7896 ms overlapping gunzip 847 ms, parse 3589 ms, sort 112 ms, write 8188 ms, index 560 ms: 4 candidates, 85688 repo-hours, 899 releases; waiting 520 ms; commit 4416 ms)
2026-11-07T16:53:29Z [load_day 2023-03-10] 2023-03-10 hour 2: 149443 events in 3 files, snapshot 529107856642285353 (task 13045 ms: download 6495 ms overlapping gunzip 709 ms, parse 2986 ms, sort 130 ms, write 6440 ms, index 468 ms: 3 candidates, 72628 repo-hours, 704 releases; waiting 2001 ms; commit 1545 ms)
2026-11-07T16:53:31Z [load_day 2023-03-10] 2023-03-10 hour 3: 136492 events in 3 files, snapshot 1606750337247614288 (task 10377 ms: download 4594 ms overlapping gunzip 619 ms, parse 2609 ms, sort 97 ms, write 5815 ms, index 388 ms: 3 candidates, 59564 repo-hours, 934 releases; waiting 518 ms; commit 1431 ms)
2026-11-07T16:53:40Z [load_day 2023-03-10] 2023-03-10 hour 4: 130430 events in 3 files, snapshot 4348867447007964796 (task 9948 ms: download 4385 ms overlapping gunzip 588 ms, parse 2474 ms, sort 88 ms, write 5536 ms, index 366 ms: 1 candidates, 54953 repo-hours, 702 releases; waiting 571 ms; commit 1254 ms)
2026-11-07T16:53:42Z [load_day 2023-03-10] 2023-03-10 hour 5: 134944 events in 3 files, snapshot 2609115670396620053 (task 10155 ms: download 4418 ms overlapping gunzip 617 ms, parse 2636 ms, sort 87 ms, write 5491 ms, index 414 ms: 2 candidates, 57736 repo-hours, 739 releases; waiting 619 ms; commit 1464 ms)
2026-11-07T16:53:52Z [load_day 2023-03-10] 2023-03-10 hour 6: 162124 events in 4 files, snapshot 4634519164530907198 (task 11908 ms: download 4590 ms overlapping gunzip 713 ms, parse 3068 ms, sort 106 ms, write 6698 ms, index 544 ms: 1 candidates, 76183 repo-hours, 822 releases; waiting 235 ms; commit 1313 ms)
2026-11-07T16:53:56Z [load_day 2023-03-10] 2023-03-10 hour 7: 178272 events in 4 files, snapshot 1546012995184930121 (task 13587 ms: download 7634 ms overlapping gunzip 865 ms, parse 3558 ms, sort 107 ms, write 7679 ms, index 546 ms: 1 candidates, 84541 repo-hours, 800 releases; waiting 540 ms; commit 1494 ms)
2026-11-07T16:54:08Z [load_day 2023-03-10] 2023-03-10 hour 8: 178417 events in 4 files, snapshot 1474849896510703161 (task 14190 ms: download 8161 ms overlapping gunzip 821 ms, parse 3503 ms, sort 111 ms, write 8009 ms, index 574 ms: 4 candidates, 92016 repo-hours, 847 releases; waiting 820 ms; commit 1615 ms)
2026-11-07T16:54:12Z [load_day 2023-03-10] 2023-03-10 hour 9: 202098 events in 5 files, snapshot 8435981462363125484 (task 15629 ms: download 8444 ms overlapping gunzip 929 ms, parse 4064 ms, sort 124 ms, write 9089 ms, index 625 ms: 3 candidates, 100613 repo-hours, 1358 releases; waiting 541 ms; commit 1265 ms)
2026-11-07T16:54:25Z [load_day 2023-03-10] 2023-03-10 hour 10: 203471 events in 5 files, snapshot 4669169453389848027 (task 16127 ms: download 8713 ms overlapping gunzip 956 ms, parse 4066 ms, sort 125 ms, write 9083 ms, index 651 ms: 3 candidates, 98330 repo-hours, 1026 releases; waiting 879 ms; commit 1566 ms)
2026-11-07T16:54:28Z [load_day 2023-03-10] 2023-03-10 hour 11: 191290 events in 4 files, snapshot 1276897988492384814 (task 14975 ms: download 8362 ms overlapping gunzip 908 ms, parse 3856 ms, sort 133 ms, write 8604 ms, index 541 ms: 2 candidates, 84601 repo-hours, 1126 releases; waiting 588 ms; commit 1577 ms)
2026-11-07T16:54:46Z [load_day 2023-03-10] 2023-03-10 hour 12: 218900 events in 5 files, snapshot 544870934878835892 (task 17637 ms: download 9990 ms overlapping gunzip 914 ms, parse 4021 ms, sort 135 ms, write 9089 ms, index 859 ms: 7 candidates, 113836 repo-hours, 988 releases; waiting 2331 ms; commit 4068 ms)
2026-11-07T16:54:54Z [load_day 2023-03-10] 2023-03-10 hour 13: 214336 events in 5 files, snapshot 629647036958830155 (task 15945 ms: download 10239 ms overlapping gunzip 939 ms, parse 4061 ms, sort 124 ms, write 9489 ms, index 683 ms: 3 candidates, 107688 repo-hours, 1081 releases; waiting 342 ms; commit 7949 ms)
2026-11-07T16:55:03Z [load_day 2023-03-10] 2023-03-10 hour 14: 195339 events in 4 files, snapshot 6608489044992063379 (task 16266 ms: download 8874 ms overlapping gunzip 982 ms, parse 4168 ms, sort 110 ms, write 9359 ms, index 660 ms: 2 candidates, 88805 repo-hours, 1166 releases; waiting 568 ms; commit 1588 ms)
2026-11-07T16:55:11Z [load_day 2023-03-10] 2023-03-10 hour 15: 192356 events in 4 files, snapshot 1185528562285868394 (task 16368 ms: download 9014 ms overlapping gunzip 955 ms, parse 4175 ms, sort 136 ms, write 9716 ms, index 619 ms: 3 candidates, 89091 repo-hours, 1222 releases; waiting 488 ms; commit 1292 ms)
2026-11-07T16:55:18Z [load_day 2023-03-10] 2023-03-10 hour 16: 169001 events in 4 files, snapshot 5041342029350386502 (task 14137 ms: download 8178 ms overlapping gunzip 820 ms, parse 3613 ms, sort 110 ms, write 8193 ms, index 557 ms: 6 candidates, 87478 repo-hours, 821 releases; waiting 555 ms; commit 1353 ms)
2026-11-07T16:55:27Z [load_day 2023-03-10] 2023-03-10 hour 17: 187949 events in 4 files, snapshot 8586015051502288244 (task 15069 ms: download 8333 ms overlapping gunzip 892 ms, parse 3845 ms, sort 122 ms, write 8682 ms, index 599 ms: 8 candidates, 87710 repo-hours, 938 releases; waiting 596 ms; commit 1406 ms)
2026-11-07T16:55:34Z [load_day 2023-03-10] 2023-03-10 hour 18: 184788 events in 4 files, snapshot 5042694412430246778 (task 15025 ms: download 8265 ms overlapping gunzip 861 ms, parse 3831 ms, sort 117 ms, write 8680 ms, index 691 ms: 4 candidates, 81776 repo-hours, 1039 releases; waiting 521 ms; commit 1387 ms)
2026-11-07T16:55:41Z [load_day 2023-03-10] 2023-03-10 hour 19: 172345 events in 4 files, snapshot 3561705114408530365 (task 13842 ms: download 7936 ms overlapping gunzip 831 ms, parse 3658 ms, sort 111 ms, write 7740 ms, index 496 ms: 4 candidates, 71453 repo-hours, 856 releases; waiting 633 ms; commit 1434 ms)
2026-11-07T16:55:49Z [load_day 2023-03-10] 2023-03-10 hour 20: 171105 events in 4 files, snapshot 3643166773867413283 (task 14888 ms: download 6714 ms overlapping gunzip 850 ms, parse 3767 ms, sort 112 ms, write 7524 ms, index 574 ms: 10 candidates, 75422 repo-hours, 961 releases; waiting 1692 ms; commit 1595 ms)
2026-11-07T16:55:55Z [load_day 2023-03-10] 2023-03-10 hour 21: 176484 events in 4 files, snapshot 3393447318067674386 (task 12668 ms: download 4979 ms overlapping gunzip 750 ms, parse 3232 ms, sort 99 ms, write 7257 ms, index 514 ms: 9 candidates, 83441 repo-hours, 946 releases; waiting 532 ms; commit 1328 ms)
2026-11-07T16:56:02Z [load_day 2023-03-10] 2023-03-10 hour 22: 168242 events in 4 files, snapshot 4068962450253168287 (task 12300 ms: download 4835 ms overlapping gunzip 744 ms, parse 3140 ms, sort 100 ms, write 6895 ms, index 562 ms: 5 candidates, 79276 repo-hours, 888 releases; waiting 511 ms; commit 1222 ms)
2026-11-07T16:56:09Z [load_day 2023-03-10] 2023-03-10 hour 23: 140498 events in 3 files, snapshot 3283602111583239452 (task 13611 ms: download 6474 ms overlapping gunzip 696 ms, parse 2899 ms, sort 96 ms, write 7083 ms, index 376 ms: 4 candidates, 56747 repo-hours, 806 releases; waiting 2092 ms; commit 1441 ms)
2026-11-07T16:56:17Z [load_day 2023-03-10] 2023-03-10: repo_hour merged from 24 files to 1 (1965896 rows, 8118 ms)
2026-11-07T16:56:19Z [load_day 2023-03-10] 2023-03-10: index committed in 9820 ms (24 + 1 + 24 files)
2026-11-07T16:56:19Z [load_day 2023-03-10] 2023-03-10: 4204375 events in 24 hours
2026-11-07T16:56:19Z [load_day 2023-03-10] attempt 1 succeeded