orcaLog in

Runs · run 903

load_day 2023-03-14, attempt 1 succeeded

Host
caf251265124:160062
Started
2026-11-07T17:04:18Z
Ended
2026-11-07T17:07:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/903/load_day/2023-03-14/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:04:18Z [load_day 2023-03-14] attempt 1 started
2026-11-07T17:04:19Z [load_day 2023-03-14] 2023-03-14: 2 hours in flight, about 1200 MB
2026-11-07T17:04:38Z [load_day 2023-03-14] 2023-03-14 hour 0: 185334 events in 4 files, snapshot 542799833016045760 (task 16297 ms: download 10641 ms overlapping gunzip 851 ms, parse 3839 ms, sort 127 ms, write 7697 ms, index 532 ms: 6 candidates, 85949 repo-hours, 977 releases; waiting 2885 ms; commit 1433 ms)
2026-11-07T17:04:40Z [load_day 2023-03-14] 2023-03-14 hour 1: 185777 events in 4 files, snapshot 128077084758513775 (task 13428 ms: download 7385 ms overlapping gunzip 810 ms, parse 3574 ms, sort 107 ms, write 7532 ms, index 561 ms: 7 candidates, 91755 repo-hours, 870 releases; waiting 525 ms; commit 1475 ms)
2026-11-07T17:04:53Z [load_day 2023-03-14] 2023-03-14 hour 2: 164220 events in 4 files, snapshot 3647398089870066918 (task 13738 ms: download 6815 ms overlapping gunzip 789 ms, parse 3278 ms, sort 104 ms, write 6480 ms, index 455 ms: 4 candidates, 69542 repo-hours, 765 releases; waiting 2293 ms; commit 1468 ms)
2026-11-07T17:04:54Z [load_day 2023-03-14] 2023-03-14 hour 3: 150555 events in 4 files, snapshot 7290639579760944293 (task 10843 ms: download 4592 ms overlapping gunzip 645 ms, parse 2776 ms, sort 103 ms, write 6062 ms, index 433 ms: 3 candidates, 63877 repo-hours, 935 releases; waiting 556 ms; commit 1589 ms)
2026-11-07T17:05:08Z [load_day 2023-03-14] 2023-03-14 hour 4: 145191 events in 3 files, snapshot 2987788771545157549 (task 10940 ms: download 4729 ms overlapping gunzip 608 ms, parse 2605 ms, sort 110 ms, write 5897 ms, index 472 ms: 5 candidates, 66735 repo-hours, 660 releases; waiting 981 ms; commit 4643 ms)
2026-11-07T17:05:09Z [load_day 2023-03-14] 2023-03-14 hour 5: 145215 events in 3 files, snapshot 1686525029493241936 (task 11172 ms: download 4730 ms overlapping gunzip 678 ms, parse 2847 ms, sort 105 ms, write 6282 ms, index 393 ms: 6 candidates, 61407 repo-hours, 746 releases; waiting 557 ms; commit 1641 ms)
2026-11-07T17:05:18Z [load_day 2023-03-14] 2023-03-14 hour 6: 168733 events in 4 files, snapshot 277268024880812102 (task 12833 ms: download 5311 ms overlapping gunzip 758 ms, parse 3175 ms, sort 101 ms, write 7086 ms, index 522 ms: 8 candidates, 75244 repo-hours, 822 releases; waiting 902 ms; commit 1472 ms)
2026-11-07T17:05:24Z [load_day 2023-03-14] 2023-03-14 hour 7: 175086 events in 4 files, snapshot 4841725430399689448 (task 14079 ms: download 7891 ms overlapping gunzip 823 ms, parse 3607 ms, sort 116 ms, write 7928 ms, index 575 ms: 8 candidates, 76825 repo-hours, 931 releases; waiting 578 ms; commit 1766 ms)
2026-11-07T17:05:34Z [load_day 2023-03-14] 2023-03-14 hour 8: 190594 events in 4 files, snapshot 1753846749761188326 (task 15476 ms: download 8643 ms overlapping gunzip 939 ms, parse 4132 ms, sort 155 ms, write 8840 ms, index 576 ms: 10 candidates, 85875 repo-hours, 1137 releases; waiting 520 ms; commit 1473 ms)
2026-11-07T17:05:43Z [load_day 2023-03-14] 2023-03-14 hour 9: 202971 events in 5 files, snapshot 8642060306760049033 (task 18332 ms: download 10612 ms overlapping gunzip 1065 ms, parse 4676 ms, sort 136 ms, write 9800 ms, index 619 ms: 5 candidates, 90632 repo-hours, 1264 releases; waiting 1686 ms; commit 1374 ms)
2026-11-07T17:05:52Z [load_day 2023-03-14] 2023-03-14 hour 10: 200170 events in 5 files, snapshot 9045717747132518425 (task 16603 ms: download 9162 ms overlapping gunzip 1010 ms, parse 4426 ms, sort 128 ms, write 9731 ms, index 562 ms: 5 candidates, 88057 repo-hours, 987 releases; waiting 385 ms; commit 1463 ms)
2026-11-07T17:06:00Z [load_day 2023-03-14] 2023-03-14 hour 11: 207486 events in 5 files, snapshot 8559357020869002013 (task 16125 ms: download 8827 ms overlapping gunzip 982 ms, parse 4269 ms, sort 121 ms, write 9350 ms, index 579 ms: 4 candidates, 88500 repo-hours, 1069 releases; waiting 513 ms; commit 1597 ms)
2026-11-07T17:06:11Z [load_day 2023-03-14] 2023-03-14 hour 12: 236672 events in 5 files, snapshot 4958061493378942504 (task 18158 ms: download 11101 ms overlapping gunzip 1033 ms, parse 4598 ms, sort 171 ms, write 10251 ms, index 863 ms: 8 candidates, 124068 repo-hours, 1159 releases; waiting 741 ms; commit 1531 ms)
2026-11-07T17:06:19Z [load_day 2023-03-14] 2023-03-14 hour 13: 231410 events in 5 files, snapshot 4468260993428581920 (task 18493 ms: download 11785 ms overlapping gunzip 1081 ms, parse 4715 ms, sort 141 ms, write 10658 ms, index 797 ms: 5 candidates, 118006 repo-hours, 1065 releases; waiting 726 ms; commit 1419 ms)
2026-11-07T17:06:31Z [load_day 2023-03-14] 2023-03-14 hour 14: 226153 events in 5 files, snapshot 5022954212939481289 (task 19232 ms: download 12631 ms overlapping gunzip 1132 ms, parse 5181 ms, sort 152 ms, write 11103 ms, index 776 ms: 8 candidates, 103043 repo-hours, 1248 releases; waiting 525 ms; commit 1694 ms)
2026-11-07T17:06:39Z [load_day 2023-03-14] 2023-03-14 hour 15: 218765 events in 5 files, snapshot 4644183597986160185 (task 18304 ms: download 12341 ms overlapping gunzip 1105 ms, parse 4777 ms, sort 130 ms, write 10799 ms, index 686 ms: 6 candidates, 100498 repo-hours, 1328 releases; waiting 564 ms; commit 1474 ms)
2026-11-07T17:06:51Z [load_day 2023-03-14] 2023-03-14 hour 16: 219030 events in 5 files, snapshot 4995601368620990446 (task 19667 ms: download 13627 ms overlapping gunzip 1159 ms, parse 5223 ms, sort 150 ms, write 10925 ms, index 690 ms: 11 candidates, 98215 repo-hours, 1233 releases; waiting 1165 ms; commit 1374 ms)
2026-11-07T17:06:57Z [load_day 2023-03-14] 2023-03-14 hour 17: 212055 events in 5 files, snapshot 4817243893042293231 (task 17778 ms: download 12014 ms overlapping gunzip 1093 ms, parse 4782 ms, sort 135 ms, write 10564 ms, index 646 ms: 5 candidates, 93206 repo-hours, 1086 releases; waiting 272 ms; commit 1474 ms)
2026-11-07T17:07:11Z [load_day 2023-03-14] 2023-03-14 hour 18: 212579 events in 5 files, snapshot 17037376500242848 (task 18643 ms: download 10775 ms overlapping gunzip 1053 ms, parse 4821 ms, sort 138 ms, write 9789 ms, index 612 ms: 5 candidates, 98713 repo-hours, 1099 releases; waiting 1953 ms; commit 1374 ms)
2026-11-07T17:07:14Z [load_day 2023-03-14] 2023-03-14 hour 19: 198829 events in 4 files, snapshot 2892661491527541606 (task 16198 ms: download 8934 ms overlapping gunzip 969 ms, parse 4275 ms, sort 133 ms, write 9260 ms, index 584 ms: 8 candidates, 84325 repo-hours, 1006 releases; waiting 663 ms; commit 1479 ms)
2026-11-07T17:07:28Z [load_day 2023-03-14] 2023-03-14 hour 20: 195873 events in 4 files, snapshot 7298561630597615250 (task 16314 ms: download 9253 ms overlapping gunzip 981 ms, parse 4349 ms, sort 148 ms, write 9203 ms, index 585 ms: 6 candidates, 83035 repo-hours, 933 releases; waiting 702 ms; commit 1665 ms)
2026-11-07T17:07:33Z [load_day 2023-03-14] 2023-03-14 hour 21: 185858 events in 4 files, snapshot 6535529779162027865 (task 17885 ms: download 11118 ms overlapping gunzip 992 ms, parse 4195 ms, sort 119 ms, write 8769 ms, index 529 ms: 6 candidates, 74922 repo-hours, 1165 releases; waiting 2897 ms; commit 1532 ms)
2026-11-07T17:07:43Z [load_day 2023-03-14] 2023-03-14 hour 22: 173738 events in 4 files, snapshot 7033557643598207279 (task 14266 ms: download 8709 ms overlapping gunzip 874 ms, parse 3707 ms, sort 111 ms, write 7972 ms, index 467 ms: 0 candidates, 68560 repo-hours, 943 releases; waiting 823 ms; commit 1571 ms)
2026-11-07T17:07:47Z [load_day 2023-03-14] 2023-03-14 hour 23: 162051 events in 4 files, snapshot 4221861443293433670 (task 12960 ms: download 5662 ms overlapping gunzip 791 ms, parse 3397 ms, sort 103 ms, write 7159 ms, index 452 ms: 5 candidates, 66625 repo-hours, 772 releases; waiting 756 ms; commit 1552 ms)
2026-11-07T17:07:55Z [load_day 2023-03-14] 2023-03-14: repo_hour merged from 24 files to 1 (2057614 rows, 8362 ms)
2026-11-07T17:07:57Z [load_day 2023-03-14] 2023-03-14: index committed in 10439 ms (23 + 1 + 24 files)
2026-11-07T17:07:57Z [load_day 2023-03-14] 2023-03-14: 4594345 events in 24 hours
2026-11-07T17:07:57Z [load_day 2023-03-14] attempt 1 succeeded