orcaLog in

Runs · run 816

load_day 2023-02-13, attempt 1 succeeded

Host
caf251265124:48430
Started
2026-11-07T15:28:44Z
Ended
2026-11-07T15:32:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/816/load_day/2023-02-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:28:44Z [load_day 2023-02-13] attempt 1 started
2026-11-07T15:28:45Z [load_day 2023-02-13] 2023-02-13: 2 hours in flight, about 1200 MB
2026-11-07T15:28:56Z [load_day 2023-02-13] 2023-02-13 hour 0: 123036 events in 3 files, snapshot 7923897500653238362 (task 8298 ms: download 1774 ms overlapping gunzip 499 ms, parse 2285 ms, sort 66 ms, write 4476 ms, index 407 ms: 8 candidates, 60617 repo-hours, 771 releases; waiting 269 ms; commit 1293 ms)
2026-11-07T15:28:59Z [load_day 2023-02-13] 2023-02-13 hour 1: 137851 events in 3 files, snapshot 1773078121404231491 (task 10588 ms: download 4367 ms overlapping gunzip 665 ms, parse 2815 ms, sort 93 ms, write 5674 ms, index 476 ms: 3 candidates, 71166 repo-hours, 793 releases; waiting 506 ms; commit 1407 ms)
2026-11-07T15:29:13Z [load_day 2023-02-13] 2023-02-13 hour 2: 147755 events in 3 files, snapshot 9094573748223310967 (task 16002 ms: download 10911 ms overlapping gunzip 1028 ms, parse 3987 ms, sort 136 ms, write 7695 ms, index 459 ms: 4 candidates, 65590 repo-hours, 759 releases; waiting 2293 ms; commit 1581 ms)
2026-11-07T15:29:15Z [load_day 2023-02-13] 2023-02-13 hour 3: 143033 events in 3 files, snapshot 221861157107500672 (task 13615 ms: download 6466 ms overlapping gunzip 983 ms, parse 3806 ms, sort 106 ms, write 7668 ms, index 387 ms: 7 candidates, 55869 repo-hours, 746 releases; waiting 384 ms; commit 1446 ms)
2026-11-07T15:29:27Z [load_day 2023-02-13] 2023-02-13 hour 4: 139568 events in 3 files, snapshot 1568985860577515537 (task 13173 ms: download 6580 ms overlapping gunzip 882 ms, parse 3471 ms, sort 106 ms, write 7275 ms, index 399 ms: 3 candidates, 53597 repo-hours, 573 releases; waiting 710 ms; commit 1521 ms)
2026-11-07T15:29:30Z [load_day 2023-02-13] 2023-02-13 hour 5: 154386 events in 4 files, snapshot 209997934556960564 (task 13983 ms: download 6523 ms overlapping gunzip 977 ms, parse 3855 ms, sort 112 ms, write 7735 ms, index 425 ms: 3 candidates, 58773 repo-hours, 732 releases; waiting 533 ms; commit 1964 ms)
2026-11-07T15:29:42Z [load_day 2023-02-13] 2023-02-13 hour 6: 164279 events in 4 files, snapshot 7771399660075733095 (task 13899 ms: download 6695 ms overlapping gunzip 906 ms, parse 3680 ms, sort 101 ms, write 7655 ms, index 444 ms: 6 candidates, 69040 repo-hours, 742 releases; waiting 798 ms; commit 1376 ms)
2026-11-07T15:29:49Z [load_day 2023-02-13] 2023-02-13 hour 7: 172402 events in 4 files, snapshot 7060146524024959589 (task 15071 ms: download 9278 ms overlapping gunzip 990 ms, parse 3986 ms, sort 106 ms, write 8390 ms, index 546 ms: 3 candidates, 70692 repo-hours, 813 releases; waiting 753 ms; commit 4306 ms)
2026-11-07T15:30:00Z [load_day 2023-02-13] 2023-02-13 hour 8: 187125 events in 4 files, snapshot 6459746537002151417 (task 17743 ms: download 11036 ms overlapping gunzip 1153 ms, parse 4672 ms, sort 124 ms, write 9662 ms, index 538 ms: 3 candidates, 79258 repo-hours, 1107 releases; waiting 1246 ms; commit 1291 ms)
2026-11-07T15:30:05Z [load_day 2023-02-13] 2023-02-13 hour 9: 199897 events in 4 files, snapshot 5600988423099867064 (task 18542 ms: download 10851 ms overlapping gunzip 1215 ms, parse 4991 ms, sort 138 ms, write 10741 ms, index 597 ms: 4 candidates, 83609 repo-hours, 1112 releases; waiting 516 ms; commit 1358 ms)
2026-11-07T15:30:20Z [load_day 2023-02-13] 2023-02-13 hour 10: 197841 events in 4 files, snapshot 3241025637068548889 (task 18641 ms: download 11155 ms overlapping gunzip 1219 ms, parse 5044 ms, sort 149 ms, write 10618 ms, index 589 ms: 3 candidates, 83100 repo-hours, 1082 releases; waiting 719 ms; commit 1435 ms)
2026-11-07T15:30:24Z [load_day 2023-02-13] 2023-02-13 hour 11: 198839 events in 4 files, snapshot 6891655457714200050 (task 18193 ms: download 10931 ms overlapping gunzip 1173 ms, parse 4780 ms, sort 130 ms, write 10195 ms, index 527 ms: 2 candidates, 82390 repo-hours, 1043 releases; waiting 992 ms; commit 1385 ms)
2026-11-07T15:30:40Z [load_day 2023-02-13] 2023-02-13 hour 12: 236210 events in 5 files, snapshot 6465574956307186724 (task 19687 ms: download 12887 ms overlapping gunzip 1199 ms, parse 4949 ms, sort 145 ms, write 10951 ms, index 746 ms: 8 candidates, 112222 repo-hours, 1076 releases; waiting 1141 ms; commit 1437 ms)
2026-11-07T15:30:45Z [load_day 2023-02-13] 2023-02-13 hour 13: 228131 events in 5 files, snapshot 2826437654321353734 (task 19957 ms: download 13242 ms overlapping gunzip 1213 ms, parse 5036 ms, sort 148 ms, write 11216 ms, index 745 ms: 6 candidates, 107504 repo-hours, 1154 releases; waiting 1261 ms; commit 1443 ms)
2026-11-07T15:31:01Z [load_day 2023-02-13] 2023-02-13 hour 14: 233818 events in 5 files, snapshot 1436259262333947256 (task 20763 ms: download 13689 ms overlapping gunzip 1310 ms, parse 5515 ms, sort 166 ms, write 12116 ms, index 697 ms: 6 candidates, 109957 repo-hours, 1211 releases; waiting 629 ms; commit 1374 ms)
2026-11-07T15:31:06Z [load_day 2023-02-13] 2023-02-13 hour 15: 230357 events in 5 files, snapshot 7071900258863491937 (task 20963 ms: download 13824 ms overlapping gunzip 1378 ms, parse 5724 ms, sort 148 ms, write 12613 ms, index 636 ms: 5 candidates, 98589 repo-hours, 1357 releases; waiting 197 ms; commit 1473 ms)
2026-11-07T15:31:22Z [load_day 2023-02-13] 2023-02-13 hour 16: 222742 events in 5 files, snapshot 8017009636722455509 (task 19609 ms: download 13375 ms overlapping gunzip 1220 ms, parse 5189 ms, sort 140 ms, write 11585 ms, index 645 ms: 6 candidates, 99798 repo-hours, 971 releases; waiting 542 ms; commit 1400 ms)
2026-11-07T15:31:26Z [load_day 2023-02-13] 2023-02-13 hour 17: 214045 events in 5 files, snapshot 4165556144623237750 (task 19569 ms: download 13738 ms overlapping gunzip 1201 ms, parse 4997 ms, sort 142 ms, write 11353 ms, index 591 ms: 5 candidates, 88408 repo-hours, 996 releases; waiting 951 ms; commit 1408 ms)
2026-11-07T15:31:41Z [load_day 2023-02-13] 2023-02-13 hour 18: 216410 events in 5 files, snapshot 3559742801266908144 (task 18808 ms: download 13174 ms overlapping gunzip 1246 ms, parse 5207 ms, sort 137 ms, write 10573 ms, index 584 ms: 9 candidates, 90492 repo-hours, 1015 releases; waiting 718 ms; commit 1319 ms)
2026-11-07T15:31:48Z [load_day 2023-02-13] 2023-02-13 hour 19: 205835 events in 5 files, snapshot 1124846778308491699 (task 20989 ms: download 13397 ms overlapping gunzip 1228 ms, parse 5126 ms, sort 138 ms, write 10562 ms, index 598 ms: 4 candidates, 81908 repo-hours, 890 releases; waiting 3012 ms; commit 1257 ms)
2026-11-07T15:32:00Z [load_day 2023-02-13] 2023-02-13 hour 20: 209218 events in 5 files, snapshot 5313343630736149730 (task 18082 ms: download 10497 ms overlapping gunzip 1178 ms, parse 4985 ms, sort 149 ms, write 10481 ms, index 566 ms: 9 candidates, 81436 repo-hours, 967 releases; waiting 397 ms; commit 1412 ms)
2026-11-07T15:32:07Z [load_day 2023-02-13] 2023-02-13 hour 21: 204827 events in 5 files, snapshot 4182342162607266014 (task 18127 ms: download 10391 ms overlapping gunzip 1208 ms, parse 4991 ms, sort 144 ms, write 10364 ms, index 592 ms: 4 candidates, 75875 repo-hours, 976 releases; waiting 534 ms; commit 1371 ms)
2026-11-07T15:32:19Z [load_day 2023-02-13] 2023-02-13 hour 22: 193581 events in 4 files, snapshot 6819681091174305987 (task 18480 ms: download 11165 ms overlapping gunzip 1309 ms, parse 5168 ms, sort 134 ms, write 10289 ms, index 468 ms: 3 candidates, 69760 repo-hours, 895 releases; waiting 697 ms; commit 1371 ms)
2026-11-07T15:32:21Z [load_day 2023-02-13] 2023-02-13 hour 23: 166849 events in 4 files, snapshot 6796154732683274169 (task 14106 ms: download 8637 ms overlapping gunzip 913 ms, parse 3787 ms, sort 103 ms, write 8017 ms, index 423 ms: 4 candidates, 63706 repo-hours, 738 releases; waiting 512 ms; commit 1243 ms)
2026-11-07T15:32:32Z [load_day 2023-02-13] 2023-02-13: repo_hour merged from 24 files to 1 (1913356 rows, 10158 ms)
2026-11-07T15:32:34Z [load_day 2023-02-13] 2023-02-13: index committed in 12374 ms (24 + 1 + 24 files)
2026-11-07T15:32:34Z [load_day 2023-02-13] 2023-02-13: 4528035 events in 24 hours
2026-11-07T15:32:34Z [load_day 2023-02-13] attempt 1 succeeded