orcaLog in

Runs · run 1733

load_day 2023-11-13, attempt 1 succeeded

Host
3c2b29713ce8:548836
Started
2026-11-08T02:44:58Z
Ended
2026-11-08T02:49:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1733/load_day/2023-11-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:44:58Z [load_day 2023-11-13] attempt 1 started
2026-11-08T02:44:59Z [load_day 2023-11-13] 2023-11-13: 2 hours in flight, about 1200 MB
2026-11-08T02:45:20Z [load_day 2023-11-13] 2023-11-13 hour 0: 158890 events in 4 files, snapshot 8479936423849909027 (task 15721 ms: download 6580 ms overlapping gunzip 941 ms, parse 4297 ms, sort 128 ms, write 9387 ms, index 749 ms: 6 candidates, 85277 repo-hours, 828 releases; waiting 15 ms; commit 3198 ms)
2026-11-08T02:45:25Z [load_day 2023-11-13] 2023-11-13 hour 1: 171050 events in 4 files, snapshot 1195405332456170975 (task 17162 ms: download 10430 ms overlapping gunzip 1030 ms, parse 4454 ms, sort 113 ms, write 10670 ms, index 673 ms: 4 candidates, 94498 repo-hours, 821 releases; waiting 17 ms; commit 4719 ms)
2026-11-08T02:45:44Z [load_day 2023-11-13] 2023-11-13 hour 2: 141913 events in 3 files, snapshot 1309396019956005885 (task 14110 ms: download 6067 ms overlapping gunzip 848 ms, parse 3454 ms, sort 134 ms, write 8889 ms, index 557 ms: 3 candidates, 61007 repo-hours, 784 releases; waiting 18 ms; commit 11689 ms)
2026-11-08T02:45:53Z [load_day 2023-11-13] 2023-11-13 hour 3: 148914 events in 3 files, snapshot 3548583303173557528 (task 16966 ms: download 6517 ms overlapping gunzip 991 ms, parse 3939 ms, sort 112 ms, write 10912 ms, index 779 ms: 3 candidates, 61872 repo-hours, 1351 releases; waiting 23 ms; commit 8711 ms)
2026-11-08T02:45:56Z [load_day 2023-11-13] 2023-11-13 hour 4: 142352 events in 3 files, snapshot 3704892924897456865 (task 16904 ms: download 7915 ms overlapping gunzip 1226 ms, parse 4850 ms, sort 133 ms, write 9759 ms, index 702 ms: 4 candidates, 57162 repo-hours, 709 releases; waiting 20 ms; commit 2902 ms)
2026-11-08T02:46:04Z [load_day 2023-11-13] 2023-11-13 hour 5: 143507 events in 3 files, snapshot 1065307479713658796 (task 16028 ms: download 7356 ms overlapping gunzip 1111 ms, parse 4623 ms, sort 235 ms, write 9404 ms, index 437 ms: 3 candidates, 58590 repo-hours, 676 releases; waiting 19 ms; commit 2497 ms)
2026-11-08T02:46:15Z [load_day 2023-11-13] 2023-11-13 hour 6: 163779 events in 4 files, snapshot 2865037021262011919 (task 17286 ms: download 9638 ms overlapping gunzip 989 ms, parse 4334 ms, sort 148 ms, write 10426 ms, index 649 ms: 7 candidates, 72257 repo-hours, 787 releases; waiting 508 ms; commit 4014 ms)
2026-11-08T02:46:27Z [load_day 2023-11-13] 2023-11-13 hour 7: 171744 events in 4 files, snapshot 7642018231079562295 (task 20631 ms: download 11524 ms overlapping gunzip 1118 ms, parse 4947 ms, sort 109 ms, write 13012 ms, index 641 ms: 8 candidates, 72635 repo-hours, 782 releases; waiting 517 ms; commit 3542 ms)
2026-11-08T02:46:36Z [load_day 2023-11-13] 2023-11-13 hour 8: 191164 events in 4 files, snapshot 6323683651265568399 (task 20846 ms: download 11404 ms overlapping gunzip 1309 ms, parse 5342 ms, sort 143 ms, write 12965 ms, index 872 ms: 8 candidates, 82031 repo-hours, 987 releases; waiting 22 ms; commit 2893 ms)
2026-11-08T02:46:53Z [load_day 2023-11-13] 2023-11-13 hour 9: 200593 events in 5 files, snapshot 1087718771543911426 (task 24504 ms: download 13602 ms overlapping gunzip 1637 ms, parse 6979 ms, sort 186 ms, write 13831 ms, index 692 ms: 5 candidates, 84264 repo-hours, 1169 releases; waiting 540 ms; commit 3805 ms)
2026-11-08T02:46:59Z [load_day 2023-11-13] 2023-11-13 hour 10: 198327 events in 4 files, snapshot 5736932316429452398 (task 22008 ms: download 12825 ms overlapping gunzip 1293 ms, parse 5486 ms, sort 169 ms, write 13674 ms, index 633 ms: 10 candidates, 84512 repo-hours, 1093 releases; waiting 198 ms; commit 2537 ms)
2026-11-08T02:47:11Z [load_day 2023-11-13] 2023-11-13 hour 11: 194348 events in 4 files, snapshot 8551549677986046386 (task 17695 ms: download 9851 ms overlapping gunzip 1091 ms, parse 4621 ms, sort 137 ms, write 11010 ms, index 637 ms: 3 candidates, 81355 repo-hours, 1070 releases; waiting 15 ms; commit 3124 ms)
2026-11-08T02:47:24Z [load_day 2023-11-13] 2023-11-13 hour 12: 243631 events in 5 files, snapshot 6725578341258566146 (task 22478 ms: download 13169 ms overlapping gunzip 1441 ms, parse 6211 ms, sort 189 ms, write 13548 ms, index 885 ms: 6 candidates, 112536 repo-hours, 1200 releases; waiting 18 ms; commit 3380 ms)
2026-11-08T02:47:38Z [load_day 2023-11-13] 2023-11-13 hour 13: 228902 events in 5 files, snapshot 6134403551545310242 (task 25194 ms: download 16447 ms overlapping gunzip 1582 ms, parse 6653 ms, sort 187 ms, write 15692 ms, index 846 ms: 14 candidates, 109416 repo-hours, 1127 releases; waiting 19 ms; commit 3139 ms)
2026-11-08T02:47:52Z [load_day 2023-11-13] 2023-11-13 hour 14: 226564 events in 5 files, snapshot 6172695864086707031 (task 26946 ms: download 17292 ms overlapping gunzip 1540 ms, parse 6798 ms, sort 196 ms, write 16439 ms, index 1762 ms: 6 candidates, 98375 repo-hours, 1226 releases; waiting 17 ms; commit 3111 ms)
2026-11-08T02:48:07Z [load_day 2023-11-13] 2023-11-13 hour 15: 227675 events in 5 files, snapshot 3135135865739289511 (task 27770 ms: download 18191 ms overlapping gunzip 1521 ms, parse 6892 ms, sort 183 ms, write 17397 ms, index 1567 ms: 9 candidates, 100197 repo-hours, 1292 releases; waiting 16 ms; commit 3320 ms)
2026-11-08T02:48:20Z [load_day 2023-11-13] 2023-11-13 hour 16: 217256 events in 5 files, snapshot 1747061905543329520 (task 26183 ms: download 18364 ms overlapping gunzip 1588 ms, parse 7070 ms, sort 191 ms, write 16293 ms, index 816 ms: 11 candidates, 95727 repo-hours, 1169 releases; waiting 18 ms; commit 3626 ms)
2026-11-08T02:48:34Z [load_day 2023-11-13] 2023-11-13 hour 17: 207383 events in 5 files, snapshot 3996778780488968223 (task 25639 ms: download 18609 ms overlapping gunzip 1601 ms, parse 6746 ms, sort 162 ms, write 15544 ms, index 811 ms: 7 candidates, 89579 repo-hours, 1089 releases; waiting 491 ms; commit 3271 ms)
2026-11-08T02:48:43Z [load_day 2023-11-13] 2023-11-13 hour 18: 208074 events in 5 files, snapshot 4158075675822847102 (task 23670 ms: download 16475 ms overlapping gunzip 1665 ms, parse 7382 ms, sort 180 ms, write 13444 ms, index 749 ms: 6 candidates, 92491 repo-hours, 1021 releases; waiting 25 ms; commit 2327 ms)
2026-11-08T02:48:58Z [load_day 2023-11-13] 2023-11-13 hour 19: 197904 events in 4 files, snapshot 1128771731402349421 (task 23416 ms: download 12671 ms overlapping gunzip 1649 ms, parse 6884 ms, sort 208 ms, write 13432 ms, index 705 ms: 8 candidates, 81778 repo-hours, 1049 releases; waiting 15 ms; commit 3022 ms)
2026-11-08T02:49:06Z [load_day 2023-11-13] 2023-11-13 hour 20: 184646 events in 4 files, snapshot 6822673294002771101 (task 21326 ms: download 12549 ms overlapping gunzip 1157 ms, parse 4824 ms, sort 148 ms, write 13901 ms, index 1062 ms: 17 candidates, 79172 repo-hours, 1038 releases; waiting 23 ms; commit 2667 ms)
2026-11-08T02:49:21Z [load_day 2023-11-13] 2023-11-13 hour 21: 186347 events in 4 files, snapshot 7791985995334898500 (task 21663 ms: download 13012 ms overlapping gunzip 1354 ms, parse 5913 ms, sort 136 ms, write 12973 ms, index 526 ms: 12 candidates, 74740 repo-hours, 1130 releases; waiting 484 ms; commit 2917 ms)
2026-11-08T02:49:28Z [load_day 2023-11-13] 2023-11-13 hour 22: 173114 events in 4 files, snapshot 5616631527160556410 (task 20070 ms: download 12678 ms overlapping gunzip 1279 ms, parse 5567 ms, sort 110 ms, write 12420 ms, index 492 ms: 8 candidates, 69074 repo-hours, 1117 releases; waiting 24 ms; commit 3658 ms)
2026-11-08T02:49:38Z [load_day 2023-11-13] 2023-11-13 hour 23: 154770 events in 4 files, snapshot 7684233080248401602 (task 16675 ms: download 10316 ms overlapping gunzip 1094 ms, parse 4593 ms, sort 98 ms, write 10207 ms, index 452 ms: 5 candidates, 64064 repo-hours, 855 releases; waiting 20 ms; commit 2513 ms)
2026-11-08T02:49:46Z [load_day 2023-11-13] 2023-11-13: repo_hour merged from 24 files to 1 (1962609 rows, 8379 ms)
2026-11-08T02:49:49Z [load_day 2023-11-13] 2023-11-13: index committed in 10689 ms (24 + 1 + 24 files)
2026-11-08T02:49:49Z [load_day 2023-11-13] 2023-11-13: 4482847 events in 24 hours
2026-11-08T02:49:49Z [load_day 2023-11-13] attempt 1 succeeded