orcaLog in

Runs · run 753

load_day 2023-01-23, attempt 1 succeeded

Host
d3d1748bf284:33711
Started
2026-11-07T14:06:07Z
Ended
2026-11-07T14:09:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/753/load_day/2023-01-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:06:07Z [load_day 2023-01-23] attempt 1 started
2026-11-07T14:06:09Z [load_day 2023-01-23] 2023-01-23: 2 hours in flight, about 1200 MB
2026-11-07T14:06:20Z [load_day 2023-01-23] 2023-01-23 hour 0: 125472 events in 3 files, snapshot 7123862391743863428 (task 8948 ms: download 2988 ms overlapping gunzip 550 ms, parse 2420 ms, sort 70 ms, write 4651 ms, index 390 ms: 9 candidates, 60385 repo-hours, 799 releases; waiting 526 ms; commit 1309 ms)
2026-11-07T14:06:22Z [load_day 2023-01-23] 2023-01-23 hour 1: 119966 events in 3 files, snapshot 2044935905048988934 (task 8865 ms: download 2929 ms overlapping gunzip 477 ms, parse 2159 ms, sort 54 ms, write 4312 ms, index 382 ms: 5 candidates, 61985 repo-hours, 658 releases; waiting 1120 ms; commit 1316 ms)
2026-11-07T14:06:32Z [load_day 2023-01-23] 2023-01-23 hour 2: 127666 events in 3 files, snapshot 5972460592763718649 (task 11073 ms: download 5155 ms overlapping gunzip 781 ms, parse 3017 ms, sort 62 ms, write 6101 ms, index 307 ms: 8 candidates, 50699 repo-hours, 543 releases; waiting 513 ms; commit 1562 ms)
2026-11-07T14:06:34Z [load_day 2023-01-23] 2023-01-23 hour 3: 132182 events in 3 files, snapshot 7742879751157516758 (task 10665 ms: download 5111 ms overlapping gunzip 727 ms, parse 2943 ms, sort 67 ms, write 5781 ms, index 301 ms: 4 candidates, 42753 repo-hours, 627 releases; waiting 522 ms; commit 1441 ms)
2026-11-07T14:06:44Z [load_day 2023-01-23] 2023-01-23 hour 4: 133759 events in 3 files, snapshot 5359159654346054504 (task 11414 ms: download 5867 ms overlapping gunzip 708 ms, parse 2854 ms, sort 61 ms, write 5707 ms, index 273 ms: 0 candidates, 45431 repo-hours, 435 releases; waiting 1217 ms; commit 1331 ms)
2026-11-07T14:06:45Z [load_day 2023-01-23] 2023-01-23 hour 5: 132524 events in 3 files, snapshot 7446187170103428889 (task 9653 ms: download 4571 ms overlapping gunzip 632 ms, parse 2641 ms, sort 63 ms, write 5153 ms, index 297 ms: 1 candidates, 46274 repo-hours, 633 releases; waiting 574 ms; commit 1379 ms)
2026-11-07T14:06:55Z [load_day 2023-01-23] 2023-01-23 hour 6: 136672 events in 3 files, snapshot 5723246366856889844 (task 10319 ms: download 5021 ms overlapping gunzip 695 ms, parse 2901 ms, sort 85 ms, write 5478 ms, index 321 ms: 3 candidates, 52476 repo-hours, 683 releases; waiting 510 ms; commit 1395 ms)
2026-11-07T14:06:58Z [load_day 2023-01-23] 2023-01-23 hour 7: 145093 events in 3 files, snapshot 2310682457676707843 (task 11825 ms: download 5565 ms overlapping gunzip 733 ms, parse 3037 ms, sort 86 ms, write 6247 ms, index 385 ms: 1 candidates, 54375 repo-hours, 603 releases; waiting 1002 ms; commit 1283 ms)
2026-11-07T14:07:09Z [load_day 2023-01-23] 2023-01-23 hour 8: 166764 events in 4 files, snapshot 1697820953474386685 (task 13758 ms: download 8416 ms overlapping gunzip 901 ms, parse 3734 ms, sort 93 ms, write 7634 ms, index 420 ms: 4 candidates, 64145 repo-hours, 790 releases; waiting 572 ms; commit 1245 ms)
2026-11-07T14:07:15Z [load_day 2023-01-23] 2023-01-23 hour 9: 183108 events in 4 files, snapshot 29153863558758198 (task 16632 ms: download 10203 ms overlapping gunzip 1034 ms, parse 4349 ms, sort 107 ms, write 8987 ms, index 445 ms: 3 candidates, 70130 repo-hours, 1029 releases; waiting 1220 ms; commit 1378 ms)
2026-11-07T14:07:26Z [load_day 2023-01-23] 2023-01-23 hour 10: 187475 events in 4 files, snapshot 8429785331562592900 (task 15747 ms: download 9422 ms overlapping gunzip 1023 ms, parse 4305 ms, sort 101 ms, write 9035 ms, index 473 ms: 5 candidates, 73972 repo-hours, 989 releases; waiting 536 ms; commit 1493 ms)
2026-11-07T14:07:32Z [load_day 2023-01-23] 2023-01-23 hour 11: 184020 events in 4 files, snapshot 7912191523867692892 (task 15555 ms: download 9418 ms overlapping gunzip 1021 ms, parse 4241 ms, sort 100 ms, write 8867 ms, index 468 ms: 2 candidates, 71539 repo-hours, 906 releases; waiting 530 ms; commit 1376 ms)
2026-11-07T14:07:43Z [load_day 2023-01-23] 2023-01-23 hour 12: 214141 events in 5 files, snapshot 848098657186811372 (task 16395 ms: download 8978 ms overlapping gunzip 1001 ms, parse 4326 ms, sort 104 ms, write 9343 ms, index 651 ms: 6 candidates, 98901 repo-hours, 910 releases; waiting 540 ms; commit 1402 ms)
2026-11-07T14:07:51Z [load_day 2023-01-23] 2023-01-23 hour 13: 220670 events in 5 files, snapshot 1967452900334356032 (task 18048 ms: download 12220 ms overlapping gunzip 1131 ms, parse 4789 ms, sort 128 ms, write 10392 ms, index 631 ms: 4 candidates, 98689 repo-hours, 1184 releases; waiting 667 ms; commit 1332 ms)
2026-11-07T14:08:02Z [load_day 2023-01-23] 2023-01-23 hour 14: 211761 events in 5 files, snapshot 4693466045646498148 (task 18032 ms: download 12662 ms overlapping gunzip 1121 ms, parse 4854 ms, sort 130 ms, write 10503 ms, index 581 ms: 2 candidates, 86822 repo-hours, 1229 releases; waiting 518 ms; commit 1329 ms)
2026-11-07T14:08:10Z [load_day 2023-01-23] 2023-01-23 hour 15: 216346 events in 5 files, snapshot 3018546818753533255 (task 18335 ms: download 12548 ms overlapping gunzip 1159 ms, parse 4969 ms, sort 121 ms, write 10649 ms, index 629 ms: 5 candidates, 88576 repo-hours, 1342 releases; waiting 512 ms; commit 1374 ms)
2026-11-07T14:08:23Z [load_day 2023-01-23] 2023-01-23 hour 16: 200939 events in 5 files, snapshot 989399980839798414 (task 17366 ms: download 9966 ms overlapping gunzip 1097 ms, parse 4675 ms, sort 118 ms, write 10066 ms, index 555 ms: 2 candidates, 85126 repo-hours, 952 releases; waiting 508 ms; commit 3925 ms)
2026-11-07T14:08:28Z [load_day 2023-01-23] 2023-01-23 hour 17: 205854 events in 5 files, snapshot 1783208078288473656 (task 17461 ms: download 10090 ms overlapping gunzip 1106 ms, parse 4659 ms, sort 119 ms, write 10224 ms, index 551 ms: 6 candidates, 84498 repo-hours, 968 releases; waiting 490 ms; commit 1294 ms)
2026-11-07T14:08:40Z [load_day 2023-01-23] 2023-01-23 hour 18: 204847 events in 5 files, snapshot 6303776985082451973 (task 19022 ms: download 10891 ms overlapping gunzip 1092 ms, parse 4653 ms, sort 113 ms, write 10184 ms, index 548 ms: 5 candidates, 85121 repo-hours, 1004 releases; waiting 1575 ms; commit 1238 ms)
2026-11-07T14:08:48Z [load_day 2023-01-23] 2023-01-23 hour 19: 197513 events in 4 files, snapshot 5360197920393994106 (task 19238 ms: download 11765 ms overlapping gunzip 1108 ms, parse 4689 ms, sort 118 ms, write 9271 ms, index 1029 ms: 6 candidates, 77065 repo-hours, 999 releases; waiting 2640 ms; commit 1278 ms)
2026-11-07T14:08:58Z [load_day 2023-01-23] 2023-01-23 hour 20: 200590 events in 5 files, snapshot 1990979158604405880 (task 17328 ms: download 10241 ms overlapping gunzip 1113 ms, parse 4742 ms, sort 121 ms, write 9775 ms, index 513 ms: 5 candidates, 77989 repo-hours, 975 releases; waiting 723 ms; commit 1368 ms)
2026-11-07T14:09:08Z [load_day 2023-01-23] 2023-01-23 hour 21: 195930 events in 4 files, snapshot 511842392071276289 (task 19089 ms: download 11686 ms overlapping gunzip 1242 ms, parse 5116 ms, sort 117 ms, write 9933 ms, index 478 ms: 4 candidates, 71724 repo-hours, 1074 releases; waiting 1695 ms; commit 1451 ms)
2026-11-07T14:09:15Z [load_day 2023-01-23] 2023-01-23 hour 22: 180985 events in 4 files, snapshot 2764845284580009836 (task 16054 ms: download 9965 ms overlapping gunzip 1008 ms, parse 4258 ms, sort 116 ms, write 9050 ms, index 447 ms: 5 candidates, 67335 repo-hours, 935 releases; waiting 777 ms; commit 1288 ms)
2026-11-07T14:09:23Z [load_day 2023-01-23] 2023-01-23 hour 23: 166611 events in 4 files, snapshot 6272768675853330614 (task 14278 ms: download 8964 ms overlapping gunzip 947 ms, parse 3955 ms, sort 78 ms, write 7966 ms, index 418 ms: 3 candidates, 61760 repo-hours, 723 releases; waiting 617 ms; commit 1277 ms)
2026-11-07T14:09:30Z [load_day 2023-01-23] 2023-01-23: repo_hour merged from 24 files to 1 (1677770 rows, 6874 ms)
2026-11-07T14:09:32Z [load_day 2023-01-23] 2023-01-23: index committed in 9020 ms (23 + 1 + 24 files)
2026-11-07T14:09:32Z [load_day 2023-01-23] 2023-01-23: 4190888 events in 24 hours
2026-11-07T14:09:32Z [load_day 2023-01-23] attempt 1 succeeded