orcaLog in

Runs · run 764

load_day 2023-01-26, attempt 1 succeeded

Host
d3d1748bf284:46920
Started
2026-11-07T14:22:10Z
Ended
2026-11-07T14:25:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/764/load_day/2023-01-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:22:10Z [load_day 2023-01-26] attempt 1 started
2026-11-07T14:22:12Z [load_day 2023-01-26] 2023-01-26: 2 hours in flight, about 1200 MB
2026-11-07T14:22:28Z [load_day 2023-01-26] 2023-01-26 hour 0: 157129 events in 4 files, snapshot 2212135618920202557 (task 13115 ms: download 6303 ms overlapping gunzip 930 ms, parse 3844 ms, sort 86 ms, write 7073 ms, index 462 ms: 6 candidates, 72637 repo-hours, 973 releases; waiting 488 ms; commit 1687 ms)
2026-11-07T14:22:29Z [load_day 2023-01-26] 2023-01-26 hour 1: 139277 events in 3 files, snapshot 8190816629115208423 (task 9991 ms: download 4513 ms overlapping gunzip 592 ms, parse 2723 ms, sort 67 ms, write 5301 ms, index 439 ms: 6 candidates, 70510 repo-hours, 761 releases; waiting 526 ms; commit 1435 ms)
2026-11-07T14:22:37Z [load_day 2023-01-26] 2023-01-26 hour 2: 119132 events in 3 files, snapshot 5332212000005414962 (task 8849 ms: download 3679 ms overlapping gunzip 563 ms, parse 2404 ms, sort 56 ms, write 4863 ms, index 361 ms: 3 candidates, 55331 repo-hours, 610 releases; waiting 294 ms; commit 1349 ms)
2026-11-07T14:22:41Z [load_day 2023-01-26] 2023-01-26 hour 3: 123350 events in 3 files, snapshot 7455745373276641549 (task 11008 ms: download 5327 ms overlapping gunzip 642 ms, parse 2817 ms, sort 66 ms, write 5475 ms, index 322 ms: 6 candidates, 48205 repo-hours, 659 releases; waiting 1049 ms; commit 1168 ms)
2026-11-07T14:22:46Z [load_day 2023-01-26] 2023-01-26 hour 4: 114216 events in 3 files, snapshot 5306979996542330925 (task 8543 ms: download 2298 ms overlapping gunzip 537 ms, parse 2312 ms, sort 47 ms, write 4530 ms, index 309 ms: 4 candidates, 45430 repo-hours, 521 releases; waiting 514 ms; commit 1264 ms)
2026-11-07T14:22:50Z [load_day 2023-01-26] 2023-01-26 hour 5: 115062 events in 3 files, snapshot 542451288850826337 (task 8552 ms: download 3585 ms overlapping gunzip 506 ms, parse 2180 ms, sort 54 ms, write 4402 ms, index 322 ms: 1 candidates, 47353 repo-hours, 653 releases; waiting 712 ms; commit 1385 ms)
2026-11-07T14:22:57Z [load_day 2023-01-26] 2023-01-26 hour 6: 127721 events in 3 files, snapshot 5175568222350168476 (task 9266 ms: download 3760 ms overlapping gunzip 583 ms, parse 2468 ms, sort 64 ms, write 5165 ms, index 365 ms: 2 candidates, 54354 repo-hours, 724 releases; waiting 311 ms; commit 1451 ms)
2026-11-07T14:23:01Z [load_day 2023-01-26] 2023-01-26 hour 7: 135719 events in 3 files, snapshot 2938986230535699127 (task 10431 ms: download 4520 ms overlapping gunzip 630 ms, parse 2724 ms, sort 90 ms, write 5793 ms, index 396 ms: 3 candidates, 55818 repo-hours, 700 releases; waiting 515 ms; commit 1264 ms)
2026-11-07T14:23:10Z [load_day 2023-01-26] 2023-01-26 hour 8: 154570 events in 4 files, snapshot 1384425256599451597 (task 12494 ms: download 5517 ms overlapping gunzip 797 ms, parse 3443 ms, sort 97 ms, write 6891 ms, index 428 ms: 2 candidates, 65936 repo-hours, 794 releases; waiting 509 ms; commit 1437 ms)
2026-11-07T14:23:17Z [load_day 2023-01-26] 2023-01-26 hour 9: 174771 events in 4 files, snapshot 1418510655210622010 (task 15009 ms: download 8801 ms overlapping gunzip 954 ms, parse 4153 ms, sort 100 ms, write 8373 ms, index 489 ms: 4 candidates, 71753 repo-hours, 997 releases; waiting 625 ms; commit 1413 ms)
2026-11-07T14:23:25Z [load_day 2023-01-26] 2023-01-26 hour 10: 175691 events in 4 files, snapshot 5386588007306460275 (task 14568 ms: download 8496 ms overlapping gunzip 953 ms, parse 4113 ms, sort 99 ms, write 8366 ms, index 493 ms: 4 candidates, 73551 repo-hours, 1004 releases; waiting 196 ms; commit 1385 ms)
2026-11-07T14:23:32Z [load_day 2023-01-26] 2023-01-26 hour 11: 172376 events in 4 files, snapshot 901022867141253931 (task 13730 ms: download 8021 ms overlapping gunzip 869 ms, parse 3801 ms, sort 91 ms, write 7799 ms, index 506 ms: 3 candidates, 71508 repo-hours, 957 releases; waiting 301 ms; commit 1352 ms)
2026-11-07T14:23:43Z [load_day 2023-01-26] 2023-01-26 hour 12: 206079 events in 5 files, snapshot 5451316211921814465 (task 16622 ms: download 9503 ms overlapping gunzip 926 ms, parse 4190 ms, sort 118 ms, write 8394 ms, index 634 ms: 7 candidates, 99359 repo-hours, 1052 releases; waiting 1891 ms; commit 1395 ms)
2026-11-07T14:23:49Z [load_day 2023-01-26] 2023-01-26 hour 13: 209448 events in 5 files, snapshot 8599933145963664318 (task 16988 ms: download 9411 ms overlapping gunzip 1079 ms, parse 4718 ms, sort 123 ms, write 9593 ms, index 620 ms: 5 candidates, 98537 repo-hours, 932 releases; waiting 511 ms; commit 1263 ms)
2026-11-07T14:24:00Z [load_day 2023-01-26] 2023-01-26 hour 14: 204366 events in 5 files, snapshot 3229881707373675281 (task 16438 ms: download 9037 ms overlapping gunzip 1016 ms, parse 4435 ms, sort 111 ms, write 9621 ms, index 553 ms: 2 candidates, 90100 repo-hours, 1056 releases; waiting 380 ms; commit 1469 ms)
2026-11-07T14:24:09Z [load_day 2023-01-26] 2023-01-26 hour 15: 215517 events in 5 files, snapshot 5908298380012155203 (task 19132 ms: download 13216 ms overlapping gunzip 1242 ms, parse 5337 ms, sort 121 ms, write 10948 ms, index 611 ms: 6 candidates, 92770 repo-hours, 1221 releases; waiting 539 ms; commit 1356 ms)
2026-11-07T14:24:18Z [load_day 2023-01-26] 2023-01-26 hour 16: 202123 events in 5 files, snapshot 464644226864519667 (task 17283 ms: download 9800 ms overlapping gunzip 1095 ms, parse 4744 ms, sort 103 ms, write 9890 ms, index 593 ms: 2 candidates, 89830 repo-hours, 1207 releases; waiting 588 ms; commit 1408 ms)
2026-11-07T14:24:26Z [load_day 2023-01-26] 2023-01-26 hour 17: 196725 events in 4 files, snapshot 1323625467530612150 (task 16539 ms: download 9225 ms overlapping gunzip 1025 ms, parse 4500 ms, sort 102 ms, write 9537 ms, index 541 ms: 7 candidates, 83685 repo-hours, 1146 releases; waiting 526 ms; commit 1299 ms)
2026-11-07T14:24:39Z [load_day 2023-01-26] 2023-01-26 hour 18: 213433 events in 5 files, snapshot 5933503816219255303 (task 20597 ms: download 13101 ms overlapping gunzip 1240 ms, parse 5415 ms, sort 117 ms, write 12367 ms, index 597 ms: 3 candidates, 89463 repo-hours, 1082 releases; waiting 521 ms; commit 1225 ms)
2026-11-07T14:24:45Z [load_day 2023-01-26] 2023-01-26 hour 19: 199376 events in 4 files, snapshot 5932839336487451012 (task 17633 ms: download 10190 ms overlapping gunzip 1158 ms, parse 4991 ms, sort 106 ms, write 9934 ms, index 529 ms: 3 candidates, 80504 repo-hours, 1004 releases; waiting 638 ms; commit 1251 ms)
2026-11-07T14:24:58Z [load_day 2023-01-26] 2023-01-26 hour 20: 191553 events in 4 files, snapshot 5450194075341966263 (task 17426 ms: download 10290 ms overlapping gunzip 1130 ms, parse 4799 ms, sort 103 ms, write 9687 ms, index 520 ms: 8 candidates, 78127 repo-hours, 957 releases; waiting 822 ms; commit 1649 ms)
2026-11-07T14:25:04Z [load_day 2023-01-26] 2023-01-26 hour 21: 197016 events in 4 files, snapshot 8389493980222119130 (task 18487 ms: download 13166 ms overlapping gunzip 1284 ms, parse 5440 ms, sort 117 ms, write 10548 ms, index 533 ms: 10 candidates, 74883 repo-hours, 1063 releases; waiting 348 ms; commit 1341 ms)
2026-11-07T14:25:27Z [load_day 2023-01-26] 2023-01-26 hour 22: 173726 events in 4 files, snapshot 4086243468778531099 (task 19034 ms: download 10179 ms overlapping gunzip 1040 ms, parse 4508 ms, sort 96 ms, write 8989 ms, index 3456 ms: 5 candidates, 66625 repo-hours, 997 releases; waiting 655 ms; commit 10735 ms)
2026-11-07T14:25:28Z [load_day 2023-01-26] 2023-01-26 hour 23: 153061 events in 4 files, snapshot 7121304496359989563 (task 13086 ms: download 6137 ms overlapping gunzip 867 ms, parse 3658 ms, sort 94 ms, write 7319 ms, index 364 ms: 6 candidates, 59719 repo-hours, 759 releases; waiting 461 ms; commit 1269 ms)
2026-11-07T14:25:35Z [load_day 2023-01-26] 2023-01-26: repo_hour merged from 24 files to 1 (1735988 rows, 7263 ms)
2026-11-07T14:25:37Z [load_day 2023-01-26] 2023-01-26: index committed in 9432 ms (24 + 1 + 24 files)
2026-11-07T14:25:37Z [load_day 2023-01-26] 2023-01-26: 4071437 events in 24 hours
2026-11-07T14:25:37Z [load_day 2023-01-26] attempt 1 succeeded