orcaLog in

Runs · run 1415

load_day 2023-08-21, attempt 1 succeeded

Host
3c2b29713ce8:247089
Started
2026-11-08T00:04:49Z
Ended
2026-11-08T00:09:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1415/load_day/2023-08-21/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:04:49Z [load_day 2023-08-21] attempt 1 started
2026-11-08T00:04:51Z [load_day 2023-08-21] 2023-08-21: 2 hours in flight, about 1200 MB
2026-11-08T00:05:10Z [load_day 2023-08-21] 2023-08-21 hour 0: 148109 events in 3 files, snapshot 9060822021449528969 (task 13637 ms: download 5786 ms overlapping gunzip 857 ms, parse 3786 ms, sort 140 ms, write 7550 ms, index 496 ms: 6 candidates, 78260 repo-hours, 929 releases; waiting 491 ms; commit 3997 ms)
2026-11-08T00:05:15Z [load_day 2023-08-21] 2023-08-21 hour 1: 155047 events in 4 files, snapshot 7225820447732372673 (task 14867 ms: download 5894 ms overlapping gunzip 888 ms, parse 4037 ms, sort 137 ms, write 8574 ms, index 596 ms: 3 candidates, 81424 repo-hours, 691 releases; waiting 353 ms; commit 5061 ms)
2026-11-08T00:05:23Z [load_day 2023-08-21] 2023-08-21 hour 2: 133688 events in 3 files, snapshot 7755052262621113771 (task 14225 ms: download 6108 ms overlapping gunzip 818 ms, parse 3463 ms, sort 94 ms, write 8416 ms, index 551 ms: 3 candidates, 55600 repo-hours, 724 releases; waiting 570 ms; commit 2242 ms)
2026-11-08T00:05:28Z [load_day 2023-08-21] 2023-08-21 hour 3: 133250 events in 3 files, snapshot 6061357235789216513 (task 13149 ms: download 6005 ms overlapping gunzip 773 ms, parse 3088 ms, sort 99 ms, write 7680 ms, index 675 ms: 3 candidates, 54440 repo-hours, 953 releases; waiting 495 ms; commit 3730 ms)
2026-11-08T00:05:38Z [load_day 2023-08-21] 2023-08-21 hour 4: 134842 events in 3 files, snapshot 398158646620676226 (task 13276 ms: download 6415 ms overlapping gunzip 972 ms, parse 3955 ms, sort 99 ms, write 7127 ms, index 349 ms: 5 candidates, 51780 repo-hours, 713 releases; waiting 455 ms; commit 2587 ms)
2026-11-08T00:05:42Z [load_day 2023-08-21] 2023-08-21 hour 5: 141315 events in 3 files, snapshot 8513776801620225884 (task 13969 ms: download 6001 ms overlapping gunzip 819 ms, parse 3456 ms, sort 142 ms, write 8350 ms, index 407 ms: 2 candidates, 57618 repo-hours, 777 releases; waiting 483 ms; commit 2471 ms)
2026-11-08T00:05:58Z [load_day 2023-08-21] 2023-08-21 hour 6: 169894 events in 4 files, snapshot 6960818171736100301 (task 17734 ms: download 10287 ms overlapping gunzip 1160 ms, parse 4915 ms, sort 154 ms, write 10177 ms, index 563 ms: 7 candidates, 75147 repo-hours, 931 releases; waiting 440 ms; commit 3558 ms)
2026-11-08T00:06:03Z [load_day 2023-08-21] 2023-08-21 hour 7: 162482 events in 4 files, snapshot 4411250684792388898 (task 18058 ms: download 10757 ms overlapping gunzip 978 ms, parse 4318 ms, sort 154 ms, write 10836 ms, index 946 ms: 6 candidates, 70656 repo-hours, 758 releases; waiting 523 ms; commit 4782 ms)
2026-11-08T00:06:17Z [load_day 2023-08-21] 2023-08-21 hour 8: 180422 events in 4 files, snapshot 3582742829691363718 (task 19433 ms: download 12279 ms overlapping gunzip 1205 ms, parse 5172 ms, sort 146 ms, write 11578 ms, index 548 ms: 6 candidates, 78412 repo-hours, 1195 releases; waiting 475 ms; commit 2320 ms)
2026-11-08T00:06:20Z [load_day 2023-08-21] 2023-08-21 hour 9: 184564 events in 4 files, snapshot 305620821306427870 (task 18043 ms: download 10691 ms overlapping gunzip 1100 ms, parse 4742 ms, sort 136 ms, write 10661 ms, index 584 ms: 6 candidates, 78985 repo-hours, 1304 releases; waiting 509 ms; commit 2122 ms)
2026-11-08T00:06:38Z [load_day 2023-08-21] 2023-08-21 hour 10: 183043 events in 4 files, snapshot 2373636132515809644 (task 20231 ms: download 11647 ms overlapping gunzip 1269 ms, parse 5389 ms, sort 198 ms, write 11876 ms, index 608 ms: 3 candidates, 78078 repo-hours, 1009 releases; waiting 533 ms; commit 2356 ms)
2026-11-08T00:06:43Z [load_day 2023-08-21] 2023-08-21 hour 11: 184697 events in 4 files, snapshot 2454497745809695560 (task 20612 ms: download 12565 ms overlapping gunzip 1148 ms, parse 4858 ms, sort 217 ms, write 12654 ms, index 753 ms: 7 candidates, 77235 repo-hours, 1093 releases; waiting 609 ms; commit 3890 ms)
2026-11-08T00:07:01Z [load_day 2023-08-21] 2023-08-21 hour 12: 226283 events in 5 files, snapshot 3273069450367520077 (task 21953 ms: download 14469 ms overlapping gunzip 1090 ms, parse 5069 ms, sort 170 ms, write 13900 ms, index 935 ms: 4 candidates, 107525 repo-hours, 1215 releases; waiting 490 ms; commit 2755 ms)
2026-11-08T00:07:09Z [load_day 2023-08-21] 2023-08-21 hour 13: 214815 events in 5 files, snapshot 3689945068098022315 (task 25042 ms: download 16960 ms overlapping gunzip 1378 ms, parse 6075 ms, sort 261 ms, write 15721 ms, index 788 ms: 3 candidates, 104249 repo-hours, 1205 releases; waiting 516 ms; commit 2917 ms)
2026-11-08T00:07:28Z [load_day 2023-08-21] 2023-08-21 hour 14: 202444 events in 5 files, snapshot 7452926877741616913 (task 24778 ms: download 18040 ms overlapping gunzip 1394 ms, parse 5710 ms, sort 160 ms, write 16122 ms, index 603 ms: 2 candidates, 90185 repo-hours, 1115 releases; waiting 497 ms; commit 3663 ms)
2026-11-08T00:07:32Z [load_day 2023-08-21] 2023-08-21 hour 15: 191842 events in 4 files, snapshot 4526308666903585611 (task 22445 ms: download 12961 ms overlapping gunzip 1400 ms, parse 5827 ms, sort 147 ms, write 13687 ms, index 592 ms: 4 candidates, 85467 repo-hours, 1166 releases; waiting 505 ms; commit 2156 ms)
2026-11-08T00:07:56Z [load_day 2023-08-21] 2023-08-21 hour 16: 186555 events in 4 files, snapshot 815501295574528314 (task 22107 ms: download 12850 ms overlapping gunzip 1499 ms, parse 6381 ms, sort 184 ms, write 12527 ms, index 832 ms: 8 candidates, 81809 repo-hours, 882 releases; waiting 375 ms; commit 7988 ms)
2026-11-08T00:07:59Z [load_day 2023-08-21] 2023-08-21 hour 17: 181975 events in 4 files, snapshot 6856458905110290235 (task 21974 ms: download 12973 ms overlapping gunzip 1198 ms, parse 5162 ms, sort 136 ms, write 13933 ms, index 734 ms: 0 candidates, 77031 repo-hours, 928 releases; waiting 517 ms; commit 2923 ms)
2026-11-08T00:08:13Z [load_day 2023-08-21] 2023-08-21 hour 18: 185323 events in 4 files, snapshot 2576534601283423359 (task 21478 ms: download 12775 ms overlapping gunzip 1271 ms, parse 5492 ms, sort 139 ms, write 12982 ms, index 832 ms: 6 candidates, 80863 repo-hours, 1515 releases; waiting 480 ms; commit 2492 ms)
2026-11-08T00:08:21Z [load_day 2023-08-21] 2023-08-21 hour 19: 175151 events in 4 files, snapshot 2188466921015627507 (task 19649 ms: download 11951 ms overlapping gunzip 1280 ms, parse 5515 ms, sort 207 ms, write 11249 ms, index 589 ms: 6 candidates, 70491 repo-hours, 1037 releases; waiting 483 ms; commit 3744 ms)
2026-11-08T00:08:35Z [load_day 2023-08-21] 2023-08-21 hour 20: 172429 events in 4 files, snapshot 5966805655570720993 (task 20005 ms: download 12236 ms overlapping gunzip 1241 ms, parse 5143 ms, sort 133 ms, write 12177 ms, index 519 ms: 11 candidates, 72170 repo-hours, 874 releases; waiting 484 ms; commit 3369 ms)
2026-11-08T00:08:38Z [load_day 2023-08-21] 2023-08-21 hour 21: 157280 events in 4 files, snapshot 6537115094267484456 (task 17596 ms: download 10984 ms overlapping gunzip 1148 ms, parse 5059 ms, sort 174 ms, write 9803 ms, index 635 ms: 3 candidates, 61615 repo-hours, 932 releases; waiting 506 ms; commit 2392 ms)
2026-11-08T00:08:50Z [load_day 2023-08-21] 2023-08-21 hour 22: 142367 events in 3 files, snapshot 1940414342100233477 (task 15534 ms: download 6777 ms overlapping gunzip 1004 ms, parse 4442 ms, sort 104 ms, write 8727 ms, index 412 ms: 3 candidates, 55163 repo-hours, 795 releases; waiting 534 ms; commit 2564 ms)
2026-11-08T00:08:53Z [load_day 2023-08-21] 2023-08-21 hour 23: 131325 events in 3 files, snapshot 7431092455813557728 (task 14266 ms: download 6508 ms overlapping gunzip 864 ms, parse 3489 ms, sort 110 ms, write 8567 ms, index 346 ms: 3 candidates, 52625 repo-hours, 687 releases; waiting 588 ms; commit 2298 ms)
2026-11-08T00:09:01Z [load_day 2023-08-21] 2023-08-21: repo_hour merged from 24 files to 1 (1776828 rows, 7497 ms)
2026-11-08T00:09:03Z [load_day 2023-08-21] 2023-08-21: index committed in 9572 ms (23 + 1 + 24 files)
2026-11-08T00:09:03Z [load_day 2023-08-21] 2023-08-21: 4079142 events in 24 hours
2026-11-08T00:09:03Z [load_day 2023-08-21] attempt 1 succeeded