orcaLog in

Runs · run 1089

load_day 2023-05-15, attempt 1 succeeded

Host
caf251265124:368596
Started
2026-11-07T20:08:21Z
Ended
2026-11-07T20:11:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1089/load_day/2023-05-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:08:21Z [load_day 2023-05-15] attempt 1 started
2026-11-07T20:08:22Z [load_day 2023-05-15] 2023-05-15: 2 hours in flight, about 1200 MB
2026-11-07T20:08:34Z [load_day 2023-05-15] 2023-05-15 hour 0: 143875 events in 3 files, snapshot 2169104321469218686 (task 8911 ms: download 2496 ms overlapping gunzip 483 ms, parse 2285 ms, sort 93 ms, write 4537 ms, index 520 ms: 7 candidates, 83888 repo-hours, 750 releases; waiting 620 ms; commit 1626 ms)
2026-11-07T20:08:40Z [load_day 2023-05-15] 2023-05-15 hour 1: 147498 events in 3 files, snapshot 5099536889648167212 (task 10725 ms: download 4456 ms overlapping gunzip 655 ms, parse 2912 ms, sort 91 ms, write 5850 ms, index 553 ms: 11 candidates, 82380 repo-hours, 735 releases; waiting 363 ms; commit 5571 ms)
2026-11-07T20:08:45Z [load_day 2023-05-15] 2023-05-15 hour 2: 128544 events in 3 files, snapshot 9192039195269705873 (task 9958 ms: download 4555 ms overlapping gunzip 628 ms, parse 2611 ms, sort 72 ms, write 5454 ms, index 386 ms: 11 candidates, 59940 repo-hours, 633 releases; waiting 514 ms; commit 1989 ms)
2026-11-07T20:08:47Z [load_day 2023-05-15] 2023-05-15 hour 3: 126660 events in 3 files, snapshot 6894258457998094891 (task 10158 ms: download 4693 ms overlapping gunzip 609 ms, parse 2591 ms, sort 83 ms, write 5346 ms, index 379 ms: 7 candidates, 55397 repo-hours, 807 releases; waiting 846 ms; commit 1875 ms)
2026-11-07T20:08:55Z [load_day 2023-05-15] 2023-05-15 hour 4: 122445 events in 3 files, snapshot 4345574102633509792 (task 9415 ms: download 2281 ms overlapping gunzip 542 ms, parse 2362 ms, sort 70 ms, write 5277 ms, index 334 ms: 6 candidates, 51148 repo-hours, 549 releases; waiting 524 ms; commit 1568 ms)
2026-11-07T20:08:59Z [load_day 2023-05-15] 2023-05-15 hour 5: 140408 events in 3 files, snapshot 8684574109253034583 (task 11605 ms: download 5244 ms overlapping gunzip 748 ms, parse 3144 ms, sort 88 ms, write 6228 ms, index 441 ms: 17 candidates, 58772 repo-hours, 811 releases; waiting 633 ms; commit 1696 ms)
2026-11-07T20:09:10Z [load_day 2023-05-15] 2023-05-15 hour 6: 169902 events in 4 files, snapshot 857602726781940355 (task 13950 ms: download 8395 ms overlapping gunzip 826 ms, parse 3503 ms, sort 118 ms, write 7463 ms, index 480 ms: 19 candidates, 80204 repo-hours, 846 releases; waiting 1264 ms; commit 1644 ms)
2026-11-07T20:09:14Z [load_day 2023-05-15] 2023-05-15 hour 7: 156546 events in 4 files, snapshot 2742237482203874836 (task 13500 ms: download 6001 ms overlapping gunzip 788 ms, parse 3408 ms, sort 107 ms, write 7473 ms, index 486 ms: 14 candidates, 77741 repo-hours, 833 releases; waiting 926 ms; commit 1664 ms)
2026-11-07T20:09:25Z [load_day 2023-05-15] 2023-05-15 hour 8: 163232 events in 4 files, snapshot 8768429592366396088 (task 14877 ms: download 9038 ms overlapping gunzip 885 ms, parse 3743 ms, sort 106 ms, write 8165 ms, index 518 ms: 15 candidates, 77118 repo-hours, 879 releases; waiting 958 ms; commit 1703 ms)
2026-11-07T20:09:30Z [load_day 2023-05-15] 2023-05-15 hour 9: 173858 events in 4 files, snapshot 3522764465023666958 (task 14900 ms: download 8632 ms overlapping gunzip 887 ms, parse 3915 ms, sort 103 ms, write 8646 ms, index 548 ms: 11 candidates, 84091 repo-hours, 996 releases; waiting 510 ms; commit 1719 ms)
2026-11-07T20:09:39Z [load_day 2023-05-15] 2023-05-15 hour 10: 167817 events in 4 files, snapshot 883982201686534151 (task 13271 ms: download 7648 ms overlapping gunzip 827 ms, parse 3709 ms, sort 106 ms, write 7871 ms, index 530 ms: 6 candidates, 77238 repo-hours, 945 releases; waiting 17 ms; commit 1636 ms)
2026-11-07T20:09:44Z [load_day 2023-05-15] 2023-05-15 hour 11: 178151 events in 4 files, snapshot 5834439200151393184 (task 13817 ms: download 7745 ms overlapping gunzip 855 ms, parse 3871 ms, sort 112 ms, write 8194 ms, index 568 ms: 11 candidates, 85960 repo-hours, 964 releases; waiting 24 ms; commit 1692 ms)
2026-11-07T20:09:56Z [load_day 2023-05-15] 2023-05-15 hour 12: 205134 events in 5 files, snapshot 2759372411935038404 (task 15345 ms: download 7993 ms overlapping gunzip 879 ms, parse 3974 ms, sort 128 ms, write 9434 ms, index 707 ms: 15 candidates, 104445 repo-hours, 994 releases; waiting 17 ms; commit 1779 ms)
2026-11-07T20:10:01Z [load_day 2023-05-15] 2023-05-15 hour 13: 198643 events in 4 files, snapshot 7253966148788861054 (task 15940 ms: download 8283 ms overlapping gunzip 986 ms, parse 4330 ms, sort 130 ms, write 9599 ms, index 641 ms: 4 candidates, 102838 repo-hours, 969 releases; waiting 15 ms; commit 2108 ms)
2026-11-07T20:10:13Z [load_day 2023-05-15] 2023-05-15 hour 14: 192804 events in 4 files, snapshot 1745149436659469094 (task 16420 ms: download 9268 ms overlapping gunzip 1035 ms, parse 4411 ms, sort 132 ms, write 9668 ms, index 632 ms: 12 candidates, 95427 repo-hours, 966 releases; waiting 294 ms; commit 1911 ms)
2026-11-07T20:10:17Z [load_day 2023-05-15] 2023-05-15 hour 15: 182521 events in 4 files, snapshot 1995508950336980426 (task 15495 ms: download 8737 ms overlapping gunzip 942 ms, parse 4155 ms, sort 114 ms, write 9319 ms, index 669 ms: 8 candidates, 91754 repo-hours, 1081 releases; waiting 28 ms; commit 1937 ms)
2026-11-07T20:10:30Z [load_day 2023-05-15] 2023-05-15 hour 16: 183935 events in 4 files, snapshot 797258244669156278 (task 15756 ms: download 9103 ms overlapping gunzip 930 ms, parse 3997 ms, sort 115 ms, write 9103 ms, index 572 ms: 26 candidates, 88554 repo-hours, 878 releases; waiting 721 ms; commit 2062 ms)
2026-11-07T20:10:33Z [load_day 2023-05-15] 2023-05-15 hour 17: 181696 events in 4 files, snapshot 8611076019734004833 (task 14884 ms: download 8277 ms overlapping gunzip 922 ms, parse 4086 ms, sort 117 ms, write 8869 ms, index 604 ms: 11 candidates, 84059 repo-hours, 814 releases; waiting 20 ms; commit 1912 ms)
2026-11-07T20:10:45Z [load_day 2023-05-15] 2023-05-15 hour 18: 184608 events in 4 files, snapshot 9064572125230994739 (task 14444 ms: download 8042 ms overlapping gunzip 893 ms, parse 3986 ms, sort 105 ms, write 8713 ms, index 533 ms: 8 candidates, 85001 repo-hours, 958 releases; waiting 17 ms; commit 1853 ms)
2026-11-07T20:10:48Z [load_day 2023-05-15] 2023-05-15 hour 19: 179032 events in 4 files, snapshot 4432952772098516315 (task 14082 ms: download 7913 ms overlapping gunzip 871 ms, parse 3879 ms, sort 103 ms, write 8505 ms, index 517 ms: 16 candidates, 80051 repo-hours, 917 releases; waiting 18 ms; commit 1714 ms)
2026-11-07T20:11:00Z [load_day 2023-05-15] 2023-05-15 hour 20: 179819 events in 4 files, snapshot 7017111695005154954 (task 14677 ms: download 8253 ms overlapping gunzip 960 ms, parse 4158 ms, sort 113 ms, write 8630 ms, index 582 ms: 18 candidates, 79240 repo-hours, 974 releases; waiting 21 ms; commit 1850 ms)
2026-11-07T20:11:03Z [load_day 2023-05-15] 2023-05-15 hour 21: 168902 events in 4 files, snapshot 4134427906535706152 (task 14649 ms: download 8661 ms overlapping gunzip 985 ms, parse 4109 ms, sort 105 ms, write 8625 ms, index 603 ms: 11 candidates, 71247 repo-hours, 933 releases; waiting 18 ms; commit 1903 ms)
2026-11-07T20:11:13Z [load_day 2023-05-15] 2023-05-15 hour 22: 150210 events in 4 files, snapshot 4095093741518669170 (task 12537 ms: download 5720 ms overlapping gunzip 812 ms, parse 3418 ms, sort 96 ms, write 7298 ms, index 420 ms: 10 candidates, 64242 repo-hours, 729 releases; waiting 236 ms; commit 1654 ms)
2026-11-07T20:11:15Z [load_day 2023-05-15] 2023-05-15 hour 23: 130226 events in 3 files, snapshot 9123052632550720655 (task 10255 ms: download 4449 ms overlapping gunzip 662 ms, parse 2913 ms, sort 59 ms, write 5995 ms, index 405 ms: 3 candidates, 56054 repo-hours, 640 releases; waiting 19 ms; commit 1780 ms)
2026-11-07T20:11:23Z [load_day 2023-05-15] 2023-05-15: repo_hour merged from 24 files to 1 (1876789 rows, 8065 ms)
2026-11-07T20:11:25Z [load_day 2023-05-15] 2023-05-15: index committed in 9713 ms (24 + 1 + 24 files)
2026-11-07T20:11:25Z [load_day 2023-05-15] 2023-05-15: 3956466 events in 24 hours
2026-11-07T20:11:25Z [load_day 2023-05-15] attempt 1 succeeded