orcaLog in

Runs · run 741

load_day 2023-01-19, attempt 1 succeeded

Host
d3d1748bf284:21621
Started
2026-11-07T13:55:47Z
Ended
2026-11-07T13:59:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/741/load_day/2023-01-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:55:47Z [load_day 2023-01-19] attempt 1 started
2026-11-07T13:55:48Z [load_day 2023-01-19] 2023-01-19: 2 hours in flight, about 1200 MB
2026-11-07T13:56:05Z [load_day 2023-01-19] 2023-01-19 hour 0: 170186 events in 4 files, snapshot 7275322646409761084 (task 14829 ms: download 9018 ms overlapping gunzip 1001 ms, parse 4234 ms, sort 100 ms, write 8202 ms, index 489 ms: 6 candidates, 76966 repo-hours, 935 releases; waiting 533 ms; commit 1365 ms)
2026-11-07T13:56:06Z [load_day 2023-01-19] 2023-01-19 hour 1: 155841 events in 4 files, snapshot 2146197144727786611 (task 14917 ms: download 8029 ms overlapping gunzip 797 ms, parse 3413 ms, sort 88 ms, write 6883 ms, index 475 ms: 11 candidates, 76271 repo-hours, 733 releases; waiting 3035 ms; commit 1437 ms)
2026-11-07T13:56:16Z [load_day 2023-01-19] 2023-01-19 hour 2: 128669 events in 3 files, snapshot 4268971117595725864 (task 10081 ms: download 4659 ms overlapping gunzip 614 ms, parse 2609 ms, sort 73 ms, write 5539 ms, index 396 ms: 6 candidates, 59816 repo-hours, 574 releases; waiting 560 ms; commit 1195 ms)
2026-11-07T13:56:17Z [load_day 2023-01-19] 2023-01-19 hour 3: 134067 events in 3 files, snapshot 3557548649083264380 (task 9379 ms: download 4083 ms overlapping gunzip 612 ms, parse 2612 ms, sort 70 ms, write 5203 ms, index 335 ms: 2 candidates, 50095 repo-hours, 731 releases; waiting 246 ms; commit 1247 ms)
2026-11-07T13:56:28Z [load_day 2023-01-19] 2023-01-19 hour 4: 137007 events in 3 files, snapshot 967769105938678451 (task 11214 ms: download 5706 ms overlapping gunzip 652 ms, parse 2768 ms, sort 94 ms, write 5574 ms, index 329 ms: 2 candidates, 50485 repo-hours, 590 releases; waiting 1413 ms; commit 1498 ms)
2026-11-07T13:56:29Z [load_day 2023-01-19] 2023-01-19 hour 5: 140288 events in 3 files, snapshot 5054787086025833918 (task 10046 ms: download 4322 ms overlapping gunzip 612 ms, parse 2687 ms, sort 92 ms, write 5501 ms, index 328 ms: 4 candidates, 52537 repo-hours, 705 releases; waiting 500 ms; commit 1175 ms)
2026-11-07T13:56:40Z [load_day 2023-01-19] 2023-01-19 hour 6: 152042 events in 4 files, snapshot 375981305964953737 (task 11756 ms: download 4561 ms overlapping gunzip 735 ms, parse 2968 ms, sort 77 ms, write 6738 ms, index 386 ms: 6 candidates, 61009 repo-hours, 725 releases; waiting 523 ms; commit 1237 ms)
2026-11-07T13:56:42Z [load_day 2023-01-19] 2023-01-19 hour 7: 161133 events in 4 files, snapshot 7351710217397733321 (task 12035 ms: download 5173 ms overlapping gunzip 757 ms, parse 3202 ms, sort 72 ms, write 6613 ms, index 404 ms: 4 candidates, 62118 repo-hours, 788 releases; waiting 649 ms; commit 1412 ms)
2026-11-07T13:56:55Z [load_day 2023-01-19] 2023-01-19 hour 8: 178110 events in 4 files, snapshot 7118329136058117805 (task 14386 ms: download 8440 ms overlapping gunzip 921 ms, parse 4068 ms, sort 96 ms, write 7969 ms, index 507 ms: 8 candidates, 71667 repo-hours, 834 releases; waiting 518 ms; commit 1335 ms)
2026-11-07T13:56:58Z [load_day 2023-01-19] 2023-01-19 hour 9: 186891 events in 4 files, snapshot 6646186555694487620 (task 15565 ms: download 9115 ms overlapping gunzip 977 ms, parse 4228 ms, sort 99 ms, write 8892 ms, index 494 ms: 5 candidates, 75737 repo-hours, 959 releases; waiting 546 ms; commit 1380 ms)
2026-11-07T13:57:12Z [load_day 2023-01-19] 2023-01-19 hour 10: 193280 events in 4 files, snapshot 5381474186235947820 (task 16157 ms: download 9200 ms overlapping gunzip 995 ms, parse 4273 ms, sort 111 ms, write 9141 ms, index 533 ms: 3 candidates, 78454 repo-hours, 945 releases; waiting 585 ms; commit 1392 ms)
2026-11-07T13:57:15Z [load_day 2023-01-19] 2023-01-19 hour 11: 188286 events in 4 files, snapshot 8419477046799295446 (task 15758 ms: download 9456 ms overlapping gunzip 961 ms, parse 4152 ms, sort 101 ms, write 8739 ms, index 485 ms: 11 candidates, 76170 repo-hours, 852 releases; waiting 999 ms; commit 1148 ms)
2026-11-07T13:57:29Z [load_day 2023-01-19] 2023-01-19 hour 12: 212465 events in 5 files, snapshot 2463330375611305502 (task 16894 ms: download 11166 ms overlapping gunzip 1040 ms, parse 4560 ms, sort 118 ms, write 9297 ms, index 650 ms: 4 candidates, 102170 repo-hours, 1021 releases; waiting 614 ms; commit 1245 ms)
2026-11-07T13:57:40Z [load_day 2023-01-19] 2023-01-19 hour 13: 234885 events in 5 files, snapshot 4302635731121961739 (task 20913 ms: download 13881 ms overlapping gunzip 1385 ms, parse 5913 ms, sort 112 ms, write 11866 ms, index 724 ms: 10 candidates, 111787 repo-hours, 1025 releases; waiting 673 ms; commit 4062 ms)
2026-11-07T13:57:52Z [load_day 2023-01-19] 2023-01-19 hour 14: 225977 events in 5 files, snapshot 1411811517286769961 (task 21799 ms: download 15130 ms overlapping gunzip 1299 ms, parse 5642 ms, sort 104 ms, write 12382 ms, index 658 ms: 4 candidates, 102677 repo-hours, 1040 releases; waiting 1390 ms; commit 1262 ms)
2026-11-07T13:57:58Z [load_day 2023-01-19] 2023-01-19 hour 15: 225268 events in 5 files, snapshot 8898377809489016010 (task 20882 ms: download 13832 ms overlapping gunzip 1351 ms, parse 5819 ms, sort 110 ms, write 12141 ms, index 772 ms: 1 candidates, 103206 repo-hours, 1114 releases; waiting 372 ms; commit 1365 ms)
2026-11-07T13:58:14Z [load_day 2023-01-19] 2023-01-19 hour 16: 214846 events in 5 files, snapshot 4104844195453294930 (task 21535 ms: download 15312 ms overlapping gunzip 1329 ms, parse 5719 ms, sort 107 ms, write 12415 ms, index 686 ms: 5 candidates, 101373 repo-hours, 934 releases; waiting 975 ms; commit 1292 ms)
2026-11-07T13:58:20Z [load_day 2023-01-19] 2023-01-19 hour 17: 220672 events in 5 files, snapshot 3136805490176424710 (task 20958 ms: download 14513 ms overlapping gunzip 1312 ms, parse 5752 ms, sort 120 ms, write 12181 ms, index 622 ms: 3 candidates, 97514 repo-hours, 882 releases; waiting 658 ms; commit 1379 ms)
2026-11-07T13:58:34Z [load_day 2023-01-19] 2023-01-19 hour 18: 218464 events in 5 files, snapshot 6182852831688066732 (task 19423 ms: download 13301 ms overlapping gunzip 1269 ms, parse 5639 ms, sort 99 ms, write 11275 ms, index 625 ms: 8 candidates, 99862 repo-hours, 901 releases; waiting 188 ms; commit 1294 ms)
2026-11-07T13:58:40Z [load_day 2023-01-19] 2023-01-19 hour 19: 209302 events in 5 files, snapshot 3392729444216677523 (task 19629 ms: download 13871 ms overlapping gunzip 1195 ms, parse 5332 ms, sort 105 ms, write 11195 ms, index 590 ms: 4 candidates, 91085 repo-hours, 877 releases; waiting 869 ms; commit 1333 ms)
2026-11-07T13:58:50Z [load_day 2023-01-19] 2023-01-19 hour 20: 191286 events in 4 files, snapshot 202257419229197449 (task 15133 ms: download 8728 ms overlapping gunzip 951 ms, parse 4249 ms, sort 115 ms, write 8603 ms, index 501 ms: 4 candidates, 78349 repo-hours, 949 releases; waiting 399 ms; commit 1234 ms)
2026-11-07T13:58:55Z [load_day 2023-01-19] 2023-01-19 hour 21: 174936 events in 4 files, snapshot 1698059051442231220 (task 14148 ms: download 8265 ms overlapping gunzip 854 ms, parse 3710 ms, sort 91 ms, write 8225 ms, index 460 ms: 2 candidates, 69137 repo-hours, 1008 releases; waiting 527 ms; commit 1308 ms)
2026-11-07T13:59:04Z [load_day 2023-01-19] 2023-01-19 hour 22: 163416 events in 4 files, snapshot 928533038219948670 (task 12764 ms: download 5434 ms overlapping gunzip 797 ms, parse 3467 ms, sort 80 ms, write 7245 ms, index 419 ms: 4 candidates, 63779 repo-hours, 870 releases; waiting 520 ms; commit 1274 ms)
2026-11-07T13:59:08Z [load_day 2023-01-19] 2023-01-19 hour 23: 146019 events in 3 files, snapshot 8169996402093419267 (task 11861 ms: download 5339 ms overlapping gunzip 705 ms, parse 3058 ms, sort 77 ms, write 6467 ms, index 380 ms: 3 candidates, 58587 repo-hours, 749 releases; waiting 826 ms; commit 1332 ms)
2026-11-07T13:59:16Z [load_day 2023-01-19] 2023-01-19: repo_hour merged from 24 files to 1 (1870851 rows, 7817 ms)
2026-11-07T13:59:17Z [load_day 2023-01-19] 2023-01-19: index committed in 9600 ms (24 + 1 + 24 files)
2026-11-07T13:59:17Z [load_day 2023-01-19] 2023-01-19: 4363336 events in 24 hours
2026-11-07T13:59:17Z [load_day 2023-01-19] attempt 1 succeeded