orcaLog in

Runs · run 1321

load_day 2023-07-22, attempt 1 succeeded

Host
3c2b29713ce8:152109
Started
2026-11-07T23:12:13Z
Ended
2026-11-07T23:14:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1321/load_day/2023-07-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:12:13Z [load_day 2023-07-22] attempt 1 started
2026-11-07T23:12:15Z [load_day 2023-07-22] 2023-07-22: 2 hours in flight, about 1200 MB
2026-11-07T23:12:31Z [load_day 2023-07-22] 2023-07-22 hour 0: 124830 events in 3 files, snapshot 3585615209091861497 (task 12338 ms: download 2871 ms overlapping gunzip 804 ms, parse 3797 ms, sort 137 ms, write 6376 ms, index 428 ms: 2 candidates, 62103 repo-hours, 906 releases; waiting 504 ms; commit 1974 ms)
2026-11-07T23:12:33Z [load_day 2023-07-22] 2023-07-22 hour 1: 128614 events in 3 files, snapshot 3244106262482945279 (task 12064 ms: download 2747 ms overlapping gunzip 789 ms, parse 3410 ms, sort 111 ms, write 6455 ms, index 501 ms: 6 candidates, 72498 repo-hours, 802 releases; waiting 504 ms; commit 2281 ms)
2026-11-07T23:12:41Z [load_day 2023-07-22] 2023-07-22 hour 2: 105334 events in 3 files, snapshot 1612763172628207354 (task 8762 ms: download 1937 ms overlapping gunzip 445 ms, parse 1999 ms, sort 78 ms, write 4819 ms, index 565 ms: 3 candidates, 44140 repo-hours, 688 releases; waiting 490 ms; commit 2268 ms)
2026-11-07T23:12:43Z [load_day 2023-07-22] 2023-07-22 hour 3: 103787 events in 3 files, snapshot 4476998932959859903 (task 8292 ms: download 1950 ms overlapping gunzip 474 ms, parse 2072 ms, sort 69 ms, write 4515 ms, index 342 ms: 2 candidates, 40499 repo-hours, 691 releases; waiting 483 ms; commit 2489 ms)
2026-11-07T23:12:50Z [load_day 2023-07-22] 2023-07-22 hour 4: 102297 events in 3 files, snapshot 8710442112860804162 (task 8506 ms: download 2120 ms overlapping gunzip 466 ms, parse 2044 ms, sort 77 ms, write 4771 ms, index 430 ms: 4 candidates, 40835 repo-hours, 588 releases; waiting 496 ms; commit 2375 ms)
2026-11-07T23:12:55Z [load_day 2023-07-22] 2023-07-22 hour 5: 108325 events in 3 files, snapshot 6773385845937050532 (task 9054 ms: download 1753 ms overlapping gunzip 472 ms, parse 2267 ms, sort 84 ms, write 5019 ms, index 447 ms: 4 candidates, 44498 repo-hours, 651 releases; waiting 476 ms; commit 4009 ms)
2026-11-07T23:13:01Z [load_day 2023-07-22] 2023-07-22 hour 6: 119674 events in 3 files, snapshot 8701170040970587895 (task 9369 ms: download 1444 ms overlapping gunzip 547 ms, parse 2462 ms, sort 72 ms, write 5262 ms, index 530 ms: 4 candidates, 52820 repo-hours, 640 releases; waiting 209 ms; commit 2282 ms)
2026-11-07T23:13:05Z [load_day 2023-07-22] 2023-07-22 hour 7: 123208 events in 3 files, snapshot 8316132269002815385 (task 10854 ms: download 2308 ms overlapping gunzip 636 ms, parse 2823 ms, sort 147 ms, write 5793 ms, index 643 ms: 6 candidates, 55124 repo-hours, 542 releases; waiting 500 ms; commit 2613 ms)
2026-11-07T23:13:13Z [load_day 2023-07-22] 2023-07-22 hour 8: 120995 events in 3 files, snapshot 1848546049075764627 (task 10448 ms: download 2427 ms overlapping gunzip 629 ms, parse 2526 ms, sort 112 ms, write 5713 ms, index 558 ms: 1 candidates, 50570 repo-hours, 598 releases; waiting 497 ms; commit 3344 ms)
2026-11-07T23:13:16Z [load_day 2023-07-22] 2023-07-22 hour 9: 124797 events in 3 files, snapshot 6972195558502127476 (task 10120 ms: download 2390 ms overlapping gunzip 620 ms, parse 2687 ms, sort 135 ms, write 5401 ms, index 444 ms: 2 candidates, 51595 repo-hours, 730 releases; waiting 478 ms; commit 2331 ms)
2026-11-07T23:13:23Z [load_day 2023-07-22] 2023-07-22 hour 10: 124013 events in 3 files, snapshot 5912109933340252283 (task 10473 ms: download 1924 ms overlapping gunzip 674 ms, parse 2972 ms, sort 82 ms, write 5802 ms, index 356 ms: 2 candidates, 52273 repo-hours, 608 releases; waiting 312 ms; commit 1755 ms)
2026-11-07T23:13:27Z [load_day 2023-07-22] 2023-07-22 hour 11: 121887 events in 3 files, snapshot 16598919496930767 (task 9023 ms: download 1776 ms overlapping gunzip 515 ms, parse 2348 ms, sort 77 ms, write 5100 ms, index 402 ms: 5 candidates, 50105 repo-hours, 637 releases; waiting 304 ms; commit 2891 ms)
2026-11-07T23:13:36Z [load_day 2023-07-22] 2023-07-22 hour 12: 193693 events in 4 files, snapshot 1441892246612203168 (task 10798 ms: download 3715 ms overlapping gunzip 584 ms, parse 2893 ms, sort 118 ms, write 5876 ms, index 522 ms: 3 candidates, 84886 repo-hours, 727 releases; waiting 512 ms; commit 2091 ms)
2026-11-07T23:13:38Z [load_day 2023-07-22] 2023-07-22 hour 13: 155483 events in 4 files, snapshot 7557266060212953281 (task 10184 ms: download 3589 ms overlapping gunzip 539 ms, parse 2472 ms, sort 90 ms, write 5778 ms, index 505 ms: 4 candidates, 79156 repo-hours, 692 releases; waiting 484 ms; commit 2519 ms)
2026-11-07T23:13:49Z [load_day 2023-07-22] 2023-07-22 hour 14: 139758 events in 3 files, snapshot 2646020720193590591 (task 12568 ms: download 4025 ms overlapping gunzip 624 ms, parse 2840 ms, sort 95 ms, write 7778 ms, index 434 ms: 5 candidates, 59090 repo-hours, 692 releases; waiting 504 ms; commit 2352 ms)
2026-11-07T23:13:54Z [load_day 2023-07-22] 2023-07-22 hour 15: 151174 events in 4 files, snapshot 1006934058260987384 (task 13046 ms: download 4888 ms overlapping gunzip 800 ms, parse 3388 ms, sort 124 ms, write 7439 ms, index 493 ms: 4 candidates, 64636 repo-hours, 835 releases; waiting 529 ms; commit 4412 ms)
2026-11-07T23:14:01Z [load_day 2023-07-22] 2023-07-22 hour 16: 143076 events in 3 files, snapshot 8419655585944776614 (task 11231 ms: download 3973 ms overlapping gunzip 692 ms, parse 3169 ms, sort 102 ms, write 6058 ms, index 399 ms: 5 candidates, 61184 repo-hours, 756 releases; waiting 501 ms; commit 2187 ms)
2026-11-07T23:14:06Z [load_day 2023-07-22] 2023-07-22 hour 17: 132173 events in 3 files, snapshot 438061158680418741 (task 10084 ms: download 3113 ms overlapping gunzip 556 ms, parse 2397 ms, sort 77 ms, write 5881 ms, index 371 ms: 4 candidates, 53643 repo-hours, 636 releases; waiting 479 ms; commit 4371 ms)
2026-11-07T23:14:14Z [load_day 2023-07-22] 2023-07-22 hour 18: 138574 events in 3 files, snapshot 4491668884441717558 (task 11144 ms: download 4267 ms overlapping gunzip 634 ms, parse 2832 ms, sort 94 ms, write 6237 ms, index 504 ms: 4 candidates, 59302 repo-hours, 731 releases; waiting 515 ms; commit 2888 ms)
2026-11-07T23:14:16Z [load_day 2023-07-22] 2023-07-22 hour 19: 120235 events in 3 files, snapshot 4423540168628229211 (task 9732 ms: download 2158 ms overlapping gunzip 491 ms, parse 2247 ms, sort 123 ms, write 5449 ms, index 553 ms: 3 candidates, 47170 repo-hours, 730 releases; waiting 557 ms; commit 2059 ms)
2026-11-07T23:14:24Z [load_day 2023-07-22] 2023-07-22 hour 20: 114322 events in 3 files, snapshot 6928473643284869394 (task 9251 ms: download 2041 ms overlapping gunzip 560 ms, parse 2492 ms, sort 82 ms, write 4967 ms, index 352 ms: 8 candidates, 46298 repo-hours, 662 releases; waiting 508 ms; commit 2404 ms)
2026-11-07T23:14:26Z [load_day 2023-07-22] 2023-07-22 hour 21: 103591 events in 3 files, snapshot 7804262765274284868 (task 8230 ms: download 1867 ms overlapping gunzip 457 ms, parse 2019 ms, sort 108 ms, write 4521 ms, index 369 ms: 4 candidates, 40562 repo-hours, 771 releases; waiting 498 ms; commit 2336 ms)
2026-11-07T23:14:32Z [load_day 2023-07-22] 2023-07-22 hour 22: 92567 events in 2 files, snapshot 3015883322275534649 (task 7771 ms: download 2281 ms overlapping gunzip 360 ms, parse 1693 ms, sort 60 ms, write 4313 ms, index 321 ms: 3 candidates, 35962 repo-hours, 614 releases; waiting 585 ms; commit 2124 ms)
2026-11-07T23:14:36Z [load_day 2023-07-22] 2023-07-22 hour 23: 87611 events in 2 files, snapshot 8173006718720105236 (task 6759 ms: download 1612 ms overlapping gunzip 367 ms, parse 1811 ms, sort 61 ms, write 3473 ms, index 257 ms: 3 candidates, 34842 repo-hours, 507 releases; waiting 486 ms; commit 3486 ms)
2026-11-07T23:14:42Z [load_day 2023-07-22] 2023-07-22: repo_hour merged from 24 files to 1 (1283791 rows, 5945 ms)
2026-11-07T23:14:44Z [load_day 2023-07-22] 2023-07-22: index committed in 8064 ms (24 + 1 + 24 files)
2026-11-07T23:14:44Z [load_day 2023-07-22] 2023-07-22: 2980018 events in 24 hours
2026-11-07T23:14:44Z [load_day 2023-07-22] attempt 1 succeeded