orcaLog in

Runs · run 1065

load_day 2023-05-07, attempt 1 succeeded

Host
caf251265124:343742
Started
2026-11-07T19:46:03Z
Ended
2026-11-07T19:48:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1065/load_day/2023-05-07/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:46:03Z [load_day 2023-05-07] attempt 1 started
2026-11-07T19:46:05Z [load_day 2023-05-07] 2023-05-07: 2 hours in flight, about 1200 MB
2026-11-07T19:46:16Z [load_day 2023-05-07] 2023-05-07 hour 0: 118777 events in 3 files, snapshot 870605020817898294 (task 8369 ms: download 2018 ms overlapping gunzip 501 ms, parse 2182 ms, sort 70 ms, write 4453 ms, index 398 ms: 5 candidates, 59964 repo-hours, 803 releases; waiting 495 ms; commit 1885 ms)
2026-11-07T19:46:18Z [load_day 2023-05-07] 2023-05-07 hour 1: 124488 events in 3 files, snapshot 7924529339372238087 (task 9164 ms: download 3901 ms overlapping gunzip 530 ms, parse 2319 ms, sort 66 ms, write 4657 ms, index 428 ms: 6 candidates, 67582 repo-hours, 742 releases; waiting 823 ms; commit 1804 ms)
2026-11-07T19:46:24Z [load_day 2023-05-07] 2023-05-07 hour 2: 107582 events in 3 files, snapshot 7594423465701699649 (task 7900 ms: download 2207 ms overlapping gunzip 467 ms, parse 1921 ms, sort 64 ms, write 4242 ms, index 318 ms: 6 candidates, 49022 repo-hours, 576 releases; waiting 546 ms; commit 1662 ms)
2026-11-07T19:46:26Z [load_day 2023-05-07] 2023-05-07 hour 3: 101765 events in 3 files, snapshot 5981196276092806930 (task 7732 ms: download 3048 ms overlapping gunzip 459 ms, parse 1935 ms, sort 72 ms, write 3971 ms, index 283 ms: 4 candidates, 39661 repo-hours, 655 releases; waiting 698 ms; commit 1993 ms)
2026-11-07T19:46:34Z [load_day 2023-05-07] 2023-05-07 hour 4: 102463 events in 3 files, snapshot 4324482505301945556 (task 8614 ms: download 3446 ms overlapping gunzip 478 ms, parse 1948 ms, sort 69 ms, write 4305 ms, index 279 ms: 3 candidates, 40550 repo-hours, 462 releases; waiting 1111 ms; commit 1662 ms)
2026-11-07T19:46:36Z [load_day 2023-05-07] 2023-05-07 hour 5: 106583 events in 3 files, snapshot 1240115508854660174 (task 7787 ms: download 2277 ms overlapping gunzip 472 ms, parse 1965 ms, sort 60 ms, write 4209 ms, index 285 ms: 6 candidates, 43073 repo-hours, 629 releases; waiting 511 ms; commit 1761 ms)
2026-11-07T19:46:45Z [load_day 2023-05-07] 2023-05-07 hour 6: 119449 events in 3 files, snapshot 8904310153020812612 (task 9204 ms: download 2516 ms overlapping gunzip 512 ms, parse 2139 ms, sort 61 ms, write 5441 ms, index 326 ms: 6 candidates, 51154 repo-hours, 725 releases; waiting 406 ms; commit 3226 ms)
2026-11-07T19:46:47Z [load_day 2023-05-07] 2023-05-07 hour 7: 117236 events in 3 files, snapshot 5083105817022955970 (task 8431 ms: download 2353 ms overlapping gunzip 527 ms, parse 2259 ms, sort 69 ms, write 4325 ms, index 387 ms: 6 candidates, 48071 repo-hours, 577 releases; waiting 560 ms; commit 1620 ms)
2026-11-07T19:46:55Z [load_day 2023-05-07] 2023-05-07 hour 8: 135752 events in 3 files, snapshot 8230447274958440356 (task 9401 ms: download 3744 ms overlapping gunzip 634 ms, parse 2716 ms, sort 88 ms, write 5045 ms, index 423 ms: 9 candidates, 60062 repo-hours, 623 releases; waiting 230 ms; commit 1606 ms)
2026-11-07T19:46:58Z [load_day 2023-05-07] 2023-05-07 hour 9: 132096 events in 3 files, snapshot 5703796043940041160 (task 9795 ms: download 4226 ms overlapping gunzip 613 ms, parse 2694 ms, sort 80 ms, write 5224 ms, index 348 ms: 9 candidates, 53738 repo-hours, 804 releases; waiting 609 ms; commit 1961 ms)
2026-11-07T19:47:06Z [load_day 2023-05-07] 2023-05-07 hour 10: 136589 events in 3 files, snapshot 4009753381742005567 (task 9504 ms: download 3908 ms overlapping gunzip 589 ms, parse 2510 ms, sort 77 ms, write 5069 ms, index 365 ms: 8 candidates, 57061 repo-hours, 691 releases; waiting 512 ms; commit 1644 ms)
2026-11-07T19:47:09Z [load_day 2023-05-07] 2023-05-07 hour 11: 133776 events in 3 files, snapshot 8218405650908369041 (task 10230 ms: download 4604 ms overlapping gunzip 632 ms, parse 2601 ms, sort 81 ms, write 5150 ms, index 385 ms: 8 candidates, 55159 repo-hours, 659 releases; waiting 1030 ms; commit 1687 ms)
2026-11-07T19:47:19Z [load_day 2023-05-07] 2023-05-07 hour 12: 202365 events in 5 files, snapshot 4673376902014048301 (task 12390 ms: download 6303 ms overlapping gunzip 715 ms, parse 3201 ms, sort 112 ms, write 6829 ms, index 577 ms: 28 candidates, 86622 repo-hours, 835 releases; waiting 599 ms; commit 1951 ms)
2026-11-07T19:47:21Z [load_day 2023-05-07] 2023-05-07 hour 13: 167020 events in 4 files, snapshot 3735969240119191214 (task 11496 ms: download 4205 ms overlapping gunzip 660 ms, parse 2888 ms, sort 96 ms, write 6349 ms, index 533 ms: 11 candidates, 85370 repo-hours, 725 releases; waiting 513 ms; commit 1741 ms)
2026-11-07T19:47:31Z [load_day 2023-05-07] 2023-05-07 hour 14: 157496 events in 4 files, snapshot 1616489507376645357 (task 11535 ms: download 4815 ms overlapping gunzip 706 ms, parse 2941 ms, sort 95 ms, write 6272 ms, index 466 ms: 7 candidates, 68386 repo-hours, 895 releases; waiting 686 ms; commit 1673 ms)
2026-11-07T19:47:34Z [load_day 2023-05-07] 2023-05-07 hour 15: 158798 events in 4 files, snapshot 6464906021919929576 (task 11529 ms: download 4810 ms overlapping gunzip 697 ms, parse 2890 ms, sort 114 ms, write 6338 ms, index 491 ms: 10 candidates, 68662 repo-hours, 949 releases; waiting 636 ms; commit 1847 ms)
2026-11-07T19:47:43Z [load_day 2023-05-07] 2023-05-07 hour 16: 154888 events in 4 files, snapshot 3151494381967353953 (task 10766 ms: download 4494 ms overlapping gunzip 659 ms, parse 2774 ms, sort 86 ms, write 6007 ms, index 451 ms: 7 candidates, 66068 repo-hours, 1245 releases; waiting 534 ms; commit 1621 ms)
2026-11-07T19:47:46Z [load_day 2023-05-07] 2023-05-07 hour 17: 150814 events in 4 files, snapshot 1520496494077341561 (task 11174 ms: download 4620 ms overlapping gunzip 679 ms, parse 2820 ms, sort 81 ms, write 6258 ms, index 462 ms: 7 candidates, 62585 repo-hours, 771 releases; waiting 532 ms; commit 1731 ms)
2026-11-07T19:47:55Z [load_day 2023-05-07] 2023-05-07 hour 18: 155238 events in 4 files, snapshot 543979073266100996 (task 10763 ms: download 4238 ms overlapping gunzip 645 ms, parse 2753 ms, sort 94 ms, write 6008 ms, index 468 ms: 8 candidates, 67622 repo-hours, 801 releases; waiting 510 ms; commit 1827 ms)
2026-11-07T19:47:57Z [load_day 2023-05-07] 2023-05-07 hour 19: 139544 events in 3 files, snapshot 3207300867381092271 (task 10454 ms: download 4512 ms overlapping gunzip 686 ms, parse 2883 ms, sort 73 ms, write 5634 ms, index 375 ms: 6 candidates, 54956 repo-hours, 791 releases; waiting 515 ms; commit 1883 ms)
2026-11-07T19:48:05Z [load_day 2023-05-07] 2023-05-07 hour 20: 136955 events in 3 files, snapshot 1895023407270406917 (task 9782 ms: download 4175 ms overlapping gunzip 624 ms, parse 2592 ms, sort 67 ms, write 5327 ms, index 384 ms: 8 candidates, 55580 repo-hours, 706 releases; waiting 519 ms; commit 1696 ms)
2026-11-07T19:48:08Z [load_day 2023-05-07] 2023-05-07 hour 21: 127544 events in 3 files, snapshot 2510741785981816314 (task 9554 ms: download 4205 ms overlapping gunzip 584 ms, parse 2442 ms, sort 70 ms, write 5100 ms, index 334 ms: 7 candidates, 48871 repo-hours, 833 releases; waiting 733 ms; commit 1842 ms)
2026-11-07T19:48:15Z [load_day 2023-05-07] 2023-05-07 hour 22: 114712 events in 3 files, snapshot 4581460130011125284 (task 8534 ms: download 1969 ms overlapping gunzip 561 ms, parse 2348 ms, sort 68 ms, write 4527 ms, index 308 ms: 4 candidates, 44547 repo-hours, 700 releases; waiting 509 ms; commit 1699 ms)
2026-11-07T19:48:17Z [load_day 2023-05-07] 2023-05-07 hour 23: 111699 events in 3 files, snapshot 8184905143837480543 (task 8541 ms: download 2148 ms overlapping gunzip 534 ms, parse 2234 ms, sort 65 ms, write 4516 ms, index 311 ms: 4 candidates, 44042 repo-hours, 560 releases; waiting 522 ms; commit 1584 ms)
2026-11-07T19:48:23Z [load_day 2023-05-07] 2023-05-07: repo_hour merged from 24 files to 1 (1378408 rows, 6175 ms)
2026-11-07T19:48:25Z [load_day 2023-05-07] 2023-05-07: index committed in 7901 ms (24 + 1 + 24 files)
2026-11-07T19:48:25Z [load_day 2023-05-07] 2023-05-07: 3213629 events in 24 hours
2026-11-07T19:48:25Z [load_day 2023-05-07] attempt 1 succeeded