orcaLog in

Runs · run 939

load_day 2023-03-26, attempt 1 succeeded

Host
caf251265124:202480
Started
2026-11-07T17:41:27Z
Ended
2026-11-07T17:43:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/939/load_day/2023-03-26/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:41:27Z [load_day 2023-03-26] attempt 1 started
2026-11-07T17:41:28Z [load_day 2023-03-26] 2023-03-26: 2 hours in flight, about 1200 MB
2026-11-07T17:41:38Z [load_day 2023-03-26] 2023-03-26 hour 0: 116687 events in 3 files, snapshot 3348852272544303606 (task 7937 ms: download 2193 ms overlapping gunzip 424 ms, parse 2047 ms, sort 66 ms, write 4151 ms, index 373 ms: 7 candidates, 59521 repo-hours, 846 releases; waiting 494 ms; commit 1580 ms)
2026-11-07T17:41:40Z [load_day 2023-03-26] 2023-03-26 hour 1: 125813 events in 3 files, snapshot 2962878407812646801 (task 8197 ms: download 2504 ms overlapping gunzip 438 ms, parse 2123 ms, sort 82 ms, write 4223 ms, index 424 ms: 3 candidates, 66551 repo-hours, 786 releases; waiting 539 ms; commit 1562 ms)
2026-11-07T17:41:46Z [load_day 2023-03-26] 2023-03-26 hour 2: 113837 events in 3 files, snapshot 7912572197171668249 (task 7254 ms: download 1879 ms overlapping gunzip 388 ms, parse 1821 ms, sort 65 ms, write 3731 ms, index 345 ms: 5 candidates, 49497 repo-hours, 582 releases; waiting 528 ms; commit 1301 ms)
2026-11-07T17:41:47Z [load_day 2023-03-26] 2023-03-26 hour 3: 104028 events in 3 files, snapshot 6431242741958289861 (task 6302 ms: download 1544 ms overlapping gunzip 373 ms, parse 1754 ms, sort 63 ms, write 3310 ms, index 286 ms: 3 candidates, 40659 repo-hours, 746 releases; waiting 184 ms; commit 1409 ms)
2026-11-07T17:41:54Z [load_day 2023-03-26] 2023-03-26 hour 4: 100044 events in 3 files, snapshot 46656011912996003 (task 6542 ms: download 2151 ms overlapping gunzip 349 ms, parse 1627 ms, sort 76 ms, write 3135 ms, index 298 ms: 1 candidates, 40128 repo-hours, 559 releases; waiting 750 ms; commit 1581 ms)
2026-11-07T17:41:56Z [load_day 2023-03-26] 2023-03-26 hour 5: 105258 events in 3 files, snapshot 5819905032096004554 (task 7509 ms: download 2487 ms overlapping gunzip 391 ms, parse 1816 ms, sort 71 ms, write 3450 ms, index 309 ms: 1 candidates, 43013 repo-hours, 698 releases; waiting 1167 ms; commit 1607 ms)
2026-11-07T17:42:01Z [load_day 2023-03-26] 2023-03-26 hour 6: 114065 events in 3 files, snapshot 6156509776546657943 (task 6911 ms: download 1928 ms overlapping gunzip 378 ms, parse 1784 ms, sort 65 ms, write 3505 ms, index 324 ms: 2 candidates, 50023 repo-hours, 664 releases; waiting 518 ms; commit 1410 ms)
2026-11-07T17:42:03Z [load_day 2023-03-26] 2023-03-26 hour 7: 114580 events in 3 files, snapshot 8860532833670192095 (task 7070 ms: download 1819 ms overlapping gunzip 396 ms, parse 1830 ms, sort 77 ms, write 3733 ms, index 326 ms: 5 candidates, 46743 repo-hours, 576 releases; waiting 357 ms; commit 1586 ms)
2026-11-07T17:42:10Z [load_day 2023-03-26] 2023-03-26 hour 8: 123506 events in 3 files, snapshot 292060899271360860 (task 7915 ms: download 2262 ms overlapping gunzip 444 ms, parse 2051 ms, sort 70 ms, write 4142 ms, index 366 ms: 3 candidates, 51802 repo-hours, 739 releases; waiting 521 ms; commit 1455 ms)
2026-11-07T17:42:13Z [load_day 2023-03-26] 2023-03-26 hour 9: 127648 events in 3 files, snapshot 7672339821422828715 (task 8500 ms: download 2581 ms overlapping gunzip 481 ms, parse 2215 ms, sort 78 ms, write 4533 ms, index 378 ms: 3 candidates, 53453 repo-hours, 812 releases; waiting 510 ms; commit 1573 ms)
2026-11-07T17:42:20Z [load_day 2023-03-26] 2023-03-26 hour 10: 131366 events in 3 files, snapshot 4909021868705496396 (task 8935 ms: download 2121 ms overlapping gunzip 491 ms, parse 2229 ms, sort 79 ms, write 4871 ms, index 390 ms: 3 candidates, 56632 repo-hours, 730 releases; waiting 611 ms; commit 1487 ms)
2026-11-07T17:42:22Z [load_day 2023-03-26] 2023-03-26 hour 11: 134710 events in 3 files, snapshot 6957672042805878269 (task 9014 ms: download 2794 ms overlapping gunzip 502 ms, parse 2316 ms, sort 89 ms, write 4783 ms, index 364 ms: 6 candidates, 56952 repo-hours, 739 releases; waiting 569 ms; commit 1387 ms)
2026-11-07T17:42:30Z [load_day 2023-03-26] 2023-03-26 hour 12: 195968 events in 4 files, snapshot 4121056819009388399 (task 10406 ms: download 3435 ms overlapping gunzip 603 ms, parse 2853 ms, sort 98 ms, write 5703 ms, index 550 ms: 4 candidates, 88418 repo-hours, 859 releases; waiting 254 ms; commit 1321 ms)
2026-11-07T17:42:37Z [load_day 2023-03-26] 2023-03-26 hour 13: 170577 events in 4 files, snapshot 2545304389576236037 (task 10151 ms: download 3536 ms overlapping gunzip 561 ms, parse 2648 ms, sort 89 ms, write 5513 ms, index 526 ms: 4 candidates, 85009 repo-hours, 822 releases; waiting 507 ms; commit 4848 ms)
2026-11-07T17:42:43Z [load_day 2023-03-26] 2023-03-26 hour 14: 163792 events in 4 files, snapshot 7095709430990772597 (task 11080 ms: download 4001 ms overlapping gunzip 605 ms, parse 2782 ms, sort 135 ms, write 6111 ms, index 580 ms: 2 candidates, 72653 repo-hours, 881 releases; waiting 559 ms; commit 1605 ms)
2026-11-07T17:42:45Z [load_day 2023-03-26] 2023-03-26 hour 15: 167730 events in 4 files, snapshot 6004780383211867598 (task 11551 ms: download 4469 ms overlapping gunzip 613 ms, parse 2810 ms, sort 117 ms, write 6094 ms, index 609 ms: 3 candidates, 74631 repo-hours, 957 releases; waiting 853 ms; commit 1428 ms)
2026-11-07T17:42:54Z [load_day 2023-03-26] 2023-03-26 hour 16: 168450 events in 4 files, snapshot 2501028443228612865 (task 10855 ms: download 3958 ms overlapping gunzip 608 ms, parse 2755 ms, sort 102 ms, write 6015 ms, index 550 ms: 4 candidates, 78625 repo-hours, 833 releases; waiting 522 ms; commit 1456 ms)
2026-11-07T17:42:56Z [load_day 2023-03-26] 2023-03-26 hour 17: 158204 events in 4 files, snapshot 4679539802256807820 (task 10304 ms: download 3959 ms overlapping gunzip 597 ms, parse 2724 ms, sort 103 ms, write 5562 ms, index 476 ms: 5 candidates, 68146 repo-hours, 696 releases; waiting 518 ms; commit 1506 ms)
2026-11-07T17:43:05Z [load_day 2023-03-26] 2023-03-26 hour 18: 164801 events in 4 files, snapshot 6330918126023943020 (task 10407 ms: download 3954 ms overlapping gunzip 589 ms, parse 2671 ms, sort 108 ms, write 5710 ms, index 479 ms: 8 candidates, 79730 repo-hours, 783 releases; waiting 563 ms; commit 1412 ms)
2026-11-07T17:43:08Z [load_day 2023-03-26] 2023-03-26 hour 19: 161180 events in 4 files, snapshot 59981500616625453 (task 10173 ms: download 3796 ms overlapping gunzip 566 ms, parse 2616 ms, sort 111 ms, write 5473 ms, index 463 ms: 3 candidates, 76380 repo-hours, 850 releases; waiting 561 ms; commit 1564 ms)
2026-11-07T17:43:16Z [load_day 2023-03-26] 2023-03-26 hour 20: 154047 events in 4 files, snapshot 4977069985766730340 (task 10060 ms: download 3515 ms overlapping gunzip 543 ms, parse 2508 ms, sort 91 ms, write 5582 ms, index 433 ms: 9 candidates, 72083 repo-hours, 817 releases; waiting 563 ms; commit 1396 ms)
2026-11-07T17:43:18Z [load_day 2023-03-26] 2023-03-26 hour 21: 131024 events in 3 files, snapshot 7632155455285110184 (task 9591 ms: download 4212 ms overlapping gunzip 509 ms, parse 2334 ms, sort 85 ms, write 4672 ms, index 372 ms: 6 candidates, 54788 repo-hours, 816 releases; waiting 1207 ms; commit 1541 ms)
2026-11-07T17:43:25Z [load_day 2023-03-26] 2023-03-26 hour 22: 120002 events in 3 files, snapshot 3208914824355425779 (task 8104 ms: download 2346 ms overlapping gunzip 472 ms, parse 2056 ms, sort 86 ms, write 4280 ms, index 397 ms: 4 candidates, 47822 repo-hours, 701 releases; waiting 521 ms; commit 1311 ms)
2026-11-07T17:43:27Z [load_day 2023-03-26] 2023-03-26 hour 23: 112826 events in 3 files, snapshot 4939944909456617865 (task 7762 ms: download 1824 ms overlapping gunzip 444 ms, parse 2048 ms, sort 72 ms, write 4104 ms, index 304 ms: 4 candidates, 45728 repo-hours, 621 releases; waiting 536 ms; commit 1536 ms)
2026-11-07T17:43:33Z [load_day 2023-03-26] 2023-03-26: repo_hour merged from 24 files to 1 (1458987 rows, 6176 ms)
2026-11-07T17:43:35Z [load_day 2023-03-26] 2023-03-26: index committed in 8094 ms (24 + 1 + 24 files)
2026-11-07T17:43:35Z [load_day 2023-03-26] 2023-03-26: 3280143 events in 24 hours
2026-11-07T17:43:35Z [load_day 2023-03-26] attempt 1 succeeded