orcaLog in

Runs · run 1730

load_day 2023-11-12, attempt 1 succeeded

Host
3c2b29713ce8:547896
Started
2026-11-08T02:44:24Z
Ended
2026-11-08T02:47:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1730/load_day/2023-11-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T02:44:24Z [load_day 2023-11-12] attempt 1 started
2026-11-08T02:44:26Z [load_day 2023-11-12] 2023-11-12: 2 hours in flight, about 1200 MB
2026-11-08T02:44:41Z [load_day 2023-11-12] 2023-11-12 hour 0: 133427 events in 3 files, snapshot 8892548469625893200 (task 10758 ms: download 1473 ms overlapping gunzip 606 ms, parse 3075 ms, sort 132 ms, write 6083 ms, index 643 ms: 6 candidates, 75220 repo-hours, 928 releases; waiting 17 ms; commit 2311 ms)
2026-11-08T02:44:43Z [load_day 2023-11-12] 2023-11-12 hour 1: 142692 events in 3 files, snapshot 7960988636773572830 (task 11561 ms: download 4374 ms overlapping gunzip 771 ms, parse 3310 ms, sort 74 ms, write 6597 ms, index 593 ms: 8 candidates, 83386 repo-hours, 746 releases; waiting 19 ms; commit 2407 ms)
2026-11-08T02:44:50Z [load_day 2023-11-12] 2023-11-12 hour 2: 105053 events in 3 files, snapshot 916313190718253227 (task 7220 ms: download 859 ms overlapping gunzip 486 ms, parse 1938 ms, sort 76 ms, write 4207 ms, index 309 ms: 3 candidates, 44034 repo-hours, 629 releases; waiting 18 ms; commit 3085 ms)
2026-11-08T02:44:52Z [load_day 2023-11-12] 2023-11-12 hour 3: 100024 events in 3 files, snapshot 6168142631947047381 (task 6664 ms: download 760 ms overlapping gunzip 418 ms, parse 1784 ms, sort 72 ms, write 3615 ms, index 551 ms: 0 candidates, 41954 repo-hours, 668 releases; waiting 19 ms; commit 2398 ms)
2026-11-08T02:44:57Z [load_day 2023-11-12] 2023-11-12 hour 4: 100719 events in 3 files, snapshot 1604742441445748958 (task 6798 ms: download 837 ms overlapping gunzip 453 ms, parse 1893 ms, sort 69 ms, write 3873 ms, index 296 ms: 1 candidates, 40843 repo-hours, 511 releases; waiting 20 ms; commit 2191 ms)
2026-11-08T02:45:00Z [load_day 2023-11-12] 2023-11-12 hour 5: 101165 events in 3 files, snapshot 3263041902389342925 (task 6336 ms: download 720 ms overlapping gunzip 385 ms, parse 1726 ms, sort 69 ms, write 3656 ms, index 284 ms: 5 candidates, 42261 repo-hours, 550 releases; waiting 23 ms; commit 2542 ms)
2026-11-08T02:45:06Z [load_day 2023-11-12] 2023-11-12 hour 6: 113847 events in 3 files, snapshot 5315027094129359140 (task 7065 ms: download 764 ms overlapping gunzip 371 ms, parse 1719 ms, sort 68 ms, write 3996 ms, index 689 ms: 4 candidates, 49997 repo-hours, 589 releases; waiting 22 ms; commit 3283 ms)
2026-11-08T02:45:10Z [load_day 2023-11-12] 2023-11-12 hour 7: 113147 events in 3 files, snapshot 140557351318769324 (task 8464 ms: download 891 ms overlapping gunzip 601 ms, parse 2437 ms, sort 79 ms, write 4740 ms, index 382 ms: 1 candidates, 45207 repo-hours, 564 releases; waiting 17 ms; commit 3495 ms)
2026-11-08T02:45:16Z [load_day 2023-11-12] 2023-11-12 hour 8: 114387 events in 3 files, snapshot 8924043277701381840 (task 9823 ms: download 2076 ms overlapping gunzip 569 ms, parse 2704 ms, sort 116 ms, write 5037 ms, index 491 ms: 2 candidates, 47832 repo-hours, 586 releases; waiting 558 ms; commit 2653 ms)
2026-11-08T02:45:23Z [load_day 2023-11-12] 2023-11-12 hour 9: 120894 events in 3 files, snapshot 7615482518106776062 (task 9844 ms: download 1529 ms overlapping gunzip 624 ms, parse 2663 ms, sort 114 ms, write 5775 ms, index 435 ms: 8 candidates, 50137 repo-hours, 827 releases; waiting 22 ms; commit 4628 ms)
2026-11-08T02:45:28Z [load_day 2023-11-12] 2023-11-12 hour 10: 127541 events in 3 files, snapshot 3266327303774020645 (task 10268 ms: download 975 ms overlapping gunzip 582 ms, parse 2402 ms, sort 127 ms, write 6472 ms, index 472 ms: 4 candidates, 53442 repo-hours, 725 releases; waiting 22 ms; commit 2983 ms)
2026-11-08T02:45:41Z [load_day 2023-11-12] 2023-11-12 hour 11: 124849 events in 3 files, snapshot 2064665032307415725 (task 11296 ms: download 2192 ms overlapping gunzip 734 ms, parse 3247 ms, sort 124 ms, write 6578 ms, index 394 ms: 2 candidates, 51812 repo-hours, 738 releases; waiting 21 ms; commit 11183 ms)
2026-11-08T02:45:48Z [load_day 2023-11-12] 2023-11-12 hour 12: 204384 events in 5 files, snapshot 2689321675433136459 (task 15068 ms: download 4608 ms overlapping gunzip 954 ms, parse 4387 ms, sort 130 ms, write 8682 ms, index 698 ms: 4 candidates, 86833 repo-hours, 764 releases; waiting 16 ms; commit 6050 ms)
2026-11-08T02:45:51Z [load_day 2023-11-12] 2023-11-12 hour 13: 161183 events in 4 files, snapshot 388262684570394128 (task 14907 ms: download 5736 ms overlapping gunzip 890 ms, parse 3983 ms, sort 98 ms, write 8508 ms, index 1231 ms: 2 candidates, 79517 repo-hours, 839 releases; waiting 21 ms; commit 3077 ms)
2026-11-08T02:45:58Z [load_day 2023-11-12] 2023-11-12 hour 14: 140793 events in 3 files, snapshot 6280054427281802073 (task 11293 ms: download 3932 ms overlapping gunzip 585 ms, parse 2786 ms, sort 139 ms, write 7080 ms, index 488 ms: 2 candidates, 62447 repo-hours, 819 releases; waiting 23 ms; commit 4259 ms)
2026-11-08T02:46:07Z [load_day 2023-11-12] 2023-11-12 hour 15: 161643 events in 4 files, snapshot 8002403781431233761 (task 13821 ms: download 4734 ms overlapping gunzip 846 ms, parse 3799 ms, sort 98 ms, write 8256 ms, index 590 ms: 5 candidates, 69756 repo-hours, 1126 releases; waiting 19 ms; commit 3956 ms)
2026-11-08T02:46:13Z [load_day 2023-11-12] 2023-11-12 hour 16: 156474 events in 4 files, snapshot 6141154431145104536 (task 15005 ms: download 5529 ms overlapping gunzip 934 ms, parse 3732 ms, sort 109 ms, write 8652 ms, index 637 ms: 8 candidates, 66392 repo-hours, 914 releases; waiting 511 ms; commit 2742 ms)
2026-11-08T02:46:21Z [load_day 2023-11-12] 2023-11-12 hour 17: 148569 events in 3 files, snapshot 2820941376920802676 (task 13386 ms: download 5255 ms overlapping gunzip 858 ms, parse 3662 ms, sort 116 ms, write 7970 ms, index 567 ms: 7 candidates, 61318 repo-hours, 769 releases; waiting 19 ms; commit 3698 ms)
2026-11-08T02:46:29Z [load_day 2023-11-12] 2023-11-12 hour 18: 155226 events in 4 files, snapshot 6448462796050506898 (task 12312 ms: download 4511 ms overlapping gunzip 744 ms, parse 3332 ms, sort 140 ms, write 7422 ms, index 459 ms: 7 candidates, 67724 repo-hours, 1011 releases; waiting 11 ms; commit 5759 ms)
2026-11-08T02:46:33Z [load_day 2023-11-12] 2023-11-12 hour 19: 141563 events in 3 files, snapshot 7261503027723601148 (task 11920 ms: download 4281 ms overlapping gunzip 819 ms, parse 3479 ms, sort 102 ms, write 6787 ms, index 475 ms: 7 candidates, 58474 repo-hours, 836 releases; waiting 57 ms; commit 2662 ms)
2026-11-08T02:46:40Z [load_day 2023-11-12] 2023-11-12 hour 20: 141969 events in 3 files, snapshot 3090295619830466750 (task 11596 ms: download 4749 ms overlapping gunzip 728 ms, parse 3193 ms, sort 134 ms, write 6788 ms, index 533 ms: 9 candidates, 58962 repo-hours, 876 releases; waiting 19 ms; commit 3017 ms)
2026-11-08T02:46:45Z [load_day 2023-11-12] 2023-11-12 hour 21: 133841 events in 3 files, snapshot 3514039940425876053 (task 10751 ms: download 4086 ms overlapping gunzip 614 ms, parse 2732 ms, sort 122 ms, write 6690 ms, index 379 ms: 6 candidates, 54711 repo-hours, 946 releases; waiting 22 ms; commit 3052 ms)
2026-11-08T02:46:51Z [load_day 2023-11-12] 2023-11-12 hour 22: 123750 events in 3 files, snapshot 7686811402489132992 (task 10861 ms: download 2910 ms overlapping gunzip 566 ms, parse 2555 ms, sort 75 ms, write 6497 ms, index 371 ms: 5 candidates, 49679 repo-hours, 801 releases; waiting 504 ms; commit 2813 ms)
2026-11-08T02:46:55Z [load_day 2023-11-12] 2023-11-12 hour 23: 115895 events in 3 files, snapshot 5935439564369243735 (task 9301 ms: download 1536 ms overlapping gunzip 612 ms, parse 2760 ms, sort 74 ms, write 5262 ms, index 374 ms: 10 candidates, 48625 repo-hours, 596 releases; waiting 21 ms; commit 2167 ms)
2026-11-08T02:47:02Z [load_day 2023-11-12] 2023-11-12: repo_hour merged from 24 files to 1 (1390563 rows, 6621 ms)
2026-11-08T02:47:04Z [load_day 2023-11-12] 2023-11-12: index committed in 8974 ms (23 + 1 + 24 files)
2026-11-08T02:47:04Z [load_day 2023-11-12] 2023-11-12: 3183035 events in 24 hours
2026-11-08T02:47:04Z [load_day 2023-11-12] attempt 1 succeeded