orcaLog in

Runs · run 1272

load_day 2023-07-07, attempt 1 succeeded

Host
3c2b29713ce8:98535
Started
2026-11-07T22:44:02Z
Ended
2026-11-07T22:47:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1272/load_day/2023-07-07/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:44:02Z [load_day 2023-07-07] attempt 1 started
2026-11-07T22:44:04Z [load_day 2023-07-07] 2023-07-07: 2 hours in flight, about 1200 MB
2026-11-07T22:44:22Z [load_day 2023-07-07] 2023-07-07 hour 0: 146252 events in 3 files, snapshot 1100277012366200944 (task 14044 ms: download 6128 ms overlapping gunzip 983 ms, parse 4345 ms, sort 128 ms, write 7647 ms, index 464 ms: 6 candidates, 67577 repo-hours, 849 releases; waiting 193 ms; commit 3010 ms)
2026-11-07T22:44:24Z [load_day 2023-07-07] 2023-07-07 hour 1: 162410 events in 4 files, snapshot 1362126200813363145 (task 14353 ms: download 6083 ms overlapping gunzip 834 ms, parse 3909 ms, sort 100 ms, write 8110 ms, index 615 ms: 6 candidates, 92387 repo-hours, 886 releases; waiting 470 ms; commit 2213 ms)
2026-11-07T22:44:37Z [load_day 2023-07-07] 2023-07-07 hour 2: 142951 events in 3 files, snapshot 770327318875216728 (task 13582 ms: download 5359 ms overlapping gunzip 938 ms, parse 4104 ms, sort 122 ms, write 7170 ms, index 455 ms: 7 candidates, 70071 repo-hours, 703 releases; waiting 505 ms; commit 3178 ms)
2026-11-07T22:44:39Z [load_day 2023-07-07] 2023-07-07 hour 3: 132909 events in 3 files, snapshot 9009650244151218031 (task 13009 ms: download 5483 ms overlapping gunzip 661 ms, parse 2883 ms, sort 101 ms, write 7869 ms, index 705 ms: 4 candidates, 60001 repo-hours, 818 releases; waiting 494 ms; commit 2217 ms)
2026-11-07T22:44:49Z [load_day 2023-07-07] 2023-07-07 hour 4: 122464 events in 3 files, snapshot 8086732843381070892 (task 12446 ms: download 5048 ms overlapping gunzip 710 ms, parse 3319 ms, sort 114 ms, write 6958 ms, index 469 ms: 2 candidates, 53470 repo-hours, 595 releases; waiting 544 ms; commit 2137 ms)
2026-11-07T22:44:54Z [load_day 2023-07-07] 2023-07-07 hour 5: 135879 events in 3 files, snapshot 4374367801204033890 (task 13885 ms: download 5473 ms overlapping gunzip 742 ms, parse 3100 ms, sort 97 ms, write 8659 ms, index 501 ms: 3 candidates, 60242 repo-hours, 772 releases; waiting 527 ms; commit 2375 ms)
2026-11-07T22:45:10Z [load_day 2023-07-07] 2023-07-07 hour 6: 162436 events in 4 files, snapshot 6660868781618433585 (task 17199 ms: download 6744 ms overlapping gunzip 1004 ms, parse 4421 ms, sort 200 ms, write 10100 ms, index 642 ms: 4 candidates, 75744 repo-hours, 908 releases; waiting 490 ms; commit 4746 ms)
2026-11-07T22:45:14Z [load_day 2023-07-07] 2023-07-07 hour 7: 166071 events in 4 files, snapshot 5516073084120025555 (task 18657 ms: download 11016 ms overlapping gunzip 1008 ms, parse 4614 ms, sort 104 ms, write 11589 ms, index 595 ms: 7 candidates, 74878 repo-hours, 924 releases; waiting 499 ms; commit 2369 ms)
2026-11-07T22:45:32Z [load_day 2023-07-07] 2023-07-07 hour 8: 182735 events in 4 files, snapshot 397753257182058494 (task 20430 ms: download 11861 ms overlapping gunzip 1192 ms, parse 5298 ms, sort 112 ms, write 12369 ms, index 674 ms: 5 candidates, 81839 repo-hours, 1056 releases; waiting 507 ms; commit 5485 ms)
2026-11-07T22:45:36Z [load_day 2023-07-07] 2023-07-07 hour 9: 184245 events in 4 files, snapshot 2678076501409530727 (task 21290 ms: download 11714 ms overlapping gunzip 1285 ms, parse 5525 ms, sort 127 ms, write 12980 ms, index 636 ms: 4 candidates, 82142 repo-hours, 1271 releases; waiting 468 ms; commit 2598 ms)
2026-11-07T22:45:50Z [load_day 2023-07-07] 2023-07-07 hour 10: 171875 events in 4 files, snapshot 1637795164430317441 (task 19736 ms: download 12119 ms overlapping gunzip 1192 ms, parse 5240 ms, sort 133 ms, write 11640 ms, index 728 ms: 2 candidates, 76744 repo-hours, 1056 releases; waiting 514 ms; commit 2592 ms)
2026-11-07T22:45:55Z [load_day 2023-07-07] 2023-07-07 hour 11: 172712 events in 4 files, snapshot 6884213660422730440 (task 18429 ms: download 10864 ms overlapping gunzip 1136 ms, parse 4873 ms, sort 152 ms, write 10629 ms, index 749 ms: 4 candidates, 74570 repo-hours, 1038 releases; waiting 530 ms; commit 2292 ms)
2026-11-07T22:46:13Z [load_day 2023-07-07] 2023-07-07 hour 12: 202621 events in 5 files, snapshot 7582348589335101321 (task 20080 ms: download 10812 ms overlapping gunzip 1059 ms, parse 4693 ms, sort 179 ms, write 12611 ms, index 664 ms: 3 candidates, 100977 repo-hours, 1053 releases; waiting 525 ms; commit 4858 ms)
2026-11-07T22:46:16Z [load_day 2023-07-07] 2023-07-07 hour 13: 198939 events in 4 files, snapshot 9036747034050920526 (task 19997 ms: download 10659 ms overlapping gunzip 1071 ms, parse 4915 ms, sort 171 ms, write 12229 ms, index 809 ms: 5 candidates, 99579 repo-hours, 1111 releases; waiting 501 ms; commit 2253 ms)
2026-11-07T22:46:31Z [load_day 2023-07-07] 2023-07-07 hour 14: 191777 events in 4 files, snapshot 1198492942541169822 (task 19863 ms: download 11350 ms overlapping gunzip 1107 ms, parse 4702 ms, sort 120 ms, write 12530 ms, index 588 ms: 3 candidates, 86632 repo-hours, 1188 releases; waiting 516 ms; commit 2176 ms)
2026-11-07T22:46:34Z [load_day 2023-07-07] 2023-07-07 hour 15: 180022 events in 4 files, snapshot 8427884653594682863 (task 17349 ms: download 10475 ms overlapping gunzip 921 ms, parse 4331 ms, sort 104 ms, write 10554 ms, index 571 ms: 4 candidates, 82179 repo-hours, 1212 releases; waiting 500 ms; commit 2094 ms)
2026-11-07T22:46:52Z [load_day 2023-07-07] 2023-07-07 hour 16: 185582 events in 4 files, snapshot 8722057722168072233 (task 15111 ms: download 8703 ms overlapping gunzip 877 ms, parse 3840 ms, sort 117 ms, write 8770 ms, index 584 ms: 6 candidates, 87761 repo-hours, 922 releases; waiting 600 ms; commit 6525 ms)
2026-11-07T22:46:55Z [load_day 2023-07-07] 2023-07-07 hour 17: 170564 events in 4 files, snapshot 9039122263531584342 (task 13952 ms: download 8168 ms overlapping gunzip 801 ms, parse 3542 ms, sort 95 ms, write 8114 ms, index 522 ms: 4 candidates, 74999 repo-hours, 1007 releases; waiting 548 ms; commit 2959 ms)
2026-11-07T22:47:05Z [load_day 2023-07-07] 2023-07-07 hour 18: 176668 events in 4 files, snapshot 2924899020169211090 (task 16790 ms: download 9867 ms overlapping gunzip 897 ms, parse 3992 ms, sort 124 ms, write 10399 ms, index 593 ms: 2 candidates, 83659 repo-hours, 1020 releases; waiting 505 ms; commit 2507 ms)
2026-11-07T22:47:11Z [load_day 2023-07-07] 2023-07-07 hour 19: 156731 events in 4 files, snapshot 3864155396473241293 (task 15874 ms: download 6840 ms overlapping gunzip 923 ms, parse 4150 ms, sort 88 ms, write 9338 ms, index 534 ms: 10 candidates, 66979 repo-hours, 1003 releases; waiting 520 ms; commit 2488 ms)
2026-11-07T22:47:23Z [load_day 2023-07-07] 2023-07-07 hour 20: 155420 events in 4 files, snapshot 763630612804745330 (task 16659 ms: download 6803 ms overlapping gunzip 1034 ms, parse 4502 ms, sort 150 ms, write 9555 ms, index 610 ms: 5 candidates, 67324 repo-hours, 868 releases; waiting 487 ms; commit 2523 ms)
2026-11-07T22:47:32Z [load_day 2023-07-07] 2023-07-07 hour 21: 150938 events in 4 files, snapshot 4113990517128050302 (task 17660 ms: download 10570 ms overlapping gunzip 1198 ms, parse 5166 ms, sort 125 ms, write 9711 ms, index 668 ms: 2 candidates, 61791 repo-hours, 1084 releases; waiting 486 ms; commit 4646 ms)
2026-11-07T22:47:42Z [load_day 2023-07-07] 2023-07-07 hour 22: 134770 events in 3 files, snapshot 6534683043473097586 (task 16944 ms: download 7633 ms overlapping gunzip 1065 ms, parse 4535 ms, sort 152 ms, write 9835 ms, index 511 ms: 2 candidates, 56603 repo-hours, 780 releases; waiting 522 ms; commit 3617 ms)
2026-11-07T22:47:44Z [load_day 2023-07-07] 2023-07-07 hour 23: 121677 events in 3 files, snapshot 8647654278433007693 (task 13527 ms: download 6935 ms overlapping gunzip 975 ms, parse 3989 ms, sort 114 ms, write 7191 ms, index 451 ms: 2 candidates, 52885 repo-hours, 676 releases; waiting 517 ms; commit 1862 ms)
2026-11-07T22:47:52Z [load_day 2023-07-07] 2023-07-07: repo_hour merged from 24 files to 1 (1791033 rows, 7915 ms)
2026-11-07T22:47:54Z [load_day 2023-07-07] 2023-07-07: index committed in 10185 ms (24 + 1 + 24 files)
2026-11-07T22:47:54Z [load_day 2023-07-07] 2023-07-07: 3908648 events in 24 hours
2026-11-07T22:47:54Z [load_day 2023-07-07] attempt 1 succeeded