orcaLog in

Runs · run 1170

load_day 2023-06-11, attempt 1 succeeded

Host
3c2b29713ce8:7363
Started
2026-11-07T21:23:13Z
Ended
2026-11-07T21:24:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1170/load_day/2023-06-11/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:23:13Z [load_day 2023-06-11] attempt 1 started
2026-11-07T21:23:14Z [load_day 2023-06-11] 2023-06-11: 4 hours in flight, about 2100 MB
2026-11-07T21:23:27Z [load_day 2023-06-11] 2023-06-11 hour 0: 102932 events in 3 files, snapshot 8438432975153291454 (task 9216 ms: download 2355 ms overlapping gunzip 512 ms, parse 2312 ms, sort 71 ms, write 5152 ms, index 342 ms: 11 candidates, 54705 repo-hours, 832 releases; waiting 511 ms; commit 1624 ms)
2026-11-07T21:23:29Z [load_day 2023-06-11] 2023-06-11 hour 1: 113554 events in 3 files, snapshot 7977034669645833305 (task 9425 ms: download 2059 ms overlapping gunzip 515 ms, parse 2517 ms, sort 65 ms, write 5280 ms, index 415 ms: 5 candidates, 67892 repo-hours, 905 releases; waiting 290 ms; commit 1844 ms)
2026-11-07T21:23:30Z [load_day 2023-06-11] 2023-06-11 hour 2: 94154 events in 2 files, snapshot 7247431848850382897 (task 8039 ms: download 2048 ms overlapping gunzip 450 ms, parse 2137 ms, sort 62 ms, write 4195 ms, index 353 ms: 4 candidates, 48395 repo-hours, 511 releases; waiting 520 ms; commit 1836 ms)
2026-11-07T21:23:33Z [load_day 2023-06-11] 2023-06-11 hour 3: 89433 events in 2 files, snapshot 6448853880630004841 (task 8002 ms: download 2044 ms overlapping gunzip 442 ms, parse 2157 ms, sort 58 ms, write 4218 ms, index 292 ms: 4 candidates, 39335 repo-hours, 794 releases; waiting 488 ms; commit 2240 ms)
2026-11-07T21:23:36Z [load_day 2023-06-11] 2023-06-11 hour 4: 88627 events in 2 files, snapshot 8510073748939261648 (task 7431 ms: download 1897 ms overlapping gunzip 344 ms, parse 1600 ms, sort 50 ms, write 4170 ms, index 316 ms: 3 candidates, 38695 repo-hours, 482 releases; waiting 596 ms; commit 2139 ms)
2026-11-07T21:23:38Z [load_day 2023-06-11] 2023-06-11 hour 5: 91942 events in 2 files, snapshot 1623296778736083116 (task 7565 ms: download 1552 ms overlapping gunzip 331 ms, parse 1614 ms, sort 62 ms, write 4296 ms, index 465 ms: 3 candidates, 41460 repo-hours, 548 releases; waiting 494 ms; commit 2130 ms)
2026-11-07T21:23:40Z [load_day 2023-06-11] 2023-06-11 hour 6: 106465 events in 3 files, snapshot 620980340367349753 (task 8728 ms: download 1924 ms overlapping gunzip 430 ms, parse 1958 ms, sort 66 ms, write 4992 ms, index 460 ms: 6 candidates, 49768 repo-hours, 672 releases; waiting 519 ms; commit 1928 ms)
2026-11-07T21:23:43Z [load_day 2023-06-11] 2023-06-11 hour 7: 108665 events in 3 files, snapshot 7756222365989407152 (task 9159 ms: download 2064 ms overlapping gunzip 410 ms, parse 1910 ms, sort 61 ms, write 5594 ms, index 324 ms: 5 candidates, 47582 repo-hours, 868 releases; waiting 519 ms; commit 2126 ms)
2026-11-07T21:23:46Z [load_day 2023-06-11] 2023-06-11 hour 8: 129721 events in 3 files, snapshot 1561180540663822223 (task 10024 ms: download 1990 ms overlapping gunzip 488 ms, parse 2270 ms, sort 100 ms, write 6286 ms, index 378 ms: 10 candidates, 64818 repo-hours, 604 releases; waiting 214 ms; commit 1838 ms)
2026-11-07T21:23:49Z [load_day 2023-06-11] 2023-06-11 hour 9: 127383 events in 3 files, snapshot 391826604852426132 (task 10452 ms: download 2131 ms overlapping gunzip 505 ms, parse 2357 ms, sort 69 ms, write 6238 ms, index 491 ms: 5 candidates, 62022 repo-hours, 727 releases; waiting 463 ms; commit 1916 ms)
2026-11-07T21:23:51Z [load_day 2023-06-11] 2023-06-11 hour 10: 120758 events in 3 files, snapshot 6797421926103249430 (task 9655 ms: download 1727 ms overlapping gunzip 437 ms, parse 2025 ms, sort 67 ms, write 6014 ms, index 372 ms: 6 candidates, 54137 repo-hours, 597 releases; waiting 497 ms; commit 1919 ms)
2026-11-07T21:23:53Z [load_day 2023-06-11] 2023-06-11 hour 11: 121363 events in 3 files, snapshot 1787398964611903533 (task 9545 ms: download 1633 ms overlapping gunzip 485 ms, parse 2265 ms, sort 80 ms, write 5826 ms, index 351 ms: 9 candidates, 53709 repo-hours, 686 releases; waiting 182 ms; commit 2092 ms)
2026-11-07T21:24:01Z [load_day 2023-06-11] 2023-06-11 hour 12: 197120 events in 4 files, snapshot 2081021183921735357 (task 13319 ms: download 3988 ms overlapping gunzip 606 ms, parse 3073 ms, sort 163 ms, write 8144 ms, index 551 ms: 13 candidates, 92716 repo-hours, 745 releases; waiting 502 ms; commit 1999 ms)
2026-11-07T21:24:02Z [load_day 2023-06-11] 2023-06-11 hour 13: 159219 events in 4 files, snapshot 3222803474854759730 (task 11819 ms: download 3810 ms overlapping gunzip 495 ms, parse 2352 ms, sort 88 ms, write 7521 ms, index 567 ms: 12 candidates, 82003 repo-hours, 808 releases; waiting 501 ms; commit 1847 ms)
2026-11-07T21:24:04Z [load_day 2023-06-11] 2023-06-11 hour 14: 143360 events in 3 files, snapshot 657366172624986082 (task 11442 ms: download 4363 ms overlapping gunzip 499 ms, parse 2313 ms, sort 86 ms, write 6805 ms, index 642 ms: 7 candidates, 66353 repo-hours, 792 releases; waiting 731 ms; commit 1833 ms)
2026-11-07T21:24:07Z [load_day 2023-06-11] 2023-06-11 hour 15: 147272 events in 3 files, snapshot 1168186700887599095 (task 11823 ms: download 4681 ms overlapping gunzip 604 ms, parse 2733 ms, sort 98 ms, write 7186 ms, index 461 ms: 5 candidates, 66326 repo-hours, 921 releases; waiting 473 ms; commit 2293 ms)
2026-11-07T21:24:13Z [load_day 2023-06-11] 2023-06-11 hour 16: 147414 events in 3 files, snapshot 7044641208680915271 (task 11001 ms: download 3957 ms overlapping gunzip 546 ms, parse 2485 ms, sort 94 ms, write 6631 ms, index 445 ms: 2 candidates, 69675 repo-hours, 902 releases; waiting 469 ms; commit 1943 ms)
2026-11-07T21:24:15Z [load_day 2023-06-11] 2023-06-11 hour 17: 133609 events in 3 files, snapshot 8363233204610940218 (task 10822 ms: download 2618 ms overlapping gunzip 498 ms, parse 2279 ms, sort 97 ms, write 6646 ms, index 510 ms: 10 candidates, 59127 repo-hours, 825 releases; waiting 484 ms; commit 1941 ms)
2026-11-07T21:24:17Z [load_day 2023-06-11] 2023-06-11 hour 18: 140570 events in 3 files, snapshot 3341274978439443318 (task 11549 ms: download 4564 ms overlapping gunzip 555 ms, parse 2458 ms, sort 93 ms, write 7012 ms, index 585 ms: 8 candidates, 65637 repo-hours, 853 releases; waiting 509 ms; commit 1813 ms)
2026-11-07T21:24:19Z [load_day 2023-06-11] 2023-06-11 hour 19: 125964 events in 3 files, snapshot 4627512301412909382 (task 10636 ms: download 1489 ms overlapping gunzip 521 ms, parse 2353 ms, sort 82 ms, write 6765 ms, index 407 ms: 5 candidates, 55031 repo-hours, 864 releases; waiting 194 ms; commit 1839 ms)
2026-11-07T21:24:23Z [load_day 2023-06-11] 2023-06-11 hour 20: 131885 events in 3 files, snapshot 109652904483884607 (task 10302 ms: download 1709 ms overlapping gunzip 597 ms, parse 2652 ms, sort 83 ms, write 5977 ms, index 406 ms: 1 candidates, 63520 repo-hours, 885 releases; waiting 305 ms; commit 1668 ms)
2026-11-07T21:24:25Z [load_day 2023-06-11] 2023-06-11 hour 21: 120795 events in 3 files, snapshot 1944285383613545566 (task 9381 ms: download 2004 ms overlapping gunzip 426 ms, parse 1963 ms, sort 90 ms, write 5677 ms, index 368 ms: 5 candidates, 56953 repo-hours, 988 releases; waiting 531 ms; commit 1729 ms)
2026-11-07T21:24:27Z [load_day 2023-06-11] 2023-06-11 hour 22: 105365 events in 3 files, snapshot 3496058029473314160 (task 8342 ms: download 1786 ms overlapping gunzip 411 ms, parse 1820 ms, sort 71 ms, write 4811 ms, index 304 ms: 3 candidates, 47007 repo-hours, 796 releases; waiting 527 ms; commit 1664 ms)
2026-11-07T21:24:29Z [load_day 2023-06-11] 2023-06-11 hour 23: 95738 events in 2 files, snapshot 3374071135834221847 (task 7689 ms: download 1811 ms overlapping gunzip 386 ms, parse 1695 ms, sort 59 ms, write 4416 ms, index 286 ms: 3 candidates, 42142 repo-hours, 635 releases; waiting 507 ms; commit 1780 ms)
2026-11-07T21:24:34Z [load_day 2023-06-11] 2023-06-11: repo_hour merged from 24 files to 1 (1389008 rows, 5788 ms)
2026-11-07T21:24:36Z [load_day 2023-06-11] 2023-06-11: index committed in 7331 ms (24 + 1 + 24 files)
2026-11-07T21:24:36Z [load_day 2023-06-11] 2023-06-11: 2943308 events in 24 hours
2026-11-07T21:24:36Z [load_day 2023-06-11] attempt 1 succeeded