orcaLog in

Runs · run 1345

load_day 2023-07-30, attempt 1 succeeded

Host
3c2b29713ce8:178037
Started
2026-11-07T23:26:41Z
Ended
2026-11-07T23:29:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1345/load_day/2023-07-30/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:26:41Z [load_day 2023-07-30] attempt 1 started
2026-11-07T23:26:42Z [load_day 2023-07-30] 2023-07-30: 2 hours in flight, about 1200 MB
2026-11-07T23:26:54Z [load_day 2023-07-30] 2023-07-30 hour 0: 107249 events in 3 files, snapshot 797254791931139368 (task 8368 ms: download 2355 ms overlapping gunzip 534 ms, parse 2147 ms, sort 107 ms, write 4374 ms, index 376 ms: 5 candidates, 59168 repo-hours, 825 releases; waiting 541 ms; commit 2158 ms)
2026-11-07T23:26:56Z [load_day 2023-07-30] 2023-07-30 hour 1: 118459 events in 3 files, snapshot 7741897720925531063 (task 9448 ms: download 4906 ms overlapping gunzip 644 ms, parse 2412 ms, sort 63 ms, write 5002 ms, index 524 ms: 3 candidates, 71252 repo-hours, 813 releases; waiting 544 ms; commit 2302 ms)
2026-11-07T23:27:03Z [load_day 2023-07-30] 2023-07-30 hour 2: 87582 events in 2 files, snapshot 75127174223286323 (task 7745 ms: download 1735 ms overlapping gunzip 502 ms, parse 1891 ms, sort 133 ms, write 4160 ms, index 552 ms: 3 candidates, 37897 repo-hours, 577 releases; waiting 208 ms; commit 2537 ms)
2026-11-07T23:27:08Z [load_day 2023-07-30] 2023-07-30 hour 3: 86877 events in 2 files, snapshot 4429397583539877270 (task 9961 ms: download 3084 ms overlapping gunzip 777 ms, parse 2673 ms, sort 122 ms, write 5134 ms, index 300 ms: 2 candidates, 36733 repo-hours, 637 releases; waiting 609 ms; commit 2731 ms)
2026-11-07T23:27:13Z [load_day 2023-07-30] 2023-07-30 hour 4: 90043 events in 2 files, snapshot 6184315027191476427 (task 7942 ms: download 2169 ms overlapping gunzip 560 ms, parse 1929 ms, sort 111 ms, write 4196 ms, index 342 ms: 2 candidates, 37174 repo-hours, 477 releases; waiting 455 ms; commit 3124 ms)
2026-11-07T23:27:18Z [load_day 2023-07-30] 2023-07-30 hour 5: 103165 events in 3 files, snapshot 5055718128623452981 (task 9333 ms: download 1890 ms overlapping gunzip 613 ms, parse 2054 ms, sort 94 ms, write 5652 ms, index 345 ms: 2 candidates, 46416 repo-hours, 622 releases; waiting 222 ms; commit 2321 ms)
2026-11-07T23:27:23Z [load_day 2023-07-30] 2023-07-30 hour 6: 111420 events in 3 files, snapshot 1769598909384724725 (task 9685 ms: download 4827 ms overlapping gunzip 604 ms, parse 2357 ms, sort 78 ms, write 5310 ms, index 334 ms: 2 candidates, 49363 repo-hours, 638 releases; waiting 624 ms; commit 2634 ms)
2026-11-07T23:27:30Z [load_day 2023-07-30] 2023-07-30 hour 7: 108241 events in 3 files, snapshot 9042980757261296120 (task 9250 ms: download 2574 ms overlapping gunzip 553 ms, parse 2124 ms, sort 83 ms, write 5248 ms, index 418 ms: 4 candidates, 44555 repo-hours, 520 releases; waiting 498 ms; commit 3745 ms)
2026-11-07T23:27:35Z [load_day 2023-07-30] 2023-07-30 hour 8: 117536 events in 3 files, snapshot 3196637537206610497 (task 10793 ms: download 5144 ms overlapping gunzip 743 ms, parse 2674 ms, sort 79 ms, write 5968 ms, index 331 ms: 3 candidates, 48067 repo-hours, 597 releases; waiting 639 ms; commit 2639 ms)
2026-11-07T23:27:42Z [load_day 2023-07-30] 2023-07-30 hour 9: 118209 events in 3 files, snapshot 3120899494427316198 (task 10247 ms: download 4731 ms overlapping gunzip 684 ms, parse 2694 ms, sort 78 ms, write 5638 ms, index 344 ms: 3 candidates, 49664 repo-hours, 860 releases; waiting 493 ms; commit 3985 ms)
2026-11-07T23:27:48Z [load_day 2023-07-30] 2023-07-30 hour 10: 121190 events in 3 files, snapshot 2259091701031456673 (task 11684 ms: download 5608 ms overlapping gunzip 708 ms, parse 2623 ms, sort 158 ms, write 6453 ms, index 519 ms: 4 candidates, 51190 repo-hours, 668 releases; waiting 934 ms; commit 3034 ms)
2026-11-07T23:27:52Z [load_day 2023-07-30] 2023-07-30 hour 11: 118651 events in 3 files, snapshot 3249851099492667612 (task 10850 ms: download 4779 ms overlapping gunzip 725 ms, parse 2928 ms, sort 108 ms, write 5904 ms, index 415 ms: 2 candidates, 49037 repo-hours, 692 releases; waiting 468 ms; commit 2813 ms)
2026-11-07T23:28:03Z [load_day 2023-07-30] 2023-07-30 hour 12: 196363 events in 4 files, snapshot 6945582157995912078 (task 14156 ms: download 8116 ms overlapping gunzip 891 ms, parse 3543 ms, sort 126 ms, write 8062 ms, index 696 ms: 3 candidates, 84697 repo-hours, 801 releases; waiting 492 ms; commit 2278 ms)
2026-11-07T23:28:08Z [load_day 2023-07-30] 2023-07-30 hour 13: 154339 events in 4 files, snapshot 7745639585939457376 (task 13005 ms: download 5352 ms overlapping gunzip 770 ms, parse 3382 ms, sort 187 ms, write 7308 ms, index 580 ms: 3 candidates, 77219 repo-hours, 760 releases; waiting 461 ms; commit 4539 ms)
2026-11-07T23:28:16Z [load_day 2023-07-30] 2023-07-30 hour 14: 139832 events in 3 files, snapshot 8431694930111698552 (task 12527 ms: download 6553 ms overlapping gunzip 849 ms, parse 3249 ms, sort 165 ms, write 6866 ms, index 466 ms: 2 candidates, 60595 repo-hours, 807 releases; waiting 334 ms; commit 2256 ms)
2026-11-07T23:28:20Z [load_day 2023-07-30] 2023-07-30 hour 15: 146456 events in 3 files, snapshot 1581009191922400978 (task 13191 ms: download 6207 ms overlapping gunzip 877 ms, parse 3189 ms, sort 133 ms, write 7358 ms, index 834 ms: 2 candidates, 62799 repo-hours, 1045 releases; waiting 482 ms; commit 2498 ms)
2026-11-07T23:28:30Z [load_day 2023-07-30] 2023-07-30 hour 16: 139805 events in 3 files, snapshot 840484764331360660 (task 12468 ms: download 5496 ms overlapping gunzip 864 ms, parse 3077 ms, sort 158 ms, write 7070 ms, index 467 ms: 1 candidates, 59634 repo-hours, 816 releases; waiting 564 ms; commit 2682 ms)
2026-11-07T23:28:33Z [load_day 2023-07-30] 2023-07-30 hour 17: 134125 events in 3 files, snapshot 5892005917444794611 (task 11081 ms: download 5013 ms overlapping gunzip 637 ms, parse 2519 ms, sort 88 ms, write 6579 ms, index 433 ms: 4 candidates, 54819 repo-hours, 714 releases; waiting 507 ms; commit 2650 ms)
2026-11-07T23:28:44Z [load_day 2023-07-30] 2023-07-30 hour 18: 137656 events in 3 files, snapshot 1038830891140598170 (task 12926 ms: download 6780 ms overlapping gunzip 928 ms, parse 3581 ms, sort 125 ms, write 6703 ms, index 442 ms: 9 candidates, 61368 repo-hours, 853 releases; waiting 833 ms; commit 1847 ms)
2026-11-07T23:28:46Z [load_day 2023-07-30] 2023-07-30 hour 19: 120594 events in 3 files, snapshot 4497501497674838096 (task 10487 ms: download 4851 ms overlapping gunzip 682 ms, parse 2591 ms, sort 79 ms, write 5840 ms, index 403 ms: 2 candidates, 49330 repo-hours, 824 releases; waiting 537 ms; commit 2864 ms)
2026-11-07T23:28:57Z [load_day 2023-07-30] 2023-07-30 hour 20: 117345 events in 3 files, snapshot 2451756909815576290 (task 11905 ms: download 6086 ms overlapping gunzip 884 ms, parse 2862 ms, sort 123 ms, write 6718 ms, index 360 ms: 4 candidates, 48913 repo-hours, 764 releases; waiting 659 ms; commit 2352 ms)
2026-11-07T23:29:00Z [load_day 2023-07-30] 2023-07-30 hour 21: 107369 events in 3 files, snapshot 6698689261671284898 (task 9689 ms: download 4456 ms overlapping gunzip 741 ms, parse 2670 ms, sort 134 ms, write 5113 ms, index 290 ms: 0 candidates, 42940 repo-hours, 768 releases; waiting 459 ms; commit 2821 ms)
2026-11-07T23:29:06Z [load_day 2023-07-30] 2023-07-30 hour 22: 100023 events in 3 files, snapshot 8089702758443069012 (task 8406 ms: download 2492 ms overlapping gunzip 587 ms, parse 2211 ms, sort 108 ms, write 4351 ms, index 307 ms: 2 candidates, 38744 repo-hours, 694 releases; waiting 553 ms; commit 2197 ms)
2026-11-07T23:29:09Z [load_day 2023-07-30] 2023-07-30 hour 23: 94353 events in 2 files, snapshot 4419649942965008124 (task 8761 ms: download 1762 ms overlapping gunzip 415 ms, parse 1972 ms, sort 61 ms, write 5191 ms, index 329 ms: 5 candidates, 38467 repo-hours, 583 releases; waiting 509 ms; commit 2528 ms)
2026-11-07T23:29:16Z [load_day 2023-07-30] 2023-07-30: repo_hour merged from 24 files to 1 (1260041 rows, 6443 ms)
2026-11-07T23:29:22Z [load_day 2023-07-30] 2023-07-30: index committed in 12313 ms (23 + 1 + 24 files)
2026-11-07T23:29:22Z [load_day 2023-07-30] 2023-07-30: 2876882 events in 24 hours
2026-11-07T23:29:22Z [load_day 2023-07-30] attempt 1 succeeded