orcaLog in

Runs · run 1280

load_day 2023-07-09, attempt 1 succeeded

Host
3c2b29713ce8:106002
Started
2026-11-07T22:47:55Z
Ended
2026-11-07T22:50:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1280/load_day/2023-07-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:47:55Z [load_day 2023-07-09] attempt 1 started
2026-11-07T22:47:57Z [load_day 2023-07-09] 2023-07-09: 2 hours in flight, about 1200 MB
2026-11-07T22:48:10Z [load_day 2023-07-09] 2023-07-09 hour 0: 103066 events in 3 files, snapshot 7768793664241032031 (task 9458 ms: download 2063 ms overlapping gunzip 611 ms, parse 3051 ms, sort 100 ms, write 4539 ms, index 349 ms: 2 candidates, 53678 repo-hours, 763 releases; waiting 502 ms; commit 2027 ms)
2026-11-07T22:48:13Z [load_day 2023-07-09] 2023-07-09 hour 1: 109773 events in 3 files, snapshot 1285643865484912048 (task 9889 ms: download 2756 ms overlapping gunzip 595 ms, parse 2948 ms, sort 94 ms, write 4828 ms, index 565 ms: 1 candidates, 63874 repo-hours, 839 releases; waiting 498 ms; commit 3439 ms)
2026-11-07T22:48:19Z [load_day 2023-07-09] 2023-07-09 hour 2: 98333 events in 2 files, snapshot 1555390332412949279 (task 8405 ms: download 1758 ms overlapping gunzip 406 ms, parse 1871 ms, sort 61 ms, write 4941 ms, index 322 ms: 3 candidates, 51516 repo-hours, 589 releases; waiting 475 ms; commit 2242 ms)
2026-11-07T22:48:21Z [load_day 2023-07-09] 2023-07-09 hour 3: 93388 events in 2 files, snapshot 6008278612125605263 (task 7847 ms: download 1681 ms overlapping gunzip 450 ms, parse 1947 ms, sort 59 ms, write 4275 ms, index 344 ms: 2 candidates, 42873 repo-hours, 711 releases; waiting 489 ms; commit 2241 ms)
2026-11-07T22:48:28Z [load_day 2023-07-09] 2023-07-09 hour 4: 93553 events in 2 files, snapshot 4268973373238455391 (task 7869 ms: download 1902 ms overlapping gunzip 490 ms, parse 2040 ms, sort 55 ms, write 4120 ms, index 272 ms: 0 candidates, 40610 repo-hours, 443 releases; waiting 584 ms; commit 2597 ms)
2026-11-07T22:48:32Z [load_day 2023-07-09] 2023-07-09 hour 5: 102371 events in 3 files, snapshot 642270810961373361 (task 9083 ms: download 2304 ms overlapping gunzip 451 ms, parse 2007 ms, sort 155 ms, write 5317 ms, index 373 ms: 1 candidates, 43148 repo-hours, 603 releases; waiting 488 ms; commit 2282 ms)
2026-11-07T22:48:38Z [load_day 2023-07-09] 2023-07-09 hour 6: 112938 events in 3 files, snapshot 1461208920056813051 (task 9111 ms: download 2195 ms overlapping gunzip 519 ms, parse 2354 ms, sort 105 ms, write 4904 ms, index 431 ms: 6 candidates, 50731 repo-hours, 589 releases; waiting 482 ms; commit 2362 ms)
2026-11-07T22:48:42Z [load_day 2023-07-09] 2023-07-09 hour 7: 107859 events in 3 files, snapshot 6312321166500827738 (task 8657 ms: download 1739 ms overlapping gunzip 607 ms, parse 2519 ms, sort 78 ms, write 4315 ms, index 471 ms: 6 candidates, 46773 repo-hours, 520 releases; waiting 335 ms; commit 2847 ms)
2026-11-07T22:48:50Z [load_day 2023-07-09] 2023-07-09 hour 8: 126294 events in 3 files, snapshot 1550269955259187982 (task 9326 ms: download 1965 ms overlapping gunzip 481 ms, parse 2395 ms, sort 73 ms, write 5137 ms, index 411 ms: 9 candidates, 60445 repo-hours, 618 releases; waiting 515 ms; commit 3154 ms)
2026-11-07T22:48:54Z [load_day 2023-07-09] 2023-07-09 hour 9: 118173 events in 3 files, snapshot 3424243689532272383 (task 9850 ms: download 2206 ms overlapping gunzip 516 ms, parse 2362 ms, sort 112 ms, write 5662 ms, index 365 ms: 4 candidates, 51747 repo-hours, 796 releases; waiting 497 ms; commit 3164 ms)
2026-11-07T22:49:02Z [load_day 2023-07-09] 2023-07-09 hour 10: 122029 events in 3 files, snapshot 2073310849744891905 (task 11162 ms: download 1837 ms overlapping gunzip 746 ms, parse 3227 ms, sort 77 ms, write 6060 ms, index 562 ms: 4 candidates, 54800 repo-hours, 736 releases; waiting 208 ms; commit 3844 ms)
2026-11-07T22:49:05Z [load_day 2023-07-09] 2023-07-09 hour 11: 121784 events in 3 files, snapshot 5688029024698382939 (task 9882 ms: download 2093 ms overlapping gunzip 513 ms, parse 2407 ms, sort 66 ms, write 5643 ms, index 439 ms: 6 candidates, 53447 repo-hours, 656 releases; waiting 527 ms; commit 2131 ms)
2026-11-07T22:49:13Z [load_day 2023-07-09] 2023-07-09 hour 12: 178052 events in 4 files, snapshot 4481261816011606152 (task 11428 ms: download 4535 ms overlapping gunzip 623 ms, parse 2829 ms, sort 71 ms, write 6588 ms, index 561 ms: 6 candidates, 86719 repo-hours, 773 releases; waiting 477 ms; commit 1955 ms)
2026-11-07T22:49:16Z [load_day 2023-07-09] 2023-07-09 hour 13: 157226 events in 4 files, snapshot 7208459449446721535 (task 10748 ms: download 4020 ms overlapping gunzip 565 ms, parse 2634 ms, sort 90 ms, write 6039 ms, index 606 ms: 3 candidates, 80929 repo-hours, 970 releases; waiting 508 ms; commit 1873 ms)
2026-11-07T22:49:24Z [load_day 2023-07-09] 2023-07-09 hour 14: 144839 events in 3 files, snapshot 5932214769722683575 (task 10078 ms: download 3952 ms overlapping gunzip 564 ms, parse 2527 ms, sort 98 ms, write 5681 ms, index 425 ms: 4 candidates, 64235 repo-hours, 863 releases; waiting 502 ms; commit 2114 ms)
2026-11-07T22:49:29Z [load_day 2023-07-09] 2023-07-09 hour 15: 148003 events in 3 files, snapshot 3509056827295722917 (task 11058 ms: download 3707 ms overlapping gunzip 550 ms, parse 2436 ms, sort 83 ms, write 6439 ms, index 766 ms: 6 candidates, 65060 repo-hours, 900 releases; waiting 494 ms; commit 2582 ms)
2026-11-07T22:49:38Z [load_day 2023-07-09] 2023-07-09 hour 16: 143124 events in 3 files, snapshot 5017717490548903328 (task 12733 ms: download 5103 ms overlapping gunzip 769 ms, parse 3453 ms, sort 94 ms, write 7104 ms, index 528 ms: 3 candidates, 62560 repo-hours, 805 releases; waiting 461 ms; commit 1956 ms)
2026-11-07T22:49:42Z [load_day 2023-07-09] 2023-07-09 hour 17: 138971 events in 3 files, snapshot 4075387857886423764 (task 10741 ms: download 4289 ms overlapping gunzip 547 ms, parse 2455 ms, sort 82 ms, write 6584 ms, index 509 ms: 3 candidates, 57539 repo-hours, 769 releases; waiting 279 ms; commit 3392 ms)
2026-11-07T22:49:50Z [load_day 2023-07-09] 2023-07-09 hour 18: 143364 events in 3 files, snapshot 1786768222605070027 (task 11513 ms: download 4138 ms overlapping gunzip 645 ms, parse 2831 ms, sort 137 ms, write 6694 ms, index 401 ms: 5 candidates, 62581 repo-hours, 865 releases; waiting 517 ms; commit 2122 ms)
2026-11-07T22:49:53Z [load_day 2023-07-09] 2023-07-09 hour 19: 129770 events in 3 files, snapshot 5114531155638210999 (task 10335 ms: download 4019 ms overlapping gunzip 586 ms, parse 2589 ms, sort 58 ms, write 6244 ms, index 411 ms: 7 candidates, 51261 repo-hours, 636 releases; waiting 226 ms; commit 2395 ms)
2026-11-07T22:50:01Z [load_day 2023-07-09] 2023-07-09 hour 20: 124938 events in 3 files, snapshot 4288909574057675780 (task 10191 ms: download 2106 ms overlapping gunzip 542 ms, parse 2498 ms, sort 76 ms, write 5751 ms, index 494 ms: 3 candidates, 50870 repo-hours, 629 releases; waiting 507 ms; commit 2201 ms)
2026-11-07T22:50:04Z [load_day 2023-07-09] 2023-07-09 hour 21: 115874 events in 3 files, snapshot 1233336687794064600 (task 10695 ms: download 2263 ms overlapping gunzip 575 ms, parse 2405 ms, sort 76 ms, write 6224 ms, index 603 ms: 4 candidates, 46464 repo-hours, 690 releases; waiting 519 ms; commit 2269 ms)
2026-11-07T22:50:12Z [load_day 2023-07-09] 2023-07-09 hour 22: 101603 events in 3 files, snapshot 5444578571234877021 (task 9648 ms: download 2306 ms overlapping gunzip 542 ms, parse 2485 ms, sort 65 ms, write 5348 ms, index 415 ms: 2 candidates, 42716 repo-hours, 697 releases; waiting 488 ms; commit 1934 ms)
2026-11-07T22:50:16Z [load_day 2023-07-09] 2023-07-09 hour 23: 99257 events in 2 files, snapshot 3396800115656263559 (task 8110 ms: download 1747 ms overlapping gunzip 512 ms, parse 2313 ms, sort 72 ms, write 4318 ms, index 310 ms: 3 candidates, 41862 repo-hours, 642 releases; waiting 323 ms; commit 3929 ms)
2026-11-07T22:50:22Z [load_day 2023-07-09] 2023-07-09: repo_hour merged from 24 files to 1 (1326438 rows, 6012 ms)
2026-11-07T22:50:24Z [load_day 2023-07-09] 2023-07-09: index committed in 8110 ms (23 + 1 + 24 files)
2026-11-07T22:50:24Z [load_day 2023-07-09] 2023-07-09: 2934582 events in 24 hours
2026-11-07T22:50:24Z [load_day 2023-07-09] attempt 1 succeeded