orcaLog in

Runs · run 1324

load_day 2023-07-23, attempt 1 succeeded

Host
3c2b29713ce8:154433
Started
2026-11-07T23:13:35Z
Ended
2026-11-07T23:16:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1324/load_day/2023-07-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:13:35Z [load_day 2023-07-23] attempt 1 started
2026-11-07T23:13:37Z [load_day 2023-07-23] 2023-07-23: 2 hours in flight, about 1200 MB
2026-11-07T23:13:52Z [load_day 2023-07-23] 2023-07-23 hour 0: 102725 events in 3 files, snapshot 1985683139501209627 (task 9869 ms: download 2523 ms overlapping gunzip 604 ms, parse 2900 ms, sort 136 ms, write 5001 ms, index 359 ms: 3 candidates, 52159 repo-hours, 809 releases; waiting 468 ms; commit 3079 ms)
2026-11-07T23:13:57Z [load_day 2023-07-23] 2023-07-23 hour 1: 112858 events in 3 files, snapshot 4982059177390955145 (task 9973 ms: download 2922 ms overlapping gunzip 541 ms, parse 2551 ms, sort 115 ms, write 5500 ms, index 446 ms: 5 candidates, 65033 repo-hours, 767 releases; waiting 472 ms; commit 4991 ms)
2026-11-07T23:14:00Z [load_day 2023-07-23] 2023-07-23 hour 2: 96925 events in 2 files, snapshot 7408780370884910302 (task 8051 ms: download 2951 ms overlapping gunzip 399 ms, parse 1703 ms, sort 99 ms, write 4313 ms, index 340 ms: 3 candidates, 45420 repo-hours, 514 releases; waiting 888 ms; commit 2302 ms)
2026-11-07T23:14:04Z [load_day 2023-07-23] 2023-07-23 hour 3: 90208 events in 2 files, snapshot 1469965885600085494 (task 6929 ms: download 1681 ms overlapping gunzip 406 ms, parse 1848 ms, sort 87 ms, write 3494 ms, index 325 ms: 3 candidates, 37086 repo-hours, 634 releases; waiting 474 ms; commit 3849 ms)
2026-11-07T23:14:09Z [load_day 2023-07-23] 2023-07-23 hour 4: 93268 events in 2 files, snapshot 9219499264776943310 (task 7689 ms: download 1667 ms overlapping gunzip 383 ms, parse 1834 ms, sort 69 ms, write 4325 ms, index 330 ms: 5 candidates, 38013 repo-hours, 451 releases; waiting 501 ms; commit 2403 ms)
2026-11-07T23:14:12Z [load_day 2023-07-23] 2023-07-23 hour 5: 101313 events in 3 files, snapshot 7641754286647628467 (task 9129 ms: download 1805 ms overlapping gunzip 456 ms, parse 2057 ms, sort 76 ms, write 5126 ms, index 596 ms: 6 candidates, 42136 repo-hours, 565 releases; waiting 514 ms; commit 1817 ms)
2026-11-07T23:14:18Z [load_day 2023-07-23] 2023-07-23 hour 6: 116493 events in 3 files, snapshot 3749545803694032133 (task 8507 ms: download 2212 ms overlapping gunzip 439 ms, parse 2088 ms, sort 78 ms, write 4695 ms, index 353 ms: 8 candidates, 51103 repo-hours, 598 releases; waiting 496 ms; commit 2452 ms)
2026-11-07T23:14:22Z [load_day 2023-07-23] 2023-07-23 hour 7: 113027 events in 3 files, snapshot 8404978310445719268 (task 8703 ms: download 1669 ms overlapping gunzip 442 ms, parse 1976 ms, sort 88 ms, write 5077 ms, index 399 ms: 5 candidates, 48448 repo-hours, 532 releases; waiting 488 ms; commit 2435 ms)
2026-11-07T23:14:29Z [load_day 2023-07-23] 2023-07-23 hour 8: 117212 events in 3 files, snapshot 5580194043017142518 (task 9115 ms: download 1932 ms overlapping gunzip 541 ms, parse 2314 ms, sort 97 ms, write 4727 ms, index 695 ms: 5 candidates, 49210 repo-hours, 620 releases; waiting 475 ms; commit 2562 ms)
2026-11-07T23:14:34Z [load_day 2023-07-23] 2023-07-23 hour 9: 123859 events in 3 files, snapshot 236366046195194149 (task 9979 ms: download 1974 ms overlapping gunzip 620 ms, parse 2681 ms, sort 87 ms, write 5304 ms, index 490 ms: 6 candidates, 51329 repo-hours, 735 releases; waiting 526 ms; commit 3373 ms)
2026-11-07T23:14:38Z [load_day 2023-07-23] 2023-07-23 hour 10: 127278 events in 3 files, snapshot 2789936783371605920 (task 8903 ms: download 1571 ms overlapping gunzip 480 ms, parse 2279 ms, sort 97 ms, write 5188 ms, index 352 ms: 3 candidates, 54051 repo-hours, 685 releases; waiting 194 ms; commit 2239 ms)
2026-11-07T23:14:42Z [load_day 2023-07-23] 2023-07-23 hour 11: 126185 events in 3 files, snapshot 2649284681363670180 (task 8321 ms: download 1855 ms overlapping gunzip 507 ms, parse 2270 ms, sort 80 ms, write 4554 ms, index 340 ms: 4 candidates, 51234 repo-hours, 599 releases; waiting 280 ms; commit 1978 ms)
2026-11-07T23:14:50Z [load_day 2023-07-23] 2023-07-23 hour 12: 196885 events in 4 files, snapshot 6316964554424312730 (task 10394 ms: download 3304 ms overlapping gunzip 565 ms, parse 2856 ms, sort 101 ms, write 5854 ms, index 564 ms: 6 candidates, 85919 repo-hours, 719 releases; waiting 184 ms; commit 2488 ms)
2026-11-07T23:14:55Z [load_day 2023-07-23] 2023-07-23 hour 13: 159827 events in 4 files, snapshot 7808938070559773207 (task 11805 ms: download 3449 ms overlapping gunzip 603 ms, parse 2689 ms, sort 106 ms, write 6496 ms, index 937 ms: 5 candidates, 79976 repo-hours, 616 releases; waiting 479 ms; commit 2180 ms)
2026-11-07T23:15:03Z [load_day 2023-07-23] 2023-07-23 hour 14: 144716 events in 3 files, snapshot 8472718576578161740 (task 12706 ms: download 5510 ms overlapping gunzip 800 ms, parse 3597 ms, sort 138 ms, write 6837 ms, index 485 ms: 3 candidates, 61601 repo-hours, 710 releases; waiting 493 ms; commit 2433 ms)
2026-11-07T23:15:10Z [load_day 2023-07-23] 2023-07-23 hour 15: 148607 events in 3 files, snapshot 5427765151375219089 (task 12237 ms: download 4931 ms overlapping gunzip 673 ms, parse 2936 ms, sort 126 ms, write 7111 ms, index 603 ms: 1 candidates, 63526 repo-hours, 893 releases; waiting 463 ms; commit 3925 ms)
2026-11-07T23:15:16Z [load_day 2023-07-23] 2023-07-23 hour 16: 144612 events in 3 files, snapshot 5276175866003472680 (task 12043 ms: download 4401 ms overlapping gunzip 658 ms, parse 2844 ms, sort 86 ms, write 6959 ms, index 515 ms: 6 candidates, 60936 repo-hours, 681 releases; waiting 624 ms; commit 2355 ms)
2026-11-07T23:15:21Z [load_day 2023-07-23] 2023-07-23 hour 17: 131733 events in 3 files, snapshot 7272543352607525930 (task 11336 ms: download 2228 ms overlapping gunzip 650 ms, parse 2886 ms, sort 77 ms, write 6289 ms, index 660 ms: 7 candidates, 55448 repo-hours, 593 releases; waiting 497 ms; commit 2170 ms)
2026-11-07T23:15:28Z [load_day 2023-07-23] 2023-07-23 hour 18: 138636 events in 3 files, snapshot 1804481390223750233 (task 10985 ms: download 4072 ms overlapping gunzip 549 ms, parse 2581 ms, sort 74 ms, write 6531 ms, index 415 ms: 2 candidates, 61252 repo-hours, 728 releases; waiting 487 ms; commit 2349 ms)
2026-11-07T23:15:34Z [load_day 2023-07-23] 2023-07-23 hour 19: 124335 events in 3 files, snapshot 7838739607787155898 (task 10580 ms: download 2037 ms overlapping gunzip 560 ms, parse 2596 ms, sort 109 ms, write 6196 ms, index 367 ms: 5 candidates, 50064 repo-hours, 736 releases; waiting 489 ms; commit 3430 ms)
2026-11-07T23:15:40Z [load_day 2023-07-23] 2023-07-23 hour 20: 119796 events in 3 files, snapshot 909626110303768507 (task 10342 ms: download 3147 ms overlapping gunzip 633 ms, parse 2714 ms, sort 87 ms, write 5513 ms, index 364 ms: 2 candidates, 49482 repo-hours, 751 releases; waiting 696 ms; commit 2397 ms)
2026-11-07T23:15:44Z [load_day 2023-07-23] 2023-07-23 hour 21: 110213 events in 3 files, snapshot 4989403929627506364 (task 9922 ms: download 2927 ms overlapping gunzip 591 ms, parse 2755 ms, sort 62 ms, write 5294 ms, index 381 ms: 4 candidates, 44215 repo-hours, 688 releases; waiting 491 ms; commit 2585 ms)
2026-11-07T23:16:03Z [load_day 2023-07-23] 2023-07-23 hour 22: 102546 events in 3 files, snapshot 5741070985349151068 (task 9070 ms: download 2383 ms overlapping gunzip 485 ms, parse 2191 ms, sort 101 ms, write 5003 ms, index 370 ms: 2 candidates, 41530 repo-hours, 676 releases; waiting 524 ms; commit 15300 ms)
2026-11-07T23:16:05Z [load_day 2023-07-23] 2023-07-23 hour 23: 95843 events in 2 files, snapshot 2096465358022035778 (task 10175 ms: download 2214 ms overlapping gunzip 458 ms, parse 1964 ms, sort 105 ms, write 6524 ms, index 366 ms: 5 candidates, 39897 repo-hours, 561 releases; waiting 425 ms; commit 2312 ms)
2026-11-07T23:16:12Z [load_day 2023-07-23] 2023-07-23: repo_hour merged from 24 files to 1 (1279068 rows, 6033 ms)
2026-11-07T23:16:13Z [load_day 2023-07-23] 2023-07-23: index committed in 7933 ms (24 + 1 + 24 files)
2026-11-07T23:16:13Z [load_day 2023-07-23] 2023-07-23: 2939100 events in 24 hours
2026-11-07T23:16:13Z [load_day 2023-07-23] attempt 1 succeeded