orcaLog in

Runs · run 1358

load_day 2023-08-03, attempt 1 succeeded

Host
3c2b29713ce8:191060
Started
2026-11-07T23:33:48Z
Ended
2026-11-07T23:37:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1358/load_day/2023-08-03/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:33:48Z [load_day 2023-08-03] attempt 1 started
2026-11-07T23:33:50Z [load_day 2023-08-03] 2023-08-03: 2 hours in flight, about 1200 MB
2026-11-07T23:34:12Z [load_day 2023-08-03] 2023-08-03 hour 0: 158553 events in 4 files, snapshot 4152066302035541273 (task 17813 ms: download 9076 ms overlapping gunzip 1198 ms, parse 4765 ms, sort 200 ms, write 9501 ms, index 885 ms: 3 candidates, 78891 repo-hours, 855 releases; waiting 709 ms; commit 2722 ms)
2026-11-07T23:34:15Z [load_day 2023-08-03] 2023-08-03 hour 1: 160482 events in 4 files, snapshot 3033525134102415191 (task 16168 ms: download 10607 ms overlapping gunzip 934 ms, parse 3911 ms, sort 156 ms, write 9228 ms, index 586 ms: 5 candidates, 88548 repo-hours, 770 releases; waiting 1050 ms; commit 2520 ms)
2026-11-07T23:34:28Z [load_day 2023-08-03] 2023-08-03 hour 2: 140952 events in 3 files, snapshot 5883411863892437256 (task 14393 ms: download 7016 ms overlapping gunzip 976 ms, parse 3536 ms, sort 102 ms, write 8446 ms, index 529 ms: 3 candidates, 61607 repo-hours, 699 releases; waiting 503 ms; commit 2138 ms)
2026-11-07T23:34:31Z [load_day 2023-08-03] 2023-08-03 hour 3: 137942 events in 3 files, snapshot 6114777937085828752 (task 14821 ms: download 7905 ms overlapping gunzip 1106 ms, parse 4272 ms, sort 129 ms, write 7758 ms, index 525 ms: 6 candidates, 58314 repo-hours, 850 releases; waiting 671 ms; commit 3460 ms)
2026-11-07T23:34:43Z [load_day 2023-08-03] 2023-08-03 hour 4: 133897 events in 3 files, snapshot 7122940270583972431 (task 13880 ms: download 6113 ms overlapping gunzip 848 ms, parse 3363 ms, sort 85 ms, write 8090 ms, index 596 ms: 3 candidates, 56170 repo-hours, 578 releases; waiting 620 ms; commit 2660 ms)
2026-11-07T23:34:48Z [load_day 2023-08-03] 2023-08-03 hour 5: 150518 events in 4 files, snapshot 6999804087431057109 (task 16685 ms: download 6546 ms overlapping gunzip 1133 ms, parse 4427 ms, sort 156 ms, write 9546 ms, index 577 ms: 8 candidates, 66193 repo-hours, 778 releases; waiting 562 ms; commit 2067 ms)
2026-11-07T23:35:08Z [load_day 2023-08-03] 2023-08-03 hour 6: 183898 events in 4 files, snapshot 3821759983738379749 (task 22779 ms: download 12887 ms overlapping gunzip 1462 ms, parse 6351 ms, sort 159 ms, write 13487 ms, index 551 ms: 6 candidates, 78819 repo-hours, 880 releases; waiting 469 ms; commit 4016 ms)
2026-11-07T23:35:12Z [load_day 2023-08-03] 2023-08-03 hour 7: 174354 events in 4 files, snapshot 5746073377363823986 (task 19798 ms: download 12181 ms overlapping gunzip 1089 ms, parse 4702 ms, sort 154 ms, write 12060 ms, index 888 ms: 5 candidates, 75978 repo-hours, 905 releases; waiting 629 ms; commit 4099 ms)
2026-11-07T23:35:24Z [load_day 2023-08-03] 2023-08-03 hour 8: 190813 events in 4 files, snapshot 4563031752893566926 (task 16782 ms: download 9829 ms overlapping gunzip 1070 ms, parse 4623 ms, sort 126 ms, write 9637 ms, index 546 ms: 9 candidates, 82388 repo-hours, 1142 releases; waiting 531 ms; commit 2241 ms)
2026-11-07T23:35:28Z [load_day 2023-08-03] 2023-08-03 hour 9: 189796 events in 4 files, snapshot 9220293407640286853 (task 15902 ms: download 8672 ms overlapping gunzip 934 ms, parse 4148 ms, sort 115 ms, write 9530 ms, index 702 ms: 7 candidates, 81448 repo-hours, 1262 releases; waiting 241 ms; commit 3032 ms)
2026-11-07T23:35:46Z [load_day 2023-08-03] 2023-08-03 hour 10: 185900 events in 4 files, snapshot 3384273711027525776 (task 19398 ms: download 12022 ms overlapping gunzip 1053 ms, parse 4701 ms, sort 125 ms, write 12187 ms, index 571 ms: 3 candidates, 78810 repo-hours, 1042 releases; waiting 519 ms; commit 3444 ms)
2026-11-07T23:35:48Z [load_day 2023-08-03] 2023-08-03 hour 11: 187811 events in 4 files, snapshot 4630728504206339417 (task 18990 ms: download 11071 ms overlapping gunzip 1172 ms, parse 4951 ms, sort 132 ms, write 11042 ms, index 1058 ms: 11 candidates, 80031 repo-hours, 1081 releases; waiting 309 ms; commit 2120 ms)
2026-11-07T23:36:07Z [load_day 2023-08-03] 2023-08-03 hour 12: 230214 events in 5 files, snapshot 8127239818080370959 (task 21274 ms: download 10689 ms overlapping gunzip 1299 ms, parse 6107 ms, sort 193 ms, write 12088 ms, index 843 ms: 8 candidates, 108769 repo-hours, 1060 releases; waiting 494 ms; commit 2246 ms)
2026-11-07T23:36:10Z [load_day 2023-08-03] 2023-08-03 hour 13: 197301 events in 4 files, snapshot 1652122996855941712 (task 20470 ms: download 10396 ms overlapping gunzip 1101 ms, parse 4965 ms, sort 182 ms, write 12071 ms, index 1311 ms: 10 candidates, 99325 repo-hours, 1126 releases; waiting 511 ms; commit 2444 ms)
2026-11-07T23:36:29Z [load_day 2023-08-03] 2023-08-03 hour 14: 187162 events in 4 files, snapshot 1872897961369870047 (task 20657 ms: download 12631 ms overlapping gunzip 1338 ms, parse 5682 ms, sort 131 ms, write 12092 ms, index 679 ms: 6 candidates, 85213 repo-hours, 1214 releases; waiting 512 ms; commit 3113 ms)
2026-11-07T23:36:31Z [load_day 2023-08-03] 2023-08-03 hour 15: 171491 events in 4 files, snapshot 2353129637995804376 (task 19205 ms: download 11790 ms overlapping gunzip 1167 ms, parse 5020 ms, sort 112 ms, write 11347 ms, index 710 ms: 9 candidates, 79376 repo-hours, 1046 releases; waiting 498 ms; commit 2528 ms)
2026-11-07T23:36:48Z [load_day 2023-08-03] 2023-08-03 hour 16: 169713 events in 4 files, snapshot 7723302551062170832 (task 18765 ms: download 11128 ms overlapping gunzip 1294 ms, parse 5709 ms, sort 123 ms, write 10359 ms, index 672 ms: 5 candidates, 76988 repo-hours, 989 releases; waiting 320 ms; commit 2761 ms)
2026-11-07T23:36:50Z [load_day 2023-08-03] 2023-08-03 hour 17: 170350 events in 4 files, snapshot 2665320113493610704 (task 17748 ms: download 10710 ms overlapping gunzip 905 ms, parse 4093 ms, sort 129 ms, write 11001 ms, index 899 ms: 6 candidates, 73027 repo-hours, 876 releases; waiting 484 ms; commit 2245 ms)
2026-11-07T23:37:07Z [load_day 2023-08-03] 2023-08-03 hour 18: 180516 events in 4 files, snapshot 4236503102162691713 (task 17926 ms: download 10796 ms overlapping gunzip 1168 ms, parse 5113 ms, sort 105 ms, write 10135 ms, index 571 ms: 7 candidates, 78682 repo-hours, 971 releases; waiting 517 ms; commit 2509 ms)
2026-11-07T23:37:10Z [load_day 2023-08-03] 2023-08-03 hour 19: 169826 events in 4 files, snapshot 2394628976092628709 (task 18132 ms: download 10919 ms overlapping gunzip 1053 ms, parse 4792 ms, sort 198 ms, write 10343 ms, index 968 ms: 6 candidates, 69031 repo-hours, 906 releases; waiting 482 ms; commit 2513 ms)
2026-11-07T23:37:27Z [load_day 2023-08-03] 2023-08-03 hour 20: 165927 events in 4 files, snapshot 8735987084268920032 (task 16901 ms: download 10085 ms overlapping gunzip 1024 ms, parse 4302 ms, sort 141 ms, write 9971 ms, index 592 ms: 12 candidates, 68642 repo-hours, 994 releases; waiting 539 ms; commit 4459 ms)
2026-11-07T23:37:29Z [load_day 2023-08-03] 2023-08-03 hour 21: 154289 events in 4 files, snapshot 2375960522776978748 (task 15835 ms: download 7162 ms overlapping gunzip 878 ms, parse 3984 ms, sort 100 ms, write 9584 ms, index 536 ms: 11 candidates, 60382 repo-hours, 1067 releases; waiting 507 ms; commit 2344 ms)
2026-11-07T23:37:40Z [load_day 2023-08-03] 2023-08-03 hour 22: 141551 events in 3 files, snapshot 2955365507424976681 (task 14515 ms: download 5838 ms overlapping gunzip 901 ms, parse 3701 ms, sort 110 ms, write 8804 ms, index 377 ms: 6 candidates, 54001 repo-hours, 913 releases; waiting 304 ms; commit 2072 ms)
2026-11-07T23:37:42Z [load_day 2023-08-03] 2023-08-03 hour 23: 127230 events in 3 files, snapshot 4434166951732939691 (task 11847 ms: download 5391 ms overlapping gunzip 653 ms, parse 3063 ms, sort 84 ms, write 7007 ms, index 345 ms: 1 candidates, 50203 repo-hours, 708 releases; waiting 391 ms; commit 1972 ms)
2026-11-07T23:37:50Z [load_day 2023-08-03] 2023-08-03: repo_hour merged from 24 files to 1 (1790836 rows, 8179 ms)
2026-11-07T23:37:52Z [load_day 2023-08-03] 2023-08-03: index committed in 10297 ms (24 + 1 + 24 files)
2026-11-07T23:37:52Z [load_day 2023-08-03] 2023-08-03: 4060486 events in 24 hours
2026-11-07T23:37:52Z [load_day 2023-08-03] attempt 1 succeeded