orcaLog in

Runs · run 2783

load_day 2024-07-31, attempt 1 succeeded

Host
73ccef5e07c2:157238
Started
2026-11-08T07:14:10Z
Ended
2026-11-08T07:16:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
725 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
179.7 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2783/load_day/2024-07-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:14:10Z [load_day 2024-07-31] attempt 1 started
2026-11-08T07:14:11Z [load_day 2024-07-31] 2024-07-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:14:19Z [load_day 2024-07-31] 2024-07-31 hour 0: 191514 events in 0 files, snapshot none (task 6683 ms: download 3824 ms overlapping gunzip 1005 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 842 ms: 8 candidates, 108974 repo-hours, 1191 releases; waiting 481 ms; commit 0 ms)
2026-11-08T07:14:19Z [load_day 2024-07-31] 2024-07-31 hour 1: 181819 events in 0 files, snapshot none (task 6480 ms: download 3660 ms overlapping gunzip 897 ms, parse 4221 ms, sort 0 ms, write 0 ms, index 748 ms: 5 candidates, 103643 repo-hours, 860 releases; waiting 288 ms; commit 0 ms)
2026-11-08T07:14:25Z [load_day 2024-07-31] 2024-07-31 hour 2: 154864 events in 0 files, snapshot none (task 6209 ms: download 3643 ms overlapping gunzip 1050 ms, parse 3945 ms, sort 0 ms, write 0 ms, index 447 ms: 2 candidates, 63275 repo-hours, 764 releases; waiting 479 ms; commit 0 ms)
2026-11-08T07:14:26Z [load_day 2024-07-31] 2024-07-31 hour 3: 177552 events in 0 files, snapshot none (task 6573 ms: download 3947 ms overlapping gunzip 1018 ms, parse 4246 ms, sort 0 ms, write 0 ms, index 568 ms: 3 candidates, 78592 repo-hours, 5407 releases; waiting 450 ms; commit 0 ms)
2026-11-08T07:14:32Z [load_day 2024-07-31] 2024-07-31 hour 4: 153997 events in 0 files, snapshot none (task 6172 ms: download 3419 ms overlapping gunzip 936 ms, parse 3944 ms, sort 0 ms, write 0 ms, index 534 ms: 8 candidates, 62237 repo-hours, 674 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:14:33Z [load_day 2024-07-31] 2024-07-31 hour 5: 169303 events in 0 files, snapshot none (task 6917 ms: download 4476 ms overlapping gunzip 1119 ms, parse 4515 ms, sort 0 ms, write 0 ms, index 564 ms: 6 candidates, 69050 repo-hours, 899 releases; waiting 445 ms; commit 0 ms)
2026-11-08T07:14:42Z [load_day 2024-07-31] 2024-07-31 hour 6: 206881 events in 0 files, snapshot none (task 6322 ms: download 4613 ms overlapping gunzip 910 ms, parse 3871 ms, sort 0 ms, write 0 ms, index 681 ms: 9 candidates, 96782 repo-hours, 1018 releases; waiting 611 ms; commit 0 ms)
2026-11-08T07:14:42Z [load_day 2024-07-31] 2024-07-31 hour 7: 202986 events in 0 files, snapshot none (task 6618 ms: download 4077 ms overlapping gunzip 993 ms, parse 4137 ms, sort 0 ms, write 0 ms, index 638 ms: 2 candidates, 85755 repo-hours, 1031 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:14:50Z [load_day 2024-07-31] 2024-07-31 hour 8: 218238 events in 0 files, snapshot none (task 7046 ms: download 4510 ms overlapping gunzip 1068 ms, parse 4452 ms, sort 0 ms, write 0 ms, index 712 ms: 8 candidates, 91815 repo-hours, 1311 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:14:51Z [load_day 2024-07-31] 2024-07-31 hour 9: 222089 events in 0 files, snapshot none (task 7629 ms: download 5062 ms overlapping gunzip 1193 ms, parse 4933 ms, sort 0 ms, write 0 ms, index 788 ms: 9 candidates, 96244 repo-hours, 1394 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:14:59Z [load_day 2024-07-31] 2024-07-31 hour 10: 212174 events in 0 files, snapshot none (task 8285 ms: download 5524 ms overlapping gunzip 1282 ms, parse 5382 ms, sort 0 ms, write 0 ms, index 894 ms: 3 candidates, 87644 repo-hours, 1059 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:15:00Z [load_day 2024-07-31] 2024-07-31 hour 11: 212630 events in 0 files, snapshot none (task 8475 ms: download 5384 ms overlapping gunzip 1171 ms, parse 5316 ms, sort 0 ms, write 0 ms, index 1169 ms: 4 candidates, 84651 repo-hours, 1210 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:15:10Z [load_day 2024-07-31] 2024-07-31 hour 12: 247473 events in 0 files, snapshot none (task 10033 ms: download 5745 ms overlapping gunzip 1418 ms, parse 6200 ms, sort 0 ms, write 0 ms, index 1603 ms: 10 candidates, 124320 repo-hours, 1249 releases; waiting 534 ms; commit 0 ms)
2026-11-08T07:15:12Z [load_day 2024-07-31] 2024-07-31 hour 13: 252472 events in 0 files, snapshot none (task 11273 ms: download 6731 ms overlapping gunzip 1629 ms, parse 7495 ms, sort 0 ms, write 0 ms, index 1431 ms: 8 candidates, 114951 repo-hours, 1307 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:15:21Z [load_day 2024-07-31] 2024-07-31 hour 14: 242938 events in 0 files, snapshot none (task 10813 ms: download 7604 ms overlapping gunzip 1674 ms, parse 7399 ms, sort 0 ms, write 0 ms, index 998 ms: 10 candidates, 101083 repo-hours, 1381 releases; waiting 476 ms; commit 0 ms)
2026-11-08T07:15:23Z [load_day 2024-07-31] 2024-07-31 hour 15: 239163 events in 0 files, snapshot none (task 10273 ms: download 7025 ms overlapping gunzip 1715 ms, parse 7238 ms, sort 0 ms, write 0 ms, index 904 ms: 12 candidates, 105744 repo-hours, 1444 releases; waiting 182 ms; commit 0 ms)
2026-11-08T07:15:31Z [load_day 2024-07-31] 2024-07-31 hour 16: 223434 events in 0 files, snapshot none (task 9534 ms: download 6082 ms overlapping gunzip 1494 ms, parse 6354 ms, sort 0 ms, write 0 ms, index 899 ms: 7 candidates, 94534 repo-hours, 1303 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:15:33Z [load_day 2024-07-31] 2024-07-31 hour 17: 212584 events in 0 files, snapshot none (task 9599 ms: download 6154 ms overlapping gunzip 1597 ms, parse 6318 ms, sort 0 ms, write 0 ms, index 766 ms: 7 candidates, 85615 repo-hours, 1082 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:15:41Z [load_day 2024-07-31] 2024-07-31 hour 18: 223457 events in 0 files, snapshot none (task 8870 ms: download 5619 ms overlapping gunzip 1455 ms, parse 5696 ms, sort 0 ms, write 0 ms, index 831 ms: 9 candidates, 99367 repo-hours, 1127 releases; waiting 630 ms; commit 0 ms)
2026-11-08T07:15:41Z [load_day 2024-07-31] 2024-07-31 hour 19: 197290 events in 0 files, snapshot none (task 8251 ms: download 5490 ms overlapping gunzip 1369 ms, parse 5501 ms, sort 0 ms, write 0 ms, index 586 ms: 4 candidates, 76974 repo-hours, 1052 releases; waiting 534 ms; commit 0 ms)
2026-11-08T07:15:49Z [load_day 2024-07-31] 2024-07-31 hour 20: 191820 events in 0 files, snapshot none (task 7822 ms: download 4349 ms overlapping gunzip 1193 ms, parse 4750 ms, sort 0 ms, write 0 ms, index 1047 ms: 11 candidates, 74675 repo-hours, 1109 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:15:50Z [load_day 2024-07-31] 2024-07-31 hour 21: 186606 events in 0 files, snapshot none (task 7931 ms: download 5293 ms overlapping gunzip 1305 ms, parse 5314 ms, sort 0 ms, write 0 ms, index 647 ms: 6 candidates, 73405 repo-hours, 1158 releases; waiting 343 ms; commit 0 ms)
2026-11-08T07:15:57Z [load_day 2024-07-31] 2024-07-31 hour 22: 161356 events in 0 files, snapshot none (task 6590 ms: download 3998 ms overlapping gunzip 1026 ms, parse 4197 ms, sort 0 ms, write 0 ms, index 533 ms: 7 candidates, 59737 repo-hours, 971 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:15:57Z [load_day 2024-07-31] 2024-07-31 hour 23: 147215 events in 0 files, snapshot none (task 5827 ms: download 3028 ms overlapping gunzip 853 ms, parse 3590 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 54814 repo-hours, 705 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:16:06Z [load_day 2024-07-31] 2024-07-31: repo_hour merged from 24 files to 1 (2093881 rows, 9367 ms)
2026-11-08T07:16:09Z [load_day 2024-07-31] 2024-07-31: index committed in 12642 ms (24 + 1 + 24 files)
2026-11-08T07:16:09Z [load_day 2024-07-31] 2024-07-31: 4829855 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:16:09Z [load_day 2024-07-31] attempt 1 succeeded