orcaLog in

Runs · run 2786

load_day 2024-08-01, attempt 1 succeeded

Host
73ccef5e07c2:157525
Started
2026-11-08T07:14:48Z
Ended
2026-11-08T07:16:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
711 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
199.3 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2786/load_day/2024-08-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:14:48Z [load_day 2024-08-01] attempt 1 started
2026-11-08T07:14:49Z [load_day 2024-08-01] 2024-08-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:14:57Z [load_day 2024-08-01] 2024-08-01 hour 0: 179040 events in 0 files, snapshot none (task 7438 ms: download 4646 ms overlapping gunzip 1194 ms, parse 4577 ms, sort 0 ms, write 0 ms, index 689 ms: 10 candidates, 88133 repo-hours, 1185 releases; waiting 652 ms; commit 0 ms)
2026-11-08T07:14:57Z [load_day 2024-08-01] 2024-08-01 hour 1: 196893 events in 0 files, snapshot none (task 7695 ms: download 4293 ms overlapping gunzip 1200 ms, parse 4884 ms, sort 0 ms, write 0 ms, index 1101 ms: 13 candidates, 105736 repo-hours, 1214 releases; waiting 256 ms; commit 0 ms)
2026-11-08T07:15:05Z [load_day 2024-08-01] 2024-08-01 hour 2: 173608 events in 0 files, snapshot none (task 8103 ms: download 4912 ms overlapping gunzip 1331 ms, parse 5345 ms, sort 0 ms, write 0 ms, index 640 ms: 13 candidates, 74927 repo-hours, 1049 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:15:05Z [load_day 2024-08-01] 2024-08-01 hour 3: 187678 events in 0 files, snapshot none (task 7451 ms: download 4369 ms overlapping gunzip 1141 ms, parse 4850 ms, sort 0 ms, write 0 ms, index 673 ms: 12 candidates, 77812 repo-hours, 5393 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:15:15Z [load_day 2024-08-01] 2024-08-01 hour 4: 166147 events in 0 files, snapshot none (task 8631 ms: download 4845 ms overlapping gunzip 1363 ms, parse 5537 ms, sort 0 ms, write 0 ms, index 912 ms: 5 candidates, 64741 repo-hours, 673 releases; waiting 524 ms; commit 0 ms)
2026-11-08T07:15:15Z [load_day 2024-08-01] 2024-08-01 hour 5: 180261 events in 0 files, snapshot none (task 9257 ms: download 5498 ms overlapping gunzip 1467 ms, parse 6072 ms, sort 0 ms, write 0 ms, index 901 ms: 8 candidates, 69612 repo-hours, 754 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:15:23Z [load_day 2024-08-01] 2024-08-01 hour 6: 215073 events in 0 files, snapshot none (task 8345 ms: download 5421 ms overlapping gunzip 1333 ms, parse 5458 ms, sort 0 ms, write 0 ms, index 792 ms: 10 candidates, 95267 repo-hours, 1048 releases; waiting 472 ms; commit 0 ms)
2026-11-08T07:15:25Z [load_day 2024-08-01] 2024-08-01 hour 7: 214164 events in 0 files, snapshot none (task 9240 ms: download 6457 ms overlapping gunzip 1492 ms, parse 5818 ms, sort 0 ms, write 0 ms, index 869 ms: 7 candidates, 89006 repo-hours, 1030 releases; waiting 749 ms; commit 0 ms)
2026-11-08T07:15:34Z [load_day 2024-08-01] 2024-08-01 hour 8: 223586 events in 0 files, snapshot none (task 9621 ms: download 7013 ms overlapping gunzip 1646 ms, parse 6458 ms, sort 0 ms, write 0 ms, index 786 ms: 4 candidates, 92229 repo-hours, 1195 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:15:35Z [load_day 2024-08-01] 2024-08-01 hour 9: 228688 events in 0 files, snapshot none (task 9981 ms: download 7019 ms overlapping gunzip 1600 ms, parse 6399 ms, sort 0 ms, write 0 ms, index 1112 ms: 8 candidates, 98156 repo-hours, 1484 releases; waiting 547 ms; commit 0 ms)
2026-11-08T07:15:43Z [load_day 2024-08-01] 2024-08-01 hour 10: 213392 events in 0 files, snapshot none (task 9015 ms: download 6581 ms overlapping gunzip 1492 ms, parse 6037 ms, sort 0 ms, write 0 ms, index 688 ms: 4 candidates, 88213 repo-hours, 1144 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:15:44Z [load_day 2024-08-01] 2024-08-01 hour 11: 215685 events in 0 files, snapshot none (task 8515 ms: download 5740 ms overlapping gunzip 1316 ms, parse 5576 ms, sort 0 ms, write 0 ms, index 823 ms: 10 candidates, 83681 repo-hours, 1116 releases; waiting 456 ms; commit 0 ms)
2026-11-08T07:15:53Z [load_day 2024-08-01] 2024-08-01 hour 12: 257648 events in 0 files, snapshot none (task 9104 ms: download 6030 ms overlapping gunzip 1318 ms, parse 5850 ms, sort 0 ms, write 0 ms, index 1144 ms: 9 candidates, 125239 repo-hours, 1251 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:15:55Z [load_day 2024-08-01] 2024-08-01 hour 13: 252213 events in 0 files, snapshot none (task 10100 ms: download 6710 ms overlapping gunzip 1583 ms, parse 6414 ms, sort 0 ms, write 0 ms, index 1347 ms: 10 candidates, 112456 repo-hours, 1324 releases; waiting 342 ms; commit 0 ms)
2026-11-08T07:16:02Z [load_day 2024-08-01] 2024-08-01 hour 14: 238882 events in 0 files, snapshot none (task 8525 ms: download 5915 ms overlapping gunzip 1454 ms, parse 5900 ms, sort 0 ms, write 0 ms, index 763 ms: 9 candidates, 98388 repo-hours, 1376 releases; waiting 193 ms; commit 0 ms)
2026-11-08T07:16:04Z [load_day 2024-08-01] 2024-08-01 hour 15: 243767 events in 0 files, snapshot none (task 8271 ms: download 5623 ms overlapping gunzip 1354 ms, parse 5393 ms, sort 0 ms, write 0 ms, index 829 ms: 15 candidates, 103921 repo-hours, 1440 releases; waiting 444 ms; commit 0 ms)
2026-11-08T07:16:10Z [load_day 2024-08-01] 2024-08-01 hour 16: 227240 events in 0 files, snapshot none (task 8252 ms: download 5471 ms overlapping gunzip 1329 ms, parse 5389 ms, sort 0 ms, write 0 ms, index 840 ms: 12 candidates, 91221 repo-hours, 1164 releases; waiting 374 ms; commit 0 ms)
2026-11-08T07:16:11Z [load_day 2024-08-01] 2024-08-01 hour 17: 215689 events in 0 files, snapshot none (task 7486 ms: download 4889 ms overlapping gunzip 1217 ms, parse 4773 ms, sort 0 ms, write 0 ms, index 669 ms: 10 candidates, 84642 repo-hours, 1075 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:16:21Z [load_day 2024-08-01] 2024-08-01 hour 18: 228918 events in 0 files, snapshot none (task 9947 ms: download 7213 ms overlapping gunzip 1615 ms, parse 6876 ms, sort 0 ms, write 0 ms, index 704 ms: 11 candidates, 99480 repo-hours, 1166 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:16:21Z [load_day 2024-08-01] 2024-08-01 hour 19: 200119 events in 0 files, snapshot none (task 9071 ms: download 6654 ms overlapping gunzip 1529 ms, parse 6306 ms, sort 0 ms, write 0 ms, index 537 ms: 12 candidates, 75017 repo-hours, 1149 releases; waiting 433 ms; commit 0 ms)
2026-11-08T07:16:29Z [load_day 2024-08-01] 2024-08-01 hour 20: 191556 events in 0 files, snapshot none (task 7996 ms: download 5617 ms overlapping gunzip 1352 ms, parse 5372 ms, sort 0 ms, write 0 ms, index 529 ms: 9 candidates, 73262 repo-hours, 998 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:16:32Z [load_day 2024-08-01] 2024-08-01 hour 21: 211444 events in 0 files, snapshot none (task 10853 ms: download 7668 ms overlapping gunzip 1804 ms, parse 7345 ms, sort 0 ms, write 0 ms, index 934 ms: 5 candidates, 78717 repo-hours, 1078 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:16:37Z [load_day 2024-08-01] 2024-08-01 hour 22: 169772 events in 0 files, snapshot none (task 7686 ms: download 4603 ms overlapping gunzip 1173 ms, parse 4861 ms, sort 0 ms, write 0 ms, index 767 ms: 4 candidates, 59560 repo-hours, 1060 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:16:40Z [load_day 2024-08-01] 2024-08-01 hour 23: 172190 events in 0 files, snapshot none (task 7240 ms: download 5081 ms overlapping gunzip 1104 ms, parse 4960 ms, sort 0 ms, write 0 ms, index 426 ms: 4 candidates, 59752 repo-hours, 945 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:16:49Z [load_day 2024-08-01] 2024-08-01: repo_hour merged from 24 files to 1 (2089168 rows, 9089 ms)
2026-11-08T07:16:52Z [load_day 2024-08-01] 2024-08-01: index committed in 11907 ms (24 + 1 + 24 files)
2026-11-08T07:16:52Z [load_day 2024-08-01] 2024-08-01: 5003653 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:16:52Z [load_day 2024-08-01] attempt 1 succeeded