orcaLog in

Runs · run 2086

load_day 2024-02-15, attempt 1 succeeded

Host
73ccef5e07c2:86889
Started
2026-11-08T04:39:42Z
Ended
2026-11-08T04:41:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
686 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
173.6 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2086/load_day/2024-02-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:39:42Z [load_day 2024-02-15] attempt 1 started
2026-11-08T04:39:43Z [load_day 2024-02-15] 2024-02-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:39:52Z [load_day 2024-02-15] 2024-02-15 hour 0: 196192 events in 0 files, snapshot none (task 7989 ms: download 4992 ms overlapping gunzip 1258 ms, parse 5371 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 91523 repo-hours, 1214 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:39:52Z [load_day 2024-02-15] 2024-02-15 hour 1: 186665 events in 0 files, snapshot none (task 7232 ms: download 3940 ms overlapping gunzip 1038 ms, parse 4559 ms, sort 0 ms, write 0 ms, index 830 ms: 6 candidates, 88347 repo-hours, 849 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:39:59Z [load_day 2024-02-15] 2024-02-15 hour 2: 153733 events in 0 files, snapshot none (task 6522 ms: download 3602 ms overlapping gunzip 1001 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 561 ms: 8 candidates, 54524 repo-hours, 630 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:39:59Z [load_day 2024-02-15] 2024-02-15 hour 3: 152865 events in 0 files, snapshot none (task 6299 ms: download 3261 ms overlapping gunzip 937 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 520 ms: 4 candidates, 52353 repo-hours, 697 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:40:05Z [load_day 2024-02-15] 2024-02-15 hour 4: 155633 events in 0 files, snapshot none (task 5520 ms: download 3146 ms overlapping gunzip 800 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 416 ms: 4 candidates, 53805 repo-hours, 526 releases; waiting 536 ms; commit 0 ms)
2026-11-08T04:40:06Z [load_day 2024-02-15] 2024-02-15 hour 5: 168106 events in 0 files, snapshot none (task 6604 ms: download 3551 ms overlapping gunzip 1027 ms, parse 4032 ms, sort 0 ms, write 0 ms, index 723 ms: 3 candidates, 58201 repo-hours, 671 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:40:12Z [load_day 2024-02-15] 2024-02-15 hour 6: 185664 events in 0 files, snapshot none (task 6461 ms: download 3591 ms overlapping gunzip 939 ms, parse 4032 ms, sort 0 ms, write 0 ms, index 665 ms: 2 candidates, 68872 repo-hours, 830 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:40:13Z [load_day 2024-02-15] 2024-02-15 hour 7: 187845 events in 0 files, snapshot none (task 6577 ms: download 4191 ms overlapping gunzip 1180 ms, parse 4666 ms, sort 0 ms, write 0 ms, index 492 ms: 11 candidates, 67121 repo-hours, 739 releases; waiting 15 ms; commit 0 ms)
2026-11-08T04:40:20Z [load_day 2024-02-15] 2024-02-15 hour 8: 197399 events in 0 files, snapshot none (task 7857 ms: download 4940 ms overlapping gunzip 1206 ms, parse 5086 ms, sort 0 ms, write 0 ms, index 802 ms: 8 candidates, 75010 repo-hours, 961 releases; waiting 548 ms; commit 0 ms)
2026-11-08T04:40:22Z [load_day 2024-02-15] 2024-02-15 hour 9: 217957 events in 0 files, snapshot none (task 8875 ms: download 6098 ms overlapping gunzip 1365 ms, parse 5991 ms, sort 0 ms, write 0 ms, index 779 ms: 8 candidates, 82757 repo-hours, 1139 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:40:28Z [load_day 2024-02-15] 2024-02-15 hour 10: 225127 events in 0 files, snapshot none (task 7361 ms: download 4594 ms overlapping gunzip 1199 ms, parse 5120 ms, sort 0 ms, write 0 ms, index 826 ms: 7 candidates, 86928 repo-hours, 1023 releases; waiting 15 ms; commit 0 ms)
2026-11-08T04:40:30Z [load_day 2024-02-15] 2024-02-15 hour 11: 218323 events in 0 files, snapshot none (task 7527 ms: download 4729 ms overlapping gunzip 1223 ms, parse 5370 ms, sort 0 ms, write 0 ms, index 703 ms: 10 candidates, 81929 repo-hours, 1155 releases; waiting 22 ms; commit 0 ms)
2026-11-08T04:40:37Z [load_day 2024-02-15] 2024-02-15 hour 12: 284638 events in 0 files, snapshot none (task 8443 ms: download 5396 ms overlapping gunzip 1353 ms, parse 6037 ms, sort 0 ms, write 0 ms, index 850 ms: 13 candidates, 115057 repo-hours, 1243 releases; waiting 21 ms; commit 0 ms)
2026-11-08T04:40:40Z [load_day 2024-02-15] 2024-02-15 hour 13: 252704 events in 0 files, snapshot none (task 9423 ms: download 5537 ms overlapping gunzip 1457 ms, parse 6322 ms, sort 0 ms, write 0 ms, index 1439 ms: 12 candidates, 110297 repo-hours, 1180 releases; waiting 20 ms; commit 0 ms)
2026-11-08T04:40:48Z [load_day 2024-02-15] 2024-02-15 hour 14: 243381 events in 0 files, snapshot none (task 10887 ms: download 7709 ms overlapping gunzip 1800 ms, parse 7652 ms, sort 0 ms, write 0 ms, index 1212 ms: 11 candidates, 97472 repo-hours, 1205 releases; waiting 26 ms; commit 0 ms)
2026-11-08T04:40:52Z [load_day 2024-02-15] 2024-02-15 hour 15: 248946 events in 0 files, snapshot none (task 11231 ms: download 7131 ms overlapping gunzip 1940 ms, parse 7911 ms, sort 0 ms, write 0 ms, index 1122 ms: 8 candidates, 102020 repo-hours, 1322 releases; waiting 30 ms; commit 0 ms)
2026-11-08T04:41:00Z [load_day 2024-02-15] 2024-02-15 hour 16: 251193 events in 0 files, snapshot none (task 11105 ms: download 7546 ms overlapping gunzip 1980 ms, parse 8046 ms, sort 0 ms, write 0 ms, index 844 ms: 11 candidates, 100688 repo-hours, 1240 releases; waiting 29 ms; commit 0 ms)
2026-11-08T04:41:02Z [load_day 2024-02-15] 2024-02-15 hour 17: 234355 events in 0 files, snapshot none (task 8945 ms: download 6301 ms overlapping gunzip 1461 ms, parse 6489 ms, sort 0 ms, write 0 ms, index 767 ms: 11 candidates, 91492 repo-hours, 1120 releases; waiting 19 ms; commit 0 ms)
2026-11-08T04:41:09Z [load_day 2024-02-15] 2024-02-15 hour 18: 238442 events in 0 files, snapshot none (task 8820 ms: download 5987 ms overlapping gunzip 1450 ms, parse 6438 ms, sort 0 ms, write 0 ms, index 740 ms: 6 candidates, 94101 repo-hours, 1167 releases; waiting 5 ms; commit 0 ms)
2026-11-08T04:41:11Z [load_day 2024-02-15] 2024-02-15 hour 19: 223949 events in 0 files, snapshot none (task 8550 ms: download 5997 ms overlapping gunzip 1432 ms, parse 6127 ms, sort 0 ms, write 0 ms, index 756 ms: 12 candidates, 82143 repo-hours, 1031 releases; waiting 22 ms; commit 0 ms)
2026-11-08T04:41:18Z [load_day 2024-02-15] 2024-02-15 hour 20: 214764 events in 0 files, snapshot none (task 7767 ms: download 4769 ms overlapping gunzip 1197 ms, parse 5547 ms, sort 0 ms, write 0 ms, index 804 ms: 6 candidates, 77949 repo-hours, 951 releases; waiting 13 ms; commit 0 ms)
2026-11-08T04:41:20Z [load_day 2024-02-15] 2024-02-15 hour 21: 214934 events in 0 files, snapshot none (task 9044 ms: download 6111 ms overlapping gunzip 1401 ms, parse 6323 ms, sort 0 ms, write 0 ms, index 1092 ms: 9 candidates, 74448 repo-hours, 998 releases; waiting 17 ms; commit 0 ms)
2026-11-08T04:41:26Z [load_day 2024-02-15] 2024-02-15 hour 22: 207381 events in 0 files, snapshot none (task 7722 ms: download 4544 ms overlapping gunzip 1295 ms, parse 5548 ms, sort 0 ms, write 0 ms, index 677 ms: 15 candidates, 66474 repo-hours, 984 releases; waiting 9 ms; commit 0 ms)
2026-11-08T04:41:28Z [load_day 2024-02-15] 2024-02-15 hour 23: 211187 events in 0 files, snapshot none (task 7350 ms: download 4899 ms overlapping gunzip 1218 ms, parse 5480 ms, sort 0 ms, write 0 ms, index 433 ms: 7 candidates, 59886 repo-hours, 699 releases; waiting 17 ms; commit 0 ms)
2026-11-08T04:41:38Z [load_day 2024-02-15] 2024-02-15: repo_hour merged from 24 files to 1 (1933397 rows, 9625 ms)
2026-11-08T04:41:41Z [load_day 2024-02-15] 2024-02-15: index committed in 12713 ms (24 + 1 + 24 files)
2026-11-08T04:41:41Z [load_day 2024-02-15] 2024-02-15: 5071383 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:41:41Z [load_day 2024-02-15] attempt 1 succeeded