orcaLog in

Runs · run 2947

load_day 2024-09-11, attempt 1 succeeded

Host
73ccef5e07c2:176083
Started
2026-11-08T07:52:07Z
Ended
2026-11-08T07:54:08Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
738 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2947/load_day/2024-09-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:52:07Z [load_day 2024-09-11] attempt 1 started
2026-11-08T07:52:08Z [load_day 2024-09-11] 2024-09-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:52:16Z [load_day 2024-09-11] 2024-09-11 hour 0: 190999 events in 0 files, snapshot none (task 7589 ms: download 4736 ms overlapping gunzip 1110 ms, parse 4935 ms, sort 0 ms, write 0 ms, index 636 ms: 10 candidates, 92109 repo-hours, 1083 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:52:16Z [load_day 2024-09-11] 2024-09-11 hour 1: 200462 events in 0 files, snapshot none (task 7521 ms: download 4612 ms overlapping gunzip 1148 ms, parse 4995 ms, sort 0 ms, write 0 ms, index 811 ms: 6 candidates, 106796 repo-hours, 845 releases; waiting 309 ms; commit 0 ms)
2026-11-08T07:52:24Z [load_day 2024-09-11] 2024-09-11 hour 2: 172296 events in 0 files, snapshot none (task 7078 ms: download 4156 ms overlapping gunzip 1053 ms, parse 4572 ms, sort 0 ms, write 0 ms, index 710 ms: 6 candidates, 76187 repo-hours, 840 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:52:24Z [load_day 2024-09-11] 2024-09-11 hour 3: 185367 events in 0 files, snapshot none (task 7531 ms: download 4462 ms overlapping gunzip 1190 ms, parse 4984 ms, sort 0 ms, write 0 ms, index 563 ms: 2 candidates, 76838 repo-hours, 4003 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:52:29Z [load_day 2024-09-11] 2024-09-11 hour 4: 160996 events in 0 files, snapshot none (task 5124 ms: download 2880 ms overlapping gunzip 787 ms, parse 3139 ms, sort 0 ms, write 0 ms, index 442 ms: 2 candidates, 63473 repo-hours, 719 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:52:30Z [load_day 2024-09-11] 2024-09-11 hour 5: 174624 events in 0 files, snapshot none (task 5525 ms: download 3078 ms overlapping gunzip 828 ms, parse 3386 ms, sort 0 ms, write 0 ms, index 552 ms: 4 candidates, 69591 repo-hours, 961 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:52:39Z [load_day 2024-09-11] 2024-09-11 hour 6: 210090 events in 0 files, snapshot none (task 8499 ms: download 5886 ms overlapping gunzip 1402 ms, parse 6024 ms, sort 0 ms, write 0 ms, index 665 ms: 9 candidates, 96598 repo-hours, 970 releases; waiting 211 ms; commit 0 ms)
2026-11-08T07:52:39Z [load_day 2024-09-11] 2024-09-11 hour 7: 216107 events in 0 files, snapshot none (task 8879 ms: download 6434 ms overlapping gunzip 1501 ms, parse 5920 ms, sort 0 ms, write 0 ms, index 627 ms: 7 candidates, 87133 repo-hours, 1272 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:52:48Z [load_day 2024-09-11] 2024-09-11 hour 8: 231058 events in 0 files, snapshot none (task 9501 ms: download 6867 ms overlapping gunzip 1541 ms, parse 6475 ms, sort 0 ms, write 0 ms, index 677 ms: 11 candidates, 96019 repo-hours, 1330 releases; waiting 529 ms; commit 0 ms)
2026-11-08T07:52:49Z [load_day 2024-09-11] 2024-09-11 hour 9: 231965 events in 0 files, snapshot none (task 9109 ms: download 6488 ms overlapping gunzip 1430 ms, parse 6111 ms, sort 0 ms, write 0 ms, index 753 ms: 9 candidates, 98561 repo-hours, 1404 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:52:57Z [load_day 2024-09-11] 2024-09-11 hour 10: 228476 events in 0 files, snapshot none (task 7922 ms: download 5359 ms overlapping gunzip 1272 ms, parse 5116 ms, sort 0 ms, write 0 ms, index 662 ms: 9 candidates, 93771 repo-hours, 1398 releases; waiting 566 ms; commit 0 ms)
2026-11-08T07:52:57Z [load_day 2024-09-11] 2024-09-11 hour 11: 220724 events in 0 files, snapshot none (task 7791 ms: download 5313 ms overlapping gunzip 1177 ms, parse 5039 ms, sort 0 ms, write 0 ms, index 627 ms: 5 candidates, 88228 repo-hours, 1167 releases; waiting 667 ms; commit 0 ms)
2026-11-08T07:53:09Z [load_day 2024-09-11] 2024-09-11 hour 12: 275118 events in 0 files, snapshot none (task 11527 ms: download 6282 ms overlapping gunzip 1679 ms, parse 7369 ms, sort 0 ms, write 0 ms, index 1623 ms: 10 candidates, 138291 repo-hours, 1395 releases; waiting 536 ms; commit 0 ms)
2026-11-08T07:53:10Z [load_day 2024-09-11] 2024-09-11 hour 13: 249237 events in 0 files, snapshot none (task 12689 ms: download 9749 ms overlapping gunzip 1715 ms, parse 7398 ms, sort 0 ms, write 0 ms, index 884 ms: 12 candidates, 118960 repo-hours, 1312 releases; waiting 2370 ms; commit 0 ms)
2026-11-08T07:53:16Z [load_day 2024-09-11] 2024-09-11 hour 14: 146764 events in 0 files, snapshot none (task 6494 ms: download 3098 ms overlapping gunzip 962 ms, parse 3721 ms, sort 0 ms, write 0 ms, index 1029 ms: 12 candidates, 76276 repo-hours, 756 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:53:20Z [load_day 2024-09-11] 2024-09-11 hour 15: 228531 events in 0 files, snapshot none (task 9523 ms: download 6808 ms overlapping gunzip 1470 ms, parse 6369 ms, sort 0 ms, write 0 ms, index 856 ms: 10 candidates, 101186 repo-hours, 1222 releases; waiting 542 ms; commit 0 ms)
2026-11-08T07:53:28Z [load_day 2024-09-11] 2024-09-11 hour 16: 237906 events in 0 files, snapshot none (task 11601 ms: download 8424 ms overlapping gunzip 1656 ms, parse 6971 ms, sort 0 ms, write 0 ms, index 804 ms: 7 candidates, 97935 repo-hours, 1243 releases; waiting 1801 ms; commit 0 ms)
2026-11-08T07:53:31Z [load_day 2024-09-11] 2024-09-11 hour 17: 229612 events in 0 files, snapshot none (task 10487 ms: download 6810 ms overlapping gunzip 1588 ms, parse 6301 ms, sort 0 ms, write 0 ms, index 1785 ms: 8 candidates, 89698 repo-hours, 1120 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:53:38Z [load_day 2024-09-11] 2024-09-11 hour 18: 242768 events in 0 files, snapshot none (task 9938 ms: download 7186 ms overlapping gunzip 1564 ms, parse 6783 ms, sort 0 ms, write 0 ms, index 770 ms: 7 candidates, 106171 repo-hours, 1344 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:53:40Z [load_day 2024-09-11] 2024-09-11 hour 19: 221131 events in 0 files, snapshot none (task 8213 ms: download 5402 ms overlapping gunzip 1284 ms, parse 5097 ms, sort 0 ms, write 0 ms, index 927 ms: 6 candidates, 83624 repo-hours, 1107 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:53:47Z [load_day 2024-09-11] 2024-09-11 hour 20: 208920 events in 0 files, snapshot none (task 8620 ms: download 5805 ms overlapping gunzip 1419 ms, parse 5795 ms, sort 0 ms, write 0 ms, index 627 ms: 11 candidates, 81244 repo-hours, 951 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:53:49Z [load_day 2024-09-11] 2024-09-11 hour 21: 195260 events in 0 files, snapshot none (task 7752 ms: download 5496 ms overlapping gunzip 1289 ms, parse 5141 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 76938 repo-hours, 1050 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:53:55Z [load_day 2024-09-11] 2024-09-11 hour 22: 179689 events in 0 files, snapshot none (task 7136 ms: download 4215 ms overlapping gunzip 1148 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 629 ms: 2 candidates, 64661 repo-hours, 1128 releases; waiting 385 ms; commit 0 ms)
2026-11-08T07:53:56Z [load_day 2024-09-11] 2024-09-11 hour 23: 173942 events in 0 files, snapshot none (task 7198 ms: download 4850 ms overlapping gunzip 1103 ms, parse 4863 ms, sort 0 ms, write 0 ms, index 434 ms: 6 candidates, 63726 repo-hours, 811 releases; waiting 567 ms; commit 0 ms)
2026-11-08T07:54:05Z [load_day 2024-09-11] 2024-09-11: repo_hour merged from 24 files to 1 (2144014 rows, 9287 ms)
2026-11-08T07:54:08Z [load_day 2024-09-11] 2024-09-11: index committed in 11864 ms (24 + 1 + 24 files)
2026-11-08T07:54:08Z [load_day 2024-09-11] 2024-09-11: 5012042 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:54:08Z [load_day 2024-09-11] attempt 1 succeeded