orcaLog in

Runs · run 2905

load_day 2024-08-30, attempt 1 succeeded

Host
73ccef5e07c2:171194
Started
2026-11-08T07:41:02Z
Ended
2026-11-08T07:42:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
717 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
167.7 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2905/load_day/2024-08-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:41:02Z [load_day 2024-08-30] attempt 1 started
2026-11-08T07:41:03Z [load_day 2024-08-30] 2024-08-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:41:09Z [load_day 2024-08-30] 2024-08-30 hour 0: 177978 events in 0 files, snapshot none (task 5464 ms: download 2846 ms overlapping gunzip 782 ms, parse 3246 ms, sort 0 ms, write 0 ms, index 661 ms: 5 candidates, 91468 repo-hours, 1102 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:41:09Z [load_day 2024-08-30] 2024-08-30 hour 1: 190045 events in 0 files, snapshot none (task 5409 ms: download 2900 ms overlapping gunzip 772 ms, parse 3295 ms, sort 0 ms, write 0 ms, index 701 ms: 7 candidates, 106864 repo-hours, 828 releases; waiting 371 ms; commit 0 ms)
2026-11-08T07:41:15Z [load_day 2024-08-30] 2024-08-30 hour 2: 167354 events in 0 files, snapshot none (task 5012 ms: download 2709 ms overlapping gunzip 708 ms, parse 2895 ms, sort 0 ms, write 0 ms, index 555 ms: 10 candidates, 74636 repo-hours, 921 releases; waiting 565 ms; commit 0 ms)
2026-11-08T07:41:15Z [load_day 2024-08-30] 2024-08-30 hour 3: 177997 events in 0 files, snapshot none (task 5011 ms: download 2552 ms overlapping gunzip 694 ms, parse 2967 ms, sort 0 ms, write 0 ms, index 531 ms: 1 candidates, 73597 repo-hours, 4803 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:41:22Z [load_day 2024-08-30] 2024-08-30 hour 4: 157963 events in 0 files, snapshot none (task 6352 ms: download 3924 ms overlapping gunzip 817 ms, parse 3589 ms, sort 0 ms, write 0 ms, index 417 ms: 9 candidates, 60253 repo-hours, 714 releases; waiting 1274 ms; commit 0 ms)
2026-11-08T07:41:22Z [load_day 2024-08-30] 2024-08-30 hour 5: 170337 events in 0 files, snapshot none (task 5677 ms: download 3228 ms overlapping gunzip 798 ms, parse 3333 ms, sort 0 ms, write 0 ms, index 590 ms: 11 candidates, 66339 repo-hours, 917 releases; waiting 591 ms; commit 0 ms)
2026-11-08T07:41:30Z [load_day 2024-08-30] 2024-08-30 hour 6: 202601 events in 0 files, snapshot none (task 7665 ms: download 5705 ms overlapping gunzip 1138 ms, parse 4699 ms, sort 0 ms, write 0 ms, index 662 ms: 11 candidates, 91291 repo-hours, 1073 releases; waiting 815 ms; commit 0 ms)
2026-11-08T07:41:30Z [load_day 2024-08-30] 2024-08-30 hour 7: 198187 events in 0 files, snapshot none (task 7255 ms: download 4627 ms overlapping gunzip 1085 ms, parse 4772 ms, sort 0 ms, write 0 ms, index 621 ms: 7 candidates, 80994 repo-hours, 1023 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:41:39Z [load_day 2024-08-30] 2024-08-30 hour 8: 208368 events in 0 files, snapshot none (task 8524 ms: download 5557 ms overlapping gunzip 1342 ms, parse 5734 ms, sort 0 ms, write 0 ms, index 672 ms: 6 candidates, 86663 repo-hours, 1106 releases; waiting 502 ms; commit 0 ms)
2026-11-08T07:41:39Z [load_day 2024-08-30] 2024-08-30 hour 9: 217817 events in 0 files, snapshot none (task 8265 ms: download 5251 ms overlapping gunzip 1214 ms, parse 5356 ms, sort 0 ms, write 0 ms, index 783 ms: 9 candidates, 93748 repo-hours, 1503 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:41:48Z [load_day 2024-08-30] 2024-08-30 hour 10: 212327 events in 0 files, snapshot none (task 9306 ms: download 6923 ms overlapping gunzip 1451 ms, parse 5892 ms, sort 0 ms, write 0 ms, index 605 ms: 15 candidates, 86649 repo-hours, 1215 releases; waiting 981 ms; commit 0 ms)
2026-11-08T07:41:48Z [load_day 2024-08-30] 2024-08-30 hour 11: 206719 events in 0 files, snapshot none (task 8591 ms: download 5871 ms overlapping gunzip 1322 ms, parse 5714 ms, sort 0 ms, write 0 ms, index 654 ms: 15 candidates, 81907 repo-hours, 1413 releases; waiting 606 ms; commit 0 ms)
2026-11-08T07:41:58Z [load_day 2024-08-30] 2024-08-30 hour 12: 256179 events in 0 files, snapshot none (task 9668 ms: download 6182 ms overlapping gunzip 1512 ms, parse 6382 ms, sort 0 ms, write 0 ms, index 979 ms: 15 candidates, 126621 repo-hours, 1404 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:41:58Z [load_day 2024-08-30] 2024-08-30 hour 13: 237194 events in 0 files, snapshot none (task 9595 ms: download 6526 ms overlapping gunzip 1429 ms, parse 6466 ms, sort 0 ms, write 0 ms, index 892 ms: 21 candidates, 109589 repo-hours, 1310 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:42:08Z [load_day 2024-08-30] 2024-08-30 hour 14: 229753 events in 0 files, snapshot none (task 9025 ms: download 6523 ms overlapping gunzip 1406 ms, parse 6143 ms, sort 0 ms, write 0 ms, index 670 ms: 21 candidates, 94585 repo-hours, 1379 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:42:08Z [load_day 2024-08-30] 2024-08-30 hour 15: 232080 events in 0 files, snapshot none (task 8904 ms: download 6352 ms overlapping gunzip 1400 ms, parse 5963 ms, sort 0 ms, write 0 ms, index 696 ms: 10 candidates, 99410 repo-hours, 1361 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:42:16Z [load_day 2024-08-30] 2024-08-30 hour 16: 212541 events in 0 files, snapshot none (task 8019 ms: download 5412 ms overlapping gunzip 1246 ms, parse 5193 ms, sort 0 ms, write 0 ms, index 756 ms: 11 candidates, 86720 repo-hours, 1151 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:42:16Z [load_day 2024-08-30] 2024-08-30 hour 17: 205131 events in 0 files, snapshot none (task 7842 ms: download 5122 ms overlapping gunzip 1238 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 713 ms: 10 candidates, 82906 repo-hours, 1195 releases; waiting 401 ms; commit 0 ms)
2026-11-08T07:42:24Z [load_day 2024-08-30] 2024-08-30 hour 18: 210251 events in 0 files, snapshot none (task 7273 ms: download 4266 ms overlapping gunzip 1094 ms, parse 4581 ms, sort 0 ms, write 0 ms, index 800 ms: 6 candidates, 93738 repo-hours, 1263 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:42:24Z [load_day 2024-08-30] 2024-08-30 hour 19: 188411 events in 0 files, snapshot none (task 7172 ms: download 4236 ms overlapping gunzip 1136 ms, parse 4550 ms, sort 0 ms, write 0 ms, index 689 ms: 12 candidates, 70779 repo-hours, 996 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:42:31Z [load_day 2024-08-30] 2024-08-30 hour 20: 179740 events in 0 files, snapshot none (task 6788 ms: download 4361 ms overlapping gunzip 1055 ms, parse 4333 ms, sort 0 ms, write 0 ms, index 502 ms: 7 candidates, 69494 repo-hours, 922 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:42:31Z [load_day 2024-08-30] 2024-08-30 hour 21: 174360 events in 0 files, snapshot none (task 6453 ms: download 4286 ms overlapping gunzip 1007 ms, parse 4320 ms, sort 0 ms, write 0 ms, index 500 ms: 6 candidates, 68212 repo-hours, 1008 releases; waiting 358 ms; commit 0 ms)
2026-11-08T07:42:36Z [load_day 2024-08-30] 2024-08-30 hour 22: 152385 events in 0 files, snapshot none (task 4881 ms: download 3435 ms overlapping gunzip 709 ms, parse 2848 ms, sort 0 ms, write 0 ms, index 374 ms: 9 candidates, 55413 repo-hours, 1042 releases; waiting 663 ms; commit 0 ms)
2026-11-08T07:42:36Z [load_day 2024-08-30] 2024-08-30 hour 23: 143792 events in 0 files, snapshot none (task 4636 ms: download 2769 ms overlapping gunzip 681 ms, parse 2722 ms, sort 0 ms, write 0 ms, index 374 ms: 4 candidates, 51850 repo-hours, 848 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:42:44Z [load_day 2024-08-30] 2024-08-30: repo_hour merged from 24 files to 1 (2003726 rows, 8031 ms)
2026-11-08T07:42:47Z [load_day 2024-08-30] 2024-08-30: index committed in 10332 ms (24 + 1 + 24 files)
2026-11-08T07:42:47Z [load_day 2024-08-30] 2024-08-30: 4709510 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:42:47Z [load_day 2024-08-30] attempt 1 succeeded