orcaLog in

Runs · run 3382

load_day 2024-12-31, attempt 1 succeeded

Host
73ccef5e07c2:230715
Started
2026-11-08T09:36:16Z
Ended
2026-11-08T09:37:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
666 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
130.8 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3382/load_day/2024-12-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:36:16Z [load_day 2024-12-31] attempt 1 started
2026-11-08T09:36:17Z [load_day 2024-12-31] 2024-12-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:36:24Z [load_day 2024-12-31] 2024-12-31 hour 0: 172543 events in 0 files, snapshot none (task 6282 ms: download 3576 ms overlapping gunzip 891 ms, parse 3881 ms, sort 0 ms, write 0 ms, index 690 ms: 9 candidates, 83254 repo-hours, 1200 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:36:24Z [load_day 2024-12-31] 2024-12-31 hour 1: 187202 events in 0 files, snapshot none (task 6805 ms: download 3408 ms overlapping gunzip 967 ms, parse 4229 ms, sort 0 ms, write 0 ms, index 782 ms: 6 candidates, 104010 repo-hours, 1092 releases; waiting 511 ms; commit 0 ms)
2026-11-08T09:36:31Z [load_day 2024-12-31] 2024-12-31 hour 2: 162910 events in 0 files, snapshot none (task 6146 ms: download 3180 ms overlapping gunzip 784 ms, parse 3199 ms, sort 0 ms, write 0 ms, index 911 ms: 2 candidates, 76176 repo-hours, 954 releases; waiting 888 ms; commit 0 ms)
2026-11-08T09:36:31Z [load_day 2024-12-31] 2024-12-31 hour 3: 183722 events in 0 files, snapshot none (task 5956 ms: download 3329 ms overlapping gunzip 828 ms, parse 3436 ms, sort 0 ms, write 0 ms, index 1058 ms: 3 candidates, 79865 repo-hours, 3951 releases; waiting 297 ms; commit 0 ms)
2026-11-08T09:36:37Z [load_day 2024-12-31] 2024-12-31 hour 4: 156558 events in 0 files, snapshot none (task 5406 ms: download 2911 ms overlapping gunzip 784 ms, parse 3358 ms, sort 0 ms, write 0 ms, index 419 ms: 3 candidates, 58270 repo-hours, 678 releases; waiting 492 ms; commit 0 ms)
2026-11-08T09:36:37Z [load_day 2024-12-31] 2024-12-31 hour 5: 164302 events in 0 files, snapshot none (task 5172 ms: download 2787 ms overlapping gunzip 797 ms, parse 3142 ms, sort 0 ms, write 0 ms, index 453 ms: 3 candidates, 61335 repo-hours, 760 releases; waiting 485 ms; commit 0 ms)
2026-11-08T09:36:45Z [load_day 2024-12-31] 2024-12-31 hour 6: 186732 events in 0 files, snapshot none (task 6862 ms: download 4224 ms overlapping gunzip 1108 ms, parse 4354 ms, sort 0 ms, write 0 ms, index 596 ms: 3 candidates, 81183 repo-hours, 824 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:36:45Z [load_day 2024-12-31] 2024-12-31 hour 7: 178655 events in 0 files, snapshot none (task 6880 ms: download 4223 ms overlapping gunzip 1063 ms, parse 4547 ms, sort 0 ms, write 0 ms, index 536 ms: 3 candidates, 68555 repo-hours, 731 releases; waiting 387 ms; commit 0 ms)
2026-11-08T09:36:52Z [load_day 2024-12-31] 2024-12-31 hour 8: 179142 events in 0 files, snapshot none (task 6638 ms: download 3680 ms overlapping gunzip 1093 ms, parse 4403 ms, sort 0 ms, write 0 ms, index 567 ms: 7 candidates, 72324 repo-hours, 831 releases; waiting 273 ms; commit 0 ms)
2026-11-08T09:36:52Z [load_day 2024-12-31] 2024-12-31 hour 9: 193784 events in 0 files, snapshot none (task 7277 ms: download 4732 ms overlapping gunzip 1149 ms, parse 4750 ms, sort 0 ms, write 0 ms, index 581 ms: 4 candidates, 78630 repo-hours, 1081 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:37:00Z [load_day 2024-12-31] 2024-12-31 hour 10: 187019 events in 0 files, snapshot none (task 7295 ms: download 4309 ms overlapping gunzip 1150 ms, parse 4705 ms, sort 0 ms, write 0 ms, index 592 ms: 1 candidates, 71580 repo-hours, 890 releases; waiting 531 ms; commit 0 ms)
2026-11-08T09:37:00Z [load_day 2024-12-31] 2024-12-31 hour 11: 176950 events in 0 files, snapshot none (task 6469 ms: download 3407 ms overlapping gunzip 1014 ms, parse 4273 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 65065 repo-hours, 929 releases; waiting 192 ms; commit 0 ms)
2026-11-08T09:37:08Z [load_day 2024-12-31] 2024-12-31 hour 12: 229309 events in 0 files, snapshot none (task 7636 ms: download 4396 ms overlapping gunzip 1068 ms, parse 5025 ms, sort 0 ms, write 0 ms, index 770 ms: 6 candidates, 112199 repo-hours, 1087 releases; waiting 526 ms; commit 0 ms)
2026-11-08T09:37:08Z [load_day 2024-12-31] 2024-12-31 hour 13: 197834 events in 0 files, snapshot none (task 7161 ms: download 4256 ms overlapping gunzip 1058 ms, parse 4619 ms, sort 0 ms, write 0 ms, index 641 ms: 9 candidates, 89229 repo-hours, 971 releases; waiting 482 ms; commit 0 ms)
2026-11-08T09:37:14Z [load_day 2024-12-31] 2024-12-31 hour 14: 181630 events in 0 files, snapshot none (task 5507 ms: download 3086 ms overlapping gunzip 782 ms, parse 3433 ms, sort 0 ms, write 0 ms, index 515 ms: 8 candidates, 70063 repo-hours, 1026 releases; waiting 517 ms; commit 0 ms)
2026-11-08T09:37:14Z [load_day 2024-12-31] 2024-12-31 hour 15: 189470 events in 0 files, snapshot none (task 5800 ms: download 3310 ms overlapping gunzip 806 ms, parse 3617 ms, sort 0 ms, write 0 ms, index 565 ms: 3 candidates, 78004 repo-hours, 1188 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:37:19Z [load_day 2024-12-31] 2024-12-31 hour 16: 175449 events in 0 files, snapshot none (task 4867 ms: download 2343 ms overlapping gunzip 719 ms, parse 3067 ms, sort 0 ms, write 0 ms, index 562 ms: 3 candidates, 70245 repo-hours, 1069 releases; waiting 193 ms; commit 0 ms)
2026-11-08T09:37:20Z [load_day 2024-12-31] 2024-12-31 hour 17: 169104 events in 0 files, snapshot none (task 5001 ms: download 2763 ms overlapping gunzip 702 ms, parse 2892 ms, sort 0 ms, write 0 ms, index 492 ms: 3 candidates, 62273 repo-hours, 937 releases; waiting 649 ms; commit 0 ms)
2026-11-08T09:37:26Z [load_day 2024-12-31] 2024-12-31 hour 18: 178246 events in 0 files, snapshot none (task 7000 ms: download 3356 ms overlapping gunzip 918 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 612 ms: 2 candidates, 78011 repo-hours, 1054 releases; waiting 542 ms; commit 0 ms)
2026-11-08T09:37:26Z [load_day 2024-12-31] 2024-12-31 hour 19: 146146 events in 0 files, snapshot none (task 6157 ms: download 2812 ms overlapping gunzip 931 ms, parse 4036 ms, sort 0 ms, write 0 ms, index 488 ms: 3 candidates, 52549 repo-hours, 786 releases; waiting 362 ms; commit 0 ms)
2026-11-08T09:37:32Z [load_day 2024-12-31] 2024-12-31 hour 20: 146125 events in 0 files, snapshot none (task 5382 ms: download 3114 ms overlapping gunzip 765 ms, parse 3246 ms, sort 0 ms, write 0 ms, index 438 ms: 4 candidates, 52134 repo-hours, 723 releases; waiting 629 ms; commit 0 ms)
2026-11-08T09:37:32Z [load_day 2024-12-31] 2024-12-31 hour 21: 143108 events in 0 files, snapshot none (task 5637 ms: download 3103 ms overlapping gunzip 858 ms, parse 3536 ms, sort 0 ms, write 0 ms, index 382 ms: 2 candidates, 53311 repo-hours, 934 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:37:37Z [load_day 2024-12-31] 2024-12-31 hour 22: 126470 events in 0 files, snapshot none (task 4490 ms: download 2793 ms overlapping gunzip 609 ms, parse 2625 ms, sort 0 ms, write 0 ms, index 449 ms: 3 candidates, 42925 repo-hours, 932 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:37:38Z [load_day 2024-12-31] 2024-12-31 hour 23: 122613 events in 0 files, snapshot none (task 4714 ms: download 2199 ms overlapping gunzip 673 ms, parse 2933 ms, sort 0 ms, write 0 ms, index 337 ms: 4 candidates, 43195 repo-hours, 586 releases; waiting 480 ms; commit 0 ms)
2026-11-08T09:37:46Z [load_day 2024-12-31] 2024-12-31: repo_hour merged from 24 files to 1 (1704385 rows, 8109 ms)
2026-11-08T09:37:49Z [load_day 2024-12-31] 2024-12-31: index committed in 11099 ms (24 + 1 + 24 files)
2026-11-08T09:37:49Z [load_day 2024-12-31] 2024-12-31: 4135023 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:37:49Z [load_day 2024-12-31] attempt 1 succeeded