orcaLog in

Runs · run 3184

load_day 2024-11-09, attempt 1 succeeded

Host
73ccef5e07c2:204961
Started
2026-11-08T08:44:03Z
Ended
2026-11-08T08:45:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
651 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
152.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3184/load_day/2024-11-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:44:03Z [load_day 2024-11-09] attempt 1 started
2026-11-08T08:44:03Z [load_day 2024-11-09] 2024-11-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:44:13Z [load_day 2024-11-09] 2024-11-09 hour 0: 170333 events in 0 files, snapshot none (task 7289 ms: download 3873 ms overlapping gunzip 1178 ms, parse 4494 ms, sort 0 ms, write 0 ms, index 811 ms: 7 candidates, 83955 repo-hours, 1140 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:44:14Z [load_day 2024-11-09] 2024-11-09 hour 1: 174463 events in 0 files, snapshot none (task 8414 ms: download 5496 ms overlapping gunzip 974 ms, parse 4324 ms, sort 0 ms, write 0 ms, index 688 ms: 3 candidates, 94623 repo-hours, 747 releases; waiting 2104 ms; commit 0 ms)
2026-11-08T08:44:20Z [load_day 2024-11-09] 2024-11-09 hour 2: 150052 events in 0 files, snapshot none (task 6620 ms: download 2669 ms overlapping gunzip 909 ms, parse 3816 ms, sort 0 ms, write 0 ms, index 975 ms: 8 candidates, 60445 repo-hours, 730 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:44:23Z [load_day 2024-11-09] 2024-11-09 hour 3: 181356 events in 0 files, snapshot none (task 7877 ms: download 4286 ms overlapping gunzip 1274 ms, parse 5374 ms, sort 0 ms, write 0 ms, index 755 ms: 6 candidates, 62159 repo-hours, 5446 releases; waiting 195 ms; commit 0 ms)
2026-11-08T08:44:28Z [load_day 2024-11-09] 2024-11-09 hour 4: 165396 events in 0 files, snapshot none (task 7524 ms: download 4205 ms overlapping gunzip 1186 ms, parse 5109 ms, sort 0 ms, write 0 ms, index 552 ms: 4 candidates, 53535 repo-hours, 1326 releases; waiting 467 ms; commit 0 ms)
2026-11-08T08:44:30Z [load_day 2024-11-09] 2024-11-09 hour 5: 165660 events in 0 files, snapshot none (task 6819 ms: download 4626 ms overlapping gunzip 1093 ms, parse 4507 ms, sort 0 ms, write 0 ms, index 469 ms: 2 candidates, 54409 repo-hours, 728 releases; waiting 453 ms; commit 0 ms)
2026-11-08T08:44:36Z [load_day 2024-11-09] 2024-11-09 hour 6: 182830 events in 0 files, snapshot none (task 7427 ms: download 3709 ms overlapping gunzip 1167 ms, parse 5076 ms, sort 0 ms, write 0 ms, index 725 ms: 2 candidates, 71020 repo-hours, 950 releases; waiting 237 ms; commit 0 ms)
2026-11-08T08:44:38Z [load_day 2024-11-09] 2024-11-09 hour 7: 172873 events in 0 files, snapshot none (task 7687 ms: download 4489 ms overlapping gunzip 1062 ms, parse 4940 ms, sort 0 ms, write 0 ms, index 838 ms: 7 candidates, 56907 repo-hours, 842 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:44:44Z [load_day 2024-11-09] 2024-11-09 hour 8: 178292 events in 0 files, snapshot none (task 7403 ms: download 4112 ms overlapping gunzip 1033 ms, parse 4302 ms, sort 0 ms, write 0 ms, index 847 ms: 6 candidates, 60941 repo-hours, 2273 releases; waiting 914 ms; commit 0 ms)
2026-11-08T08:44:46Z [load_day 2024-11-09] 2024-11-09 hour 9: 187296 events in 0 files, snapshot none (task 7692 ms: download 4138 ms overlapping gunzip 1216 ms, parse 4851 ms, sort 0 ms, write 0 ms, index 835 ms: 4 candidates, 67994 repo-hours, 1956 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:44:52Z [load_day 2024-11-09] 2024-11-09 hour 10: 184202 events in 0 files, snapshot none (task 7025 ms: download 4565 ms overlapping gunzip 1193 ms, parse 4881 ms, sort 0 ms, write 0 ms, index 517 ms: 7 candidates, 66901 repo-hours, 800 releases; waiting 169 ms; commit 0 ms)
2026-11-08T08:44:53Z [load_day 2024-11-09] 2024-11-09 hour 11: 189226 events in 0 files, snapshot none (task 5827 ms: download 3504 ms overlapping gunzip 864 ms, parse 3890 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 70308 repo-hours, 655 releases; waiting 268 ms; commit 0 ms)
2026-11-08T08:45:00Z [load_day 2024-11-09] 2024-11-09 hour 12: 231724 events in 0 files, snapshot none (task 7838 ms: download 4004 ms overlapping gunzip 1015 ms, parse 5064 ms, sort 0 ms, write 0 ms, index 973 ms: 11 candidates, 111950 repo-hours, 893 releases; waiting 485 ms; commit 0 ms)
2026-11-08T08:45:02Z [load_day 2024-11-09] 2024-11-09 hour 13: 216135 events in 0 files, snapshot none (task 8210 ms: download 5210 ms overlapping gunzip 1230 ms, parse 5300 ms, sort 0 ms, write 0 ms, index 703 ms: 7 candidates, 88518 repo-hours, 754 releases; waiting 191 ms; commit 0 ms)
2026-11-08T08:45:11Z [load_day 2024-11-09] 2024-11-09 hour 14: 201648 events in 0 files, snapshot none (task 8615 ms: download 5504 ms overlapping gunzip 1378 ms, parse 5736 ms, sort 0 ms, write 0 ms, index 599 ms: 2 candidates, 72906 repo-hours, 773 releases; waiting 614 ms; commit 0 ms)
2026-11-08T08:45:12Z [load_day 2024-11-09] 2024-11-09 hour 15: 213174 events in 0 files, snapshot none (task 9149 ms: download 5488 ms overlapping gunzip 1325 ms, parse 5604 ms, sort 0 ms, write 0 ms, index 620 ms: 6 candidates, 86637 repo-hours, 858 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:45:20Z [load_day 2024-11-09] 2024-11-09 hour 16: 202055 events in 0 files, snapshot none (task 7915 ms: download 5054 ms overlapping gunzip 1118 ms, parse 5056 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 74434 repo-hours, 820 releases; waiting 706 ms; commit 0 ms)
2026-11-08T08:45:20Z [load_day 2024-11-09] 2024-11-09 hour 17: 199445 events in 0 files, snapshot none (task 7234 ms: download 4662 ms overlapping gunzip 1094 ms, parse 4714 ms, sort 0 ms, write 0 ms, index 632 ms: 10 candidates, 68271 repo-hours, 755 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:45:26Z [load_day 2024-11-09] 2024-11-09 hour 18: 209487 events in 0 files, snapshot none (task 6012 ms: download 3615 ms overlapping gunzip 873 ms, parse 3719 ms, sort 0 ms, write 0 ms, index 590 ms: 1 candidates, 84581 repo-hours, 931 releases; waiting 528 ms; commit 0 ms)
2026-11-08T08:45:26Z [load_day 2024-11-09] 2024-11-09 hour 19: 187877 events in 0 files, snapshot none (task 5601 ms: download 3498 ms overlapping gunzip 869 ms, parse 3538 ms, sort 0 ms, write 0 ms, index 427 ms: 3 candidates, 60912 repo-hours, 810 releases; waiting 533 ms; commit 0 ms)
2026-11-08T08:45:32Z [load_day 2024-11-09] 2024-11-09 hour 20: 181831 events in 0 files, snapshot none (task 5489 ms: download 3325 ms overlapping gunzip 829 ms, parse 3460 ms, sort 0 ms, write 0 ms, index 420 ms: 5 candidates, 62386 repo-hours, 646 releases; waiting 492 ms; commit 0 ms)
2026-11-08T08:45:32Z [load_day 2024-11-09] 2024-11-09 hour 21: 177547 events in 0 files, snapshot none (task 5235 ms: download 3084 ms overlapping gunzip 833 ms, parse 3453 ms, sort 0 ms, write 0 ms, index 446 ms: 6 candidates, 64796 repo-hours, 866 releases; waiting 209 ms; commit 0 ms)
2026-11-08T08:45:38Z [load_day 2024-11-09] 2024-11-09 hour 22: 160345 events in 0 files, snapshot none (task 5660 ms: download 3170 ms overlapping gunzip 818 ms, parse 3394 ms, sort 0 ms, write 0 ms, index 686 ms: 2 candidates, 52037 repo-hours, 1178 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:45:38Z [load_day 2024-11-09] 2024-11-09 hour 23: 153209 events in 0 files, snapshot none (task 5262 ms: download 2714 ms overlapping gunzip 740 ms, parse 3107 ms, sort 0 ms, write 0 ms, index 711 ms: 5 candidates, 50214 repo-hours, 701 releases; waiting 495 ms; commit 0 ms)
2026-11-08T08:45:46Z [load_day 2024-11-09] 2024-11-09: repo_hour merged from 24 files to 1 (1680839 rows, 7725 ms)
2026-11-08T08:45:49Z [load_day 2024-11-09] 2024-11-09: index committed in 10737 ms (24 + 1 + 24 files)
2026-11-08T08:45:49Z [load_day 2024-11-09] 2024-11-09: 4436456 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:45:49Z [load_day 2024-11-09] attempt 1 succeeded