orcaLog in

Runs · run 2796

load_day 2024-08-03, attempt 1 succeeded

Host
73ccef5e07c2:158668
Started
2026-11-08T07:16:53Z
Ended
2026-11-08T07:18:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
611 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.5 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2796/load_day/2024-08-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:16:53Z [load_day 2024-08-03] attempt 1 started
2026-11-08T07:16:54Z [load_day 2024-08-03] 2024-08-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:17:00Z [load_day 2024-08-03] 2024-08-03 hour 0: 161223 events in 0 files, snapshot none (task 5755 ms: download 2856 ms overlapping gunzip 746 ms, parse 3495 ms, sort 0 ms, write 0 ms, index 737 ms: 8 candidates, 87433 repo-hours, 1019 releases; waiting 566 ms; commit 0 ms)
2026-11-08T07:17:00Z [load_day 2024-08-03] 2024-08-03 hour 1: 168238 events in 0 files, snapshot none (task 5929 ms: download 3081 ms overlapping gunzip 817 ms, parse 3521 ms, sort 0 ms, write 0 ms, index 728 ms: 3 candidates, 95784 repo-hours, 716 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:17:05Z [load_day 2024-08-03] 2024-08-03 hour 2: 123183 events in 0 files, snapshot none (task 4658 ms: download 2632 ms overlapping gunzip 658 ms, parse 2728 ms, sort 0 ms, write 0 ms, index 462 ms: 4 candidates, 49112 repo-hours, 617 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:17:06Z [load_day 2024-08-03] 2024-08-03 hour 3: 149115 events in 0 files, snapshot none (task 4885 ms: download 3113 ms overlapping gunzip 697 ms, parse 2963 ms, sort 0 ms, write 0 ms, index 426 ms: 3 candidates, 60525 repo-hours, 5261 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:17:10Z [load_day 2024-08-03] 2024-08-03 hour 4: 120614 events in 0 files, snapshot none (task 4212 ms: download 2853 ms overlapping gunzip 529 ms, parse 2266 ms, sort 0 ms, write 0 ms, index 500 ms: 3 candidates, 46832 repo-hours, 453 releases; waiting 594 ms; commit 0 ms)
2026-11-08T07:17:12Z [load_day 2024-08-03] 2024-08-03 hour 5: 130645 events in 0 files, snapshot none (task 5321 ms: download 2343 ms overlapping gunzip 757 ms, parse 3132 ms, sort 0 ms, write 0 ms, index 653 ms: 5 candidates, 49938 repo-hours, 625 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:17:16Z [load_day 2024-08-03] 2024-08-03 hour 6: 154424 events in 0 files, snapshot none (task 5706 ms: download 3051 ms overlapping gunzip 835 ms, parse 3541 ms, sort 0 ms, write 0 ms, index 553 ms: 2 candidates, 68640 repo-hours, 945 releases; waiting 473 ms; commit 0 ms)
2026-11-08T07:17:17Z [load_day 2024-08-03] 2024-08-03 hour 7: 145051 events in 0 files, snapshot none (task 5019 ms: download 2598 ms overlapping gunzip 813 ms, parse 3369 ms, sort 0 ms, write 0 ms, index 390 ms: 6 candidates, 55172 repo-hours, 782 releases; waiting 208 ms; commit 0 ms)
2026-11-08T07:17:22Z [load_day 2024-08-03] 2024-08-03 hour 8: 152808 events in 0 files, snapshot none (task 5333 ms: download 3173 ms overlapping gunzip 767 ms, parse 3200 ms, sort 0 ms, write 0 ms, index 496 ms: 8 candidates, 60026 repo-hours, 800 releases; waiting 562 ms; commit 0 ms)
2026-11-08T07:17:23Z [load_day 2024-08-03] 2024-08-03 hour 9: 159814 events in 0 files, snapshot none (task 5433 ms: download 2919 ms overlapping gunzip 787 ms, parse 3346 ms, sort 0 ms, write 0 ms, index 501 ms: 3 candidates, 67282 repo-hours, 960 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:17:27Z [load_day 2024-08-03] 2024-08-03 hour 10: 157785 events in 0 files, snapshot none (task 4991 ms: download 2085 ms overlapping gunzip 603 ms, parse 2645 ms, sort 0 ms, write 0 ms, index 765 ms: 3 candidates, 61067 repo-hours, 775 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:17:28Z [load_day 2024-08-03] 2024-08-03 hour 11: 151778 events in 0 files, snapshot none (task 4451 ms: download 2171 ms overlapping gunzip 579 ms, parse 2460 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 56617 repo-hours, 716 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:17:34Z [load_day 2024-08-03] 2024-08-03 hour 12: 230621 events in 0 files, snapshot none (task 5607 ms: download 2658 ms overlapping gunzip 687 ms, parse 3493 ms, sort 0 ms, write 0 ms, index 732 ms: 6 candidates, 105197 repo-hours, 890 releases; waiting 472 ms; commit 0 ms)
2026-11-08T07:17:35Z [load_day 2024-08-03] 2024-08-03 hour 13: 181464 events in 0 files, snapshot none (task 5628 ms: download 3935 ms overlapping gunzip 665 ms, parse 2926 ms, sort 0 ms, write 0 ms, index 656 ms: 8 candidates, 83686 repo-hours, 672 releases; waiting 895 ms; commit 0 ms)
2026-11-08T07:17:40Z [load_day 2024-08-03] 2024-08-03 hour 14: 164613 events in 0 files, snapshot none (task 5898 ms: download 2969 ms overlapping gunzip 851 ms, parse 3615 ms, sort 0 ms, write 0 ms, index 657 ms: 4 candidates, 66246 repo-hours, 722 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:17:41Z [load_day 2024-08-03] 2024-08-03 hour 15: 173292 events in 0 files, snapshot none (task 5571 ms: download 3071 ms overlapping gunzip 775 ms, parse 3408 ms, sort 0 ms, write 0 ms, index 579 ms: 4 candidates, 76565 repo-hours, 945 releases; waiting 468 ms; commit 0 ms)
2026-11-08T07:17:46Z [load_day 2024-08-03] 2024-08-03 hour 16: 162268 events in 0 files, snapshot none (task 5696 ms: download 2988 ms overlapping gunzip 805 ms, parse 3552 ms, sort 0 ms, write 0 ms, index 594 ms: 5 candidates, 67125 repo-hours, 720 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:17:47Z [load_day 2024-08-03] 2024-08-03 hour 17: 158167 events in 0 files, snapshot none (task 5058 ms: download 2651 ms overlapping gunzip 724 ms, parse 3151 ms, sort 0 ms, write 0 ms, index 426 ms: 5 candidates, 63605 repo-hours, 796 releases; waiting 462 ms; commit 0 ms)
2026-11-08T07:17:52Z [load_day 2024-08-03] 2024-08-03 hour 18: 171437 events in 0 files, snapshot none (task 5072 ms: download 2319 ms overlapping gunzip 665 ms, parse 2966 ms, sort 0 ms, write 0 ms, index 676 ms: 3 candidates, 80326 repo-hours, 850 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:17:52Z [load_day 2024-08-03] 2024-08-03 hour 19: 146827 events in 0 files, snapshot none (task 4123 ms: download 2434 ms overlapping gunzip 562 ms, parse 2466 ms, sort 0 ms, write 0 ms, index 403 ms: 9 candidates, 55491 repo-hours, 696 releases; waiting 376 ms; commit 0 ms)
2026-11-08T07:17:56Z [load_day 2024-08-03] 2024-08-03 hour 20: 147524 events in 0 files, snapshot none (task 4277 ms: download 1988 ms overlapping gunzip 604 ms, parse 2560 ms, sort 0 ms, write 0 ms, index 377 ms: 6 candidates, 55453 repo-hours, 687 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:17:56Z [load_day 2024-08-03] 2024-08-03 hour 21: 152293 events in 0 files, snapshot none (task 4156 ms: download 1980 ms overlapping gunzip 554 ms, parse 2394 ms, sort 0 ms, write 0 ms, index 453 ms: 7 candidates, 60721 repo-hours, 796 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:18:00Z [load_day 2024-08-03] 2024-08-03 hour 22: 125021 events in 0 files, snapshot none (task 3589 ms: download 1878 ms overlapping gunzip 458 ms, parse 2021 ms, sort 0 ms, write 0 ms, index 333 ms: 6 candidates, 44049 repo-hours, 752 releases; waiting 485 ms; commit 0 ms)
2026-11-08T07:18:00Z [load_day 2024-08-03] 2024-08-03 hour 23: 115867 events in 0 files, snapshot none (task 3349 ms: download 1825 ms overlapping gunzip 401 ms, parse 1849 ms, sort 0 ms, write 0 ms, index 327 ms: 3 candidates, 42271 repo-hours, 565 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:18:07Z [load_day 2024-08-03] 2024-08-03: repo_hour merged from 24 files to 1 (1559163 rows, 6857 ms)
2026-11-08T07:18:10Z [load_day 2024-08-03] 2024-08-03: index committed in 9820 ms (24 + 1 + 24 files)
2026-11-08T07:18:10Z [load_day 2024-08-03] 2024-08-03: 3704072 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:18:10Z [load_day 2024-08-03] attempt 1 succeeded