orcaLog in

Runs · run 3048

load_day 2024-10-06, attempt 1 succeeded

Host
73ccef5e07c2:188157
Started
2026-11-08T08:13:49Z
Ended
2026-11-08T08:15:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
690 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
104.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3048/load_day/2024-10-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:13:49Z [load_day 2024-10-06] attempt 1 started
2026-11-08T08:13:49Z [load_day 2024-10-06] 2024-10-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:13:54Z [load_day 2024-10-06] 2024-10-06 hour 0: 139910 events in 0 files, snapshot none (task 4254 ms: download 2360 ms overlapping gunzip 569 ms, parse 2366 ms, sort 0 ms, write 0 ms, index 544 ms: 5 candidates, 67701 repo-hours, 982 releases; waiting 487 ms; commit 0 ms)
2026-11-08T08:13:55Z [load_day 2024-10-06] 2024-10-06 hour 1: 158622 events in 0 files, snapshot none (task 4667 ms: download 2508 ms overlapping gunzip 620 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 617 ms: 3 candidates, 89666 repo-hours, 738 releases; waiting 378 ms; commit 0 ms)
2026-11-08T08:13:58Z [load_day 2024-10-06] 2024-10-06 hour 2: 123927 events in 0 files, snapshot none (task 3906 ms: download 2121 ms overlapping gunzip 516 ms, parse 2061 ms, sort 0 ms, write 0 ms, index 559 ms: 5 candidates, 55879 repo-hours, 594 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:13:59Z [load_day 2024-10-06] 2024-10-06 hour 3: 146539 events in 0 files, snapshot none (task 4378 ms: download 2140 ms overlapping gunzip 636 ms, parse 2518 ms, sort 0 ms, write 0 ms, index 459 ms: 3 candidates, 58324 repo-hours, 3739 releases; waiting 496 ms; commit 0 ms)
2026-11-08T08:14:02Z [load_day 2024-10-06] 2024-10-06 hour 4: 131760 events in 0 files, snapshot none (task 3513 ms: download 1687 ms overlapping gunzip 374 ms, parse 1537 ms, sort 0 ms, write 0 ms, index 829 ms: 4 candidates, 49259 repo-hours, 730 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:14:03Z [load_day 2024-10-06] 2024-10-06 hour 5: 140961 events in 0 files, snapshot none (task 3481 ms: download 1620 ms overlapping gunzip 395 ms, parse 1677 ms, sort 0 ms, write 0 ms, index 652 ms: 2 candidates, 52452 repo-hours, 705 releases; waiting 502 ms; commit 0 ms)
2026-11-08T08:14:07Z [load_day 2024-10-06] 2024-10-06 hour 6: 164082 events in 0 files, snapshot none (task 4027 ms: download 2077 ms overlapping gunzip 518 ms, parse 2140 ms, sort 0 ms, write 0 ms, index 545 ms: 3 candidates, 70713 repo-hours, 758 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:14:08Z [load_day 2024-10-06] 2024-10-06 hour 7: 156828 events in 0 files, snapshot none (task 4184 ms: download 1726 ms overlapping gunzip 574 ms, parse 2298 ms, sort 0 ms, write 0 ms, index 833 ms: 5 candidates, 58766 repo-hours, 577 releases; waiting 180 ms; commit 0 ms)
2026-11-08T08:14:12Z [load_day 2024-10-06] 2024-10-06 hour 8: 161439 events in 0 files, snapshot none (task 4047 ms: download 2172 ms overlapping gunzip 535 ms, parse 2117 ms, sort 0 ms, write 0 ms, index 524 ms: 5 candidates, 63296 repo-hours, 666 releases; waiting 562 ms; commit 0 ms)
2026-11-08T08:14:13Z [load_day 2024-10-06] 2024-10-06 hour 9: 175695 events in 0 files, snapshot none (task 4431 ms: download 1892 ms overlapping gunzip 556 ms, parse 2422 ms, sort 0 ms, write 0 ms, index 665 ms: 7 candidates, 70349 repo-hours, 857 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:14:16Z [load_day 2024-10-06] 2024-10-06 hour 10: 169546 events in 0 files, snapshot none (task 4013 ms: download 2335 ms overlapping gunzip 492 ms, parse 2098 ms, sort 0 ms, write 0 ms, index 568 ms: 5 candidates, 65173 repo-hours, 784 releases; waiting 503 ms; commit 0 ms)
2026-11-08T08:14:17Z [load_day 2024-10-06] 2024-10-06 hour 11: 169733 events in 0 files, snapshot none (task 3793 ms: download 1974 ms overlapping gunzip 513 ms, parse 2090 ms, sort 0 ms, write 0 ms, index 447 ms: 7 candidates, 63255 repo-hours, 695 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:14:22Z [load_day 2024-10-06] 2024-10-06 hour 12: 228936 events in 0 files, snapshot none (task 4831 ms: download 2505 ms overlapping gunzip 604 ms, parse 2721 ms, sort 0 ms, write 0 ms, index 738 ms: 8 candidates, 111478 repo-hours, 871 releases; waiting 506 ms; commit 0 ms)
2026-11-08T08:14:22Z [load_day 2024-10-06] 2024-10-06 hour 13: 208866 events in 0 files, snapshot none (task 4616 ms: download 2677 ms overlapping gunzip 625 ms, parse 2634 ms, sort 0 ms, write 0 ms, index 643 ms: 9 candidates, 92102 repo-hours, 797 releases; waiting 401 ms; commit 0 ms)
2026-11-08T08:14:27Z [load_day 2024-10-06] 2024-10-06 hour 14: 193217 events in 0 files, snapshot none (task 4807 ms: download 3821 ms overlapping gunzip 588 ms, parse 2363 ms, sort 0 ms, write 0 ms, index 563 ms: 4 candidates, 75476 repo-hours, 898 releases; waiting 1012 ms; commit 0 ms)
2026-11-08T08:14:27Z [load_day 2024-10-06] 2024-10-06 hour 15: 203490 events in 0 files, snapshot none (task 4409 ms: download 2642 ms overlapping gunzip 761 ms, parse 2649 ms, sort 0 ms, write 0 ms, index 566 ms: 10 candidates, 83839 repo-hours, 1044 releases; waiting 209 ms; commit 0 ms)
2026-11-08T08:14:34Z [load_day 2024-10-06] 2024-10-06 hour 16: 203579 events in 0 files, snapshot none (task 6473 ms: download 3808 ms overlapping gunzip 1128 ms, parse 4009 ms, sort 0 ms, write 0 ms, index 607 ms: 4 candidates, 76997 repo-hours, 873 releases; waiting 410 ms; commit 0 ms)
2026-11-08T08:14:34Z [load_day 2024-10-06] 2024-10-06 hour 17: 193295 events in 0 files, snapshot none (task 5739 ms: download 3116 ms overlapping gunzip 901 ms, parse 3404 ms, sort 0 ms, write 0 ms, index 558 ms: 7 candidates, 71241 repo-hours, 903 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:14:40Z [load_day 2024-10-06] 2024-10-06 hour 18: 208209 events in 0 files, snapshot none (task 5727 ms: download 2798 ms overlapping gunzip 814 ms, parse 3454 ms, sort 0 ms, write 0 ms, index 681 ms: 6 candidates, 88547 repo-hours, 957 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:14:40Z [load_day 2024-10-06] 2024-10-06 hour 19: 187508 events in 0 files, snapshot none (task 5937 ms: download 3753 ms overlapping gunzip 903 ms, parse 3609 ms, sort 0 ms, write 0 ms, index 572 ms: 7 candidates, 64951 repo-hours, 928 releases; waiting 484 ms; commit 0 ms)
2026-11-08T08:14:46Z [load_day 2024-10-06] 2024-10-06 hour 20: 177804 events in 0 files, snapshot none (task 5911 ms: download 2594 ms overlapping gunzip 878 ms, parse 3659 ms, sort 0 ms, write 0 ms, index 607 ms: 3 candidates, 63773 repo-hours, 939 releases; waiting 494 ms; commit 0 ms)
2026-11-08T08:14:47Z [load_day 2024-10-06] 2024-10-06 hour 21: 174989 events in 0 files, snapshot none (task 6193 ms: download 2872 ms overlapping gunzip 974 ms, parse 3931 ms, sort 0 ms, write 0 ms, index 453 ms: 9 candidates, 62892 repo-hours, 1003 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:14:51Z [load_day 2024-10-06] 2024-10-06 hour 22: 151834 events in 0 files, snapshot none (task 4048 ms: download 2009 ms overlapping gunzip 578 ms, parse 2350 ms, sort 0 ms, write 0 ms, index 460 ms: 6 candidates, 51225 repo-hours, 920 releases; waiting 363 ms; commit 0 ms)
2026-11-08T08:14:52Z [load_day 2024-10-06] 2024-10-06 hour 23: 145539 events in 0 files, snapshot none (task 4380 ms: download 2266 ms overlapping gunzip 571 ms, parse 2550 ms, sort 0 ms, write 0 ms, index 394 ms: 9 candidates, 48951 repo-hours, 881 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:14:59Z [load_day 2024-10-06] 2024-10-06: repo_hour merged from 24 files to 1 (1656305 rows, 7601 ms)
2026-11-08T08:15:02Z [load_day 2024-10-06] 2024-10-06: index committed in 10320 ms (24 + 1 + 24 files)
2026-11-08T08:15:02Z [load_day 2024-10-06] 2024-10-06: 4116308 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:15:02Z [load_day 2024-10-06] attempt 1 succeeded