orcaLog in

Runs · run 2207

load_day 2024-03-17, attempt 1 succeeded

Host
73ccef5e07c2:98747
Started
2026-11-08T05:09:04Z
Ended
2026-11-08T05:10:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
636 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
111.0 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2207/load_day/2024-03-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:09:04Z [load_day 2024-03-17] attempt 1 started
2026-11-08T05:09:05Z [load_day 2024-03-17] 2024-03-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:09:11Z [load_day 2024-03-17] 2024-03-17 hour 0: 167134 events in 0 files, snapshot none (task 5962 ms: download 3270 ms overlapping gunzip 891 ms, parse 3555 ms, sort 0 ms, write 0 ms, index 668 ms: 5 candidates, 85914 repo-hours, 1047 releases; waiting 530 ms; commit 0 ms)
2026-11-08T05:09:11Z [load_day 2024-03-17] 2024-03-17 hour 1: 166530 events in 0 files, snapshot none (task 5653 ms: download 3373 ms overlapping gunzip 858 ms, parse 3262 ms, sort 0 ms, write 0 ms, index 666 ms: 4 candidates, 85446 repo-hours, 804 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:09:16Z [load_day 2024-03-17] 2024-03-17 hour 2: 118704 events in 0 files, snapshot none (task 4539 ms: download 2305 ms overlapping gunzip 645 ms, parse 2666 ms, sort 0 ms, write 0 ms, index 396 ms: 5 candidates, 46236 repo-hours, 630 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:09:17Z [load_day 2024-03-17] 2024-03-17 hour 3: 118356 events in 0 files, snapshot none (task 4514 ms: download 2388 ms overlapping gunzip 619 ms, parse 2632 ms, sort 0 ms, write 0 ms, index 441 ms: 3 candidates, 46487 repo-hours, 692 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:09:22Z [load_day 2024-03-17] 2024-03-17 hour 4: 122285 events in 0 files, snapshot none (task 4769 ms: download 2478 ms overlapping gunzip 706 ms, parse 2706 ms, sort 0 ms, write 0 ms, index 519 ms: 3 candidates, 48220 repo-hours, 466 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:09:23Z [load_day 2024-03-17] 2024-03-17 hour 5: 131372 events in 0 files, snapshot none (task 5814 ms: download 3123 ms overlapping gunzip 960 ms, parse 3571 ms, sort 0 ms, write 0 ms, index 489 ms: 2 candidates, 49811 repo-hours, 498 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:09:26Z [load_day 2024-03-17] 2024-03-17 hour 6: 138484 events in 0 files, snapshot none (task 3648 ms: download 2396 ms overlapping gunzip 459 ms, parse 1941 ms, sort 0 ms, write 0 ms, index 461 ms: 3 candidates, 57956 repo-hours, 643 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:09:28Z [load_day 2024-03-17] 2024-03-17 hour 7: 137475 events in 0 files, snapshot none (task 4544 ms: download 2941 ms overlapping gunzip 555 ms, parse 2274 ms, sort 0 ms, write 0 ms, index 678 ms: 6 candidates, 52693 repo-hours, 539 releases; waiting 640 ms; commit 0 ms)
2026-11-08T05:09:31Z [load_day 2024-03-17] 2024-03-17 hour 8: 140950 events in 0 files, snapshot none (task 4791 ms: download 2484 ms overlapping gunzip 633 ms, parse 2617 ms, sort 0 ms, write 0 ms, index 757 ms: 2 candidates, 57172 repo-hours, 610 releases; waiting 465 ms; commit 0 ms)
2026-11-08T05:09:33Z [load_day 2024-03-17] 2024-03-17 hour 9: 150781 events in 0 files, snapshot none (task 4421 ms: download 2371 ms overlapping gunzip 600 ms, parse 2467 ms, sort 0 ms, write 0 ms, index 471 ms: 7 candidates, 59753 repo-hours, 744 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:09:37Z [load_day 2024-03-17] 2024-03-17 hour 10: 153827 events in 0 files, snapshot none (task 5323 ms: download 2123 ms overlapping gunzip 738 ms, parse 3167 ms, sort 0 ms, write 0 ms, index 591 ms: 3 candidates, 63505 repo-hours, 662 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:09:38Z [load_day 2024-03-17] 2024-03-17 hour 11: 158443 events in 0 files, snapshot none (task 4918 ms: download 2594 ms overlapping gunzip 692 ms, parse 2890 ms, sort 0 ms, write 0 ms, index 474 ms: 2 candidates, 67932 repo-hours, 687 releases; waiting 538 ms; commit 0 ms)
2026-11-08T05:09:44Z [load_day 2024-03-17] 2024-03-17 hour 12: 248230 events in 0 files, snapshot none (task 6284 ms: download 3236 ms overlapping gunzip 819 ms, parse 4005 ms, sort 0 ms, write 0 ms, index 676 ms: 8 candidates, 107787 repo-hours, 859 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:09:45Z [load_day 2024-03-17] 2024-03-17 hour 13: 197342 events in 0 files, snapshot none (task 5913 ms: download 3322 ms overlapping gunzip 800 ms, parse 3712 ms, sort 0 ms, write 0 ms, index 647 ms: 4 candidates, 90876 repo-hours, 751 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:09:51Z [load_day 2024-03-17] 2024-03-17 hour 14: 183498 events in 0 files, snapshot none (task 6244 ms: download 3420 ms overlapping gunzip 939 ms, parse 3773 ms, sort 0 ms, write 0 ms, index 715 ms: 14 candidates, 76340 repo-hours, 818 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:09:52Z [load_day 2024-03-17] 2024-03-17 hour 15: 189286 events in 0 files, snapshot none (task 6441 ms: download 3654 ms overlapping gunzip 942 ms, parse 4110 ms, sort 0 ms, write 0 ms, index 656 ms: 4 candidates, 79402 repo-hours, 1036 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:09:56Z [load_day 2024-03-17] 2024-03-17 hour 16: 181380 events in 0 files, snapshot none (task 4932 ms: download 3369 ms overlapping gunzip 667 ms, parse 2817 ms, sort 0 ms, write 0 ms, index 598 ms: 11 candidates, 74104 repo-hours, 773 releases; waiting 582 ms; commit 0 ms)
2026-11-08T05:09:57Z [load_day 2024-03-17] 2024-03-17 hour 17: 177580 events in 0 files, snapshot none (task 4900 ms: download 2547 ms overlapping gunzip 610 ms, parse 2609 ms, sort 0 ms, write 0 ms, index 557 ms: 8 candidates, 70538 repo-hours, 720 releases; waiting 846 ms; commit 0 ms)
2026-11-08T05:10:01Z [load_day 2024-03-17] 2024-03-17 hour 18: 182162 events in 0 files, snapshot none (task 4721 ms: download 2298 ms overlapping gunzip 624 ms, parse 2737 ms, sort 0 ms, write 0 ms, index 563 ms: 7 candidates, 77210 repo-hours, 854 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:10:02Z [load_day 2024-03-17] 2024-03-17 hour 19: 171208 events in 0 files, snapshot none (task 4362 ms: download 2471 ms overlapping gunzip 570 ms, parse 2514 ms, sort 0 ms, write 0 ms, index 543 ms: 1 candidates, 69784 repo-hours, 817 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:10:08Z [load_day 2024-03-17] 2024-03-17 hour 20: 163079 events in 0 files, snapshot none (task 5948 ms: download 3220 ms overlapping gunzip 823 ms, parse 3464 ms, sort 0 ms, write 0 ms, index 730 ms: 5 candidates, 64608 repo-hours, 773 releases; waiting 573 ms; commit 0 ms)
2026-11-08T05:10:08Z [load_day 2024-03-17] 2024-03-17 hour 21: 159537 events in 0 files, snapshot none (task 5505 ms: download 2211 ms overlapping gunzip 796 ms, parse 3506 ms, sort 0 ms, write 0 ms, index 475 ms: 8 candidates, 59578 repo-hours, 1745 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:10:14Z [load_day 2024-03-17] 2024-03-17 hour 22: 148317 events in 0 files, snapshot none (task 5909 ms: download 2560 ms overlapping gunzip 805 ms, parse 3615 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 58519 repo-hours, 794 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:10:14Z [load_day 2024-03-17] 2024-03-17 hour 23: 132060 events in 0 files, snapshot none (task 5398 ms: download 3386 ms overlapping gunzip 716 ms, parse 2984 ms, sort 0 ms, write 0 ms, index 809 ms: 4 candidates, 51638 repo-hours, 673 releases; waiting 561 ms; commit 0 ms)
2026-11-08T05:10:22Z [load_day 2024-03-17] 2024-03-17: repo_hour merged from 24 files to 1 (1601509 rows, 7722 ms)
2026-11-08T05:10:24Z [load_day 2024-03-17] 2024-03-17: index committed in 10051 ms (24 + 1 + 24 files)
2026-11-08T05:10:24Z [load_day 2024-03-17] 2024-03-17: 3838020 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:10:24Z [load_day 2024-03-17] attempt 1 succeeded