orcaLog in

Runs · run 2828

load_day 2024-08-11, attempt 1 succeeded

Host
73ccef5e07c2:162319
Started
2026-11-08T07:24:04Z
Ended
2026-11-08T07:25:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
613 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
105.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2828/load_day/2024-08-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:24:04Z [load_day 2024-08-11] attempt 1 started
2026-11-08T07:24:05Z [load_day 2024-08-11] 2024-08-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:24:10Z [load_day 2024-08-11] 2024-08-11 hour 0: 130635 events in 0 files, snapshot none (task 4618 ms: download 2402 ms overlapping gunzip 535 ms, parse 2600 ms, sort 0 ms, write 0 ms, index 602 ms: 5 candidates, 68848 repo-hours, 1004 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:24:10Z [load_day 2024-08-11] 2024-08-11 hour 1: 146627 events in 0 files, snapshot none (task 4704 ms: download 2053 ms overlapping gunzip 606 ms, parse 2718 ms, sort 0 ms, write 0 ms, index 617 ms: 12 candidates, 83149 repo-hours, 756 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:24:15Z [load_day 2024-08-11] 2024-08-11 hour 2: 124232 events in 0 files, snapshot none (task 4474 ms: download 1932 ms overlapping gunzip 509 ms, parse 2252 ms, sort 0 ms, write 0 ms, index 951 ms: 8 candidates, 53175 repo-hours, 696 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:24:16Z [load_day 2024-08-11] 2024-08-11 hour 3: 142015 events in 0 files, snapshot none (task 5284 ms: download 2363 ms overlapping gunzip 663 ms, parse 3117 ms, sort 0 ms, write 0 ms, index 668 ms: 3 candidates, 57505 repo-hours, 5332 releases; waiting 547 ms; commit 0 ms)
2026-11-08T07:24:20Z [load_day 2024-08-11] 2024-08-11 hour 4: 118241 events in 0 files, snapshot none (task 4425 ms: download 2262 ms overlapping gunzip 534 ms, parse 2433 ms, sort 0 ms, write 0 ms, index 677 ms: 8 candidates, 44664 repo-hours, 485 releases; waiting 428 ms; commit 0 ms)
2026-11-08T07:24:21Z [load_day 2024-08-11] 2024-08-11 hour 5: 123401 events in 0 files, snapshot none (task 5096 ms: download 2802 ms overlapping gunzip 671 ms, parse 3004 ms, sort 0 ms, write 0 ms, index 360 ms: 5 candidates, 47543 repo-hours, 636 releases; waiting 785 ms; commit 0 ms)
2026-11-08T07:24:25Z [load_day 2024-08-11] 2024-08-11 hour 6: 146612 events in 0 files, snapshot none (task 4023 ms: download 1840 ms overlapping gunzip 500 ms, parse 2180 ms, sort 0 ms, write 0 ms, index 539 ms: 8 candidates, 66117 repo-hours, 726 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:24:26Z [load_day 2024-08-11] 2024-08-11 hour 7: 135217 events in 0 files, snapshot none (task 3770 ms: download 2266 ms overlapping gunzip 473 ms, parse 2038 ms, sort 0 ms, write 0 ms, index 390 ms: 5 candidates, 52998 repo-hours, 527 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:24:29Z [load_day 2024-08-11] 2024-08-11 hour 8: 146723 events in 0 files, snapshot none (task 3939 ms: download 1969 ms overlapping gunzip 507 ms, parse 2250 ms, sort 0 ms, write 0 ms, index 438 ms: 5 candidates, 58839 repo-hours, 700 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:24:31Z [load_day 2024-08-11] 2024-08-11 hour 9: 159925 events in 0 files, snapshot none (task 4443 ms: download 1988 ms overlapping gunzip 566 ms, parse 2472 ms, sort 0 ms, write 0 ms, index 618 ms: 7 candidates, 66087 repo-hours, 810 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:24:33Z [load_day 2024-08-11] 2024-08-11 hour 10: 150571 events in 0 files, snapshot none (task 3628 ms: download 1773 ms overlapping gunzip 499 ms, parse 2185 ms, sort 0 ms, write 0 ms, index 454 ms: 8 candidates, 59825 repo-hours, 647 releases; waiting 192 ms; commit 0 ms)
2026-11-08T07:24:36Z [load_day 2024-08-11] 2024-08-11 hour 11: 153247 events in 0 files, snapshot none (task 4524 ms: download 2537 ms overlapping gunzip 533 ms, parse 2359 ms, sort 0 ms, write 0 ms, index 799 ms: 5 candidates, 58043 repo-hours, 628 releases; waiting 543 ms; commit 0 ms)
2026-11-08T07:24:40Z [load_day 2024-08-11] 2024-08-11 hour 12: 221943 events in 0 files, snapshot none (task 6348 ms: download 3828 ms overlapping gunzip 759 ms, parse 4116 ms, sort 0 ms, write 0 ms, index 722 ms: 10 candidates, 105594 repo-hours, 898 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:24:41Z [load_day 2024-08-11] 2024-08-11 hour 13: 180593 events in 0 files, snapshot none (task 5300 ms: download 2866 ms overlapping gunzip 744 ms, parse 3210 ms, sort 0 ms, write 0 ms, index 602 ms: 7 candidates, 87037 repo-hours, 794 releases; waiting 427 ms; commit 0 ms)
2026-11-08T07:24:46Z [load_day 2024-08-11] 2024-08-11 hour 14: 167794 events in 0 files, snapshot none (task 5337 ms: download 2535 ms overlapping gunzip 707 ms, parse 3208 ms, sort 0 ms, write 0 ms, index 637 ms: 5 candidates, 69649 repo-hours, 790 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:24:47Z [load_day 2024-08-11] 2024-08-11 hour 15: 178920 events in 0 files, snapshot none (task 5329 ms: download 2794 ms overlapping gunzip 756 ms, parse 3227 ms, sort 0 ms, write 0 ms, index 614 ms: 3 candidates, 79409 repo-hours, 1103 releases; waiting 458 ms; commit 0 ms)
2026-11-08T07:24:52Z [load_day 2024-08-11] 2024-08-11 hour 16: 169544 events in 0 files, snapshot none (task 5923 ms: download 3416 ms overlapping gunzip 792 ms, parse 3567 ms, sort 0 ms, write 0 ms, index 670 ms: 4 candidates, 69872 repo-hours, 998 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:24:53Z [load_day 2024-08-11] 2024-08-11 hour 17: 161340 events in 0 files, snapshot none (task 5728 ms: download 3074 ms overlapping gunzip 833 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 453 ms: 9 candidates, 63494 repo-hours, 811 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:24:58Z [load_day 2024-08-11] 2024-08-11 hour 18: 176840 events in 0 files, snapshot none (task 5628 ms: download 2369 ms overlapping gunzip 753 ms, parse 3416 ms, sort 0 ms, write 0 ms, index 669 ms: 13 candidates, 78951 repo-hours, 902 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:25:00Z [load_day 2024-08-11] 2024-08-11 hour 19: 150983 events in 0 files, snapshot none (task 6661 ms: download 3735 ms overlapping gunzip 906 ms, parse 3690 ms, sort 0 ms, write 0 ms, index 867 ms: 15 candidates, 55801 repo-hours, 671 releases; waiting 855 ms; commit 0 ms)
2026-11-08T07:25:05Z [load_day 2024-08-11] 2024-08-11 hour 20: 152348 events in 0 files, snapshot none (task 5979 ms: download 3476 ms overlapping gunzip 833 ms, parse 3788 ms, sort 0 ms, write 0 ms, index 522 ms: 2 candidates, 56947 repo-hours, 771 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:25:06Z [load_day 2024-08-11] 2024-08-11 hour 21: 149093 events in 0 files, snapshot none (task 4549 ms: download 2711 ms overlapping gunzip 707 ms, parse 2895 ms, sort 0 ms, write 0 ms, index 436 ms: 4 candidates, 57983 repo-hours, 1039 releases; waiting 199 ms; commit 0 ms)
2026-11-08T07:25:10Z [load_day 2024-08-11] 2024-08-11 hour 22: 133182 events in 0 files, snapshot none (task 4965 ms: download 1943 ms overlapping gunzip 722 ms, parse 3011 ms, sort 0 ms, write 0 ms, index 481 ms: 9 candidates, 51660 repo-hours, 740 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:25:11Z [load_day 2024-08-11] 2024-08-11 hour 23: 124462 events in 0 files, snapshot none (task 4668 ms: download 1866 ms overlapping gunzip 684 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 350 ms: 5 candidates, 45203 repo-hours, 544 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:25:18Z [load_day 2024-08-11] 2024-08-11: repo_hour merged from 24 files to 1 (1538393 rows, 7110 ms)
2026-11-08T07:25:21Z [load_day 2024-08-11] 2024-08-11: index committed in 9976 ms (24 + 1 + 24 files)
2026-11-08T07:25:21Z [load_day 2024-08-11] 2024-08-11: 3644488 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:25:21Z [load_day 2024-08-11] attempt 1 succeeded