orcaLog in

Runs · run 2823

load_day 2024-08-10, attempt 1 succeeded

Host
73ccef5e07c2:161833
Started
2026-11-08T07:23:15Z
Ended
2026-11-08T07:24:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
620 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
105.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2823/load_day/2024-08-10/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:23:15Z [load_day 2024-08-10] attempt 1 started
2026-11-08T07:23:15Z [load_day 2024-08-10] 2024-08-10: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:23:22Z [load_day 2024-08-10] 2024-08-10 hour 0: 151553 events in 0 files, snapshot none (task 6332 ms: download 3144 ms overlapping gunzip 911 ms, parse 3919 ms, sort 0 ms, write 0 ms, index 692 ms: 13 candidates, 78267 repo-hours, 1097 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:23:22Z [load_day 2024-08-10] 2024-08-10 hour 1: 158133 events in 0 files, snapshot none (task 5919 ms: download 2763 ms overlapping gunzip 823 ms, parse 3619 ms, sort 0 ms, write 0 ms, index 748 ms: 7 candidates, 89297 repo-hours, 797 releases; waiting 436 ms; commit 0 ms)
2026-11-08T07:23:28Z [load_day 2024-08-10] 2024-08-10 hour 2: 120712 events in 0 files, snapshot none (task 5365 ms: download 3035 ms overlapping gunzip 793 ms, parse 3349 ms, sort 0 ms, write 0 ms, index 435 ms: 10 candidates, 49716 repo-hours, 642 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:23:29Z [load_day 2024-08-10] 2024-08-10 hour 3: 143295 events in 0 files, snapshot none (task 5910 ms: download 3017 ms overlapping gunzip 941 ms, parse 3634 ms, sort 0 ms, write 0 ms, index 526 ms: 4 candidates, 59738 repo-hours, 5432 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:23:33Z [load_day 2024-08-10] 2024-08-10 hour 4: 126242 events in 0 files, snapshot none (task 4187 ms: download 2056 ms overlapping gunzip 561 ms, parse 2448 ms, sort 0 ms, write 0 ms, index 432 ms: 9 candidates, 47815 repo-hours, 568 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:23:34Z [load_day 2024-08-10] 2024-08-10 hour 5: 135976 events in 0 files, snapshot none (task 4312 ms: download 1940 ms overlapping gunzip 566 ms, parse 2480 ms, sort 0 ms, write 0 ms, index 417 ms: 7 candidates, 51350 repo-hours, 763 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:23:39Z [load_day 2024-08-10] 2024-08-10 hour 6: 158446 events in 0 files, snapshot none (task 5354 ms: download 3467 ms overlapping gunzip 708 ms, parse 3139 ms, sort 0 ms, write 0 ms, index 629 ms: 6 candidates, 70021 repo-hours, 986 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:23:39Z [load_day 2024-08-10] 2024-08-10 hour 7: 145805 events in 0 files, snapshot none (task 4984 ms: download 2366 ms overlapping gunzip 720 ms, parse 3081 ms, sort 0 ms, write 0 ms, index 414 ms: 6 candidates, 54558 repo-hours, 854 releases; waiting 475 ms; commit 0 ms)
2026-11-08T07:23:45Z [load_day 2024-08-10] 2024-08-10 hour 8: 146970 events in 0 files, snapshot none (task 5620 ms: download 3067 ms overlapping gunzip 761 ms, parse 3512 ms, sort 0 ms, write 0 ms, index 425 ms: 6 candidates, 58632 repo-hours, 800 releases; waiting 562 ms; commit 0 ms)
2026-11-08T07:23:45Z [load_day 2024-08-10] 2024-08-10 hour 9: 155775 events in 0 files, snapshot none (task 5617 ms: download 2657 ms overlapping gunzip 808 ms, parse 3546 ms, sort 0 ms, write 0 ms, index 464 ms: 2 candidates, 65437 repo-hours, 1116 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:23:50Z [load_day 2024-08-10] 2024-08-10 hour 10: 150798 events in 0 files, snapshot none (task 4617 ms: download 1868 ms overlapping gunzip 647 ms, parse 2893 ms, sort 0 ms, write 0 ms, index 552 ms: 2 candidates, 58635 repo-hours, 780 releases; waiting 195 ms; commit 0 ms)
2026-11-08T07:23:51Z [load_day 2024-08-10] 2024-08-10 hour 11: 144343 events in 0 files, snapshot none (task 4893 ms: download 2283 ms overlapping gunzip 662 ms, parse 3013 ms, sort 0 ms, write 0 ms, index 412 ms: 7 candidates, 55522 repo-hours, 734 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:23:56Z [load_day 2024-08-10] 2024-08-10 hour 12: 215822 events in 0 files, snapshot none (task 5337 ms: download 3580 ms overlapping gunzip 618 ms, parse 3017 ms, sort 0 ms, write 0 ms, index 714 ms: 8 candidates, 103448 repo-hours, 878 releases; waiting 647 ms; commit 0 ms)
2026-11-08T07:23:56Z [load_day 2024-08-10] 2024-08-10 hour 13: 177762 events in 0 files, snapshot none (task 5183 ms: download 3612 ms overlapping gunzip 588 ms, parse 2611 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 83478 repo-hours, 780 releases; waiting 951 ms; commit 0 ms)
2026-11-08T07:24:01Z [load_day 2024-08-10] 2024-08-10 hour 14: 166345 events in 0 files, snapshot none (task 4738 ms: download 3329 ms overlapping gunzip 622 ms, parse 2669 ms, sort 0 ms, write 0 ms, index 546 ms: 6 candidates, 66053 repo-hours, 770 releases; waiting 526 ms; commit 0 ms)
2026-11-08T07:24:01Z [load_day 2024-08-10] 2024-08-10 hour 15: 179261 events in 0 files, snapshot none (task 4636 ms: download 2185 ms overlapping gunzip 626 ms, parse 2682 ms, sort 0 ms, write 0 ms, index 587 ms: 3 candidates, 75514 repo-hours, 941 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:24:06Z [load_day 2024-08-10] 2024-08-10 hour 16: 166446 events in 0 files, snapshot none (task 4320 ms: download 2366 ms overlapping gunzip 567 ms, parse 2523 ms, sort 0 ms, write 0 ms, index 484 ms: 1 candidates, 65398 repo-hours, 749 releases; waiting 525 ms; commit 0 ms)
2026-11-08T07:24:06Z [load_day 2024-08-10] 2024-08-10 hour 17: 163334 events in 0 files, snapshot none (task 4264 ms: download 1995 ms overlapping gunzip 555 ms, parse 2593 ms, sort 0 ms, write 0 ms, index 435 ms: 4 candidates, 61256 repo-hours, 685 releases; waiting 384 ms; commit 0 ms)
2026-11-08T07:24:11Z [load_day 2024-08-10] 2024-08-10 hour 18: 170214 events in 0 files, snapshot none (task 5233 ms: download 2662 ms overlapping gunzip 713 ms, parse 3183 ms, sort 0 ms, write 0 ms, index 592 ms: 13 candidates, 75675 repo-hours, 834 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:24:11Z [load_day 2024-08-10] 2024-08-10 hour 19: 140818 events in 0 files, snapshot none (task 4865 ms: download 2342 ms overlapping gunzip 660 ms, parse 2860 ms, sort 0 ms, write 0 ms, index 511 ms: 11 candidates, 52678 repo-hours, 695 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:24:17Z [load_day 2024-08-10] 2024-08-10 hour 20: 137294 events in 0 files, snapshot none (task 4803 ms: download 2455 ms overlapping gunzip 660 ms, parse 2943 ms, sort 0 ms, write 0 ms, index 442 ms: 7 candidates, 52486 repo-hours, 702 releases; waiting 459 ms; commit 0 ms)
2026-11-08T07:24:17Z [load_day 2024-08-10] 2024-08-10 hour 21: 131648 events in 0 files, snapshot none (task 4896 ms: download 2370 ms overlapping gunzip 628 ms, parse 2977 ms, sort 0 ms, write 0 ms, index 495 ms: 6 candidates, 53802 repo-hours, 963 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:24:22Z [load_day 2024-08-10] 2024-08-10 hour 22: 114616 events in 0 files, snapshot none (task 4177 ms: download 2077 ms overlapping gunzip 572 ms, parse 2521 ms, sort 0 ms, write 0 ms, index 347 ms: 2 candidates, 43310 repo-hours, 761 releases; waiting 489 ms; commit 0 ms)
2026-11-08T07:24:22Z [load_day 2024-08-10] 2024-08-10 hour 23: 111385 events in 0 files, snapshot none (task 4086 ms: download 1838 ms overlapping gunzip 568 ms, parse 2421 ms, sort 0 ms, write 0 ms, index 336 ms: 3 candidates, 41464 repo-hours, 601 releases; waiting 480 ms; commit 0 ms)
2026-11-08T07:24:29Z [load_day 2024-08-10] 2024-08-10: repo_hour merged from 24 files to 1 (1513550 rows, 6768 ms)
2026-11-08T07:24:31Z [load_day 2024-08-10] 2024-08-10: index committed in 9082 ms (24 + 1 + 24 files)
2026-11-08T07:24:31Z [load_day 2024-08-10] 2024-08-10: 3612993 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:24:31Z [load_day 2024-08-10] attempt 1 succeeded