orcaLog in

Runs · run 2261

load_day 2024-03-31, attempt 1 succeeded

Host
73ccef5e07c2:103761
Started
2026-11-08T05:23:13Z
Ended
2026-11-08T05:24:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
591 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
107.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2261/load_day/2024-03-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:23:13Z [load_day 2024-03-31] attempt 1 started
2026-11-08T05:23:14Z [load_day 2024-03-31] 2024-03-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:23:19Z [load_day 2024-03-31] 2024-03-31 hour 0: 174363 events in 0 files, snapshot none (task 4411 ms: download 2411 ms overlapping gunzip 581 ms, parse 2482 ms, sort 0 ms, write 0 ms, index 805 ms: 4 candidates, 76496 repo-hours, 1067 releases; waiting 265 ms; commit 0 ms)
2026-11-08T05:23:19Z [load_day 2024-03-31] 2024-03-31 hour 1: 179497 events in 0 files, snapshot none (task 4855 ms: download 2107 ms overlapping gunzip 576 ms, parse 2705 ms, sort 0 ms, write 0 ms, index 815 ms: 6 candidates, 85388 repo-hours, 714 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:23:23Z [load_day 2024-03-31] 2024-03-31 hour 2: 145763 events in 0 files, snapshot none (task 3877 ms: download 1683 ms overlapping gunzip 517 ms, parse 2265 ms, sort 0 ms, write 0 ms, index 489 ms: 6 candidates, 46839 repo-hours, 548 releases; waiting 311 ms; commit 0 ms)
2026-11-08T05:23:23Z [load_day 2024-03-31] 2024-03-31 hour 3: 144433 events in 0 files, snapshot none (task 3951 ms: download 1752 ms overlapping gunzip 475 ms, parse 2151 ms, sort 0 ms, write 0 ms, index 556 ms: 3 candidates, 45996 repo-hours, 653 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:23:28Z [load_day 2024-03-31] 2024-03-31 hour 4: 144881 events in 0 files, snapshot none (task 4171 ms: download 1936 ms overlapping gunzip 578 ms, parse 2444 ms, sort 0 ms, write 0 ms, index 426 ms: 7 candidates, 46699 repo-hours, 517 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:23:28Z [load_day 2024-03-31] 2024-03-31 hour 5: 149103 events in 0 files, snapshot none (task 4215 ms: download 1933 ms overlapping gunzip 668 ms, parse 2673 ms, sort 0 ms, write 0 ms, index 433 ms: 3 candidates, 48618 repo-hours, 553 releases; waiting 192 ms; commit 0 ms)
2026-11-08T05:23:34Z [load_day 2024-03-31] 2024-03-31 hour 6: 158975 events in 0 files, snapshot none (task 5678 ms: download 2532 ms overlapping gunzip 816 ms, parse 3527 ms, sort 0 ms, write 0 ms, index 543 ms: 3 candidates, 57131 repo-hours, 640 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:23:34Z [load_day 2024-03-31] 2024-03-31 hour 7: 156758 events in 0 files, snapshot none (task 5478 ms: download 2089 ms overlapping gunzip 759 ms, parse 3445 ms, sort 0 ms, write 0 ms, index 567 ms: 9 candidates, 53981 repo-hours, 565 releases; waiting 422 ms; commit 0 ms)
2026-11-08T05:23:40Z [load_day 2024-03-31] 2024-03-31 hour 8: 169647 events in 0 files, snapshot none (task 5012 ms: download 2035 ms overlapping gunzip 745 ms, parse 3161 ms, sort 0 ms, write 0 ms, index 410 ms: 9 candidates, 58706 repo-hours, 618 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:23:40Z [load_day 2024-03-31] 2024-03-31 hour 9: 171527 events in 0 files, snapshot none (task 5057 ms: download 2587 ms overlapping gunzip 698 ms, parse 3108 ms, sort 0 ms, write 0 ms, index 409 ms: 8 candidates, 59629 repo-hours, 706 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:23:45Z [load_day 2024-03-31] 2024-03-31 hour 10: 173017 events in 0 files, snapshot none (task 5138 ms: download 2593 ms overlapping gunzip 676 ms, parse 3003 ms, sort 0 ms, write 0 ms, index 500 ms: 7 candidates, 61823 repo-hours, 633 releases; waiting 645 ms; commit 0 ms)
2026-11-08T05:23:45Z [load_day 2024-03-31] 2024-03-31 hour 11: 173496 events in 0 files, snapshot none (task 4614 ms: download 2412 ms overlapping gunzip 609 ms, parse 2701 ms, sort 0 ms, write 0 ms, index 502 ms: 5 candidates, 63251 repo-hours, 727 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:23:52Z [load_day 2024-03-31] 2024-03-31 hour 12: 257224 events in 0 files, snapshot none (task 6177 ms: download 2628 ms overlapping gunzip 794 ms, parse 3900 ms, sort 0 ms, write 0 ms, index 630 ms: 4 candidates, 97397 repo-hours, 768 releases; waiting 573 ms; commit 0 ms)
2026-11-08T05:23:52Z [load_day 2024-03-31] 2024-03-31 hour 13: 205295 events in 0 files, snapshot none (task 5287 ms: download 2444 ms overlapping gunzip 696 ms, parse 3109 ms, sort 0 ms, write 0 ms, index 738 ms: 5 candidates, 85465 repo-hours, 820 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:23:58Z [load_day 2024-03-31] 2024-03-31 hour 14: 204110 events in 0 files, snapshot none (task 5639 ms: download 3652 ms overlapping gunzip 838 ms, parse 3507 ms, sort 0 ms, write 0 ms, index 529 ms: 3 candidates, 72757 repo-hours, 940 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:23:58Z [load_day 2024-03-31] 2024-03-31 hour 15: 203748 events in 0 files, snapshot none (task 5910 ms: download 3401 ms overlapping gunzip 806 ms, parse 3745 ms, sort 0 ms, write 0 ms, index 517 ms: 9 candidates, 70462 repo-hours, 920 releases; waiting 542 ms; commit 0 ms)
2026-11-08T05:24:04Z [load_day 2024-03-31] 2024-03-31 hour 16: 199912 events in 0 files, snapshot none (task 5471 ms: download 3057 ms overlapping gunzip 779 ms, parse 3388 ms, sort 0 ms, write 0 ms, index 504 ms: 7 candidates, 67958 repo-hours, 911 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:24:04Z [load_day 2024-03-31] 2024-03-31 hour 17: 191963 events in 0 files, snapshot none (task 5028 ms: download 2626 ms overlapping gunzip 723 ms, parse 3072 ms, sort 0 ms, write 0 ms, index 495 ms: 4 candidates, 67427 repo-hours, 808 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:24:09Z [load_day 2024-03-31] 2024-03-31 hour 18: 198699 events in 0 files, snapshot none (task 4604 ms: download 2604 ms overlapping gunzip 597 ms, parse 2701 ms, sort 0 ms, write 0 ms, index 534 ms: 6 candidates, 72327 repo-hours, 923 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:24:09Z [load_day 2024-03-31] 2024-03-31 hour 19: 183359 events in 0 files, snapshot none (task 4278 ms: download 2386 ms overlapping gunzip 569 ms, parse 2501 ms, sort 0 ms, write 0 ms, index 436 ms: 6 candidates, 61867 repo-hours, 744 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:24:15Z [load_day 2024-03-31] 2024-03-31 hour 20: 179825 events in 0 files, snapshot none (task 5493 ms: download 2353 ms overlapping gunzip 903 ms, parse 3604 ms, sort 0 ms, write 0 ms, index 433 ms: 6 candidates, 57551 repo-hours, 757 releases; waiting 273 ms; commit 0 ms)
2026-11-08T05:24:15Z [load_day 2024-03-31] 2024-03-31 hour 21: 171931 events in 0 files, snapshot none (task 5597 ms: download 2503 ms overlapping gunzip 838 ms, parse 3479 ms, sort 0 ms, write 0 ms, index 505 ms: 8 candidates, 52722 repo-hours, 846 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:24:20Z [load_day 2024-03-31] 2024-03-31 hour 22: 161083 events in 0 files, snapshot none (task 4546 ms: download 2123 ms overlapping gunzip 618 ms, parse 2654 ms, sort 0 ms, write 0 ms, index 426 ms: 4 candidates, 48673 repo-hours, 719 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:24:20Z [load_day 2024-03-31] 2024-03-31 hour 23: 155749 events in 0 files, snapshot none (task 4024 ms: download 1726 ms overlapping gunzip 594 ms, parse 2553 ms, sort 0 ms, write 0 ms, index 412 ms: 3 candidates, 47428 repo-hours, 582 releases; waiting 199 ms; commit 0 ms)
2026-11-08T05:24:27Z [load_day 2024-03-31] 2024-03-31: repo_hour merged from 24 files to 1 (1506591 rows, 7006 ms)
2026-11-08T05:24:29Z [load_day 2024-03-31] 2024-03-31: index committed in 9426 ms (24 + 1 + 24 files)
2026-11-08T05:24:29Z [load_day 2024-03-31] 2024-03-31: 4254358 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:24:29Z [load_day 2024-03-31] attempt 1 succeeded