orcaLog in

Runs · run 3023

load_day 2024-09-29, attempt 1 succeeded

Host
73ccef5e07c2:185215
Started
2026-11-08T08:08:32Z
Ended
2026-11-08T08:09:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
671 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
102.6 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3023/load_day/2024-09-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:08:32Z [load_day 2024-09-29] attempt 1 started
2026-11-08T08:08:33Z [load_day 2024-09-29] 2024-09-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:08:38Z [load_day 2024-09-29] 2024-09-29 hour 0: 148884 events in 0 files, snapshot none (task 4268 ms: download 3261 ms overlapping gunzip 528 ms, parse 2231 ms, sort 0 ms, write 0 ms, index 617 ms: 7 candidates, 69269 repo-hours, 1100 releases; waiting 631 ms; commit 0 ms)
2026-11-08T08:08:38Z [load_day 2024-09-29] 2024-09-29 hour 1: 173244 events in 0 files, snapshot none (task 4840 ms: download 2078 ms overlapping gunzip 597 ms, parse 2630 ms, sort 0 ms, write 0 ms, index 811 ms: 2 candidates, 95717 repo-hours, 837 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:08:42Z [load_day 2024-09-29] 2024-09-29 hour 2: 139766 events in 0 files, snapshot none (task 3978 ms: download 2351 ms overlapping gunzip 516 ms, parse 2069 ms, sort 0 ms, write 0 ms, index 596 ms: 4 candidates, 63667 repo-hours, 718 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:08:43Z [load_day 2024-09-29] 2024-09-29 hour 3: 160431 events in 0 files, snapshot none (task 4504 ms: download 2681 ms overlapping gunzip 592 ms, parse 2538 ms, sort 0 ms, write 0 ms, index 552 ms: 3 candidates, 63557 repo-hours, 3925 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:08:46Z [load_day 2024-09-29] 2024-09-29 hour 4: 137825 events in 0 files, snapshot none (task 3324 ms: download 1668 ms overlapping gunzip 485 ms, parse 1891 ms, sort 0 ms, write 0 ms, index 438 ms: 3 candidates, 49678 repo-hours, 552 releases; waiting 302 ms; commit 0 ms)
2026-11-08T08:08:47Z [load_day 2024-09-29] 2024-09-29 hour 5: 144530 events in 0 files, snapshot none (task 3372 ms: download 1937 ms overlapping gunzip 405 ms, parse 1694 ms, sort 0 ms, write 0 ms, index 404 ms: 6 candidates, 56312 repo-hours, 724 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:08:50Z [load_day 2024-09-29] 2024-09-29 hour 6: 176400 events in 0 files, snapshot none (task 3906 ms: download 1971 ms overlapping gunzip 503 ms, parse 2092 ms, sort 0 ms, write 0 ms, index 593 ms: 7 candidates, 77469 repo-hours, 787 releases; waiting 502 ms; commit 0 ms)
2026-11-08T08:08:51Z [load_day 2024-09-29] 2024-09-29 hour 7: 161731 events in 0 files, snapshot none (task 3772 ms: download 2254 ms overlapping gunzip 491 ms, parse 1925 ms, sort 0 ms, write 0 ms, index 450 ms: 5 candidates, 62484 repo-hours, 736 releases; waiting 550 ms; commit 0 ms)
2026-11-08T08:08:56Z [load_day 2024-09-29] 2024-09-29 hour 8: 172032 events in 0 files, snapshot none (task 5370 ms: download 2794 ms overlapping gunzip 768 ms, parse 3089 ms, sort 0 ms, write 0 ms, index 645 ms: 18 candidates, 67665 repo-hours, 965 releases; waiting 581 ms; commit 0 ms)
2026-11-08T08:08:57Z [load_day 2024-09-29] 2024-09-29 hour 9: 182216 events in 0 files, snapshot none (task 5220 ms: download 3556 ms overlapping gunzip 765 ms, parse 3060 ms, sort 0 ms, write 0 ms, index 522 ms: 5 candidates, 73801 repo-hours, 1002 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:09:02Z [load_day 2024-09-29] 2024-09-29 hour 10: 173723 events in 0 files, snapshot none (task 5624 ms: download 3337 ms overlapping gunzip 805 ms, parse 3101 ms, sort 0 ms, write 0 ms, index 604 ms: 3 candidates, 67504 repo-hours, 873 releases; waiting 735 ms; commit 0 ms)
2026-11-08T08:09:03Z [load_day 2024-09-29] 2024-09-29 hour 11: 169593 events in 0 files, snapshot none (task 5468 ms: download 2651 ms overlapping gunzip 812 ms, parse 3418 ms, sort 0 ms, write 0 ms, index 493 ms: 2 candidates, 62939 repo-hours, 713 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:09:08Z [load_day 2024-09-29] 2024-09-29 hour 12: 231384 events in 0 files, snapshot none (task 5746 ms: download 2968 ms overlapping gunzip 671 ms, parse 3081 ms, sort 0 ms, write 0 ms, index 1007 ms: 5 candidates, 111904 repo-hours, 878 releases; waiting 647 ms; commit 0 ms)
2026-11-08T08:09:09Z [load_day 2024-09-29] 2024-09-29 hour 13: 207899 events in 0 files, snapshot none (task 5602 ms: download 3268 ms overlapping gunzip 740 ms, parse 3010 ms, sort 0 ms, write 0 ms, index 825 ms: 9 candidates, 92421 repo-hours, 883 releases; waiting 750 ms; commit 0 ms)
2026-11-08T08:09:15Z [load_day 2024-09-29] 2024-09-29 hour 14: 191656 events in 0 files, snapshot none (task 6349 ms: download 5139 ms overlapping gunzip 863 ms, parse 3285 ms, sort 0 ms, write 0 ms, index 625 ms: 8 candidates, 74211 repo-hours, 929 releases; waiting 1272 ms; commit 0 ms)
2026-11-08T08:09:16Z [load_day 2024-09-29] 2024-09-29 hour 15: 205444 events in 0 files, snapshot none (task 6395 ms: download 3170 ms overlapping gunzip 921 ms, parse 3716 ms, sort 0 ms, write 0 ms, index 666 ms: 10 candidates, 83675 repo-hours, 1184 releases; waiting 662 ms; commit 0 ms)
2026-11-08T08:09:21Z [load_day 2024-09-29] 2024-09-29 hour 16: 198639 events in 0 files, snapshot none (task 5509 ms: download 3912 ms overlapping gunzip 629 ms, parse 2726 ms, sort 0 ms, write 0 ms, index 652 ms: 8 candidates, 76767 repo-hours, 971 releases; waiting 1218 ms; commit 0 ms)
2026-11-08T08:09:21Z [load_day 2024-09-29] 2024-09-29 hour 17: 189734 events in 0 files, snapshot none (task 4860 ms: download 2846 ms overlapping gunzip 629 ms, parse 2630 ms, sort 0 ms, write 0 ms, index 572 ms: 13 candidates, 69247 repo-hours, 956 releases; waiting 672 ms; commit 0 ms)
2026-11-08T08:09:27Z [load_day 2024-09-29] 2024-09-29 hour 18: 204368 events in 0 files, snapshot none (task 5557 ms: download 2776 ms overlapping gunzip 826 ms, parse 3392 ms, sort 0 ms, write 0 ms, index 615 ms: 8 candidates, 85066 repo-hours, 989 releases; waiting 369 ms; commit 0 ms)
2026-11-08T08:09:28Z [load_day 2024-09-29] 2024-09-29 hour 19: 179601 events in 0 files, snapshot none (task 5831 ms: download 3123 ms overlapping gunzip 904 ms, parse 3723 ms, sort 0 ms, write 0 ms, index 463 ms: 10 candidates, 63603 repo-hours, 843 releases; waiting 453 ms; commit 0 ms)
2026-11-08T08:09:33Z [load_day 2024-09-29] 2024-09-29 hour 20: 171292 events in 0 files, snapshot none (task 5570 ms: download 3037 ms overlapping gunzip 851 ms, parse 3332 ms, sort 0 ms, write 0 ms, index 575 ms: 6 candidates, 62754 repo-hours, 877 releases; waiting 557 ms; commit 0 ms)
2026-11-08T08:09:33Z [load_day 2024-09-29] 2024-09-29 hour 21: 159808 events in 0 files, snapshot none (task 4781 ms: download 2509 ms overlapping gunzip 725 ms, parse 2776 ms, sort 0 ms, write 0 ms, index 537 ms: 2 candidates, 62053 repo-hours, 955 releases; waiting 486 ms; commit 0 ms)
2026-11-08T08:09:38Z [load_day 2024-09-29] 2024-09-29 hour 22: 144062 events in 0 files, snapshot none (task 4096 ms: download 2407 ms overlapping gunzip 555 ms, parse 2253 ms, sort 0 ms, write 0 ms, index 463 ms: 5 candidates, 49997 repo-hours, 896 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:09:38Z [load_day 2024-09-29] 2024-09-29 hour 23: 140010 events in 0 files, snapshot none (task 3700 ms: download 1724 ms overlapping gunzip 463 ms, parse 2018 ms, sort 0 ms, write 0 ms, index 388 ms: 3 candidates, 48208 repo-hours, 686 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:09:46Z [load_day 2024-09-29] 2024-09-29: repo_hour merged from 24 files to 1 (1689968 rows, 7724 ms)
2026-11-08T08:09:49Z [load_day 2024-09-29] 2024-09-29: index committed in 10696 ms (24 + 1 + 24 files)
2026-11-08T08:09:49Z [load_day 2024-09-29] 2024-09-29: 4164272 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:09:49Z [load_day 2024-09-29] attempt 1 succeeded