orcaLog in

Runs · run 4452

load_day 2025-09-29, attempt 1 succeeded

Host
73ccef5e07c2:386906
Started
2026-11-08T14:02:38Z
Ended
2026-11-08T14:04:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
681 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
162.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4452/load_day/2025-09-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:02:38Z [load_day 2025-09-29] attempt 1 started
2026-11-08T14:02:39Z [load_day 2025-09-29] 2025-09-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:02:46Z [load_day 2025-09-29] 2025-09-29 hour 0: 165824 events in 0 files, snapshot none (task 6025 ms: download 3322 ms overlapping gunzip 926 ms, parse 3736 ms, sort 0 ms, write 0 ms, index 557 ms: 6 candidates, 62044 repo-hours, 919 releases; waiting 518 ms; commit 0 ms)
2026-11-08T14:02:46Z [load_day 2025-09-29] 2025-09-29 hour 1: 180932 events in 0 files, snapshot none (task 5668 ms: download 3607 ms overlapping gunzip 830 ms, parse 3264 ms, sort 0 ms, write 0 ms, index 685 ms: 3 candidates, 79835 repo-hours, 577 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:02:52Z [load_day 2025-09-29] 2025-09-29 hour 2: 168054 events in 0 files, snapshot none (task 5951 ms: download 3006 ms overlapping gunzip 904 ms, parse 3582 ms, sort 0 ms, write 0 ms, index 903 ms: 6 candidates, 60582 repo-hours, 589 releases; waiting 251 ms; commit 0 ms)
2026-11-08T14:02:53Z [load_day 2025-09-29] 2025-09-29 hour 3: 172441 events in 0 files, snapshot none (task 6184 ms: download 3382 ms overlapping gunzip 964 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 480 ms: 18 candidates, 62493 repo-hours, 1540 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:03:01Z [load_day 2025-09-29] 2025-09-29 hour 4: 169562 events in 0 files, snapshot none (task 6960 ms: download 4676 ms overlapping gunzip 1122 ms, parse 4243 ms, sort 0 ms, write 0 ms, index 500 ms: 11 candidates, 56792 repo-hours, 524 releases; waiting 830 ms; commit 0 ms)
2026-11-08T14:03:01Z [load_day 2025-09-29] 2025-09-29 hour 5: 172500 events in 0 files, snapshot none (task 6393 ms: download 3353 ms overlapping gunzip 998 ms, parse 4087 ms, sort 0 ms, write 0 ms, index 489 ms: 10 candidates, 58687 repo-hours, 505 releases; waiting 383 ms; commit 0 ms)
2026-11-08T14:03:09Z [load_day 2025-09-29] 2025-09-29 hour 6: 173968 events in 0 files, snapshot none (task 6892 ms: download 4308 ms overlapping gunzip 1096 ms, parse 4425 ms, sort 0 ms, write 0 ms, index 612 ms: 9 candidates, 72952 repo-hours, 497 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:03:09Z [load_day 2025-09-29] 2025-09-29 hour 7: 172233 events in 0 files, snapshot none (task 7002 ms: download 4666 ms overlapping gunzip 1145 ms, parse 4517 ms, sort 0 ms, write 0 ms, index 518 ms: 7 candidates, 69740 repo-hours, 642 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:03:17Z [load_day 2025-09-29] 2025-09-29 hour 8: 171679 events in 0 files, snapshot none (task 7447 ms: download 4830 ms overlapping gunzip 1213 ms, parse 4581 ms, sort 0 ms, write 0 ms, index 899 ms: 7 candidates, 78861 repo-hours, 697 releases; waiting 498 ms; commit 0 ms)
2026-11-08T14:03:18Z [load_day 2025-09-29] 2025-09-29 hour 9: 170287 events in 0 files, snapshot none (task 8858 ms: download 5556 ms overlapping gunzip 1427 ms, parse 5391 ms, sort 0 ms, write 0 ms, index 1070 ms: 8 candidates, 79837 repo-hours, 786 releases; waiting 739 ms; commit 0 ms)
2026-11-08T14:03:28Z [load_day 2025-09-29] 2025-09-29 hour 10: 171142 events in 0 files, snapshot none (task 10210 ms: download 5720 ms overlapping gunzip 1577 ms, parse 6491 ms, sort 0 ms, write 0 ms, index 1145 ms: 10 candidates, 79253 repo-hours, 685 releases; waiting 574 ms; commit 0 ms)
2026-11-08T14:03:29Z [load_day 2025-09-29] 2025-09-29 hour 11: 171550 events in 0 files, snapshot none (task 9670 ms: download 6219 ms overlapping gunzip 1660 ms, parse 6444 ms, sort 0 ms, write 0 ms, index 739 ms: 10 candidates, 77622 repo-hours, 657 releases; waiting 504 ms; commit 0 ms)
2026-11-08T14:03:37Z [load_day 2025-09-29] 2025-09-29 hour 12: 173294 events in 0 files, snapshot none (task 9215 ms: download 6339 ms overlapping gunzip 1090 ms, parse 4474 ms, sort 0 ms, write 0 ms, index 793 ms: 14 candidates, 95299 repo-hours, 759 releases; waiting 2496 ms; commit 0 ms)
2026-11-08T14:03:38Z [load_day 2025-09-29] 2025-09-29 hour 13: 178788 events in 0 files, snapshot none (task 8759 ms: download 5928 ms overlapping gunzip 1299 ms, parse 5196 ms, sort 0 ms, write 0 ms, index 756 ms: 10 candidates, 94083 repo-hours, 717 releases; waiting 1133 ms; commit 0 ms)
2026-11-08T14:03:46Z [load_day 2025-09-29] 2025-09-29 hour 14: 169309 events in 0 files, snapshot none (task 8120 ms: download 4746 ms overlapping gunzip 1286 ms, parse 5188 ms, sort 0 ms, write 0 ms, index 787 ms: 13 candidates, 86566 repo-hours, 891 releases; waiting 516 ms; commit 0 ms)
2026-11-08T14:03:47Z [load_day 2025-09-29] 2025-09-29 hour 15: 166077 events in 0 files, snapshot none (task 8469 ms: download 5778 ms overlapping gunzip 1393 ms, parse 5234 ms, sort 0 ms, write 0 ms, index 659 ms: 9 candidates, 84627 repo-hours, 762 releases; waiting 855 ms; commit 0 ms)
2026-11-08T14:03:54Z [load_day 2025-09-29] 2025-09-29 hour 16: 168413 events in 0 files, snapshot none (task 7628 ms: download 5215 ms overlapping gunzip 983 ms, parse 3879 ms, sort 0 ms, write 0 ms, index 594 ms: 12 candidates, 82532 repo-hours, 645 releases; waiting 1837 ms; commit 0 ms)
2026-11-08T14:03:54Z [load_day 2025-09-29] 2025-09-29 hour 17: 171619 events in 0 files, snapshot none (task 6089 ms: download 3695 ms overlapping gunzip 985 ms, parse 4048 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 80643 repo-hours, 673 releases; waiting 178 ms; commit 0 ms)
2026-11-08T14:04:01Z [load_day 2025-09-29] 2025-09-29 hour 18: 169235 events in 0 files, snapshot none (task 6659 ms: download 4556 ms overlapping gunzip 981 ms, parse 3757 ms, sort 0 ms, write 0 ms, index 658 ms: 7 candidates, 85682 repo-hours, 831 releases; waiting 882 ms; commit 0 ms)
2026-11-08T14:04:02Z [load_day 2025-09-29] 2025-09-29 hour 19: 169593 events in 0 files, snapshot none (task 7490 ms: download 5074 ms overlapping gunzip 1042 ms, parse 4045 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 78251 repo-hours, 707 releases; waiting 1421 ms; commit 0 ms)
2026-11-08T14:04:10Z [load_day 2025-09-29] 2025-09-29 hour 20: 172436 events in 0 files, snapshot none (task 8419 ms: download 6058 ms overlapping gunzip 1474 ms, parse 5589 ms, sort 0 ms, write 0 ms, index 627 ms: 11 candidates, 80659 repo-hours, 769 releases; waiting 422 ms; commit 0 ms)
2026-11-08T14:04:10Z [load_day 2025-09-29] 2025-09-29 hour 21: 171151 events in 0 files, snapshot none (task 7353 ms: download 5014 ms overlapping gunzip 1259 ms, parse 4926 ms, sort 0 ms, write 0 ms, index 532 ms: 7 candidates, 70410 repo-hours, 685 releases; waiting 364 ms; commit 0 ms)
2026-11-08T14:04:18Z [load_day 2025-09-29] 2025-09-29 hour 22: 164883 events in 0 files, snapshot none (task 7561 ms: download 5155 ms overlapping gunzip 1260 ms, parse 4955 ms, sort 0 ms, write 0 ms, index 461 ms: 9 candidates, 61605 repo-hours, 636 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:04:18Z [load_day 2025-09-29] 2025-09-29 hour 23: 167908 events in 0 files, snapshot none (task 7304 ms: download 5144 ms overlapping gunzip 1275 ms, parse 4942 ms, sort 0 ms, write 0 ms, index 422 ms: 2 candidates, 56710 repo-hours, 657 releases; waiting 396 ms; commit 0 ms)
2026-11-08T14:04:27Z [load_day 2025-09-29] 2025-09-29: repo_hour merged from 24 files to 1 (1795765 rows, 9034 ms)
2026-11-08T14:04:30Z [load_day 2025-09-29] 2025-09-29: index committed in 11981 ms (24 + 1 + 24 files)
2026-11-08T14:04:30Z [load_day 2025-09-29] 2025-09-29: 4102878 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:04:30Z [load_day 2025-09-29] attempt 1 succeeded