orcaLog in

Runs · run 4669

load_day 2025-12-01, attempt 1 succeeded

Host
73ccef5e07c2:411063
Started
2026-11-08T14:37:39Z
Ended
2026-11-08T14:38:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
753 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.3 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4669/load_day/2025-12-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:37:39Z [load_day 2025-12-01] attempt 1 started
2026-11-08T14:37:40Z [load_day 2025-12-01] 2025-12-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:37:45Z [load_day 2025-12-01] 2025-12-01 hour 0: 148113 events in 0 files, snapshot none (task 4558 ms: download 2881 ms overlapping gunzip 517 ms, parse 1680 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 69935 repo-hours, 608 releases; waiting 1420 ms; commit 0 ms)
2026-11-08T14:37:45Z [load_day 2025-12-01] 2025-12-01 hour 1: 156825 events in 0 files, snapshot none (task 3523 ms: download 1822 ms overlapping gunzip 362 ms, parse 1242 ms, sort 0 ms, write 0 ms, index 943 ms: 7 candidates, 91287 repo-hours, 390 releases; waiting 674 ms; commit 0 ms)
2026-11-08T14:37:49Z [load_day 2025-12-01] 2025-12-01 hour 2: 154554 events in 0 files, snapshot none (task 4273 ms: download 2371 ms overlapping gunzip 671 ms, parse 2312 ms, sort 0 ms, write 0 ms, index 585 ms: 4 candidates, 80383 repo-hours, 334 releases; waiting 438 ms; commit 0 ms)
2026-11-08T14:37:50Z [load_day 2025-12-01] 2025-12-01 hour 3: 150363 events in 0 files, snapshot none (task 4455 ms: download 2531 ms overlapping gunzip 759 ms, parse 2501 ms, sort 0 ms, write 0 ms, index 590 ms: 7 candidates, 69956 repo-hours, 502 releases; waiting 351 ms; commit 0 ms)
2026-11-08T14:37:54Z [load_day 2025-12-01] 2025-12-01 hour 4: 149578 events in 0 files, snapshot none (task 4094 ms: download 3115 ms overlapping gunzip 504 ms, parse 1765 ms, sort 0 ms, write 0 ms, index 574 ms: 6 candidates, 73090 repo-hours, 694 releases; waiting 951 ms; commit 0 ms)
2026-11-08T14:37:54Z [load_day 2025-12-01] 2025-12-01 hour 5: 151439 events in 0 files, snapshot none (task 3784 ms: download 2158 ms overlapping gunzip 530 ms, parse 1820 ms, sort 0 ms, write 0 ms, index 587 ms: 7 candidates, 73545 repo-hours, 303 releases; waiting 515 ms; commit 0 ms)
2026-11-08T14:37:58Z [load_day 2025-12-01] 2025-12-01 hour 6: 152252 events in 0 files, snapshot none (task 3685 ms: download 2442 ms overlapping gunzip 446 ms, parse 1436 ms, sort 0 ms, write 0 ms, index 690 ms: 8 candidates, 78298 repo-hours, 422 releases; waiting 731 ms; commit 0 ms)
2026-11-08T14:38:00Z [load_day 2025-12-01] 2025-12-01 hour 7: 154502 events in 0 files, snapshot none (task 5748 ms: download 2219 ms overlapping gunzip 424 ms, parse 1512 ms, sort 0 ms, write 0 ms, index 2706 ms: 5 candidates, 77708 repo-hours, 279 releases; waiting 525 ms; commit 0 ms)
2026-11-08T14:38:07Z [load_day 2025-12-01] 2025-12-01 hour 8: 148825 events in 0 files, snapshot none (task 3216 ms: download 1999 ms overlapping gunzip 378 ms, parse 1175 ms, sort 0 ms, write 0 ms, index 610 ms: 6 candidates, 78533 repo-hours, 449 releases; waiting 667 ms; commit 0 ms)
2026-11-08T14:38:07Z [load_day 2025-12-01] 2025-12-01 hour 9: 151744 events in 0 files, snapshot none (task 2624 ms: download 1493 ms overlapping gunzip 326 ms, parse 1056 ms, sort 0 ms, write 0 ms, index 590 ms: 2 candidates, 81073 repo-hours, 334 releases; waiting 414 ms; commit 0 ms)
2026-11-08T14:38:11Z [load_day 2025-12-01] 2025-12-01 hour 10: 152458 events in 0 files, snapshot none (task 3809 ms: download 2577 ms overlapping gunzip 467 ms, parse 1448 ms, sort 0 ms, write 0 ms, index 637 ms: 5 candidates, 81964 repo-hours, 267 releases; waiting 953 ms; commit 0 ms)
2026-11-08T14:38:11Z [load_day 2025-12-01] 2025-12-01 hour 11: 155031 events in 0 files, snapshot none (task 3475 ms: download 1854 ms overlapping gunzip 486 ms, parse 1567 ms, sort 0 ms, write 0 ms, index 646 ms: 2 candidates, 81768 repo-hours, 194 releases; waiting 492 ms; commit 0 ms)
2026-11-08T14:38:15Z [load_day 2025-12-01] 2025-12-01 hour 12: 162482 events in 0 files, snapshot none (task 2957 ms: download 1602 ms overlapping gunzip 312 ms, parse 1110 ms, sort 0 ms, write 0 ms, index 734 ms: 6 candidates, 100424 repo-hours, 192 releases; waiting 407 ms; commit 0 ms)
2026-11-08T14:38:15Z [load_day 2025-12-01] 2025-12-01 hour 13: 161511 events in 0 files, snapshot none (task 3149 ms: download 1805 ms overlapping gunzip 343 ms, parse 1174 ms, sort 0 ms, write 0 ms, index 663 ms: 5 candidates, 95255 repo-hours, 265 releases; waiting 699 ms; commit 0 ms)
2026-11-08T14:38:18Z [load_day 2025-12-01] 2025-12-01 hour 14: 155331 events in 0 files, snapshot none (task 3383 ms: download 2101 ms overlapping gunzip 357 ms, parse 1209 ms, sort 0 ms, write 0 ms, index 638 ms: 5 candidates, 86194 repo-hours, 271 releases; waiting 804 ms; commit 0 ms)
2026-11-08T14:38:18Z [load_day 2025-12-01] 2025-12-01 hour 15: 153504 events in 0 files, snapshot none (task 2697 ms: download 1603 ms overlapping gunzip 346 ms, parse 1069 ms, sort 0 ms, write 0 ms, index 691 ms: 9 candidates, 87469 repo-hours, 249 releases; waiting 276 ms; commit 0 ms)
2026-11-08T14:38:22Z [load_day 2025-12-01] 2025-12-01 hour 16: 150442 events in 0 files, snapshot none (task 2852 ms: download 1776 ms overlapping gunzip 313 ms, parse 1048 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 85206 repo-hours, 242 releases; waiting 556 ms; commit 0 ms)
2026-11-08T14:38:22Z [load_day 2025-12-01] 2025-12-01 hour 17: 156707 events in 0 files, snapshot none (task 3226 ms: download 1904 ms overlapping gunzip 353 ms, parse 1078 ms, sort 0 ms, write 0 ms, index 639 ms: 5 candidates, 87350 repo-hours, 197 releases; waiting 836 ms; commit 0 ms)
2026-11-08T14:38:26Z [load_day 2025-12-01] 2025-12-01 hour 18: 150483 events in 0 files, snapshot none (task 3779 ms: download 2594 ms overlapping gunzip 345 ms, parse 1170 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 86893 repo-hours, 252 releases; waiting 1266 ms; commit 0 ms)
2026-11-08T14:38:27Z [load_day 2025-12-01] 2025-12-01 hour 19: 155807 events in 0 files, snapshot none (task 4190 ms: download 2627 ms overlapping gunzip 357 ms, parse 1216 ms, sort 0 ms, write 0 ms, index 614 ms: 7 candidates, 82732 repo-hours, 264 releases; waiting 1502 ms; commit 0 ms)
2026-11-08T14:38:31Z [load_day 2025-12-01] 2025-12-01 hour 20: 153630 events in 0 files, snapshot none (task 4587 ms: download 2702 ms overlapping gunzip 598 ms, parse 1958 ms, sort 0 ms, write 0 ms, index 694 ms: 11 candidates, 80760 repo-hours, 343 releases; waiting 993 ms; commit 0 ms)
2026-11-08T14:38:31Z [load_day 2025-12-01] 2025-12-01 hour 21: 151420 events in 0 files, snapshot none (task 3698 ms: download 2350 ms overlapping gunzip 517 ms, parse 1657 ms, sort 0 ms, write 0 ms, index 616 ms: 7 candidates, 79511 repo-hours, 303 releases; waiting 632 ms; commit 0 ms)
2026-11-08T14:38:36Z [load_day 2025-12-01] 2025-12-01 hour 22: 150392 events in 0 files, snapshot none (task 4329 ms: download 2409 ms overlapping gunzip 597 ms, parse 2088 ms, sort 0 ms, write 0 ms, index 690 ms: 6 candidates, 76088 repo-hours, 393 releases; waiting 597 ms; commit 0 ms)
2026-11-08T14:38:36Z [load_day 2025-12-01] 2025-12-01 hour 23: 150026 events in 0 files, snapshot none (task 4264 ms: download 2469 ms overlapping gunzip 604 ms, parse 2033 ms, sort 0 ms, write 0 ms, index 752 ms: 6 candidates, 73033 repo-hours, 357 releases; waiting 561 ms; commit 0 ms)
2026-11-08T14:38:44Z [load_day 2025-12-01] 2025-12-01: repo_hour merged from 24 files to 1 (1958455 rows, 8160 ms)
2026-11-08T14:38:47Z [load_day 2025-12-01] 2025-12-01: index committed in 11710 ms (24 + 1 + 24 files)
2026-11-08T14:38:47Z [load_day 2025-12-01] 2025-12-01: 3677419 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:38:47Z [load_day 2025-12-01] attempt 1 succeeded