orcaLog in

Runs · run 2258

load_day 2024-03-30, attempt 1 succeeded

Host
73ccef5e07c2:103498
Started
2026-11-08T05:22:51Z
Ended
2026-11-08T05:24:07Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
602 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
109.2 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2258/load_day/2024-03-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:22:51Z [load_day 2024-03-30] attempt 1 started
2026-11-08T05:22:52Z [load_day 2024-03-30] 2024-03-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:22:58Z [load_day 2024-03-30] 2024-03-30 hour 0: 191384 events in 0 files, snapshot none (task 6244 ms: download 3301 ms overlapping gunzip 894 ms, parse 3889 ms, sort 0 ms, write 0 ms, index 652 ms: 8 candidates, 86173 repo-hours, 1060 releases; waiting 469 ms; commit 0 ms)
2026-11-08T05:22:58Z [load_day 2024-03-30] 2024-03-30 hour 1: 177527 events in 0 files, snapshot none (task 5810 ms: download 2964 ms overlapping gunzip 756 ms, parse 3536 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 81945 repo-hours, 683 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:23:03Z [load_day 2024-03-30] 2024-03-30 hour 2: 148970 events in 0 files, snapshot none (task 3848 ms: download 2010 ms overlapping gunzip 525 ms, parse 2157 ms, sort 0 ms, write 0 ms, index 359 ms: 4 candidates, 47576 repo-hours, 662 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:23:03Z [load_day 2024-03-30] 2024-03-30 hour 3: 147678 events in 0 files, snapshot none (task 3954 ms: download 2514 ms overlapping gunzip 506 ms, parse 2200 ms, sort 0 ms, write 0 ms, index 353 ms: 3 candidates, 47410 repo-hours, 739 releases; waiting 618 ms; commit 0 ms)
2026-11-08T05:23:07Z [load_day 2024-03-30] 2024-03-30 hour 4: 149057 events in 0 files, snapshot none (task 3780 ms: download 2020 ms overlapping gunzip 487 ms, parse 2136 ms, sort 0 ms, write 0 ms, index 361 ms: 3 candidates, 47022 repo-hours, 511 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:23:07Z [load_day 2024-03-30] 2024-03-30 hour 5: 159017 events in 0 files, snapshot none (task 4215 ms: download 1996 ms overlapping gunzip 584 ms, parse 2411 ms, sort 0 ms, write 0 ms, index 411 ms: 6 candidates, 51254 repo-hours, 587 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:23:11Z [load_day 2024-03-30] 2024-03-30 hour 6: 173935 events in 0 files, snapshot none (task 3606 ms: download 1863 ms overlapping gunzip 485 ms, parse 2140 ms, sort 0 ms, write 0 ms, index 435 ms: 4 candidates, 60446 repo-hours, 896 releases; waiting 262 ms; commit 0 ms)
2026-11-08T05:23:11Z [load_day 2024-03-30] 2024-03-30 hour 7: 165679 events in 0 files, snapshot none (task 3680 ms: download 2110 ms overlapping gunzip 485 ms, parse 2068 ms, sort 0 ms, write 0 ms, index 387 ms: 9 candidates, 53996 repo-hours, 760 releases; waiting 478 ms; commit 0 ms)
2026-11-08T05:23:16Z [load_day 2024-03-30] 2024-03-30 hour 8: 174019 events in 0 files, snapshot none (task 4570 ms: download 2396 ms overlapping gunzip 563 ms, parse 2397 ms, sort 0 ms, write 0 ms, index 783 ms: 7 candidates, 57502 repo-hours, 801 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:23:16Z [load_day 2024-03-30] 2024-03-30 hour 9: 172136 events in 0 files, snapshot none (task 4140 ms: download 2172 ms overlapping gunzip 531 ms, parse 2399 ms, sort 0 ms, write 0 ms, index 436 ms: 4 candidates, 56950 repo-hours, 935 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:23:21Z [load_day 2024-03-30] 2024-03-30 hour 10: 175405 events in 0 files, snapshot none (task 4579 ms: download 2445 ms overlapping gunzip 610 ms, parse 2624 ms, sort 0 ms, write 0 ms, index 561 ms: 9 candidates, 60403 repo-hours, 718 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:23:21Z [load_day 2024-03-30] 2024-03-30 hour 11: 183109 events in 0 files, snapshot none (task 4693 ms: download 2241 ms overlapping gunzip 677 ms, parse 2754 ms, sort 0 ms, write 0 ms, index 527 ms: 16 candidates, 60777 repo-hours, 659 releases; waiting 458 ms; commit 0 ms)
2026-11-08T05:23:28Z [load_day 2024-03-30] 2024-03-30 hour 12: 267703 events in 0 files, snapshot none (task 6210 ms: download 3008 ms overlapping gunzip 797 ms, parse 3880 ms, sort 0 ms, write 0 ms, index 702 ms: 15 candidates, 97973 repo-hours, 843 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:23:28Z [load_day 2024-03-30] 2024-03-30 hour 13: 204440 events in 0 files, snapshot none (task 5503 ms: download 2414 ms overlapping gunzip 746 ms, parse 3295 ms, sort 0 ms, write 0 ms, index 681 ms: 12 candidates, 84513 repo-hours, 1539 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:23:35Z [load_day 2024-03-30] 2024-03-30 hour 14: 199689 events in 0 files, snapshot none (task 6832 ms: download 3647 ms overlapping gunzip 1013 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 566 ms: 9 candidates, 76685 repo-hours, 833 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:23:35Z [load_day 2024-03-30] 2024-03-30 hour 15: 198079 events in 0 files, snapshot none (task 6884 ms: download 4129 ms overlapping gunzip 1044 ms, parse 4575 ms, sort 0 ms, write 0 ms, index 505 ms: 12 candidates, 72378 repo-hours, 935 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:23:41Z [load_day 2024-03-30] 2024-03-30 hour 16: 197223 events in 0 files, snapshot none (task 5659 ms: download 2996 ms overlapping gunzip 784 ms, parse 3350 ms, sort 0 ms, write 0 ms, index 645 ms: 5 candidates, 70539 repo-hours, 710 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:23:41Z [load_day 2024-03-30] 2024-03-30 hour 17: 192514 events in 0 files, snapshot none (task 5545 ms: download 3006 ms overlapping gunzip 767 ms, parse 3361 ms, sort 0 ms, write 0 ms, index 669 ms: 9 candidates, 63738 repo-hours, 751 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:23:47Z [load_day 2024-03-30] 2024-03-30 hour 18: 196115 events in 0 files, snapshot none (task 5405 ms: download 2622 ms overlapping gunzip 748 ms, parse 3131 ms, sort 0 ms, write 0 ms, index 848 ms: 8 candidates, 71287 repo-hours, 813 releases; waiting 414 ms; commit 0 ms)
2026-11-08T05:23:47Z [load_day 2024-03-30] 2024-03-30 hour 19: 175476 events in 0 files, snapshot none (task 5017 ms: download 2837 ms overlapping gunzip 720 ms, parse 2994 ms, sort 0 ms, write 0 ms, index 516 ms: 3 candidates, 58097 repo-hours, 711 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:23:52Z [load_day 2024-03-30] 2024-03-30 hour 20: 180891 events in 0 files, snapshot none (task 4268 ms: download 1863 ms overlapping gunzip 607 ms, parse 2794 ms, sort 0 ms, write 0 ms, index 446 ms: 6 candidates, 66334 repo-hours, 618 releases; waiting 174 ms; commit 0 ms)
2026-11-08T05:23:52Z [load_day 2024-03-30] 2024-03-30 hour 21: 159185 events in 0 files, snapshot none (task 4296 ms: download 2712 ms overlapping gunzip 575 ms, parse 2551 ms, sort 0 ms, write 0 ms, index 356 ms: 9 candidates, 51232 repo-hours, 766 releases; waiting 474 ms; commit 0 ms)
2026-11-08T05:23:57Z [load_day 2024-03-30] 2024-03-30 hour 22: 150134 events in 0 files, snapshot none (task 4768 ms: download 2393 ms overlapping gunzip 710 ms, parse 2868 ms, sort 0 ms, write 0 ms, index 366 ms: 6 candidates, 48068 repo-hours, 715 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:23:57Z [load_day 2024-03-30] 2024-03-30 hour 23: 148625 events in 0 files, snapshot none (task 4558 ms: download 2528 ms overlapping gunzip 632 ms, parse 2834 ms, sort 0 ms, write 0 ms, index 335 ms: 8 candidates, 46440 repo-hours, 566 releases; waiting 534 ms; commit 0 ms)
2026-11-08T05:24:05Z [load_day 2024-03-30] 2024-03-30: repo_hour merged from 24 files to 1 (1518738 rows, 7248 ms)
2026-11-08T05:24:07Z [load_day 2024-03-30] 2024-03-30: index committed in 9959 ms (24 + 1 + 24 files)
2026-11-08T05:24:07Z [load_day 2024-03-30] 2024-03-30: 4287990 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:24:07Z [load_day 2024-03-30] attempt 1 succeeded