orcaLog in

Runs · run 2123

load_day 2024-02-24, attempt 1 succeeded

Host
73ccef5e07c2:90937
Started
2026-11-08T04:48:46Z
Ended
2026-11-08T04:50:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
585 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
131.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2123/load_day/2024-02-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:48:46Z [load_day 2024-02-24] attempt 1 started
2026-11-08T04:48:47Z [load_day 2024-02-24] 2024-02-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:48:56Z [load_day 2024-02-24] 2024-02-24 hour 0: 257761 events in 0 files, snapshot none (task 7564 ms: download 4598 ms overlapping gunzip 1148 ms, parse 5023 ms, sort 0 ms, write 0 ms, index 661 ms: 9 candidates, 78268 repo-hours, 983 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:48:56Z [load_day 2024-02-24] 2024-02-24 hour 1: 237346 events in 0 files, snapshot none (task 6879 ms: download 3642 ms overlapping gunzip 1033 ms, parse 4541 ms, sort 0 ms, write 0 ms, index 548 ms: 4 candidates, 70320 repo-hours, 648 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:49:02Z [load_day 2024-02-24] 2024-02-24 hour 2: 228987 events in 0 files, snapshot none (task 5909 ms: download 2602 ms overlapping gunzip 871 ms, parse 3942 ms, sort 0 ms, write 0 ms, index 543 ms: 7 candidates, 43791 repo-hours, 591 releases; waiting 269 ms; commit 0 ms)
2026-11-08T04:49:02Z [load_day 2024-02-24] 2024-02-24 hour 3: 227033 events in 0 files, snapshot none (task 6315 ms: download 2846 ms overlapping gunzip 903 ms, parse 4253 ms, sort 0 ms, write 0 ms, index 411 ms: 3 candidates, 44126 repo-hours, 636 releases; waiting 491 ms; commit 0 ms)
2026-11-08T04:49:07Z [load_day 2024-02-24] 2024-02-24 hour 4: 220189 events in 0 files, snapshot none (task 4728 ms: download 2163 ms overlapping gunzip 603 ms, parse 2820 ms, sort 0 ms, write 0 ms, index 511 ms: 9 candidates, 42532 repo-hours, 469 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:49:08Z [load_day 2024-02-24] 2024-02-24 hour 5: 232815 events in 0 files, snapshot none (task 5500 ms: download 3432 ms overlapping gunzip 700 ms, parse 3198 ms, sort 0 ms, write 0 ms, index 591 ms: 5 candidates, 45897 repo-hours, 581 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:49:15Z [load_day 2024-02-24] 2024-02-24 hour 6: 236300 events in 0 files, snapshot none (task 6905 ms: download 2490 ms overlapping gunzip 770 ms, parse 3780 ms, sort 0 ms, write 0 ms, index 1866 ms: 4 candidates, 52998 repo-hours, 804 releases; waiting 192 ms; commit 0 ms)
2026-11-08T04:49:15Z [load_day 2024-02-24] 2024-02-24 hour 7: 233173 events in 0 files, snapshot none (task 6015 ms: download 3119 ms overlapping gunzip 686 ms, parse 3303 ms, sort 0 ms, write 0 ms, index 1267 ms: 2 candidates, 47848 repo-hours, 671 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:49:22Z [load_day 2024-02-24] 2024-02-24 hour 8: 256694 events in 0 files, snapshot none (task 6767 ms: download 3732 ms overlapping gunzip 961 ms, parse 4559 ms, sort 0 ms, write 0 ms, index 472 ms: 5 candidates, 54636 repo-hours, 761 releases; waiting 550 ms; commit 0 ms)
2026-11-08T04:49:22Z [load_day 2024-02-24] 2024-02-24 hour 9: 269407 events in 0 files, snapshot none (task 6544 ms: download 3652 ms overlapping gunzip 932 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 500 ms: 7 candidates, 59013 repo-hours, 1548 releases; waiting 332 ms; commit 0 ms)
2026-11-08T04:49:28Z [load_day 2024-02-24] 2024-02-24 hour 10: 271445 events in 0 files, snapshot none (task 5721 ms: download 2853 ms overlapping gunzip 782 ms, parse 3538 ms, sort 0 ms, write 0 ms, index 635 ms: 11 candidates, 59879 repo-hours, 624 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:49:28Z [load_day 2024-02-24] 2024-02-24 hour 11: 281059 events in 0 files, snapshot none (task 5758 ms: download 2803 ms overlapping gunzip 799 ms, parse 3873 ms, sort 0 ms, write 0 ms, index 638 ms: 7 candidates, 59055 repo-hours, 593 releases; waiting 252 ms; commit 0 ms)
2026-11-08T04:49:36Z [load_day 2024-02-24] 2024-02-24 hour 12: 327075 events in 0 files, snapshot none (task 7037 ms: download 4087 ms overlapping gunzip 1004 ms, parse 4592 ms, sort 0 ms, write 0 ms, index 606 ms: 8 candidates, 91740 repo-hours, 738 releases; waiting 481 ms; commit 0 ms)
2026-11-08T04:49:36Z [load_day 2024-02-24] 2024-02-24 hour 13: 287692 events in 0 files, snapshot none (task 6232 ms: download 3594 ms overlapping gunzip 885 ms, parse 4002 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 78284 repo-hours, 685 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:49:43Z [load_day 2024-02-24] 2024-02-24 hour 14: 285969 events in 0 files, snapshot none (task 7036 ms: download 4349 ms overlapping gunzip 1042 ms, parse 4741 ms, sort 0 ms, write 0 ms, index 564 ms: 10 candidates, 68584 repo-hours, 743 releases; waiting 467 ms; commit 0 ms)
2026-11-08T04:49:43Z [load_day 2024-02-24] 2024-02-24 hour 15: 294672 events in 0 files, snapshot none (task 7051 ms: download 4323 ms overlapping gunzip 1076 ms, parse 4744 ms, sort 0 ms, write 0 ms, index 629 ms: 7 candidates, 75220 repo-hours, 1517 releases; waiting 255 ms; commit 0 ms)
2026-11-08T04:49:51Z [load_day 2024-02-24] 2024-02-24 hour 16: 290235 events in 0 files, snapshot none (task 7841 ms: download 4576 ms overlapping gunzip 1113 ms, parse 5384 ms, sort 0 ms, write 0 ms, index 575 ms: 14 candidates, 71003 repo-hours, 760 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:49:51Z [load_day 2024-02-24] 2024-02-24 hour 17: 279601 events in 0 files, snapshot none (task 7575 ms: download 4721 ms overlapping gunzip 1102 ms, parse 5247 ms, sort 0 ms, write 0 ms, index 591 ms: 9 candidates, 66863 repo-hours, 711 releases; waiting 382 ms; commit 0 ms)
2026-11-08T04:49:58Z [load_day 2024-02-24] 2024-02-24 hour 18: 288244 events in 0 files, snapshot none (task 6553 ms: download 3905 ms overlapping gunzip 949 ms, parse 4331 ms, sort 0 ms, write 0 ms, index 539 ms: 9 candidates, 71054 repo-hours, 927 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:49:58Z [load_day 2024-02-24] 2024-02-24 hour 19: 276296 events in 0 files, snapshot none (task 6380 ms: download 3168 ms overlapping gunzip 914 ms, parse 4309 ms, sort 0 ms, write 0 ms, index 459 ms: 7 candidates, 58386 repo-hours, 1427 releases; waiting 463 ms; commit 0 ms)
2026-11-08T04:50:04Z [load_day 2024-02-24] 2024-02-24 hour 20: 269564 events in 0 files, snapshot none (task 5128 ms: download 2717 ms overlapping gunzip 696 ms, parse 3213 ms, sort 0 ms, write 0 ms, index 403 ms: 5 candidates, 57946 repo-hours, 630 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:50:04Z [load_day 2024-02-24] 2024-02-24 hour 21: 261228 events in 0 files, snapshot none (task 4852 ms: download 2467 ms overlapping gunzip 677 ms, parse 3028 ms, sort 0 ms, write 0 ms, index 390 ms: 6 candidates, 53124 repo-hours, 757 releases; waiting 466 ms; commit 0 ms)
2026-11-08T04:50:09Z [load_day 2024-02-24] 2024-02-24 hour 22: 245198 events in 0 files, snapshot none (task 4973 ms: download 2478 ms overlapping gunzip 647 ms, parse 3049 ms, sort 0 ms, write 0 ms, index 419 ms: 5 candidates, 49072 repo-hours, 767 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:50:09Z [load_day 2024-02-24] 2024-02-24 hour 23: 236281 events in 0 files, snapshot none (task 4450 ms: download 2072 ms overlapping gunzip 593 ms, parse 2738 ms, sort 0 ms, write 0 ms, index 374 ms: 3 candidates, 49774 repo-hours, 557 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:50:16Z [load_day 2024-02-24] 2024-02-24: repo_hour merged from 24 files to 1 (1449413 rows, 6768 ms)
2026-11-08T04:50:19Z [load_day 2024-02-24] 2024-02-24: index committed in 9418 ms (24 + 1 + 24 files)
2026-11-08T04:50:19Z [load_day 2024-02-24] 2024-02-24: 6294264 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:50:19Z [load_day 2024-02-24] attempt 1 succeeded