orcaLog in

Runs · run 2126

load_day 2024-02-25, attempt 1 succeeded

Host
73ccef5e07c2:91346
Started
2026-11-08T04:50:13Z
Ended
2026-11-08T04:51:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
633 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
136.6 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2126/load_day/2024-02-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:50:13Z [load_day 2024-02-25] attempt 1 started
2026-11-08T04:50:14Z [load_day 2024-02-25] 2024-02-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:50:19Z [load_day 2024-02-25] 2024-02-25 hour 0: 261258 events in 0 files, snapshot none (task 4703 ms: download 2172 ms overlapping gunzip 653 ms, parse 3044 ms, sort 0 ms, write 0 ms, index 562 ms: 8 candidates, 77807 repo-hours, 1082 releases; waiting 198 ms; commit 0 ms)
2026-11-08T04:50:19Z [load_day 2024-02-25] 2024-02-25 hour 1: 262961 events in 0 files, snapshot none (task 4800 ms: download 2218 ms overlapping gunzip 605 ms, parse 2899 ms, sort 0 ms, write 0 ms, index 621 ms: 3 candidates, 79235 repo-hours, 720 releases; waiting 346 ms; commit 0 ms)
2026-11-08T04:50:25Z [load_day 2024-02-25] 2024-02-25 hour 2: 233101 events in 0 files, snapshot none (task 5287 ms: download 2170 ms overlapping gunzip 664 ms, parse 3284 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 44287 repo-hours, 579 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:50:25Z [load_day 2024-02-25] 2024-02-25 hour 3: 232360 events in 0 files, snapshot none (task 5450 ms: download 2224 ms overlapping gunzip 734 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 479 ms: 3 candidates, 43789 repo-hours, 626 releases; waiting 493 ms; commit 0 ms)
2026-11-08T04:50:30Z [load_day 2024-02-25] 2024-02-25 hour 4: 235919 events in 0 files, snapshot none (task 4946 ms: download 2315 ms overlapping gunzip 672 ms, parse 3126 ms, sort 0 ms, write 0 ms, index 359 ms: 3 candidates, 45120 repo-hours, 485 releases; waiting 489 ms; commit 0 ms)
2026-11-08T04:50:31Z [load_day 2024-02-25] 2024-02-25 hour 5: 241351 events in 0 files, snapshot none (task 5447 ms: download 2530 ms overlapping gunzip 764 ms, parse 3557 ms, sort 0 ms, write 0 ms, index 445 ms: 7 candidates, 47715 repo-hours, 632 releases; waiting 444 ms; commit 0 ms)
2026-11-08T04:50:37Z [load_day 2024-02-25] 2024-02-25 hour 6: 246868 events in 0 files, snapshot none (task 6783 ms: download 3932 ms overlapping gunzip 961 ms, parse 4597 ms, sort 0 ms, write 0 ms, index 427 ms: 3 candidates, 57856 repo-hours, 642 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:50:37Z [load_day 2024-02-25] 2024-02-25 hour 7: 236441 events in 0 files, snapshot none (task 6110 ms: download 3186 ms overlapping gunzip 893 ms, parse 4067 ms, sort 0 ms, write 0 ms, index 440 ms: 2 candidates, 52579 repo-hours, 511 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:50:44Z [load_day 2024-02-25] 2024-02-25 hour 8: 241276 events in 0 files, snapshot none (task 6044 ms: download 2875 ms overlapping gunzip 846 ms, parse 3793 ms, sort 0 ms, write 0 ms, index 606 ms: 3 candidates, 55036 repo-hours, 680 releases; waiting 510 ms; commit 0 ms)
2026-11-08T04:50:45Z [load_day 2024-02-25] 2024-02-25 hour 9: 256350 events in 0 files, snapshot none (task 7580 ms: download 4544 ms overlapping gunzip 1116 ms, parse 5141 ms, sort 0 ms, write 0 ms, index 572 ms: 10 candidates, 58741 repo-hours, 781 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:50:51Z [load_day 2024-02-25] 2024-02-25 hour 10: 264484 events in 0 files, snapshot none (task 6894 ms: download 3305 ms overlapping gunzip 1030 ms, parse 4548 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 62678 repo-hours, 594 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:50:52Z [load_day 2024-02-25] 2024-02-25 hour 11: 260281 events in 0 files, snapshot none (task 6498 ms: download 3870 ms overlapping gunzip 1005 ms, parse 4199 ms, sort 0 ms, write 0 ms, index 430 ms: 2 candidates, 60124 repo-hours, 964 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:50:59Z [load_day 2024-02-25] 2024-02-25 hour 12: 314801 events in 0 files, snapshot none (task 7186 ms: download 3315 ms overlapping gunzip 932 ms, parse 4558 ms, sort 0 ms, write 0 ms, index 878 ms: 10 candidates, 92981 repo-hours, 1048 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:51:00Z [load_day 2024-02-25] 2024-02-25 hour 13: 281936 events in 0 files, snapshot none (task 7180 ms: download 4017 ms overlapping gunzip 1078 ms, parse 4714 ms, sort 0 ms, write 0 ms, index 660 ms: 8 candidates, 82888 repo-hours, 663 releases; waiting 457 ms; commit 0 ms)
2026-11-08T04:51:06Z [load_day 2024-02-25] 2024-02-25 hour 14: 278883 events in 0 files, snapshot none (task 6373 ms: download 3655 ms overlapping gunzip 855 ms, parse 4191 ms, sort 0 ms, write 0 ms, index 535 ms: 7 candidates, 72764 repo-hours, 752 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:51:08Z [load_day 2024-02-25] 2024-02-25 hour 15: 289182 events in 0 files, snapshot none (task 6977 ms: download 4194 ms overlapping gunzip 980 ms, parse 4434 ms, sort 0 ms, write 0 ms, index 773 ms: 4 candidates, 74491 repo-hours, 958 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:51:14Z [load_day 2024-02-25] 2024-02-25 hour 16: 284541 events in 0 files, snapshot none (task 8300 ms: download 4803 ms overlapping gunzip 1192 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 533 ms: 10 candidates, 72290 repo-hours, 830 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:51:15Z [load_day 2024-02-25] 2024-02-25 hour 17: 266168 events in 0 files, snapshot none (task 7011 ms: download 4167 ms overlapping gunzip 1007 ms, parse 4607 ms, sort 0 ms, write 0 ms, index 601 ms: 3 candidates, 75509 repo-hours, 762 releases; waiting 441 ms; commit 0 ms)
2026-11-08T04:51:23Z [load_day 2024-02-25] 2024-02-25 hour 18: 268461 events in 0 files, snapshot none (task 7796 ms: download 4615 ms overlapping gunzip 1032 ms, parse 5062 ms, sort 0 ms, write 0 ms, index 976 ms: 6 candidates, 77135 repo-hours, 947 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:51:23Z [load_day 2024-02-25] 2024-02-25 hour 19: 256520 events in 0 files, snapshot none (task 7665 ms: download 4742 ms overlapping gunzip 1069 ms, parse 5373 ms, sort 0 ms, write 0 ms, index 545 ms: 8 candidates, 65938 repo-hours, 838 releases; waiting 455 ms; commit 0 ms)
2026-11-08T04:51:30Z [load_day 2024-02-25] 2024-02-25 hour 20: 244652 events in 0 files, snapshot none (task 6601 ms: download 3412 ms overlapping gunzip 866 ms, parse 4303 ms, sort 0 ms, write 0 ms, index 669 ms: 3 candidates, 64656 repo-hours, 766 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:51:30Z [load_day 2024-02-25] 2024-02-25 hour 21: 239989 events in 0 files, snapshot none (task 6235 ms: download 3284 ms overlapping gunzip 851 ms, parse 3924 ms, sort 0 ms, write 0 ms, index 665 ms: 5 candidates, 60026 repo-hours, 841 releases; waiting 478 ms; commit 0 ms)
2026-11-08T04:51:36Z [load_day 2024-02-25] 2024-02-25 hour 22: 234899 events in 0 files, snapshot none (task 6256 ms: download 3647 ms overlapping gunzip 866 ms, parse 4227 ms, sort 0 ms, write 0 ms, index 411 ms: 7 candidates, 55078 repo-hours, 836 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:51:36Z [load_day 2024-02-25] 2024-02-25 hour 23: 215592 events in 0 files, snapshot none (task 5652 ms: download 3159 ms overlapping gunzip 758 ms, parse 3707 ms, sort 0 ms, write 0 ms, index 389 ms: 8 candidates, 51964 repo-hours, 603 releases; waiting 540 ms; commit 0 ms)
2026-11-08T04:51:44Z [load_day 2024-02-25] 2024-02-25: repo_hour merged from 24 files to 1 (1530687 rows, 7464 ms)
2026-11-08T04:51:47Z [load_day 2024-02-25] 2024-02-25: index committed in 10144 ms (24 + 1 + 24 files)
2026-11-08T04:51:47Z [load_day 2024-02-25] 2024-02-25: 6148274 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:51:47Z [load_day 2024-02-25] attempt 1 succeeded