orcaLog in

Runs · run 1902

load_day 2023-12-27, attempt 1 succeeded

Host
73ccef5e07c2:13211
Started
2026-11-08T03:54:59Z
Ended
2026-11-08T03:56:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
603 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
124.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1902/load_day/2023-12-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:54:59Z [load_day 2023-12-27] attempt 1 started
2026-11-08T03:55:00Z [load_day 2023-12-27] 2023-12-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:55:06Z [load_day 2023-12-27] 2023-12-27 hour 0: 159572 events in 0 files, snapshot none (task 5289 ms: download 2529 ms overlapping gunzip 725 ms, parse 3169 ms, sort 0 ms, write 0 ms, index 657 ms: 10 candidates, 75569 repo-hours, 1047 releases; waiting 507 ms; commit 0 ms)
2026-11-08T03:55:06Z [load_day 2023-12-27] 2023-12-27 hour 1: 157413 events in 0 files, snapshot none (task 5323 ms: download 2742 ms overlapping gunzip 699 ms, parse 3240 ms, sort 0 ms, write 0 ms, index 586 ms: 13 candidates, 80620 repo-hours, 729 releases; waiting 475 ms; commit 0 ms)
2026-11-08T03:55:11Z [load_day 2023-12-27] 2023-12-27 hour 2: 135283 events in 0 files, snapshot none (task 4209 ms: download 1465 ms overlapping gunzip 655 ms, parse 2589 ms, sort 0 ms, write 0 ms, index 575 ms: 9 candidates, 51025 repo-hours, 676 releases; waiting 188 ms; commit 0 ms)
2026-11-08T03:55:12Z [load_day 2023-12-27] 2023-12-27 hour 3: 134342 events in 0 files, snapshot none (task 5193 ms: download 2424 ms overlapping gunzip 711 ms, parse 2910 ms, sort 0 ms, write 0 ms, index 344 ms: 6 candidates, 50749 repo-hours, 690 releases; waiting 530 ms; commit 0 ms)
2026-11-08T03:55:16Z [load_day 2023-12-27] 2023-12-27 hour 4: 132660 events in 0 files, snapshot none (task 4894 ms: download 2846 ms overlapping gunzip 576 ms, parse 2586 ms, sort 0 ms, write 0 ms, index 705 ms: 4 candidates, 46187 repo-hours, 571 releases; waiting 338 ms; commit 0 ms)
2026-11-08T03:55:17Z [load_day 2023-12-27] 2023-12-27 hour 5: 136841 events in 0 files, snapshot none (task 4470 ms: download 2333 ms overlapping gunzip 663 ms, parse 2710 ms, sort 0 ms, write 0 ms, index 383 ms: 4 candidates, 52192 repo-hours, 611 releases; waiting 497 ms; commit 0 ms)
2026-11-08T03:55:22Z [load_day 2023-12-27] 2023-12-27 hour 6: 160497 events in 0 files, snapshot none (task 5108 ms: download 1913 ms overlapping gunzip 739 ms, parse 3125 ms, sort 0 ms, write 0 ms, index 742 ms: 7 candidates, 65533 repo-hours, 903 releases; waiting 259 ms; commit 0 ms)
2026-11-08T03:55:24Z [load_day 2023-12-27] 2023-12-27 hour 7: 159406 events in 0 files, snapshot none (task 5280 ms: download 2871 ms overlapping gunzip 761 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 448 ms: 7 candidates, 60761 repo-hours, 740 releases; waiting 504 ms; commit 0 ms)
2026-11-08T03:55:27Z [load_day 2023-12-27] 2023-12-27 hour 8: 170039 events in 0 files, snapshot none (task 5021 ms: download 3557 ms overlapping gunzip 681 ms, parse 2876 ms, sort 0 ms, write 0 ms, index 523 ms: 5 candidates, 66107 repo-hours, 732 releases; waiting 596 ms; commit 0 ms)
2026-11-08T03:55:29Z [load_day 2023-12-27] 2023-12-27 hour 9: 173007 events in 0 files, snapshot none (task 4944 ms: download 2601 ms overlapping gunzip 700 ms, parse 2921 ms, sort 0 ms, write 0 ms, index 518 ms: 5 candidates, 67044 repo-hours, 1013 releases; waiting 526 ms; commit 0 ms)
2026-11-08T03:55:33Z [load_day 2023-12-27] 2023-12-27 hour 10: 173774 events in 0 files, snapshot none (task 5251 ms: download 2902 ms overlapping gunzip 783 ms, parse 3246 ms, sort 0 ms, write 0 ms, index 521 ms: 7 candidates, 66107 repo-hours, 804 releases; waiting 494 ms; commit 0 ms)
2026-11-08T03:55:34Z [load_day 2023-12-27] 2023-12-27 hour 11: 163900 events in 0 files, snapshot none (task 4688 ms: download 2325 ms overlapping gunzip 651 ms, parse 2757 ms, sort 0 ms, write 0 ms, index 488 ms: 8 candidates, 63154 repo-hours, 771 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:55:40Z [load_day 2023-12-27] 2023-12-27 hour 12: 228879 events in 0 files, snapshot none (task 6955 ms: download 3855 ms overlapping gunzip 937 ms, parse 4522 ms, sort 0 ms, write 0 ms, index 701 ms: 12 candidates, 95897 repo-hours, 876 releases; waiting 392 ms; commit 0 ms)
2026-11-08T03:55:41Z [load_day 2023-12-27] 2023-12-27 hour 13: 195524 events in 0 files, snapshot none (task 6720 ms: download 4105 ms overlapping gunzip 942 ms, parse 4271 ms, sort 0 ms, write 0 ms, index 709 ms: 4 candidates, 87734 repo-hours, 814 releases; waiting 443 ms; commit 0 ms)
2026-11-08T03:55:48Z [load_day 2023-12-27] 2023-12-27 hour 14: 194826 events in 0 files, snapshot none (task 7278 ms: download 4328 ms overlapping gunzip 1078 ms, parse 4255 ms, sort 0 ms, write 0 ms, index 1083 ms: 6 candidates, 75145 repo-hours, 913 releases; waiting 559 ms; commit 0 ms)
2026-11-08T03:55:49Z [load_day 2023-12-27] 2023-12-27 hour 15: 196408 events in 0 files, snapshot none (task 6807 ms: download 3857 ms overlapping gunzip 1010 ms, parse 4091 ms, sort 0 ms, write 0 ms, index 915 ms: 8 candidates, 75385 repo-hours, 1046 releases; waiting 525 ms; commit 0 ms)
2026-11-08T03:55:55Z [load_day 2023-12-27] 2023-12-27 hour 16: 186448 events in 0 files, snapshot none (task 6747 ms: download 4651 ms overlapping gunzip 987 ms, parse 4016 ms, sort 0 ms, write 0 ms, index 594 ms: 11 candidates, 73524 repo-hours, 994 releases; waiting 794 ms; commit 0 ms)
2026-11-08T03:55:55Z [load_day 2023-12-27] 2023-12-27 hour 17: 179598 events in 0 files, snapshot none (task 5450 ms: download 2450 ms overlapping gunzip 837 ms, parse 3468 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 66884 repo-hours, 972 releases; waiting 230 ms; commit 0 ms)
2026-11-08T03:56:02Z [load_day 2023-12-27] 2023-12-27 hour 18: 180114 events in 0 files, snapshot none (task 6140 ms: download 3325 ms overlapping gunzip 888 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 69951 repo-hours, 835 releases; waiting 504 ms; commit 0 ms)
2026-11-08T03:56:02Z [load_day 2023-12-27] 2023-12-27 hour 19: 165929 events in 0 files, snapshot none (task 5784 ms: download 3007 ms overlapping gunzip 876 ms, parse 3583 ms, sort 0 ms, write 0 ms, index 522 ms: 2 candidates, 57385 repo-hours, 859 releases; waiting 495 ms; commit 0 ms)
2026-11-08T03:56:08Z [load_day 2023-12-27] 2023-12-27 hour 20: 160039 events in 0 files, snapshot none (task 5513 ms: download 2528 ms overlapping gunzip 824 ms, parse 3475 ms, sort 0 ms, write 0 ms, index 391 ms: 7 candidates, 56062 repo-hours, 786 releases; waiting 521 ms; commit 0 ms)
2026-11-08T03:56:08Z [load_day 2023-12-27] 2023-12-27 hour 21: 150993 events in 0 files, snapshot none (task 5231 ms: download 2301 ms overlapping gunzip 762 ms, parse 3218 ms, sort 0 ms, write 0 ms, index 650 ms: 6 candidates, 52158 repo-hours, 896 releases; waiting 388 ms; commit 0 ms)
2026-11-08T03:56:13Z [load_day 2023-12-27] 2023-12-27 hour 22: 139953 events in 0 files, snapshot none (task 5138 ms: download 2748 ms overlapping gunzip 731 ms, parse 3045 ms, sort 0 ms, write 0 ms, index 513 ms: 4 candidates, 47891 repo-hours, 834 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:56:14Z [load_day 2023-12-27] 2023-12-27 hour 23: 133621 events in 0 files, snapshot none (task 5509 ms: download 2632 ms overlapping gunzip 792 ms, parse 3435 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 45803 repo-hours, 768 releases; waiting 533 ms; commit 0 ms)
2026-11-08T03:56:21Z [load_day 2023-12-27] 2023-12-27: repo_hour merged from 24 files to 1 (1548867 rows, 6845 ms)
2026-11-08T03:56:23Z [load_day 2023-12-27] 2023-12-27: index committed in 8915 ms (24 + 1 + 24 files)
2026-11-08T03:56:23Z [load_day 2023-12-27] 2023-12-27: 3969066 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:56:23Z [load_day 2023-12-27] attempt 1 succeeded