orcaLog in

Runs · run 1929

load_day 2024-01-03, attempt 1 succeeded

Host
73ccef5e07c2:15381
Started
2026-11-08T03:59:30Z
Ended
2026-11-08T04:01:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
682 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
155.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1929/load_day/2024-01-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:59:30Z [load_day 2024-01-03] attempt 1 started
2026-11-08T03:59:31Z [load_day 2024-01-03] 2024-01-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:59:38Z [load_day 2024-01-03] 2024-01-03 hour 0: 186803 events in 0 files, snapshot none (task 6737 ms: download 4103 ms overlapping gunzip 1016 ms, parse 4423 ms, sort 0 ms, write 0 ms, index 557 ms: 7 candidates, 81234 repo-hours, 999 releases; waiting 455 ms; commit 0 ms)
2026-11-08T03:59:38Z [load_day 2024-01-03] 2024-01-03 hour 1: 191861 events in 0 files, snapshot none (task 6333 ms: download 4302 ms overlapping gunzip 881 ms, parse 4015 ms, sort 0 ms, write 0 ms, index 635 ms: 4 candidates, 89593 repo-hours, 883 releases; waiting 493 ms; commit 0 ms)
2026-11-08T03:59:45Z [load_day 2024-01-03] 2024-01-03 hour 2: 166677 events in 0 files, snapshot none (task 5991 ms: download 3542 ms overlapping gunzip 887 ms, parse 3751 ms, sort 0 ms, write 0 ms, index 472 ms: 3 candidates, 58948 repo-hours, 737 releases; waiting 525 ms; commit 0 ms)
2026-11-08T03:59:45Z [load_day 2024-01-03] 2024-01-03 hour 3: 163153 events in 0 files, snapshot none (task 6309 ms: download 3707 ms overlapping gunzip 1038 ms, parse 4240 ms, sort 0 ms, write 0 ms, index 391 ms: 6 candidates, 56281 repo-hours, 900 releases; waiting 352 ms; commit 0 ms)
2026-11-08T03:59:51Z [load_day 2024-01-03] 2024-01-03 hour 4: 158591 events in 0 files, snapshot none (task 5380 ms: download 2524 ms overlapping gunzip 764 ms, parse 3268 ms, sort 0 ms, write 0 ms, index 538 ms: 2 candidates, 52100 repo-hours, 640 releases; waiting 516 ms; commit 0 ms)
2026-11-08T03:59:52Z [load_day 2024-01-03] 2024-01-03 hour 5: 172331 events in 0 files, snapshot none (task 6391 ms: download 3758 ms overlapping gunzip 1043 ms, parse 4072 ms, sort 0 ms, write 0 ms, index 465 ms: 3 candidates, 57218 repo-hours, 625 releases; waiting 521 ms; commit 0 ms)
2026-11-08T03:59:57Z [load_day 2024-01-03] 2024-01-03 hour 6: 187004 events in 0 files, snapshot none (task 5196 ms: download 2641 ms overlapping gunzip 703 ms, parse 3073 ms, sort 0 ms, write 0 ms, index 580 ms: 3 candidates, 71387 repo-hours, 764 releases; waiting 502 ms; commit 0 ms)
2026-11-08T03:59:58Z [load_day 2024-01-03] 2024-01-03 hour 7: 188143 events in 0 files, snapshot none (task 5416 ms: download 2828 ms overlapping gunzip 782 ms, parse 3196 ms, sort 0 ms, write 0 ms, index 586 ms: 1 candidates, 67621 repo-hours, 720 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:00:04Z [load_day 2024-01-03] 2024-01-03 hour 8: 201180 events in 0 files, snapshot none (task 7222 ms: download 4217 ms overlapping gunzip 1024 ms, parse 4367 ms, sort 0 ms, write 0 ms, index 1044 ms: 7 candidates, 75299 repo-hours, 935 releases; waiting 486 ms; commit 0 ms)
2026-11-08T04:00:05Z [load_day 2024-01-03] 2024-01-03 hour 9: 203841 events in 0 files, snapshot none (task 7136 ms: download 4224 ms overlapping gunzip 1116 ms, parse 4560 ms, sort 0 ms, write 0 ms, index 689 ms: 2 candidates, 78883 repo-hours, 1280 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:00:11Z [load_day 2024-01-03] 2024-01-03 hour 10: 202394 events in 0 files, snapshot none (task 6514 ms: download 3715 ms overlapping gunzip 921 ms, parse 3937 ms, sort 0 ms, write 0 ms, index 894 ms: 9 candidates, 77829 repo-hours, 975 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:00:12Z [load_day 2024-01-03] 2024-01-03 hour 11: 207113 events in 0 files, snapshot none (task 6280 ms: download 3763 ms overlapping gunzip 955 ms, parse 3994 ms, sort 0 ms, write 0 ms, index 535 ms: 5 candidates, 73745 repo-hours, 991 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:00:19Z [load_day 2024-01-03] 2024-01-03 hour 12: 253333 events in 0 files, snapshot none (task 6659 ms: download 3871 ms overlapping gunzip 977 ms, parse 4278 ms, sort 0 ms, write 0 ms, index 756 ms: 9 candidates, 106521 repo-hours, 1049 releases; waiting 281 ms; commit 0 ms)
2026-11-08T04:00:19Z [load_day 2024-01-03] 2024-01-03 hour 13: 232338 events in 0 files, snapshot none (task 6536 ms: download 3955 ms overlapping gunzip 993 ms, parse 4193 ms, sort 0 ms, write 0 ms, index 710 ms: 12 candidates, 100353 repo-hours, 1072 releases; waiting 311 ms; commit 0 ms)
2026-11-08T04:00:26Z [load_day 2024-01-03] 2024-01-03 hour 14: 231880 events in 0 files, snapshot none (task 6746 ms: download 4229 ms overlapping gunzip 1004 ms, parse 4327 ms, sort 0 ms, write 0 ms, index 667 ms: 9 candidates, 87144 repo-hours, 1234 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:00:27Z [load_day 2024-01-03] 2024-01-03 hour 15: 234867 events in 0 files, snapshot none (task 6729 ms: download 4181 ms overlapping gunzip 1040 ms, parse 4196 ms, sort 0 ms, write 0 ms, index 688 ms: 4 candidates, 89525 repo-hours, 1303 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:00:35Z [load_day 2024-01-03] 2024-01-03 hour 16: 230059 events in 0 files, snapshot none (task 8684 ms: download 6026 ms overlapping gunzip 1346 ms, parse 5852 ms, sort 0 ms, write 0 ms, index 655 ms: 8 candidates, 85796 repo-hours, 1124 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:00:35Z [load_day 2024-01-03] 2024-01-03 hour 17: 222887 events in 0 files, snapshot none (task 8280 ms: download 5696 ms overlapping gunzip 1279 ms, parse 5620 ms, sort 0 ms, write 0 ms, index 583 ms: 12 candidates, 79106 repo-hours, 1050 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:00:44Z [load_day 2024-01-03] 2024-01-03 hour 18: 220617 events in 0 files, snapshot none (task 8500 ms: download 5673 ms overlapping gunzip 1323 ms, parse 5458 ms, sort 0 ms, write 0 ms, index 995 ms: 7 candidates, 82822 repo-hours, 1121 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:00:44Z [load_day 2024-01-03] 2024-01-03 hour 19: 202737 events in 0 files, snapshot none (task 8453 ms: download 5591 ms overlapping gunzip 1190 ms, parse 5583 ms, sort 0 ms, write 0 ms, index 881 ms: 6 candidates, 69677 repo-hours, 960 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:00:52Z [load_day 2024-01-03] 2024-01-03 hour 20: 198676 events in 0 files, snapshot none (task 6637 ms: download 3792 ms overlapping gunzip 1010 ms, parse 4156 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 68007 repo-hours, 977 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:00:52Z [load_day 2024-01-03] 2024-01-03 hour 21: 195214 events in 0 files, snapshot none (task 6800 ms: download 3674 ms overlapping gunzip 1088 ms, parse 4342 ms, sort 0 ms, write 0 ms, index 635 ms: 7 candidates, 63177 repo-hours, 1113 releases; waiting 467 ms; commit 0 ms)
2026-11-08T04:00:59Z [load_day 2024-01-03] 2024-01-03 hour 22: 185022 events in 0 files, snapshot none (task 6873 ms: download 3829 ms overlapping gunzip 1015 ms, parse 4154 ms, sort 0 ms, write 0 ms, index 689 ms: 6 candidates, 58899 repo-hours, 905 releases; waiting 718 ms; commit 0 ms)
2026-11-08T04:00:59Z [load_day 2024-01-03] 2024-01-03 hour 23: 177978 events in 0 files, snapshot none (task 6765 ms: download 3644 ms overlapping gunzip 1037 ms, parse 4448 ms, sort 0 ms, write 0 ms, index 432 ms: 3 candidates, 53914 repo-hours, 819 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:01:08Z [load_day 2024-01-03] 2024-01-03: repo_hour merged from 24 files to 1 (1785079 rows, 8675 ms)
2026-11-08T04:01:11Z [load_day 2024-01-03] 2024-01-03: index committed in 11420 ms (24 + 1 + 24 files)
2026-11-08T04:01:11Z [load_day 2024-01-03] 2024-01-03: 4814699 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:01:11Z [load_day 2024-01-03] attempt 1 succeeded