orcaLog in

Runs · run 1874

load_day 2023-12-19, attempt 1 succeeded

Host
73ccef5e07c2:10987
Started
2026-11-08T03:49:13Z
Ended
2026-11-08T03:51:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
678 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
171.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1874/load_day/2023-12-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:49:13Z [load_day 2023-12-19] attempt 1 started
2026-11-08T03:49:14Z [load_day 2023-12-19] 2023-12-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T03:49:23Z [load_day 2023-12-19] 2023-12-19 hour 0: 177609 events in 0 files, snapshot none (task 8254 ms: download 5070 ms overlapping gunzip 1306 ms, parse 5329 ms, sort 0 ms, write 0 ms, index 743 ms: 10 candidates, 89814 repo-hours, 1046 releases; waiting 523 ms; commit 0 ms)
2026-11-08T03:49:23Z [load_day 2023-12-19] 2023-12-19 hour 1: 171326 events in 0 files, snapshot none (task 7803 ms: download 4918 ms overlapping gunzip 1201 ms, parse 4789 ms, sort 0 ms, write 0 ms, index 835 ms: 13 candidates, 92657 repo-hours, 883 releases; waiting 698 ms; commit 0 ms)
2026-11-08T03:49:30Z [load_day 2023-12-19] 2023-12-19 hour 2: 145232 events in 0 files, snapshot none (task 6178 ms: download 3467 ms overlapping gunzip 867 ms, parse 3516 ms, sort 0 ms, write 0 ms, index 643 ms: 6 candidates, 63069 repo-hours, 740 releases; waiting 842 ms; commit 0 ms)
2026-11-08T03:49:30Z [load_day 2023-12-19] 2023-12-19 hour 3: 141898 events in 0 files, snapshot none (task 5681 ms: download 2598 ms overlapping gunzip 828 ms, parse 3316 ms, sort 0 ms, write 0 ms, index 685 ms: 3 candidates, 60794 repo-hours, 835 releases; waiting 256 ms; commit 0 ms)
2026-11-08T03:49:35Z [load_day 2023-12-19] 2023-12-19 hour 4: 135984 events in 0 files, snapshot none (task 5052 ms: download 3095 ms overlapping gunzip 791 ms, parse 3114 ms, sort 0 ms, write 0 ms, index 410 ms: 5 candidates, 56784 repo-hours, 708 releases; waiting 500 ms; commit 0 ms)
2026-11-08T03:49:37Z [load_day 2023-12-19] 2023-12-19 hour 5: 149261 events in 0 files, snapshot none (task 6455 ms: download 3876 ms overlapping gunzip 988 ms, parse 3934 ms, sort 0 ms, write 0 ms, index 763 ms: 5 candidates, 61596 repo-hours, 775 releases; waiting 480 ms; commit 0 ms)
2026-11-08T03:49:43Z [load_day 2023-12-19] 2023-12-19 hour 6: 168367 events in 0 files, snapshot none (task 6777 ms: download 3938 ms overlapping gunzip 1004 ms, parse 4522 ms, sort 0 ms, write 0 ms, index 527 ms: 7 candidates, 76212 repo-hours, 869 releases; waiting 428 ms; commit 0 ms)
2026-11-08T03:49:44Z [load_day 2023-12-19] 2023-12-19 hour 7: 176325 events in 0 files, snapshot none (task 6962 ms: download 4373 ms overlapping gunzip 1091 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 625 ms: 7 candidates, 74451 repo-hours, 920 releases; waiting 464 ms; commit 0 ms)
2026-11-08T03:49:52Z [load_day 2023-12-19] 2023-12-19 hour 8: 194618 events in 0 files, snapshot none (task 8500 ms: download 5433 ms overlapping gunzip 1312 ms, parse 5415 ms, sort 0 ms, write 0 ms, index 830 ms: 13 candidates, 83860 repo-hours, 1103 releases; waiting 661 ms; commit 0 ms)
2026-11-08T03:49:54Z [load_day 2023-12-19] 2023-12-19 hour 9: 199855 events in 0 files, snapshot none (task 8740 ms: download 6178 ms overlapping gunzip 1379 ms, parse 5821 ms, sort 0 ms, write 0 ms, index 681 ms: 11 candidates, 88158 repo-hours, 1393 releases; waiting 512 ms; commit 0 ms)
2026-11-08T03:49:59Z [load_day 2023-12-19] 2023-12-19 hour 10: 199205 events in 0 files, snapshot none (task 6865 ms: download 4402 ms overlapping gunzip 1044 ms, parse 4444 ms, sort 0 ms, write 0 ms, index 595 ms: 9 candidates, 86998 repo-hours, 1168 releases; waiting 501 ms; commit 0 ms)
2026-11-08T03:50:01Z [load_day 2023-12-19] 2023-12-19 hour 11: 189668 events in 0 files, snapshot none (task 6626 ms: download 4168 ms overlapping gunzip 1033 ms, parse 4180 ms, sort 0 ms, write 0 ms, index 587 ms: 9 candidates, 80792 repo-hours, 1233 releases; waiting 527 ms; commit 0 ms)
2026-11-08T03:50:07Z [load_day 2023-12-19] 2023-12-19 hour 12: 240196 events in 0 files, snapshot none (task 7399 ms: download 4617 ms overlapping gunzip 1101 ms, parse 4752 ms, sort 0 ms, write 0 ms, index 734 ms: 7 candidates, 113260 repo-hours, 1531 releases; waiting 538 ms; commit 0 ms)
2026-11-08T03:50:09Z [load_day 2023-12-19] 2023-12-19 hour 13: 222500 events in 0 files, snapshot none (task 7512 ms: download 4353 ms overlapping gunzip 1092 ms, parse 4746 ms, sort 0 ms, write 0 ms, index 1210 ms: 8 candidates, 108106 repo-hours, 1269 releases; waiting 203 ms; commit 0 ms)
2026-11-08T03:50:18Z [load_day 2023-12-19] 2023-12-19 hour 14: 218658 events in 0 files, snapshot none (task 10210 ms: download 6509 ms overlapping gunzip 1621 ms, parse 6906 ms, sort 0 ms, write 0 ms, index 877 ms: 5 candidates, 95179 repo-hours, 1276 releases; waiting 498 ms; commit 0 ms)
2026-11-08T03:50:19Z [load_day 2023-12-19] 2023-12-19 hour 15: 221029 events in 0 files, snapshot none (task 9551 ms: download 6833 ms overlapping gunzip 1544 ms, parse 6448 ms, sort 0 ms, write 0 ms, index 699 ms: 11 candidates, 97913 repo-hours, 1411 releases; waiting 530 ms; commit 0 ms)
2026-11-08T03:50:27Z [load_day 2023-12-19] 2023-12-19 hour 16: 215343 events in 0 files, snapshot none (task 8955 ms: download 6406 ms overlapping gunzip 1419 ms, parse 6028 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 93681 repo-hours, 1152 releases; waiting 538 ms; commit 0 ms)
2026-11-08T03:50:28Z [load_day 2023-12-19] 2023-12-19 hour 17: 199670 events in 0 files, snapshot none (task 8279 ms: download 5846 ms overlapping gunzip 1351 ms, parse 5476 ms, sort 0 ms, write 0 ms, index 673 ms: 6 candidates, 85436 repo-hours, 1079 releases; waiting 493 ms; commit 0 ms)
2026-11-08T03:50:35Z [load_day 2023-12-19] 2023-12-19 hour 18: 196754 events in 0 files, snapshot none (task 7804 ms: download 5382 ms overlapping gunzip 1288 ms, parse 5128 ms, sort 0 ms, write 0 ms, index 679 ms: 12 candidates, 87451 repo-hours, 1043 releases; waiting 459 ms; commit 0 ms)
2026-11-08T03:50:35Z [load_day 2023-12-19] 2023-12-19 hour 19: 183930 events in 0 files, snapshot none (task 7201 ms: download 4690 ms overlapping gunzip 1165 ms, parse 4764 ms, sort 0 ms, write 0 ms, index 656 ms: 8 candidates, 75555 repo-hours, 1011 releases; waiting 333 ms; commit 0 ms)
2026-11-08T03:50:43Z [load_day 2023-12-19] 2023-12-19 hour 20: 166042 events in 0 files, snapshot none (task 6811 ms: download 4397 ms overlapping gunzip 1067 ms, parse 4485 ms, sort 0 ms, write 0 ms, index 548 ms: 11 candidates, 71165 repo-hours, 946 releases; waiting 451 ms; commit 0 ms)
2026-11-08T03:50:43Z [load_day 2023-12-19] 2023-12-19 hour 21: 164698 events in 0 files, snapshot none (task 6848 ms: download 4465 ms overlapping gunzip 1150 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 504 ms: 11 candidates, 68435 repo-hours, 1109 releases; waiting 497 ms; commit 0 ms)
2026-11-08T03:50:50Z [load_day 2023-12-19] 2023-12-19 hour 22: 154934 events in 0 files, snapshot none (task 6806 ms: download 4557 ms overlapping gunzip 1093 ms, parse 4446 ms, sort 0 ms, write 0 ms, index 502 ms: 9 candidates, 63177 repo-hours, 1134 releases; waiting 480 ms; commit 0 ms)
2026-11-08T03:50:50Z [load_day 2023-12-19] 2023-12-19 hour 23: 135906 events in 0 files, snapshot none (task 5954 ms: download 3618 ms overlapping gunzip 963 ms, parse 3642 ms, sort 0 ms, write 0 ms, index 513 ms: 10 candidates, 56486 repo-hours, 801 releases; waiting 499 ms; commit 0 ms)
2026-11-08T03:50:59Z [load_day 2023-12-19] 2023-12-19: repo_hour merged from 24 files to 1 (1931029 rows, 8537 ms)
2026-11-08T03:51:01Z [load_day 2023-12-19] 2023-12-19: index committed in 10833 ms (24 + 1 + 24 files)
2026-11-08T03:51:01Z [load_day 2023-12-19] 2023-12-19: 4369008 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T03:51:01Z [load_day 2023-12-19] attempt 1 succeeded