orcaLog in

Runs · run 2950

load_day 2024-09-12, attempt 1 succeeded

Host
73ccef5e07c2:176536
Started
2026-11-08T07:53:00Z
Ended
2026-11-08T07:55:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
822 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
193.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2950/load_day/2024-09-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:53:00Z [load_day 2024-09-12] attempt 1 started
2026-11-08T07:53:01Z [load_day 2024-09-12] 2024-09-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:53:11Z [load_day 2024-09-12] 2024-09-12 hour 0: 190416 events in 0 files, snapshot none (task 8599 ms: download 5761 ms overlapping gunzip 1354 ms, parse 5728 ms, sort 0 ms, write 0 ms, index 709 ms: 2 candidates, 90943 repo-hours, 1020 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:53:11Z [load_day 2024-09-12] 2024-09-12 hour 1: 204381 events in 0 files, snapshot none (task 8695 ms: download 5973 ms overlapping gunzip 1414 ms, parse 5605 ms, sort 0 ms, write 0 ms, index 950 ms: 8 candidates, 108743 repo-hours, 832 releases; waiting 467 ms; commit 0 ms)
2026-11-08T07:53:19Z [load_day 2024-09-12] 2024-09-12 hour 2: 183013 events in 0 files, snapshot none (task 7453 ms: download 4457 ms overlapping gunzip 1206 ms, parse 4639 ms, sort 0 ms, write 0 ms, index 671 ms: 1 candidates, 79089 repo-hours, 906 releases; waiting 488 ms; commit 0 ms)
2026-11-08T07:53:19Z [load_day 2024-09-12] 2024-09-12 hour 3: 198627 events in 0 files, snapshot none (task 7685 ms: download 4752 ms overlapping gunzip 1177 ms, parse 4843 ms, sort 0 ms, write 0 ms, index 673 ms: 8 candidates, 79171 repo-hours, 4107 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:53:27Z [load_day 2024-09-12] 2024-09-12 hour 4: 175296 events in 0 files, snapshot none (task 7547 ms: download 4743 ms overlapping gunzip 1186 ms, parse 4879 ms, sort 0 ms, write 0 ms, index 683 ms: 4 candidates, 65880 repo-hours, 682 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:53:27Z [load_day 2024-09-12] 2024-09-12 hour 5: 187690 events in 0 files, snapshot none (task 7973 ms: download 5087 ms overlapping gunzip 1304 ms, parse 5166 ms, sort 0 ms, write 0 ms, index 664 ms: 6 candidates, 71385 repo-hours, 1058 releases; waiting 567 ms; commit 0 ms)
2026-11-08T07:53:37Z [load_day 2024-09-12] 2024-09-12 hour 6: 221664 events in 0 files, snapshot none (task 9831 ms: download 6328 ms overlapping gunzip 1474 ms, parse 6346 ms, sort 0 ms, write 0 ms, index 971 ms: 13 candidates, 98509 repo-hours, 1055 releases; waiting 670 ms; commit 0 ms)
2026-11-08T07:53:38Z [load_day 2024-09-12] 2024-09-12 hour 7: 227400 events in 0 files, snapshot none (task 9961 ms: download 7011 ms overlapping gunzip 1709 ms, parse 6752 ms, sort 0 ms, write 0 ms, index 650 ms: 7 candidates, 89146 repo-hours, 1053 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:53:47Z [load_day 2024-09-12] 2024-09-12 hour 8: 238778 events in 0 files, snapshot none (task 9564 ms: download 6804 ms overlapping gunzip 1622 ms, parse 6504 ms, sort 0 ms, write 0 ms, index 717 ms: 15 candidates, 97907 repo-hours, 1222 releases; waiting 455 ms; commit 0 ms)
2026-11-08T07:53:49Z [load_day 2024-09-12] 2024-09-12 hour 9: 247126 events in 0 files, snapshot none (task 10277 ms: download 7681 ms overlapping gunzip 1629 ms, parse 7104 ms, sort 0 ms, write 0 ms, index 722 ms: 14 candidates, 102942 repo-hours, 1347 releases; waiting 520 ms; commit 0 ms)
2026-11-08T07:53:57Z [load_day 2024-09-12] 2024-09-12 hour 10: 224190 events in 0 files, snapshot none (task 9158 ms: download 6511 ms overlapping gunzip 1553 ms, parse 5910 ms, sort 0 ms, write 0 ms, index 640 ms: 6 candidates, 90981 repo-hours, 1041 releases; waiting 566 ms; commit 0 ms)
2026-11-08T07:53:58Z [load_day 2024-09-12] 2024-09-12 hour 11: 225314 events in 0 files, snapshot none (task 8861 ms: download 6463 ms overlapping gunzip 1426 ms, parse 5916 ms, sort 0 ms, write 0 ms, index 599 ms: 9 candidates, 88089 repo-hours, 1270 releases; waiting 628 ms; commit 0 ms)
2026-11-08T07:54:06Z [load_day 2024-09-12] 2024-09-12 hour 12: 277243 events in 0 files, snapshot none (task 8648 ms: download 6329 ms overlapping gunzip 1239 ms, parse 5120 ms, sort 0 ms, write 0 ms, index 956 ms: 15 candidates, 135883 repo-hours, 1405 releases; waiting 884 ms; commit 0 ms)
2026-11-08T07:54:06Z [load_day 2024-09-12] 2024-09-12 hour 13: 255638 events in 0 files, snapshot none (task 8107 ms: download 5480 ms overlapping gunzip 1239 ms, parse 5266 ms, sort 0 ms, write 0 ms, index 825 ms: 8 candidates, 117692 repo-hours, 1367 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:54:16Z [load_day 2024-09-12] 2024-09-12 hour 14: 229101 events in 0 files, snapshot none (task 9483 ms: download 5823 ms overlapping gunzip 1423 ms, parse 5742 ms, sort 0 ms, write 0 ms, index 966 ms: 9 candidates, 101451 repo-hours, 1283 releases; waiting 876 ms; commit 0 ms)
2026-11-08T07:54:17Z [load_day 2024-09-12] 2024-09-12 hour 15: 244991 events in 0 files, snapshot none (task 10414 ms: download 7175 ms overlapping gunzip 1508 ms, parse 6190 ms, sort 0 ms, write 0 ms, index 944 ms: 5 candidates, 108553 repo-hours, 1342 releases; waiting 1400 ms; commit 0 ms)
2026-11-08T07:54:26Z [load_day 2024-09-12] 2024-09-12 hour 16: 233119 events in 0 files, snapshot none (task 9421 ms: download 6508 ms overlapping gunzip 1535 ms, parse 6257 ms, sort 0 ms, write 0 ms, index 754 ms: 4 candidates, 100351 repo-hours, 1438 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:54:26Z [load_day 2024-09-12] 2024-09-12 hour 17: 225024 events in 0 files, snapshot none (task 9010 ms: download 6388 ms overlapping gunzip 1478 ms, parse 6044 ms, sort 0 ms, write 0 ms, index 675 ms: 12 candidates, 90766 repo-hours, 1066 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:54:37Z [load_day 2024-09-12] 2024-09-12 hour 18: 235529 events in 0 files, snapshot none (task 10417 ms: download 6682 ms overlapping gunzip 1663 ms, parse 6968 ms, sort 0 ms, write 0 ms, index 998 ms: 3 candidates, 108822 repo-hours, 1214 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:54:37Z [load_day 2024-09-12] 2024-09-12 hour 19: 211699 events in 0 files, snapshot none (task 9810 ms: download 6533 ms overlapping gunzip 1608 ms, parse 6815 ms, sort 0 ms, write 0 ms, index 782 ms: 9 candidates, 81880 repo-hours, 1086 releases; waiting 229 ms; commit 0 ms)
2026-11-08T07:54:45Z [load_day 2024-09-12] 2024-09-12 hour 20: 201071 events in 0 files, snapshot none (task 7608 ms: download 4762 ms overlapping gunzip 1207 ms, parse 4814 ms, sort 0 ms, write 0 ms, index 680 ms: 14 candidates, 79077 repo-hours, 1039 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:54:45Z [load_day 2024-09-12] 2024-09-12 hour 21: 194973 events in 0 files, snapshot none (task 6588 ms: download 3941 ms overlapping gunzip 1008 ms, parse 4268 ms, sort 0 ms, write 0 ms, index 709 ms: 5 candidates, 76147 repo-hours, 1071 releases; waiting 270 ms; commit 0 ms)
2026-11-08T07:54:52Z [load_day 2024-09-12] 2024-09-12 hour 22: 169943 events in 0 files, snapshot none (task 6119 ms: download 3769 ms overlapping gunzip 929 ms, parse 4226 ms, sort 0 ms, write 0 ms, index 497 ms: 2 candidates, 62178 repo-hours, 910 releases; waiting 193 ms; commit 0 ms)
2026-11-08T07:54:52Z [load_day 2024-09-12] 2024-09-12 hour 23: 162629 events in 0 files, snapshot none (task 6484 ms: download 4099 ms overlapping gunzip 1030 ms, parse 4241 ms, sort 0 ms, write 0 ms, index 400 ms: 7 candidates, 58635 repo-hours, 835 releases; waiting 546 ms; commit 0 ms)
2026-11-08T07:55:02Z [load_day 2024-09-12] 2024-09-12: repo_hour merged from 24 files to 1 (2184220 rows, 9644 ms)
2026-11-08T07:55:05Z [load_day 2024-09-12] 2024-09-12: index committed in 12630 ms (24 + 1 + 24 files)
2026-11-08T07:55:05Z [load_day 2024-09-12] 2024-09-12: 5164855 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:55:05Z [load_day 2024-09-12] attempt 1 succeeded