orcaLog in

Runs · run 3377

load_day 2024-12-30, attempt 1 succeeded

Host
73ccef5e07c2:230060
Started
2026-11-08T09:35:34Z
Ended
2026-11-08T09:37:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3377/load_day/2024-12-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:35:34Z [load_day 2024-12-30] attempt 1 started
2026-11-08T09:35:35Z [load_day 2024-12-30] 2024-12-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:35:43Z [load_day 2024-12-30] 2024-12-30 hour 0: 162962 events in 0 files, snapshot none (task 5755 ms: download 2675 ms overlapping gunzip 844 ms, parse 3479 ms, sort 0 ms, write 0 ms, index 860 ms: 8 candidates, 78294 repo-hours, 1105 releases; waiting 85 ms; commit 0 ms)
2026-11-08T09:35:44Z [load_day 2024-12-30] 2024-12-30 hour 1: 192479 events in 0 files, snapshot none (task 6643 ms: download 3570 ms overlapping gunzip 1019 ms, parse 4074 ms, sort 0 ms, write 0 ms, index 1025 ms: 4 candidates, 105391 repo-hours, 875 releases; waiting 252 ms; commit 0 ms)
2026-11-08T09:35:50Z [load_day 2024-12-30] 2024-12-30 hour 2: 166720 events in 0 files, snapshot none (task 6906 ms: download 3703 ms overlapping gunzip 917 ms, parse 3811 ms, sort 0 ms, write 0 ms, index 1228 ms: 4 candidates, 74653 repo-hours, 841 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:35:51Z [load_day 2024-12-30] 2024-12-30 hour 3: 182519 events in 0 files, snapshot none (task 6568 ms: download 3248 ms overlapping gunzip 971 ms, parse 4008 ms, sort 0 ms, write 0 ms, index 762 ms: 5 candidates, 75261 repo-hours, 3884 releases; waiting 580 ms; commit 0 ms)
2026-11-08T09:35:58Z [load_day 2024-12-30] 2024-12-30 hour 4: 162142 events in 0 files, snapshot none (task 6877 ms: download 3360 ms overlapping gunzip 1118 ms, parse 4327 ms, sort 0 ms, write 0 ms, index 568 ms: 5 candidates, 58505 repo-hours, 635 releases; waiting 521 ms; commit 0 ms)
2026-11-08T09:35:58Z [load_day 2024-12-30] 2024-12-30 hour 5: 165482 events in 0 files, snapshot none (task 6704 ms: download 3306 ms overlapping gunzip 1059 ms, parse 4155 ms, sort 0 ms, write 0 ms, index 676 ms: 3 candidates, 62061 repo-hours, 769 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:36:04Z [load_day 2024-12-30] 2024-12-30 hour 6: 193473 events in 0 files, snapshot none (task 5864 ms: download 2786 ms overlapping gunzip 991 ms, parse 3717 ms, sort 0 ms, write 0 ms, index 698 ms: 4 candidates, 83107 repo-hours, 917 releases; waiting 187 ms; commit 0 ms)
2026-11-08T09:36:05Z [load_day 2024-12-30] 2024-12-30 hour 7: 186531 events in 0 files, snapshot none (task 6440 ms: download 3920 ms overlapping gunzip 1007 ms, parse 4001 ms, sort 0 ms, write 0 ms, index 549 ms: 3 candidates, 70576 repo-hours, 867 releases; waiting 525 ms; commit 0 ms)
2026-11-08T09:36:11Z [load_day 2024-12-30] 2024-12-30 hour 8: 192751 events in 0 files, snapshot none (task 6115 ms: download 3627 ms overlapping gunzip 929 ms, parse 3725 ms, sort 0 ms, write 0 ms, index 582 ms: 9 candidates, 77612 repo-hours, 812 releases; waiting 573 ms; commit 0 ms)
2026-11-08T09:36:12Z [load_day 2024-12-30] 2024-12-30 hour 9: 203364 events in 0 files, snapshot none (task 6595 ms: download 3974 ms overlapping gunzip 1017 ms, parse 3926 ms, sort 0 ms, write 0 ms, index 596 ms: 3 candidates, 83565 repo-hours, 1024 releases; waiting 596 ms; commit 0 ms)
2026-11-08T09:36:17Z [load_day 2024-12-30] 2024-12-30 hour 10: 196124 events in 0 files, snapshot none (task 6240 ms: download 3756 ms overlapping gunzip 922 ms, parse 3728 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 77255 repo-hours, 866 releases; waiting 637 ms; commit 0 ms)
2026-11-08T09:36:18Z [load_day 2024-12-30] 2024-12-30 hour 11: 196992 events in 0 files, snapshot none (task 5813 ms: download 3653 ms overlapping gunzip 884 ms, parse 3605 ms, sort 0 ms, write 0 ms, index 553 ms: 4 candidates, 75040 repo-hours, 856 releases; waiting 403 ms; commit 0 ms)
2026-11-08T09:36:26Z [load_day 2024-12-30] 2024-12-30 hour 12: 244505 events in 0 files, snapshot none (task 7991 ms: download 5222 ms overlapping gunzip 1217 ms, parse 5164 ms, sort 0 ms, write 0 ms, index 809 ms: 8 candidates, 121824 repo-hours, 1113 releases; waiting 495 ms; commit 0 ms)
2026-11-08T09:36:27Z [load_day 2024-12-30] 2024-12-30 hour 13: 219275 events in 0 files, snapshot none (task 7959 ms: download 5114 ms overlapping gunzip 1181 ms, parse 5144 ms, sort 0 ms, write 0 ms, index 731 ms: 5 candidates, 101566 repo-hours, 997 releases; waiting 406 ms; commit 0 ms)
2026-11-08T09:36:34Z [load_day 2024-12-30] 2024-12-30 hour 14: 208095 events in 0 files, snapshot none (task 7590 ms: download 4748 ms overlapping gunzip 1162 ms, parse 4726 ms, sort 0 ms, write 0 ms, index 813 ms: 16 candidates, 82335 repo-hours, 1146 releases; waiting 577 ms; commit 0 ms)
2026-11-08T09:36:36Z [load_day 2024-12-30] 2024-12-30 hour 15: 218968 events in 0 files, snapshot none (task 7887 ms: download 4476 ms overlapping gunzip 1329 ms, parse 5028 ms, sort 0 ms, write 0 ms, index 718 ms: 14 candidates, 89377 repo-hours, 1409 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:36:43Z [load_day 2024-12-30] 2024-12-30 hour 16: 207732 events in 0 files, snapshot none (task 8660 ms: download 4834 ms overlapping gunzip 1340 ms, parse 5417 ms, sort 0 ms, write 0 ms, index 893 ms: 5 candidates, 82335 repo-hours, 1172 releases; waiting 702 ms; commit 0 ms)
2026-11-08T09:36:45Z [load_day 2024-12-30] 2024-12-30 hour 17: 211821 events in 0 files, snapshot none (task 8860 ms: download 5992 ms overlapping gunzip 1438 ms, parse 5811 ms, sort 0 ms, write 0 ms, index 713 ms: 1 candidates, 90558 repo-hours, 1041 releases; waiting 543 ms; commit 0 ms)
2026-11-08T09:36:52Z [load_day 2024-12-30] 2024-12-30 hour 18: 211774 events in 0 files, snapshot none (task 8155 ms: download 5103 ms overlapping gunzip 1274 ms, parse 5325 ms, sort 0 ms, write 0 ms, index 748 ms: 6 candidates, 90159 repo-hours, 1107 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:36:53Z [load_day 2024-12-30] 2024-12-30 hour 19: 190363 events in 0 files, snapshot none (task 7776 ms: download 5315 ms overlapping gunzip 1247 ms, parse 5179 ms, sort 0 ms, write 0 ms, index 569 ms: 4 candidates, 71359 repo-hours, 926 releases; waiting 510 ms; commit 0 ms)
2026-11-08T09:36:59Z [load_day 2024-12-30] 2024-12-30 hour 20: 183206 events in 0 files, snapshot none (task 7271 ms: download 4493 ms overlapping gunzip 1175 ms, parse 4595 ms, sort 0 ms, write 0 ms, index 719 ms: 4 candidates, 68773 repo-hours, 913 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:37:00Z [load_day 2024-12-30] 2024-12-30 hour 21: 177143 events in 0 files, snapshot none (task 6502 ms: download 3984 ms overlapping gunzip 1027 ms, parse 4056 ms, sort 0 ms, write 0 ms, index 545 ms: 4 candidates, 66616 repo-hours, 999 releases; waiting 473 ms; commit 0 ms)
2026-11-08T09:37:07Z [load_day 2024-12-30] 2024-12-30 hour 22: 167764 events in 0 files, snapshot none (task 7023 ms: download 4305 ms overlapping gunzip 1090 ms, parse 4557 ms, sort 0 ms, write 0 ms, index 572 ms: 5 candidates, 58649 repo-hours, 1215 releases; waiting 516 ms; commit 0 ms)
2026-11-08T09:37:07Z [load_day 2024-12-30] 2024-12-30 hour 23: 155732 events in 0 files, snapshot none (task 6462 ms: download 4051 ms overlapping gunzip 989 ms, parse 4126 ms, sort 0 ms, write 0 ms, index 405 ms: 6 candidates, 54635 repo-hours, 749 releases; waiting 555 ms; commit 0 ms)
2026-11-08T09:37:16Z [load_day 2024-12-30] 2024-12-30: repo_hour merged from 24 files to 1 (1899506 rows, 8329 ms)
2026-11-08T09:37:18Z [load_day 2024-12-30] 2024-12-30: index committed in 11056 ms (24 + 1 + 24 files)
2026-11-08T09:37:18Z [load_day 2024-12-30] 2024-12-30: 4597917 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:37:18Z [load_day 2024-12-30] attempt 1 succeeded