orcaLog in

Runs · run 2917

load_day 2024-09-03, attempt 1 succeeded

Host
73ccef5e07c2:172543
Started
2026-11-08T07:44:07Z
Ended
2026-11-08T07:45:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
851 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
186.0 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2917/load_day/2024-09-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:44:07Z [load_day 2024-09-03] attempt 1 started
2026-11-08T07:44:08Z [load_day 2024-09-03] 2024-09-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:44:15Z [load_day 2024-09-03] 2024-09-03 hour 0: 174714 events in 0 files, snapshot none (task 6563 ms: download 3593 ms overlapping gunzip 963 ms, parse 4160 ms, sort 0 ms, write 0 ms, index 645 ms: 13 candidates, 90990 repo-hours, 1021 releases; waiting 421 ms; commit 0 ms)
2026-11-08T07:44:15Z [load_day 2024-09-03] 2024-09-03 hour 1: 192918 events in 0 files, snapshot none (task 6376 ms: download 3407 ms overlapping gunzip 937 ms, parse 4101 ms, sort 0 ms, write 0 ms, index 864 ms: 10 candidates, 108610 repo-hours, 865 releases; waiting 262 ms; commit 0 ms)
2026-11-08T07:44:30Z [load_day 2024-09-03] 2024-09-03 hour 2: 165897 events in 0 files, snapshot none (task 10349 ms: download 3035 ms overlapping gunzip 824 ms, parse 3438 ms, sort 0 ms, write 0 ms, index 5284 ms: 7 candidates, 73324 repo-hours, 972 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:44:30Z [load_day 2024-09-03] 2024-09-03 hour 3: 182390 events in 0 files, snapshot none (task 10382 ms: download 3375 ms overlapping gunzip 882 ms, parse 3792 ms, sort 0 ms, write 0 ms, index 4863 ms: 1 candidates, 73824 repo-hours, 4338 releases; waiting 555 ms; commit 0 ms)
2026-11-08T07:44:37Z [load_day 2024-09-03] 2024-09-03 hour 4: 159166 events in 0 files, snapshot none (task 5371 ms: download 3005 ms overlapping gunzip 809 ms, parse 3361 ms, sort 0 ms, write 0 ms, index 464 ms: 6 candidates, 62408 repo-hours, 753 releases; waiting 454 ms; commit 0 ms)
2026-11-08T07:44:38Z [load_day 2024-09-03] 2024-09-03 hour 5: 178260 events in 0 files, snapshot none (task 6612 ms: download 4370 ms overlapping gunzip 1095 ms, parse 4246 ms, sort 0 ms, write 0 ms, index 510 ms: 10 candidates, 68475 repo-hours, 910 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:44:44Z [load_day 2024-09-03] 2024-09-03 hour 6: 209475 events in 0 files, snapshot none (task 6014 ms: download 3453 ms overlapping gunzip 888 ms, parse 3705 ms, sort 0 ms, write 0 ms, index 715 ms: 9 candidates, 95267 repo-hours, 1067 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:44:45Z [load_day 2024-09-03] 2024-09-03 hour 7: 212238 events in 0 files, snapshot none (task 6630 ms: download 4148 ms overlapping gunzip 1004 ms, parse 4147 ms, sort 0 ms, write 0 ms, index 606 ms: 15 candidates, 87314 repo-hours, 1061 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:44:51Z [load_day 2024-09-03] 2024-09-03 hour 8: 228416 events in 0 files, snapshot none (task 7309 ms: download 4761 ms overlapping gunzip 1172 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 666 ms: 13 candidates, 93873 repo-hours, 1218 releases; waiting 376 ms; commit 0 ms)
2026-11-08T07:44:55Z [load_day 2024-09-03] 2024-09-03 hour 9: 239275 events in 0 files, snapshot none (task 9344 ms: download 6555 ms overlapping gunzip 1154 ms, parse 4743 ms, sort 0 ms, write 0 ms, index 738 ms: 18 candidates, 104796 repo-hours, 1375 releases; waiting 2229 ms; commit 0 ms)
2026-11-08T07:44:59Z [load_day 2024-09-03] 2024-09-03 hour 10: 218997 events in 0 files, snapshot none (task 7584 ms: download 4911 ms overlapping gunzip 1151 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 696 ms: 10 candidates, 89228 repo-hours, 1262 releases; waiting 662 ms; commit 0 ms)
2026-11-08T07:45:03Z [load_day 2024-09-03] 2024-09-03 hour 11: 221679 events in 0 files, snapshot none (task 7228 ms: download 4469 ms overlapping gunzip 1100 ms, parse 4482 ms, sort 0 ms, write 0 ms, index 739 ms: 13 candidates, 87386 repo-hours, 1253 releases; waiting 581 ms; commit 0 ms)
2026-11-08T07:45:08Z [load_day 2024-09-03] 2024-09-03 hour 12: 277051 events in 0 files, snapshot none (task 8205 ms: download 5157 ms overlapping gunzip 1188 ms, parse 5161 ms, sort 0 ms, write 0 ms, index 1009 ms: 13 candidates, 136118 repo-hours, 1560 releases; waiting 512 ms; commit 0 ms)
2026-11-08T07:45:11Z [load_day 2024-09-03] 2024-09-03 hour 13: 238761 events in 0 files, snapshot none (task 7643 ms: download 4929 ms overlapping gunzip 1190 ms, parse 4812 ms, sort 0 ms, write 0 ms, index 780 ms: 18 candidates, 113078 repo-hours, 1237 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:45:16Z [load_day 2024-09-03] 2024-09-03 hour 14: 242310 events in 0 files, snapshot none (task 7439 ms: download 4922 ms overlapping gunzip 1211 ms, parse 4912 ms, sort 0 ms, write 0 ms, index 707 ms: 11 candidates, 103146 repo-hours, 1397 releases; waiting 302 ms; commit 0 ms)
2026-11-08T07:45:20Z [load_day 2024-09-03] 2024-09-03 hour 15: 247190 events in 0 files, snapshot none (task 8480 ms: download 5915 ms overlapping gunzip 1357 ms, parse 5444 ms, sort 0 ms, write 0 ms, index 765 ms: 14 candidates, 107154 repo-hours, 1555 releases; waiting 645 ms; commit 0 ms)
2026-11-08T07:45:24Z [load_day 2024-09-03] 2024-09-03 hour 16: 235267 events in 0 files, snapshot none (task 7576 ms: download 5113 ms overlapping gunzip 1206 ms, parse 4877 ms, sort 0 ms, write 0 ms, index 693 ms: 15 candidates, 98707 repo-hours, 1279 releases; waiting 549 ms; commit 0 ms)
2026-11-08T07:45:27Z [load_day 2024-09-03] 2024-09-03 hour 17: 224480 events in 0 files, snapshot none (task 7070 ms: download 4335 ms overlapping gunzip 1070 ms, parse 4340 ms, sort 0 ms, write 0 ms, index 664 ms: 16 candidates, 90672 repo-hours, 1138 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:45:31Z [load_day 2024-09-03] 2024-09-03 hour 18: 226922 events in 0 files, snapshot none (task 6807 ms: download 4319 ms overlapping gunzip 1019 ms, parse 4183 ms, sort 0 ms, write 0 ms, index 698 ms: 15 candidates, 102377 repo-hours, 1231 releases; waiting 601 ms; commit 0 ms)
2026-11-08T07:45:35Z [load_day 2024-09-03] 2024-09-03 hour 19: 208816 events in 0 files, snapshot none (task 6793 ms: download 4341 ms overlapping gunzip 1060 ms, parse 4336 ms, sort 0 ms, write 0 ms, index 618 ms: 11 candidates, 80375 repo-hours, 1239 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:45:39Z [load_day 2024-09-03] 2024-09-03 hour 20: 204609 events in 0 files, snapshot none (task 6805 ms: download 4126 ms overlapping gunzip 1042 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 663 ms: 21 candidates, 79197 repo-hours, 1118 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:45:42Z [load_day 2024-09-03] 2024-09-03 hour 21: 200458 events in 0 files, snapshot none (task 6932 ms: download 4653 ms overlapping gunzip 1088 ms, parse 4400 ms, sort 0 ms, write 0 ms, index 542 ms: 3 candidates, 79947 repo-hours, 1188 releases; waiting 594 ms; commit 0 ms)
2026-11-08T07:45:45Z [load_day 2024-09-03] 2024-09-03 hour 22: 184471 events in 0 files, snapshot none (task 6428 ms: download 4144 ms overlapping gunzip 1030 ms, parse 4126 ms, sort 0 ms, write 0 ms, index 495 ms: 9 candidates, 71759 repo-hours, 1205 releases; waiting 511 ms; commit 0 ms)
2026-11-08T07:45:47Z [load_day 2024-09-03] 2024-09-03 hour 23: 162852 events in 0 files, snapshot none (task 4933 ms: download 2874 ms overlapping gunzip 762 ms, parse 3029 ms, sort 0 ms, write 0 ms, index 407 ms: 5 candidates, 59635 repo-hours, 867 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:45:56Z [load_day 2024-09-03] 2024-09-03: repo_hour merged from 24 files to 1 (2157660 rows, 8906 ms)
2026-11-08T07:45:59Z [load_day 2024-09-03] 2024-09-03: index committed in 11761 ms (24 + 1 + 24 files)
2026-11-08T07:45:59Z [load_day 2024-09-03] 2024-09-03: 5036612 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:45:59Z [load_day 2024-09-03] attempt 1 succeeded