orcaLog in

Runs · run 3138

load_day 2024-10-28, attempt 1 succeeded

Host
73ccef5e07c2:199000
Started
2026-11-08T08:32:27Z
Ended
2026-11-08T08:34:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
747 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3138/load_day/2024-10-28/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:32:27Z [load_day 2024-10-28] attempt 1 started
2026-11-08T08:32:29Z [load_day 2024-10-28] 2024-10-28: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:32:36Z [load_day 2024-10-28] 2024-10-28 hour 0: 179370 events in 0 files, snapshot none (task 6121 ms: download 3505 ms overlapping gunzip 962 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 602 ms: 4 candidates, 82653 repo-hours, 1123 releases; waiting 667 ms; commit 0 ms)
2026-11-08T08:32:36Z [load_day 2024-10-28] 2024-10-28 hour 1: 202532 events in 0 files, snapshot none (task 6203 ms: download 3262 ms overlapping gunzip 1010 ms, parse 3865 ms, sort 0 ms, write 0 ms, index 750 ms: 6 candidates, 108694 repo-hours, 979 releases; waiting 279 ms; commit 0 ms)
2026-11-08T08:32:42Z [load_day 2024-10-28] 2024-10-28 hour 2: 183166 events in 0 files, snapshot none (task 5865 ms: download 3235 ms overlapping gunzip 1018 ms, parse 3628 ms, sort 0 ms, write 0 ms, index 636 ms: 6 candidates, 79626 repo-hours, 888 releases; waiting 364 ms; commit 0 ms)
2026-11-08T08:32:43Z [load_day 2024-10-28] 2024-10-28 hour 3: 205395 events in 0 files, snapshot none (task 7072 ms: download 4491 ms overlapping gunzip 1105 ms, parse 4248 ms, sort 0 ms, write 0 ms, index 702 ms: 4 candidates, 80791 repo-hours, 4001 releases; waiting 522 ms; commit 0 ms)
2026-11-08T08:32:49Z [load_day 2024-10-28] 2024-10-28 hour 4: 188486 events in 0 files, snapshot none (task 6592 ms: download 4222 ms overlapping gunzip 1168 ms, parse 3924 ms, sort 0 ms, write 0 ms, index 725 ms: 7 candidates, 65619 repo-hours, 722 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:32:50Z [load_day 2024-10-28] 2024-10-28 hour 5: 191747 events in 0 files, snapshot none (task 6030 ms: download 3980 ms overlapping gunzip 1115 ms, parse 3975 ms, sort 0 ms, write 0 ms, index 517 ms: 5 candidates, 69145 repo-hours, 916 releases; waiting 209 ms; commit 0 ms)
2026-11-08T08:32:57Z [load_day 2024-10-28] 2024-10-28 hour 6: 218657 events in 0 files, snapshot none (task 7275 ms: download 4519 ms overlapping gunzip 1236 ms, parse 4407 ms, sort 0 ms, write 0 ms, index 782 ms: 12 candidates, 92939 repo-hours, 983 releases; waiting 558 ms; commit 0 ms)
2026-11-08T08:32:57Z [load_day 2024-10-28] 2024-10-28 hour 7: 220118 events in 0 files, snapshot none (task 7316 ms: download 5121 ms overlapping gunzip 1182 ms, parse 4445 ms, sort 0 ms, write 0 ms, index 625 ms: 12 candidates, 82802 repo-hours, 957 releases; waiting 788 ms; commit 0 ms)
2026-11-08T08:33:06Z [load_day 2024-10-28] 2024-10-28 hour 8: 237207 events in 0 files, snapshot none (task 8946 ms: download 6156 ms overlapping gunzip 1518 ms, parse 5844 ms, sort 0 ms, write 0 ms, index 869 ms: 10 candidates, 93959 repo-hours, 1154 releases; waiting 495 ms; commit 0 ms)
2026-11-08T08:33:08Z [load_day 2024-10-28] 2024-10-28 hour 9: 250833 events in 0 files, snapshot none (task 10205 ms: download 7890 ms overlapping gunzip 1553 ms, parse 5814 ms, sort 0 ms, write 0 ms, index 777 ms: 5 candidates, 101748 repo-hours, 1417 releases; waiting 1796 ms; commit 0 ms)
2026-11-08T08:33:17Z [load_day 2024-10-28] 2024-10-28 hour 10: 240297 events in 0 files, snapshot none (task 9724 ms: download 6232 ms overlapping gunzip 1704 ms, parse 6319 ms, sort 0 ms, write 0 ms, index 1059 ms: 17 candidates, 94828 repo-hours, 1257 releases; waiting 369 ms; commit 0 ms)
2026-11-08T08:33:19Z [load_day 2024-10-28] 2024-10-28 hour 11: 243827 events in 0 files, snapshot none (task 10192 ms: download 7194 ms overlapping gunzip 1742 ms, parse 6135 ms, sort 0 ms, write 0 ms, index 1001 ms: 12 candidates, 91429 repo-hours, 1311 releases; waiting 1023 ms; commit 0 ms)
2026-11-08T08:33:25Z [load_day 2024-10-28] 2024-10-28 hour 12: 279012 events in 0 files, snapshot none (task 7604 ms: download 4489 ms overlapping gunzip 1201 ms, parse 4476 ms, sort 0 ms, write 0 ms, index 1131 ms: 10 candidates, 137325 repo-hours, 1307 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:33:27Z [load_day 2024-10-28] 2024-10-28 hour 13: 273444 events in 0 files, snapshot none (task 7453 ms: download 5006 ms overlapping gunzip 1247 ms, parse 4498 ms, sort 0 ms, write 0 ms, index 881 ms: 12 candidates, 122705 repo-hours, 1349 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:33:33Z [load_day 2024-10-28] 2024-10-28 hour 14: 251812 events in 0 files, snapshot none (task 7360 ms: download 4954 ms overlapping gunzip 1239 ms, parse 4231 ms, sort 0 ms, write 0 ms, index 850 ms: 25 candidates, 106149 repo-hours, 1338 releases; waiting 755 ms; commit 0 ms)
2026-11-08T08:33:36Z [load_day 2024-10-28] 2024-10-28 hour 15: 267820 events in 0 files, snapshot none (task 8693 ms: download 5109 ms overlapping gunzip 1325 ms, parse 4754 ms, sort 0 ms, write 0 ms, index 1445 ms: 14 candidates, 113784 repo-hours, 1517 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:33:42Z [load_day 2024-10-28] 2024-10-28 hour 16: 260538 events in 0 files, snapshot none (task 8707 ms: download 6146 ms overlapping gunzip 1532 ms, parse 5882 ms, sort 0 ms, write 0 ms, index 852 ms: 12 candidates, 105650 repo-hours, 1360 releases; waiting 204 ms; commit 0 ms)
2026-11-08T08:33:45Z [load_day 2024-10-28] 2024-10-28 hour 17: 255600 events in 0 files, snapshot none (task 8396 ms: download 5144 ms overlapping gunzip 1306 ms, parse 4696 ms, sort 0 ms, write 0 ms, index 1576 ms: 7 candidates, 98376 repo-hours, 1158 releases; waiting 563 ms; commit 0 ms)
2026-11-08T08:33:52Z [load_day 2024-10-28] 2024-10-28 hour 18: 266927 events in 0 files, snapshot none (task 9778 ms: download 6688 ms overlapping gunzip 1582 ms, parse 5949 ms, sort 0 ms, write 0 ms, index 1464 ms: 13 candidates, 114370 repo-hours, 1298 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:33:53Z [load_day 2024-10-28] 2024-10-28 hour 19: 240851 events in 0 files, snapshot none (task 7837 ms: download 5100 ms overlapping gunzip 1404 ms, parse 4851 ms, sort 0 ms, write 0 ms, index 769 ms: 5 candidates, 87593 repo-hours, 1292 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:34:01Z [load_day 2024-10-28] 2024-10-28 hour 20: 232336 events in 0 files, snapshot none (task 8800 ms: download 5068 ms overlapping gunzip 1589 ms, parse 5692 ms, sort 0 ms, write 0 ms, index 946 ms: 11 candidates, 86145 repo-hours, 1122 releases; waiting 302 ms; commit 0 ms)
2026-11-08T08:34:03Z [load_day 2024-10-28] 2024-10-28 hour 21: 228760 events in 0 files, snapshot none (task 9032 ms: download 6637 ms overlapping gunzip 1718 ms, parse 5858 ms, sort 0 ms, write 0 ms, index 679 ms: 8 candidates, 84816 repo-hours, 1515 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:34:10Z [load_day 2024-10-28] 2024-10-28 hour 22: 205417 events in 0 files, snapshot none (task 7945 ms: download 4901 ms overlapping gunzip 1406 ms, parse 4938 ms, sort 0 ms, write 0 ms, index 752 ms: 11 candidates, 72763 repo-hours, 1234 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:34:11Z [load_day 2024-10-28] 2024-10-28 hour 23: 203893 events in 0 files, snapshot none (task 7685 ms: download 5445 ms overlapping gunzip 1429 ms, parse 4786 ms, sort 0 ms, write 0 ms, index 561 ms: 6 candidates, 68194 repo-hours, 891 releases; waiting 666 ms; commit 0 ms)
2026-11-08T08:34:21Z [load_day 2024-10-28] 2024-10-28: repo_hour merged from 24 files to 1 (2242103 rows, 9714 ms)
2026-11-08T08:34:24Z [load_day 2024-10-28] 2024-10-28: index committed in 12427 ms (24 + 1 + 24 files)
2026-11-08T08:34:24Z [load_day 2024-10-28] 2024-10-28: 5528045 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:34:24Z [load_day 2024-10-28] attempt 1 succeeded