orcaLog in

Runs · run 3825

load_day 2025-04-25, attempt 1 succeeded

Host
73ccef5e07c2:293434
Started
2026-11-08T11:35:59Z
Ended
2026-11-08T11:38:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
864 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
201.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3825/load_day/2025-04-25/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:35:59Z [load_day 2025-04-25] attempt 1 started
2026-11-08T11:36:00Z [load_day 2025-04-25] 2025-04-25: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:36:09Z [load_day 2025-04-25] 2025-04-25 hour 0: 209118 events in 0 files, snapshot none (task 8827 ms: download 5660 ms overlapping gunzip 1437 ms, parse 5577 ms, sort 0 ms, write 0 ms, index 1002 ms: 9 candidates, 96436 repo-hours, 1256 releases; waiting 573 ms; commit 0 ms)
2026-11-08T11:36:09Z [load_day 2025-04-25] 2025-04-25 hour 1: 229690 events in 0 files, snapshot none (task 8231 ms: download 4558 ms overlapping gunzip 1163 ms, parse 5059 ms, sort 0 ms, write 0 ms, index 1142 ms: 5 candidates, 125683 repo-hours, 1055 releases; waiting 476 ms; commit 0 ms)
2026-11-08T11:36:18Z [load_day 2025-04-25] 2025-04-25 hour 2: 198714 events in 0 files, snapshot none (task 8254 ms: download 5449 ms overlapping gunzip 1359 ms, parse 5675 ms, sort 0 ms, write 0 ms, index 652 ms: 5 candidates, 87286 repo-hours, 1107 releases; waiting 216 ms; commit 0 ms)
2026-11-08T11:36:19Z [load_day 2025-04-25] 2025-04-25 hour 3: 211501 events in 0 files, snapshot none (task 8869 ms: download 6008 ms overlapping gunzip 1432 ms, parse 5943 ms, sort 0 ms, write 0 ms, index 755 ms: 5 candidates, 89090 repo-hours, 3033 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:36:27Z [load_day 2025-04-25] 2025-04-25 hour 4: 197301 events in 0 files, snapshot none (task 8342 ms: download 4850 ms overlapping gunzip 1267 ms, parse 5251 ms, sort 0 ms, write 0 ms, index 1006 ms: 5 candidates, 75916 repo-hours, 801 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:36:27Z [load_day 2025-04-25] 2025-04-25 hour 5: 204105 events in 0 files, snapshot none (task 7825 ms: download 4584 ms overlapping gunzip 1203 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 728 ms: 1 candidates, 81869 repo-hours, 837 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:36:37Z [load_day 2025-04-25] 2025-04-25 hour 6: 231024 events in 0 files, snapshot none (task 9911 ms: download 5953 ms overlapping gunzip 1513 ms, parse 6369 ms, sort 0 ms, write 0 ms, index 1069 ms: 4 candidates, 104881 repo-hours, 1139 releases; waiting 650 ms; commit 0 ms)
2026-11-08T11:36:38Z [load_day 2025-04-25] 2025-04-25 hour 7: 236366 events in 0 files, snapshot none (task 10072 ms: download 6665 ms overlapping gunzip 1631 ms, parse 7016 ms, sort 0 ms, write 0 ms, index 860 ms: 9 candidates, 97756 repo-hours, 1181 releases; waiting 262 ms; commit 0 ms)
2026-11-08T11:36:48Z [load_day 2025-04-25] 2025-04-25 hour 8: 244358 events in 0 files, snapshot none (task 10004 ms: download 6796 ms overlapping gunzip 1597 ms, parse 6661 ms, sort 0 ms, write 0 ms, index 894 ms: 6 candidates, 104673 repo-hours, 1352 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:36:48Z [load_day 2025-04-25] 2025-04-25 hour 9: 247878 events in 0 files, snapshot none (task 9529 ms: download 6218 ms overlapping gunzip 1448 ms, parse 6384 ms, sort 0 ms, write 0 ms, index 885 ms: 6 candidates, 106065 repo-hours, 1365 releases; waiting 522 ms; commit 0 ms)
2026-11-08T11:36:57Z [load_day 2025-04-25] 2025-04-25 hour 10: 237640 events in 0 files, snapshot none (task 8327 ms: download 5474 ms overlapping gunzip 1263 ms, parse 5315 ms, sort 0 ms, write 0 ms, index 798 ms: 5 candidates, 100012 repo-hours, 1185 releases; waiting 529 ms; commit 0 ms)
2026-11-08T11:36:57Z [load_day 2025-04-25] 2025-04-25 hour 11: 243059 events in 0 files, snapshot none (task 7957 ms: download 5134 ms overlapping gunzip 1247 ms, parse 5162 ms, sort 0 ms, write 0 ms, index 814 ms: 4 candidates, 96506 repo-hours, 1203 releases; waiting 367 ms; commit 0 ms)
2026-11-08T11:37:06Z [load_day 2025-04-25] 2025-04-25 hour 12: 277707 events in 0 files, snapshot none (task 8651 ms: download 5616 ms overlapping gunzip 1286 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 1171 ms: 6 candidates, 140444 repo-hours, 1434 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:37:06Z [load_day 2025-04-25] 2025-04-25 hour 13: 271164 events in 0 files, snapshot none (task 8948 ms: download 6235 ms overlapping gunzip 1369 ms, parse 5897 ms, sort 0 ms, write 0 ms, index 904 ms: 6 candidates, 125154 repo-hours, 1389 releases; waiting 536 ms; commit 0 ms)
2026-11-08T11:37:18Z [load_day 2025-04-25] 2025-04-25 hour 14: 261124 events in 0 files, snapshot none (task 11677 ms: download 8556 ms overlapping gunzip 1938 ms, parse 8128 ms, sort 0 ms, write 0 ms, index 896 ms: 8 candidates, 110554 repo-hours, 1383 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:37:18Z [load_day 2025-04-25] 2025-04-25 hour 15: 258837 events in 0 files, snapshot none (task 11193 ms: download 7876 ms overlapping gunzip 1752 ms, parse 7614 ms, sort 0 ms, write 0 ms, index 997 ms: 11 candidates, 110371 repo-hours, 1419 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:37:29Z [load_day 2025-04-25] 2025-04-25 hour 16: 246954 events in 0 files, snapshot none (task 10371 ms: download 7345 ms overlapping gunzip 1659 ms, parse 7093 ms, sort 0 ms, write 0 ms, index 1092 ms: 13 candidates, 104948 repo-hours, 1129 releases; waiting 311 ms; commit 0 ms)
2026-11-08T11:37:30Z [load_day 2025-04-25] 2025-04-25 hour 17: 245206 events in 0 files, snapshot none (task 11224 ms: download 7815 ms overlapping gunzip 1671 ms, parse 7449 ms, sort 0 ms, write 0 ms, index 932 ms: 2 candidates, 97979 repo-hours, 1202 releases; waiting 865 ms; commit 0 ms)
2026-11-08T11:37:39Z [load_day 2025-04-25] 2025-04-25 hour 18: 246482 events in 0 files, snapshot none (task 9664 ms: download 6475 ms overlapping gunzip 1490 ms, parse 6675 ms, sort 0 ms, write 0 ms, index 878 ms: 8 candidates, 106184 repo-hours, 1528 releases; waiting 316 ms; commit 0 ms)
2026-11-08T11:37:39Z [load_day 2025-04-25] 2025-04-25 hour 19: 228123 events in 0 files, snapshot none (task 9085 ms: download 6222 ms overlapping gunzip 1325 ms, parse 6311 ms, sort 0 ms, write 0 ms, index 681 ms: 11 candidates, 86996 repo-hours, 1146 releases; waiting 472 ms; commit 0 ms)
2026-11-08T11:37:49Z [load_day 2025-04-25] 2025-04-25 hour 20: 220012 events in 0 files, snapshot none (task 9179 ms: download 6615 ms overlapping gunzip 1430 ms, parse 6248 ms, sort 0 ms, write 0 ms, index 750 ms: 7 candidates, 85989 repo-hours, 1180 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:37:49Z [load_day 2025-04-25] 2025-04-25 hour 21: 200905 events in 0 files, snapshot none (task 8185 ms: download 5824 ms overlapping gunzip 1313 ms, parse 5700 ms, sort 0 ms, write 0 ms, index 597 ms: 12 candidates, 77389 repo-hours, 1185 releases; waiting 352 ms; commit 0 ms)
2026-11-08T11:37:58Z [load_day 2025-04-25] 2025-04-25 hour 22: 189757 events in 0 files, snapshot none (task 8061 ms: download 4893 ms overlapping gunzip 1113 ms, parse 4603 ms, sort 0 ms, write 0 ms, index 552 ms: 8 candidates, 69163 repo-hours, 1036 releases; waiting 1360 ms; commit 0 ms)
2026-11-08T11:37:58Z [load_day 2025-04-25] 2025-04-25 hour 23: 181675 events in 0 files, snapshot none (task 6616 ms: download 3589 ms overlapping gunzip 908 ms, parse 3993 ms, sort 0 ms, write 0 ms, index 877 ms: 9 candidates, 65590 repo-hours, 1068 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:38:08Z [load_day 2025-04-25] 2025-04-25: repo_hour merged from 24 files to 1 (2346934 rows, 10100 ms)
2026-11-08T11:38:11Z [load_day 2025-04-25] 2025-04-25: index committed in 12996 ms (24 + 1 + 24 files)
2026-11-08T11:38:11Z [load_day 2025-04-25] 2025-04-25: 5518700 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:38:11Z [load_day 2025-04-25] attempt 1 succeeded