orcaLog in

Runs · run 3146

load_day 2024-10-30, attempt 1 succeeded

Host
73ccef5e07c2:200188
Started
2026-11-08T08:34:24Z
Ended
2026-11-08T08:36:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
883 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
166.2 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3146/load_day/2024-10-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:34:24Z [load_day 2024-10-30] attempt 1 started
2026-11-08T08:34:25Z [load_day 2024-10-30] 2024-10-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:34:33Z [load_day 2024-10-30] 2024-10-30 hour 0: 198974 events in 0 files, snapshot none (task 7069 ms: download 3847 ms overlapping gunzip 1115 ms, parse 4367 ms, sort 0 ms, write 0 ms, index 815 ms: 7 candidates, 94565 repo-hours, 1246 releases; waiting 479 ms; commit 0 ms)
2026-11-08T08:34:33Z [load_day 2024-10-30] 2024-10-30 hour 1: 212628 events in 0 files, snapshot none (task 7370 ms: download 3995 ms overlapping gunzip 1132 ms, parse 4424 ms, sort 0 ms, write 0 ms, index 1006 ms: 7 candidates, 113716 repo-hours, 971 releases; waiting 510 ms; commit 0 ms)
2026-11-08T08:34:39Z [load_day 2024-10-30] 2024-10-30 hour 2: 190951 events in 0 files, snapshot none (task 6022 ms: download 3084 ms overlapping gunzip 946 ms, parse 3614 ms, sort 0 ms, write 0 ms, index 661 ms: 6 candidates, 84741 repo-hours, 950 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:34:41Z [load_day 2024-10-30] 2024-10-30 hour 3: 202187 events in 0 files, snapshot none (task 6989 ms: download 4050 ms overlapping gunzip 1016 ms, parse 4042 ms, sort 0 ms, write 0 ms, index 699 ms: 4 candidates, 79883 repo-hours, 4131 releases; waiting 566 ms; commit 0 ms)
2026-11-08T08:34:46Z [load_day 2024-10-30] 2024-10-30 hour 4: 180066 events in 0 files, snapshot none (task 5922 ms: download 3242 ms overlapping gunzip 981 ms, parse 3619 ms, sort 0 ms, write 0 ms, index 513 ms: 2 candidates, 65083 repo-hours, 754 releases; waiting 505 ms; commit 0 ms)
2026-11-08T08:34:47Z [load_day 2024-10-30] 2024-10-30 hour 5: 177994 events in 0 files, snapshot none (task 5778 ms: download 3861 ms overlapping gunzip 962 ms, parse 3322 ms, sort 0 ms, write 0 ms, index 541 ms: 4 candidates, 68993 repo-hours, 783 releases; waiting 609 ms; commit 0 ms)
2026-11-08T08:34:54Z [load_day 2024-10-30] 2024-10-30 hour 6: 188221 events in 0 files, snapshot none (task 7188 ms: download 4240 ms overlapping gunzip 1066 ms, parse 4122 ms, sort 0 ms, write 0 ms, index 733 ms: 9 candidates, 83215 repo-hours, 768 releases; waiting 889 ms; commit 0 ms)
2026-11-08T08:34:54Z [load_day 2024-10-30] 2024-10-30 hour 7: 208771 events in 0 files, snapshot none (task 6956 ms: download 4465 ms overlapping gunzip 1098 ms, parse 4359 ms, sort 0 ms, write 0 ms, index 699 ms: 4 candidates, 81621 repo-hours, 858 releases; waiting 500 ms; commit 0 ms)
2026-11-08T08:35:02Z [load_day 2024-10-30] 2024-10-30 hour 8: 224305 events in 0 files, snapshot none (task 7910 ms: download 4573 ms overlapping gunzip 1332 ms, parse 4940 ms, sort 0 ms, write 0 ms, index 1101 ms: 9 candidates, 93471 repo-hours, 1136 releases; waiting 256 ms; commit 0 ms)
2026-11-08T08:35:03Z [load_day 2024-10-30] 2024-10-30 hour 9: 245299 events in 0 files, snapshot none (task 7904 ms: download 5459 ms overlapping gunzip 1339 ms, parse 4957 ms, sort 0 ms, write 0 ms, index 813 ms: 18 candidates, 101103 repo-hours, 1571 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:35:11Z [load_day 2024-10-30] 2024-10-30 hour 10: 233106 events in 0 files, snapshot none (task 8071 ms: download 5522 ms overlapping gunzip 1477 ms, parse 5356 ms, sort 0 ms, write 0 ms, index 769 ms: 8 candidates, 93363 repo-hours, 1332 releases; waiting 177 ms; commit 0 ms)
2026-11-08T08:35:11Z [load_day 2024-10-30] 2024-10-30 hour 11: 233953 events in 0 files, snapshot none (task 7772 ms: download 5511 ms overlapping gunzip 1374 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 666 ms: 10 candidates, 89848 repo-hours, 1273 releases; waiting 362 ms; commit 0 ms)
2026-11-08T08:35:18Z [load_day 2024-10-30] 2024-10-30 hour 12: 268172 events in 0 files, snapshot none (task 6947 ms: download 4102 ms overlapping gunzip 1021 ms, parse 4033 ms, sort 0 ms, write 0 ms, index 997 ms: 12 candidates, 135360 repo-hours, 1426 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:35:19Z [load_day 2024-10-30] 2024-10-30 hour 13: 264676 events in 0 files, snapshot none (task 7347 ms: download 4952 ms overlapping gunzip 1176 ms, parse 4278 ms, sort 0 ms, write 0 ms, index 809 ms: 8 candidates, 120438 repo-hours, 1398 releases; waiting 757 ms; commit 0 ms)
2026-11-08T08:35:25Z [load_day 2024-10-30] 2024-10-30 hour 14: 257695 events in 0 files, snapshot none (task 6719 ms: download 4324 ms overlapping gunzip 1126 ms, parse 4028 ms, sort 0 ms, write 0 ms, index 727 ms: 8 candidates, 107753 repo-hours, 1642 releases; waiting 560 ms; commit 0 ms)
2026-11-08T08:35:26Z [load_day 2024-10-30] 2024-10-30 hour 15: 264593 events in 0 files, snapshot none (task 7180 ms: download 4518 ms overlapping gunzip 1132 ms, parse 4157 ms, sort 0 ms, write 0 ms, index 1056 ms: 9 candidates, 114105 repo-hours, 1586 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:35:34Z [load_day 2024-10-30] 2024-10-30 hour 16: 249612 events in 0 files, snapshot none (task 8649 ms: download 5797 ms overlapping gunzip 1392 ms, parse 5286 ms, sort 0 ms, write 0 ms, index 1063 ms: 7 candidates, 103934 repo-hours, 1349 releases; waiting 559 ms; commit 0 ms)
2026-11-08T08:35:35Z [load_day 2024-10-30] 2024-10-30 hour 17: 243721 events in 0 files, snapshot none (task 8200 ms: download 5272 ms overlapping gunzip 1297 ms, parse 4912 ms, sort 0 ms, write 0 ms, index 1161 ms: 9 candidates, 94986 repo-hours, 1177 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:35:43Z [load_day 2024-10-30] 2024-10-30 hour 18: 244881 events in 0 files, snapshot none (task 7527 ms: download 4392 ms overlapping gunzip 1293 ms, parse 4910 ms, sort 0 ms, write 0 ms, index 821 ms: 9 candidates, 105962 repo-hours, 1326 releases; waiting 216 ms; commit 0 ms)
2026-11-08T08:35:43Z [load_day 2024-10-30] 2024-10-30 hour 19: 234661 events in 0 files, snapshot none (task 7569 ms: download 5135 ms overlapping gunzip 1276 ms, parse 4860 ms, sort 0 ms, write 0 ms, index 670 ms: 14 candidates, 87363 repo-hours, 1183 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:35:51Z [load_day 2024-10-30] 2024-10-30 hour 20: 219143 events in 0 files, snapshot none (task 8099 ms: download 5381 ms overlapping gunzip 1378 ms, parse 4993 ms, sort 0 ms, write 0 ms, index 887 ms: 8 candidates, 83955 repo-hours, 1289 releases; waiting 540 ms; commit 0 ms)
2026-11-08T08:35:52Z [load_day 2024-10-30] 2024-10-30 hour 21: 221592 events in 0 files, snapshot none (task 7735 ms: download 5107 ms overlapping gunzip 1283 ms, parse 5041 ms, sort 0 ms, write 0 ms, index 667 ms: 9 candidates, 83751 repo-hours, 1336 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:35:59Z [load_day 2024-10-30] 2024-10-30 hour 22: 199008 events in 0 files, snapshot none (task 7325 ms: download 4746 ms overlapping gunzip 1247 ms, parse 4608 ms, sort 0 ms, write 0 ms, index 625 ms: 12 candidates, 70446 repo-hours, 1399 releases; waiting 549 ms; commit 0 ms)
2026-11-08T08:35:59Z [load_day 2024-10-30] 2024-10-30 hour 23: 186435 events in 0 files, snapshot none (task 6632 ms: download 4038 ms overlapping gunzip 1155 ms, parse 4050 ms, sort 0 ms, write 0 ms, index 646 ms: 17 candidates, 65696 repo-hours, 1006 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:36:09Z [load_day 2024-10-30] 2024-10-30: repo_hour merged from 24 files to 1 (2223351 rows, 9843 ms)
2026-11-08T08:36:12Z [load_day 2024-10-30] 2024-10-30: index committed in 12656 ms (24 + 1 + 24 files)
2026-11-08T08:36:12Z [load_day 2024-10-30] 2024-10-30: 5350644 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:36:12Z [load_day 2024-10-30] attempt 1 succeeded