orcaLog in

Runs · run 2083

load_day 2024-02-14, attempt 1 succeeded

Host
73ccef5e07c2:86581
Started
2026-11-08T04:38:29Z
Ended
2026-11-08T04:40:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
700 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.3 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2083/load_day/2024-02-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:38:29Z [load_day 2024-02-14] attempt 1 started
2026-11-08T04:38:30Z [load_day 2024-02-14] 2024-02-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:38:40Z [load_day 2024-02-14] 2024-02-14 hour 0: 249134 events in 0 files, snapshot none (task 9287 ms: download 5698 ms overlapping gunzip 1391 ms, parse 6344 ms, sort 0 ms, write 0 ms, index 775 ms: 9 candidates, 91083 repo-hours, 1122 releases; waiting 466 ms; commit 0 ms)
2026-11-08T04:38:40Z [load_day 2024-02-14] 2024-02-14 hour 1: 243618 events in 0 files, snapshot none (task 8485 ms: download 4929 ms overlapping gunzip 1204 ms, parse 5385 ms, sort 0 ms, write 0 ms, index 1068 ms: 12 candidates, 89750 repo-hours, 731 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:38:47Z [load_day 2024-02-14] 2024-02-14 hour 2: 206156 events in 0 files, snapshot none (task 6633 ms: download 3646 ms overlapping gunzip 1038 ms, parse 4340 ms, sort 0 ms, write 0 ms, index 465 ms: 7 candidates, 54067 repo-hours, 593 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:38:47Z [load_day 2024-02-14] 2024-02-14 hour 3: 206082 events in 0 files, snapshot none (task 6753 ms: download 3867 ms overlapping gunzip 1014 ms, parse 4533 ms, sort 0 ms, write 0 ms, index 501 ms: 8 candidates, 53977 repo-hours, 714 releases; waiting 456 ms; commit 0 ms)
2026-11-08T04:38:54Z [load_day 2024-02-14] 2024-02-14 hour 4: 211329 events in 0 files, snapshot none (task 6820 ms: download 3507 ms overlapping gunzip 971 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 662 ms: 8 candidates, 56215 repo-hours, 785 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:38:54Z [load_day 2024-02-14] 2024-02-14 hour 5: 217263 events in 0 files, snapshot none (task 6846 ms: download 4100 ms overlapping gunzip 1049 ms, parse 4495 ms, sort 0 ms, write 0 ms, index 512 ms: 8 candidates, 59343 repo-hours, 593 releases; waiting 483 ms; commit 0 ms)
2026-11-08T04:39:02Z [load_day 2024-02-14] 2024-02-14 hour 6: 229560 events in 0 files, snapshot none (task 7224 ms: download 4274 ms overlapping gunzip 1087 ms, parse 4674 ms, sort 0 ms, write 0 ms, index 730 ms: 5 candidates, 68493 repo-hours, 677 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:39:02Z [load_day 2024-02-14] 2024-02-14 hour 7: 231794 events in 0 files, snapshot none (task 6987 ms: download 4235 ms overlapping gunzip 1098 ms, parse 4565 ms, sort 0 ms, write 0 ms, index 576 ms: 7 candidates, 66182 repo-hours, 711 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:39:11Z [load_day 2024-02-14] 2024-02-14 hour 8: 242306 events in 0 files, snapshot none (task 8786 ms: download 5928 ms overlapping gunzip 1275 ms, parse 5970 ms, sort 0 ms, write 0 ms, index 801 ms: 12 candidates, 74506 repo-hours, 965 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:39:12Z [load_day 2024-02-14] 2024-02-14 hour 9: 255791 events in 0 files, snapshot none (task 9253 ms: download 6023 ms overlapping gunzip 1366 ms, parse 6255 ms, sort 0 ms, write 0 ms, index 834 ms: 9 candidates, 81215 repo-hours, 1118 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:39:22Z [load_day 2024-02-14] 2024-02-14 hour 10: 263606 events in 0 files, snapshot none (task 10088 ms: download 6867 ms overlapping gunzip 1616 ms, parse 7145 ms, sort 0 ms, write 0 ms, index 614 ms: 6 candidates, 83337 repo-hours, 1039 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:39:22Z [load_day 2024-02-14] 2024-02-14 hour 11: 256616 events in 0 files, snapshot none (task 9135 ms: download 6290 ms overlapping gunzip 1499 ms, parse 6225 ms, sort 0 ms, write 0 ms, index 630 ms: 2 candidates, 78072 repo-hours, 962 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:39:31Z [load_day 2024-02-14] 2024-02-14 hour 12: 306618 events in 0 files, snapshot none (task 8819 ms: download 5586 ms overlapping gunzip 1236 ms, parse 5680 ms, sort 0 ms, write 0 ms, index 763 ms: 11 candidates, 111876 repo-hours, 1069 releases; waiting 458 ms; commit 0 ms)
2026-11-08T04:39:31Z [load_day 2024-02-14] 2024-02-14 hour 13: 279722 events in 0 files, snapshot none (task 8699 ms: download 5998 ms overlapping gunzip 1288 ms, parse 5897 ms, sort 0 ms, write 0 ms, index 755 ms: 12 candidates, 104881 repo-hours, 1148 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:39:41Z [load_day 2024-02-14] 2024-02-14 hour 14: 261061 events in 0 files, snapshot none (task 8668 ms: download 6000 ms overlapping gunzip 1262 ms, parse 5461 ms, sort 0 ms, write 0 ms, index 690 ms: 11 candidates, 95005 repo-hours, 1179 releases; waiting 901 ms; commit 0 ms)
2026-11-08T04:39:41Z [load_day 2024-02-14] 2024-02-14 hour 15: 260316 events in 0 files, snapshot none (task 8532 ms: download 5883 ms overlapping gunzip 1351 ms, parse 5661 ms, sort 0 ms, write 0 ms, index 710 ms: 8 candidates, 97338 repo-hours, 1330 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:39:51Z [load_day 2024-02-14] 2024-02-14 hour 16: 265171 events in 0 files, snapshot none (task 10095 ms: download 7138 ms overlapping gunzip 1498 ms, parse 6909 ms, sort 0 ms, write 0 ms, index 917 ms: 12 candidates, 96895 repo-hours, 1164 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:39:51Z [load_day 2024-02-14] 2024-02-14 hour 17: 252134 events in 0 files, snapshot none (task 9992 ms: download 6806 ms overlapping gunzip 1623 ms, parse 6807 ms, sort 0 ms, write 0 ms, index 807 ms: 9 candidates, 87669 repo-hours, 1103 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:40:02Z [load_day 2024-02-14] 2024-02-14 hour 18: 272641 events in 0 files, snapshot none (task 10600 ms: download 7258 ms overlapping gunzip 1638 ms, parse 7283 ms, sort 0 ms, write 0 ms, index 1135 ms: 8 candidates, 91964 repo-hours, 1139 releases; waiting 325 ms; commit 0 ms)
2026-11-08T04:40:03Z [load_day 2024-02-14] 2024-02-14 hour 19: 279544 events in 0 files, snapshot none (task 11595 ms: download 7730 ms overlapping gunzip 1721 ms, parse 7919 ms, sort 0 ms, write 0 ms, index 1192 ms: 9 candidates, 122929 repo-hours, 1005 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:40:12Z [load_day 2024-02-14] 2024-02-14 hour 20: 249259 events in 0 files, snapshot none (task 8821 ms: download 5709 ms overlapping gunzip 1303 ms, parse 6036 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 75939 repo-hours, 1000 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:40:12Z [load_day 2024-02-14] 2024-02-14 hour 21: 242741 events in 0 files, snapshot none (task 8714 ms: download 6056 ms overlapping gunzip 1373 ms, parse 5920 ms, sort 0 ms, write 0 ms, index 667 ms: 5 candidates, 71330 repo-hours, 1139 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:40:20Z [load_day 2024-02-14] 2024-02-14 hour 22: 192691 events in 0 files, snapshot none (task 8360 ms: download 5529 ms overlapping gunzip 1408 ms, parse 5571 ms, sort 0 ms, write 0 ms, index 583 ms: 7 candidates, 66040 repo-hours, 977 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:40:21Z [load_day 2024-02-14] 2024-02-14 hour 23: 168427 events in 0 files, snapshot none (task 7832 ms: download 5128 ms overlapping gunzip 1248 ms, parse 5257 ms, sort 0 ms, write 0 ms, index 499 ms: 10 candidates, 58890 repo-hours, 770 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:40:31Z [load_day 2024-02-14] 2024-02-14: repo_hour merged from 24 files to 1 (1936996 rows, 9888 ms)
2026-11-08T04:40:34Z [load_day 2024-02-14] 2024-02-14: index committed in 12724 ms (24 + 1 + 24 files)
2026-11-08T04:40:34Z [load_day 2024-02-14] 2024-02-14: 5843580 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:40:34Z [load_day 2024-02-14] attempt 1 succeeded