orcaLog in

Runs · run 2456

load_day 2024-05-15, attempt 1 succeeded

Host
73ccef5e07c2:122547
Started
2026-11-08T06:06:03Z
Ended
2026-11-08T06:08:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
864 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2456/load_day/2024-05-15/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:06:04Z [load_day 2024-05-15] attempt 1 started
2026-11-08T06:06:04Z [load_day 2024-05-15] 2024-05-15: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:06:12Z [load_day 2024-05-15] 2024-05-15 hour 0: 206860 events in 0 files, snapshot none (task 7256 ms: download 4235 ms overlapping gunzip 1041 ms, parse 4689 ms, sort 0 ms, write 0 ms, index 742 ms: 9 candidates, 95790 repo-hours, 1030 releases; waiting 508 ms; commit 0 ms)
2026-11-08T06:06:12Z [load_day 2024-05-15] 2024-05-15 hour 1: 195567 events in 0 files, snapshot none (task 7407 ms: download 4479 ms overlapping gunzip 1145 ms, parse 4712 ms, sort 0 ms, write 0 ms, index 786 ms: 10 candidates, 103559 repo-hours, 823 releases; waiting 487 ms; commit 0 ms)
2026-11-08T06:06:20Z [load_day 2024-05-15] 2024-05-15 hour 2: 171525 events in 0 files, snapshot none (task 7161 ms: download 4026 ms overlapping gunzip 1128 ms, parse 4542 ms, sort 0 ms, write 0 ms, index 723 ms: 5 candidates, 67800 repo-hours, 861 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:06:20Z [load_day 2024-05-15] 2024-05-15 hour 3: 175503 events in 0 files, snapshot none (task 7257 ms: download 4291 ms overlapping gunzip 1150 ms, parse 4709 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 71821 repo-hours, 2986 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:06:28Z [load_day 2024-05-15] 2024-05-15 hour 4: 160029 events in 0 files, snapshot none (task 7128 ms: download 3858 ms overlapping gunzip 1104 ms, parse 4490 ms, sort 0 ms, write 0 ms, index 608 ms: 7 candidates, 60455 repo-hours, 699 releases; waiting 635 ms; commit 0 ms)
2026-11-08T06:06:28Z [load_day 2024-05-15] 2024-05-15 hour 5: 189202 events in 0 files, snapshot none (task 7295 ms: download 4674 ms overlapping gunzip 1281 ms, parse 4857 ms, sort 0 ms, write 0 ms, index 527 ms: 5 candidates, 66927 repo-hours, 850 releases; waiting 399 ms; commit 0 ms)
2026-11-08T06:06:34Z [load_day 2024-05-15] 2024-05-15 hour 6: 211288 events in 0 files, snapshot none (task 6020 ms: download 3530 ms overlapping gunzip 901 ms, parse 3873 ms, sort 0 ms, write 0 ms, index 662 ms: 2 candidates, 92807 repo-hours, 1141 releases; waiting 316 ms; commit 0 ms)
2026-11-08T06:06:35Z [load_day 2024-05-15] 2024-05-15 hour 7: 221551 events in 0 files, snapshot none (task 6683 ms: download 4241 ms overlapping gunzip 1056 ms, parse 4268 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 84411 repo-hours, 1026 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:06:42Z [load_day 2024-05-15] 2024-05-15 hour 8: 230174 events in 0 files, snapshot none (task 7222 ms: download 4751 ms overlapping gunzip 1118 ms, parse 4594 ms, sort 0 ms, write 0 ms, index 685 ms: 13 candidates, 93679 repo-hours, 1570 releases; waiting 550 ms; commit 0 ms)
2026-11-08T06:06:43Z [load_day 2024-05-15] 2024-05-15 hour 9: 238877 events in 0 files, snapshot none (task 7206 ms: download 4530 ms overlapping gunzip 1082 ms, parse 4554 ms, sort 0 ms, write 0 ms, index 842 ms: 6 candidates, 98072 repo-hours, 1333 releases; waiting 463 ms; commit 0 ms)
2026-11-08T06:06:50Z [load_day 2024-05-15] 2024-05-15 hour 10: 226844 events in 0 files, snapshot none (task 7426 ms: download 4233 ms overlapping gunzip 1197 ms, parse 5194 ms, sort 0 ms, write 0 ms, index 823 ms: 11 candidates, 89696 repo-hours, 1083 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:06:50Z [load_day 2024-05-15] 2024-05-15 hour 11: 221534 events in 0 files, snapshot none (task 6838 ms: download 4364 ms overlapping gunzip 1164 ms, parse 4837 ms, sort 0 ms, write 0 ms, index 630 ms: 4 candidates, 88969 repo-hours, 1176 releases; waiting 22 ms; commit 0 ms)
2026-11-08T06:06:59Z [load_day 2024-05-15] 2024-05-15 hour 12: 277664 events in 0 files, snapshot none (task 8802 ms: download 5813 ms overlapping gunzip 1367 ms, parse 6298 ms, sort 0 ms, write 0 ms, index 921 ms: 9 candidates, 131342 repo-hours, 1304 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:07:00Z [load_day 2024-05-15] 2024-05-15 hour 13: 264136 events in 0 files, snapshot none (task 9324 ms: download 6551 ms overlapping gunzip 1597 ms, parse 6642 ms, sort 0 ms, write 0 ms, index 872 ms: 13 candidates, 121615 repo-hours, 1330 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:07:12Z [load_day 2024-05-15] 2024-05-15 hour 14: 258505 events in 0 files, snapshot none (task 12982 ms: download 9317 ms overlapping gunzip 2285 ms, parse 9467 ms, sort 0 ms, write 0 ms, index 947 ms: 14 candidates, 107016 repo-hours, 1306 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:07:12Z [load_day 2024-05-15] 2024-05-15 hour 15: 253060 events in 0 files, snapshot none (task 12109 ms: download 8161 ms overlapping gunzip 1972 ms, parse 8630 ms, sort 0 ms, write 0 ms, index 1254 ms: 17 candidates, 108317 repo-hours, 1320 releases; waiting 28 ms; commit 0 ms)
2026-11-08T06:07:23Z [load_day 2024-05-15] 2024-05-15 hour 16: 249059 events in 0 files, snapshot none (task 10286 ms: download 6765 ms overlapping gunzip 1633 ms, parse 7483 ms, sort 0 ms, write 0 ms, index 934 ms: 19 candidates, 94545 repo-hours, 1210 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:07:23Z [load_day 2024-05-15] 2024-05-15 hour 17: 226921 events in 0 files, snapshot none (task 10067 ms: download 6226 ms overlapping gunzip 1693 ms, parse 7178 ms, sort 0 ms, write 0 ms, index 991 ms: 11 candidates, 91165 repo-hours, 1174 releases; waiting 5 ms; commit 0 ms)
2026-11-08T06:07:33Z [load_day 2024-05-15] 2024-05-15 hour 18: 238461 events in 0 files, snapshot none (task 8732 ms: download 5726 ms overlapping gunzip 1393 ms, parse 5812 ms, sort 0 ms, write 0 ms, index 785 ms: 13 candidates, 101007 repo-hours, 1211 releases; waiting 472 ms; commit 0 ms)
2026-11-08T06:07:33Z [load_day 2024-05-15] 2024-05-15 hour 19: 212870 events in 0 files, snapshot none (task 7354 ms: download 4514 ms overlapping gunzip 1289 ms, parse 5133 ms, sort 0 ms, write 0 ms, index 714 ms: 11 candidates, 84127 repo-hours, 1140 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:07:41Z [load_day 2024-05-15] 2024-05-15 hour 20: 209171 events in 0 files, snapshot none (task 7484 ms: download 4211 ms overlapping gunzip 1209 ms, parse 5246 ms, sort 0 ms, write 0 ms, index 815 ms: 8 candidates, 83600 repo-hours, 978 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:07:41Z [load_day 2024-05-15] 2024-05-15 hour 21: 193751 events in 0 files, snapshot none (task 7491 ms: download 4627 ms overlapping gunzip 1151 ms, parse 4764 ms, sort 0 ms, write 0 ms, index 773 ms: 8 candidates, 76628 repo-hours, 1079 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:07:46Z [load_day 2024-05-15] 2024-05-15 hour 22: 164061 events in 0 files, snapshot none (task 5086 ms: download 2862 ms overlapping gunzip 929 ms, parse 3515 ms, sort 0 ms, write 0 ms, index 441 ms: 12 candidates, 62143 repo-hours, 1055 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:07:47Z [load_day 2024-05-15] 2024-05-15 hour 23: 158578 events in 0 files, snapshot none (task 5382 ms: download 3198 ms overlapping gunzip 866 ms, parse 3874 ms, sort 0 ms, write 0 ms, index 430 ms: 13 candidates, 59297 repo-hours, 698 releases; waiting 12 ms; commit 0 ms)
2026-11-08T06:07:59Z [load_day 2024-05-15] 2024-05-15: repo_hour merged from 24 files to 1 (2134788 rows, 12690 ms)
2026-11-08T06:08:02Z [load_day 2024-05-15] 2024-05-15: index committed in 15309 ms (24 + 1 + 24 files)
2026-11-08T06:08:02Z [load_day 2024-05-15] 2024-05-15: 5155191 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:08:02Z [load_day 2024-05-15] attempt 1 succeeded