orcaLog in

Runs · run 3864

load_day 2025-05-06, attempt 1 succeeded

Host
73ccef5e07c2:299348
Started
2026-11-08T11:47:09Z
Ended
2026-11-08T11:49:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
860 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
218.9 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3864/load_day/2025-05-06/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:47:09Z [load_day 2025-05-06] attempt 1 started
2026-11-08T11:47:10Z [load_day 2025-05-06] 2025-05-06: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:47:21Z [load_day 2025-05-06] 2025-05-06 hour 0: 210130 events in 0 files, snapshot none (task 10388 ms: download 7344 ms overlapping gunzip 1771 ms, parse 7101 ms, sort 0 ms, write 0 ms, index 702 ms: 12 candidates, 94188 repo-hours, 1235 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:47:21Z [load_day 2025-05-06] 2025-05-06 hour 1: 236298 events in 0 files, snapshot none (task 10124 ms: download 6633 ms overlapping gunzip 1521 ms, parse 6815 ms, sort 0 ms, write 0 ms, index 1187 ms: 13 candidates, 127606 repo-hours, 962 releases; waiting 297 ms; commit 0 ms)
2026-11-08T11:47:29Z [load_day 2025-05-06] 2025-05-06 hour 2: 205617 events in 0 files, snapshot none (task 7558 ms: download 4829 ms overlapping gunzip 1170 ms, parse 4821 ms, sort 0 ms, write 0 ms, index 717 ms: 14 candidates, 92040 repo-hours, 892 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:47:29Z [load_day 2025-05-06] 2025-05-06 hour 3: 218524 events in 0 files, snapshot none (task 7583 ms: download 4947 ms overlapping gunzip 1208 ms, parse 4863 ms, sort 0 ms, write 0 ms, index 700 ms: 13 candidates, 91998 repo-hours, 2901 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:47:38Z [load_day 2025-05-06] 2025-05-06 hour 4: 203811 events in 0 files, snapshot none (task 9107 ms: download 5855 ms overlapping gunzip 1454 ms, parse 6033 ms, sort 0 ms, write 0 ms, index 779 ms: 5 candidates, 78647 repo-hours, 766 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:47:38Z [load_day 2025-05-06] 2025-05-06 hour 5: 214433 events in 0 files, snapshot none (task 9201 ms: download 6182 ms overlapping gunzip 1504 ms, parse 6329 ms, sort 0 ms, write 0 ms, index 797 ms: 6 candidates, 85168 repo-hours, 939 releases; waiting 241 ms; commit 0 ms)
2026-11-08T11:47:48Z [load_day 2025-05-06] 2025-05-06 hour 6: 235376 events in 0 files, snapshot none (task 9293 ms: download 6266 ms overlapping gunzip 1451 ms, parse 5986 ms, sort 0 ms, write 0 ms, index 869 ms: 5 candidates, 107459 repo-hours, 979 releases; waiting 657 ms; commit 0 ms)
2026-11-08T11:47:48Z [load_day 2025-05-06] 2025-05-06 hour 7: 242215 events in 0 files, snapshot none (task 9415 ms: download 6181 ms overlapping gunzip 1508 ms, parse 6229 ms, sort 0 ms, write 0 ms, index 1007 ms: 8 candidates, 102360 repo-hours, 1198 releases; waiting 375 ms; commit 0 ms)
2026-11-08T11:47:59Z [load_day 2025-05-06] 2025-05-06 hour 8: 256977 events in 0 files, snapshot none (task 10412 ms: download 6941 ms overlapping gunzip 1662 ms, parse 6809 ms, sort 0 ms, write 0 ms, index 1168 ms: 9 candidates, 109198 repo-hours, 1305 releases; waiting 491 ms; commit 0 ms)
2026-11-08T11:48:00Z [load_day 2025-05-06] 2025-05-06 hour 9: 259481 events in 0 files, snapshot none (task 11233 ms: download 7263 ms overlapping gunzip 1882 ms, parse 7624 ms, sort 0 ms, write 0 ms, index 1171 ms: 7 candidates, 111964 repo-hours, 1448 releases; waiting 200 ms; commit 0 ms)
2026-11-08T11:48:09Z [load_day 2025-05-06] 2025-05-06 hour 10: 251256 events in 0 files, snapshot none (task 9529 ms: download 6890 ms overlapping gunzip 1555 ms, parse 6641 ms, sort 0 ms, write 0 ms, index 808 ms: 6 candidates, 106422 repo-hours, 1326 releases; waiting 273 ms; commit 0 ms)
2026-11-08T11:48:10Z [load_day 2025-05-06] 2025-05-06 hour 11: 257279 events in 0 files, snapshot none (task 9660 ms: download 6875 ms overlapping gunzip 1609 ms, parse 6396 ms, sort 0 ms, write 0 ms, index 915 ms: 4 candidates, 104387 repo-hours, 1265 releases; waiting 446 ms; commit 0 ms)
2026-11-08T11:48:20Z [load_day 2025-05-06] 2025-05-06 hour 12: 279933 events in 0 files, snapshot none (task 10231 ms: download 7244 ms overlapping gunzip 1497 ms, parse 6916 ms, sort 0 ms, write 0 ms, index 1018 ms: 11 candidates, 145383 repo-hours, 1322 releases; waiting 474 ms; commit 0 ms)
2026-11-08T11:48:22Z [load_day 2025-05-06] 2025-05-06 hour 13: 277555 events in 0 files, snapshot none (task 10457 ms: download 7146 ms overlapping gunzip 1508 ms, parse 6750 ms, sort 0 ms, write 0 ms, index 1103 ms: 9 candidates, 135316 repo-hours, 1333 releases; waiting 473 ms; commit 0 ms)
2026-11-08T11:48:31Z [load_day 2025-05-06] 2025-05-06 hour 14: 267457 events in 0 files, snapshot none (task 10745 ms: download 8104 ms overlapping gunzip 1748 ms, parse 7090 ms, sort 0 ms, write 0 ms, index 826 ms: 7 candidates, 120213 repo-hours, 1343 releases; waiting 783 ms; commit 0 ms)
2026-11-08T11:48:32Z [load_day 2025-05-06] 2025-05-06 hour 15: 267521 events in 0 files, snapshot none (task 9831 ms: download 7329 ms overlapping gunzip 1628 ms, parse 6765 ms, sort 0 ms, write 0 ms, index 844 ms: 17 candidates, 118488 repo-hours, 1436 releases; waiting 232 ms; commit 0 ms)
2026-11-08T11:48:40Z [load_day 2025-05-06] 2025-05-06 hour 16: 265398 events in 0 files, snapshot none (task 8541 ms: download 5767 ms overlapping gunzip 1348 ms, parse 5587 ms, sort 0 ms, write 0 ms, index 863 ms: 10 candidates, 115260 repo-hours, 1266 releases; waiting 417 ms; commit 0 ms)
2026-11-08T11:48:41Z [load_day 2025-05-06] 2025-05-06 hour 17: 261669 events in 0 files, snapshot none (task 8836 ms: download 6192 ms overlapping gunzip 1377 ms, parse 5715 ms, sort 0 ms, write 0 ms, index 778 ms: 11 candidates, 106728 repo-hours, 1236 releases; waiting 681 ms; commit 0 ms)
2026-11-08T11:48:51Z [load_day 2025-05-06] 2025-05-06 hour 18: 253222 events in 0 files, snapshot none (task 10764 ms: download 7282 ms overlapping gunzip 1390 ms, parse 6039 ms, sort 0 ms, write 0 ms, index 960 ms: 7 candidates, 112618 repo-hours, 1272 releases; waiting 2073 ms; commit 0 ms)
2026-11-08T11:48:51Z [load_day 2025-05-06] 2025-05-06 hour 19: 239493 events in 0 files, snapshot none (task 9375 ms: download 5196 ms overlapping gunzip 1461 ms, parse 5851 ms, sort 0 ms, write 0 ms, index 1129 ms: 9 candidates, 96678 repo-hours, 1187 releases; waiting 661 ms; commit 0 ms)
2026-11-08T11:49:01Z [load_day 2025-05-06] 2025-05-06 hour 20: 237024 events in 0 files, snapshot none (task 9069 ms: download 6372 ms overlapping gunzip 1408 ms, parse 6140 ms, sort 0 ms, write 0 ms, index 686 ms: 10 candidates, 95224 repo-hours, 1173 releases; waiting 497 ms; commit 0 ms)
2026-11-08T11:49:01Z [load_day 2025-05-06] 2025-05-06 hour 21: 213391 events in 0 files, snapshot none (task 8265 ms: download 5398 ms overlapping gunzip 1275 ms, parse 5311 ms, sort 0 ms, write 0 ms, index 834 ms: 11 candidates, 84164 repo-hours, 1194 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:49:10Z [load_day 2025-05-06] 2025-05-06 hour 22: 204916 events in 0 files, snapshot none (task 8567 ms: download 5612 ms overlapping gunzip 1292 ms, parse 5496 ms, sort 0 ms, write 0 ms, index 1047 ms: 16 candidates, 78387 repo-hours, 1109 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:49:10Z [load_day 2025-05-06] 2025-05-06 hour 23: 198093 events in 0 files, snapshot none (task 8863 ms: download 6132 ms overlapping gunzip 1364 ms, parse 6056 ms, sort 0 ms, write 0 ms, index 647 ms: 9 candidates, 76097 repo-hours, 1238 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:49:21Z [load_day 2025-05-06] 2025-05-06: repo_hour merged from 24 files to 1 (2495993 rows, 10785 ms)
2026-11-08T11:49:24Z [load_day 2025-05-06] 2025-05-06: index committed in 13616 ms (24 + 1 + 24 files)
2026-11-08T11:49:24Z [load_day 2025-05-06] 2025-05-06: 5757069 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:49:24Z [load_day 2025-05-06] attempt 1 succeeded