orcaLog in

Runs · run 2451

load_day 2024-05-14, attempt 1 succeeded

Host
73ccef5e07c2:122094
Started
2026-11-08T06:04:44Z
Ended
2026-11-08T06:06:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
775 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.8 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2451/load_day/2024-05-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:04:44Z [load_day 2024-05-14] attempt 1 started
2026-11-08T06:04:45Z [load_day 2024-05-14] 2024-05-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:04:55Z [load_day 2024-05-14] 2024-05-14 hour 0: 201234 events in 0 files, snapshot none (task 8733 ms: download 5306 ms overlapping gunzip 1370 ms, parse 5619 ms, sort 0 ms, write 0 ms, index 955 ms: 12 candidates, 102894 repo-hours, 1154 releases; waiting 464 ms; commit 0 ms)
2026-11-08T06:04:55Z [load_day 2024-05-14] 2024-05-14 hour 1: 207850 events in 0 files, snapshot none (task 8450 ms: download 4633 ms overlapping gunzip 1223 ms, parse 5456 ms, sort 0 ms, write 0 ms, index 1031 ms: 11 candidates, 108387 repo-hours, 823 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:05:02Z [load_day 2024-05-14] 2024-05-14 hour 2: 184075 events in 0 files, snapshot none (task 6784 ms: download 4152 ms overlapping gunzip 1029 ms, parse 4196 ms, sort 0 ms, write 0 ms, index 632 ms: 7 candidates, 68814 repo-hours, 800 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:05:02Z [load_day 2024-05-14] 2024-05-14 hour 3: 193323 events in 0 files, snapshot none (task 6313 ms: download 3773 ms overlapping gunzip 911 ms, parse 3837 ms, sort 0 ms, write 0 ms, index 695 ms: 3 candidates, 74738 repo-hours, 2966 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:05:09Z [load_day 2024-05-14] 2024-05-14 hour 4: 174677 events in 0 files, snapshot none (task 6763 ms: download 4275 ms overlapping gunzip 1015 ms, parse 4532 ms, sort 0 ms, write 0 ms, index 492 ms: 6 candidates, 64321 repo-hours, 634 releases; waiting 476 ms; commit 0 ms)
2026-11-08T06:05:10Z [load_day 2024-05-14] 2024-05-14 hour 5: 190178 events in 0 files, snapshot none (task 7869 ms: download 5463 ms overlapping gunzip 1390 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 536 ms: 7 candidates, 72659 repo-hours, 808 releases; waiting 459 ms; commit 0 ms)
2026-11-08T06:05:18Z [load_day 2024-05-14] 2024-05-14 hour 6: 220419 events in 0 files, snapshot none (task 8239 ms: download 4744 ms overlapping gunzip 1207 ms, parse 5312 ms, sort 0 ms, write 0 ms, index 920 ms: 5 candidates, 95786 repo-hours, 995 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:05:19Z [load_day 2024-05-14] 2024-05-14 hour 7: 219692 events in 0 files, snapshot none (task 8498 ms: download 5482 ms overlapping gunzip 1325 ms, parse 5705 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 90610 repo-hours, 1289 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:05:28Z [load_day 2024-05-14] 2024-05-14 hour 8: 233092 events in 0 files, snapshot none (task 9525 ms: download 5701 ms overlapping gunzip 1391 ms, parse 5966 ms, sort 0 ms, write 0 ms, index 1000 ms: 15 candidates, 98546 repo-hours, 1364 releases; waiting 770 ms; commit 0 ms)
2026-11-08T06:05:28Z [load_day 2024-05-14] 2024-05-14 hour 9: 238220 events in 0 files, snapshot none (task 8529 ms: download 5395 ms overlapping gunzip 1341 ms, parse 5813 ms, sort 0 ms, write 0 ms, index 877 ms: 12 candidates, 99264 repo-hours, 1343 releases; waiting 241 ms; commit 0 ms)
2026-11-08T06:05:37Z [load_day 2024-05-14] 2024-05-14 hour 10: 222832 events in 0 files, snapshot none (task 8227 ms: download 4547 ms overlapping gunzip 1221 ms, parse 5330 ms, sort 0 ms, write 0 ms, index 883 ms: 13 candidates, 91234 repo-hours, 1167 releases; waiting 494 ms; commit 0 ms)
2026-11-08T06:05:37Z [load_day 2024-05-14] 2024-05-14 hour 11: 218972 events in 0 files, snapshot none (task 8104 ms: download 4754 ms overlapping gunzip 1233 ms, parse 5150 ms, sort 0 ms, write 0 ms, index 808 ms: 15 candidates, 88964 repo-hours, 1158 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:05:47Z [load_day 2024-05-14] 2024-05-14 hour 12: 279759 events in 0 files, snapshot none (task 9795 ms: download 5764 ms overlapping gunzip 1358 ms, parse 5937 ms, sort 0 ms, write 0 ms, index 1391 ms: 13 candidates, 132832 repo-hours, 1363 releases; waiting 873 ms; commit 0 ms)
2026-11-08T06:05:47Z [load_day 2024-05-14] 2024-05-14 hour 13: 260882 events in 0 files, snapshot none (task 9746 ms: download 6143 ms overlapping gunzip 1498 ms, parse 6397 ms, sort 0 ms, write 0 ms, index 1093 ms: 21 candidates, 119642 repo-hours, 1253 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:05:55Z [load_day 2024-05-14] 2024-05-14 hour 14: 257119 events in 0 files, snapshot none (task 7563 ms: download 4726 ms overlapping gunzip 1180 ms, parse 4864 ms, sort 0 ms, write 0 ms, index 758 ms: 11 candidates, 106607 repo-hours, 1373 releases; waiting 198 ms; commit 0 ms)
2026-11-08T06:05:56Z [load_day 2024-05-14] 2024-05-14 hour 15: 247876 events in 0 files, snapshot none (task 7971 ms: download 5354 ms overlapping gunzip 1217 ms, parse 5219 ms, sort 0 ms, write 0 ms, index 739 ms: 10 candidates, 110094 repo-hours, 1482 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:06:02Z [load_day 2024-05-14] 2024-05-14 hour 16: 230792 events in 0 files, snapshot none (task 7028 ms: download 4564 ms overlapping gunzip 1064 ms, parse 4445 ms, sort 0 ms, write 0 ms, index 667 ms: 10 candidates, 95863 repo-hours, 1176 releases; waiting 623 ms; commit 0 ms)
2026-11-08T06:06:03Z [load_day 2024-05-14] 2024-05-14 hour 17: 224864 events in 0 files, snapshot none (task 6925 ms: download 4334 ms overlapping gunzip 1035 ms, parse 4328 ms, sort 0 ms, write 0 ms, index 685 ms: 13 candidates, 91508 repo-hours, 1117 releases; waiting 523 ms; commit 0 ms)
2026-11-08T06:06:12Z [load_day 2024-05-14] 2024-05-14 hour 18: 238709 events in 0 files, snapshot none (task 8627 ms: download 5599 ms overlapping gunzip 1280 ms, parse 5808 ms, sort 0 ms, write 0 ms, index 745 ms: 4 candidates, 100819 repo-hours, 1189 releases; waiting 545 ms; commit 0 ms)
2026-11-08T06:06:12Z [load_day 2024-05-14] 2024-05-14 hour 19: 215564 events in 0 files, snapshot none (task 8713 ms: download 6164 ms overlapping gunzip 1365 ms, parse 5867 ms, sort 0 ms, write 0 ms, index 685 ms: 11 candidates, 83805 repo-hours, 1183 releases; waiting 539 ms; commit 0 ms)
2026-11-08T06:06:21Z [load_day 2024-05-14] 2024-05-14 hour 20: 209301 events in 0 files, snapshot none (task 8696 ms: download 6207 ms overlapping gunzip 1436 ms, parse 5816 ms, sort 0 ms, write 0 ms, index 593 ms: 15 candidates, 81749 repo-hours, 976 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:06:21Z [load_day 2024-05-14] 2024-05-14 hour 21: 195332 events in 0 files, snapshot none (task 8115 ms: download 5790 ms overlapping gunzip 1291 ms, parse 5506 ms, sort 0 ms, write 0 ms, index 598 ms: 10 candidates, 78018 repo-hours, 1088 releases; waiting 511 ms; commit 0 ms)
2026-11-08T06:06:29Z [load_day 2024-05-14] 2024-05-14 hour 22: 175755 events in 0 files, snapshot none (task 7627 ms: download 5257 ms overlapping gunzip 1232 ms, parse 5084 ms, sort 0 ms, write 0 ms, index 435 ms: 14 candidates, 64625 repo-hours, 960 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:06:29Z [load_day 2024-05-14] 2024-05-14 hour 23: 166023 events in 0 files, snapshot none (task 6539 ms: download 4147 ms overlapping gunzip 969 ms, parse 4306 ms, sort 0 ms, write 0 ms, index 448 ms: 9 candidates, 60762 repo-hours, 735 releases; waiting 501 ms; commit 0 ms)
2026-11-08T06:06:38Z [load_day 2024-05-14] 2024-05-14: repo_hour merged from 24 files to 1 (2182541 rows, 9635 ms)
2026-11-08T06:06:41Z [load_day 2024-05-14] 2024-05-14: index committed in 12128 ms (24 + 1 + 24 files)
2026-11-08T06:06:41Z [load_day 2024-05-14] 2024-05-14: 5206540 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:06:41Z [load_day 2024-05-14] attempt 1 succeeded