orcaLog in

Runs · run 2050

load_day 2024-02-05, attempt 1 succeeded

Host
73ccef5e07c2:83298
Started
2026-11-08T04:29:58Z
Ended
2026-11-08T04:32:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
708 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
196.3 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2050/load_day/2024-02-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:29:58Z [load_day 2024-02-05] attempt 1 started
2026-11-08T04:29:59Z [load_day 2024-02-05] 2024-02-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:30:07Z [load_day 2024-02-05] 2024-02-05 hour 0: 195143 events in 0 files, snapshot none (task 7393 ms: download 3765 ms overlapping gunzip 998 ms, parse 4415 ms, sort 0 ms, write 0 ms, index 1130 ms: 9 candidates, 83776 repo-hours, 1093 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:30:09Z [load_day 2024-02-05] 2024-02-05 hour 1: 193738 events in 0 files, snapshot none (task 8610 ms: download 5196 ms overlapping gunzip 1361 ms, parse 5629 ms, sort 0 ms, write 0 ms, index 875 ms: 10 candidates, 91121 repo-hours, 771 releases; waiting 483 ms; commit 0 ms)
2026-11-08T04:30:15Z [load_day 2024-02-05] 2024-02-05 hour 2: 156467 events in 0 files, snapshot none (task 6945 ms: download 3392 ms overlapping gunzip 1174 ms, parse 4497 ms, sort 0 ms, write 0 ms, index 459 ms: 11 candidates, 58309 repo-hours, 741 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:30:16Z [load_day 2024-02-05] 2024-02-05 hour 3: 171230 events in 0 files, snapshot none (task 6841 ms: download 4221 ms overlapping gunzip 1131 ms, parse 4405 ms, sort 0 ms, write 0 ms, index 527 ms: 3 candidates, 60485 repo-hours, 827 releases; waiting 551 ms; commit 0 ms)
2026-11-08T04:30:22Z [load_day 2024-02-05] 2024-02-05 hour 4: 191029 events in 0 files, snapshot none (task 6615 ms: download 3530 ms overlapping gunzip 1060 ms, parse 4321 ms, sort 0 ms, write 0 ms, index 450 ms: 2 candidates, 58057 repo-hours, 626 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:30:24Z [load_day 2024-02-05] 2024-02-05 hour 5: 202292 events in 0 files, snapshot none (task 7237 ms: download 4730 ms overlapping gunzip 1225 ms, parse 4765 ms, sort 0 ms, write 0 ms, index 460 ms: 2 candidates, 62651 repo-hours, 666 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:30:30Z [load_day 2024-02-05] 2024-02-05 hour 6: 221788 events in 0 files, snapshot none (task 7480 ms: download 4831 ms overlapping gunzip 1199 ms, parse 4942 ms, sort 0 ms, write 0 ms, index 580 ms: 4 candidates, 75036 repo-hours, 824 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:30:33Z [load_day 2024-02-05] 2024-02-05 hour 7: 223031 events in 0 files, snapshot none (task 8544 ms: download 5828 ms overlapping gunzip 1340 ms, parse 5482 ms, sort 0 ms, write 0 ms, index 906 ms: 10 candidates, 73732 repo-hours, 852 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:30:38Z [load_day 2024-02-05] 2024-02-05 hour 8: 229596 events in 0 files, snapshot none (task 7156 ms: download 4578 ms overlapping gunzip 1145 ms, parse 4554 ms, sort 0 ms, write 0 ms, index 651 ms: 11 candidates, 78995 repo-hours, 944 releases; waiting 554 ms; commit 0 ms)
2026-11-08T04:30:42Z [load_day 2024-02-05] 2024-02-05 hour 9: 253931 events in 0 files, snapshot none (task 8339 ms: download 5873 ms overlapping gunzip 1361 ms, parse 5479 ms, sort 0 ms, write 0 ms, index 637 ms: 8 candidates, 87912 repo-hours, 1214 releases; waiting 562 ms; commit 0 ms)
2026-11-08T04:30:49Z [load_day 2024-02-05] 2024-02-05 hour 10: 259078 events in 0 files, snapshot none (task 9680 ms: download 5642 ms overlapping gunzip 1536 ms, parse 6434 ms, sort 0 ms, write 0 ms, index 943 ms: 7 candidates, 91939 repo-hours, 1092 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:30:52Z [load_day 2024-02-05] 2024-02-05 hour 11: 246102 events in 0 files, snapshot none (task 10023 ms: download 6976 ms overlapping gunzip 1582 ms, parse 6644 ms, sort 0 ms, write 0 ms, index 839 ms: 5 candidates, 82445 repo-hours, 998 releases; waiting 648 ms; commit 0 ms)
2026-11-08T04:31:00Z [load_day 2024-02-05] 2024-02-05 hour 12: 299735 events in 0 files, snapshot none (task 10714 ms: download 6579 ms overlapping gunzip 1668 ms, parse 7361 ms, sort 0 ms, write 0 ms, index 1099 ms: 6 candidates, 114601 repo-hours, 1199 releases; waiting 328 ms; commit 0 ms)
2026-11-08T04:31:05Z [load_day 2024-02-05] 2024-02-05 hour 13: 283155 events in 0 files, snapshot none (task 11887 ms: download 8464 ms overlapping gunzip 1963 ms, parse 8032 ms, sort 0 ms, write 0 ms, index 1092 ms: 5 candidates, 108070 repo-hours, 1056 releases; waiting 521 ms; commit 0 ms)
2026-11-08T04:31:12Z [load_day 2024-02-05] 2024-02-05 hour 14: 285159 events in 0 files, snapshot none (task 10558 ms: download 7652 ms overlapping gunzip 1716 ms, parse 7253 ms, sort 0 ms, write 0 ms, index 795 ms: 9 candidates, 99217 repo-hours, 1147 releases; waiting 533 ms; commit 0 ms)
2026-11-08T04:31:17Z [load_day 2024-02-05] 2024-02-05 hour 15: 285727 events in 0 files, snapshot none (task 11921 ms: download 7606 ms overlapping gunzip 1934 ms, parse 7864 ms, sort 0 ms, write 0 ms, index 1388 ms: 20 candidates, 103959 repo-hours, 1581 releases; waiting 464 ms; commit 0 ms)
2026-11-08T04:31:25Z [load_day 2024-02-05] 2024-02-05 hour 16: 278007 events in 0 files, snapshot none (task 13123 ms: download 8899 ms overlapping gunzip 2227 ms, parse 8959 ms, sort 0 ms, write 0 ms, index 1010 ms: 16 candidates, 101013 repo-hours, 1238 releases; waiting 560 ms; commit 0 ms)
2026-11-08T04:31:30Z [load_day 2024-02-05] 2024-02-05 hour 17: 269363 events in 0 files, snapshot none (task 12345 ms: download 8727 ms overlapping gunzip 2126 ms, parse 8560 ms, sort 0 ms, write 0 ms, index 943 ms: 10 candidates, 93465 repo-hours, 1013 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:31:37Z [load_day 2024-02-05] 2024-02-05 hour 18: 268637 events in 0 files, snapshot none (task 10816 ms: download 6796 ms overlapping gunzip 1706 ms, parse 6952 ms, sort 0 ms, write 0 ms, index 1275 ms: 9 candidates, 98976 repo-hours, 1131 releases; waiting 541 ms; commit 0 ms)
2026-11-08T04:31:37Z [load_day 2024-02-05] 2024-02-05 hour 19: 139013 events in 0 files, snapshot none (task 6613 ms: download 3543 ms overlapping gunzip 1106 ms, parse 4082 ms, sort 0 ms, write 0 ms, index 601 ms: 3 candidates, 53734 repo-hours, 567 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:31:47Z [load_day 2024-02-05] 2024-02-05 hour 20: 242290 events in 0 files, snapshot none (task 9934 ms: download 7079 ms overlapping gunzip 1631 ms, parse 6896 ms, sort 0 ms, write 0 ms, index 719 ms: 3 candidates, 80544 repo-hours, 990 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:31:48Z [load_day 2024-02-05] 2024-02-05 hour 21: 242900 events in 0 files, snapshot none (task 10199 ms: download 7529 ms overlapping gunzip 1821 ms, parse 6948 ms, sort 0 ms, write 0 ms, index 682 ms: 9 candidates, 76402 repo-hours, 1075 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:31:57Z [load_day 2024-02-05] 2024-02-05 hour 22: 238118 events in 0 files, snapshot none (task 9653 ms: download 6534 ms overlapping gunzip 1681 ms, parse 6484 ms, sort 0 ms, write 0 ms, index 733 ms: 11 candidates, 72189 repo-hours, 990 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:31:57Z [load_day 2024-02-05] 2024-02-05 hour 23: 214249 events in 0 files, snapshot none (task 8168 ms: download 5122 ms overlapping gunzip 1384 ms, parse 5314 ms, sort 0 ms, write 0 ms, index 624 ms: 13 candidates, 62489 repo-hours, 872 releases; waiting 537 ms; commit 0 ms)
2026-11-08T04:32:06Z [load_day 2024-02-05] 2024-02-05: repo_hour merged from 24 files to 1 (1969117 rows, 9051 ms)
2026-11-08T04:32:09Z [load_day 2024-02-05] 2024-02-05: index committed in 11260 ms (24 + 1 + 24 files)
2026-11-08T04:32:09Z [load_day 2024-02-05] 2024-02-05: 5589778 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:32:09Z [load_day 2024-02-05] attempt 1 succeeded