orcaLog in

Runs · run 3119

load_day 2024-10-23, attempt 1 succeeded

Host
73ccef5e07c2:196852
Started
2026-11-08T08:28:20Z
Ended
2026-11-08T08:30:30Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
787 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
171.9 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3119/load_day/2024-10-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:28:20Z [load_day 2024-10-23] attempt 1 started
2026-11-08T08:28:21Z [load_day 2024-10-23] 2024-10-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:28:28Z [load_day 2024-10-23] 2024-10-23 hour 0: 199404 events in 0 files, snapshot none (task 6059 ms: download 3147 ms overlapping gunzip 908 ms, parse 3562 ms, sort 0 ms, write 0 ms, index 889 ms: 15 candidates, 92637 repo-hours, 1235 releases; waiting 432 ms; commit 0 ms)
2026-11-08T08:28:29Z [load_day 2024-10-23] 2024-10-23 hour 1: 212810 events in 0 files, snapshot none (task 6638 ms: download 3256 ms overlapping gunzip 973 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 971 ms: 16 candidates, 108063 repo-hours, 969 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:28:34Z [load_day 2024-10-23] 2024-10-23 hour 2: 187169 events in 0 files, snapshot none (task 5613 ms: download 2886 ms overlapping gunzip 898 ms, parse 3286 ms, sort 0 ms, write 0 ms, index 604 ms: 6 candidates, 81387 repo-hours, 914 releases; waiting 571 ms; commit 0 ms)
2026-11-08T08:28:36Z [load_day 2024-10-23] 2024-10-23 hour 3: 211930 events in 0 files, snapshot none (task 6613 ms: download 3668 ms overlapping gunzip 958 ms, parse 3833 ms, sort 0 ms, write 0 ms, index 1032 ms: 10 candidates, 81052 repo-hours, 3979 releases; waiting 514 ms; commit 0 ms)
2026-11-08T08:28:41Z [load_day 2024-10-23] 2024-10-23 hour 4: 196848 events in 0 files, snapshot none (task 6753 ms: download 4248 ms overlapping gunzip 1162 ms, parse 4290 ms, sort 0 ms, write 0 ms, index 515 ms: 11 candidates, 69641 repo-hours, 678 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:28:43Z [load_day 2024-10-23] 2024-10-23 hour 5: 204312 events in 0 files, snapshot none (task 5838 ms: download 3534 ms overlapping gunzip 997 ms, parse 3715 ms, sort 0 ms, write 0 ms, index 607 ms: 15 candidates, 73842 repo-hours, 891 releases; waiting 250 ms; commit 0 ms)
2026-11-08T08:28:49Z [load_day 2024-10-23] 2024-10-23 hour 6: 234813 events in 0 files, snapshot none (task 6632 ms: download 4203 ms overlapping gunzip 1076 ms, parse 4024 ms, sort 0 ms, write 0 ms, index 696 ms: 25 candidates, 97656 repo-hours, 1107 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:28:49Z [load_day 2024-10-23] 2024-10-23 hour 7: 235901 events in 0 files, snapshot none (task 6445 ms: download 4208 ms overlapping gunzip 1060 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 643 ms: 20 candidates, 90463 repo-hours, 1008 releases; waiting 521 ms; commit 0 ms)
2026-11-08T08:28:55Z [load_day 2024-10-23] 2024-10-23 hour 8: 249481 events in 0 files, snapshot none (task 6495 ms: download 4261 ms overlapping gunzip 1098 ms, parse 4012 ms, sort 0 ms, write 0 ms, index 677 ms: 32 candidates, 99946 repo-hours, 1331 releases; waiting 498 ms; commit 0 ms)
2026-11-08T08:28:57Z [load_day 2024-10-23] 2024-10-23 hour 9: 257876 events in 0 files, snapshot none (task 7051 ms: download 4594 ms overlapping gunzip 1126 ms, parse 4151 ms, sort 0 ms, write 0 ms, index 744 ms: 12 candidates, 105660 repo-hours, 1581 releases; waiting 758 ms; commit 0 ms)
2026-11-08T08:29:04Z [load_day 2024-10-23] 2024-10-23 hour 10: 239115 events in 0 files, snapshot none (task 8282 ms: download 5754 ms overlapping gunzip 1339 ms, parse 5407 ms, sort 0 ms, write 0 ms, index 704 ms: 5 candidates, 94917 repo-hours, 1233 releases; waiting 612 ms; commit 0 ms)
2026-11-08T08:29:05Z [load_day 2024-10-23] 2024-10-23 hour 11: 246155 events in 0 files, snapshot none (task 7517 ms: download 5065 ms overlapping gunzip 1168 ms, parse 4742 ms, sort 0 ms, write 0 ms, index 713 ms: 16 candidates, 92817 repo-hours, 1145 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:29:14Z [load_day 2024-10-23] 2024-10-23 hour 12: 283420 events in 0 files, snapshot none (task 9484 ms: download 5262 ms overlapping gunzip 1461 ms, parse 5788 ms, sort 0 ms, write 0 ms, index 1478 ms: 18 candidates, 141819 repo-hours, 1420 releases; waiting 491 ms; commit 0 ms)
2026-11-08T08:29:15Z [load_day 2024-10-23] 2024-10-23 hour 13: 269698 events in 0 files, snapshot none (task 8897 ms: download 5131 ms overlapping gunzip 1426 ms, parse 5381 ms, sort 0 ms, write 0 ms, index 1018 ms: 16 candidates, 125201 repo-hours, 1344 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:29:25Z [load_day 2024-10-23] 2024-10-23 hour 14: 268961 events in 0 files, snapshot none (task 10298 ms: download 6997 ms overlapping gunzip 1675 ms, parse 6787 ms, sort 0 ms, write 0 ms, index 1037 ms: 20 candidates, 111393 repo-hours, 2001 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:29:26Z [load_day 2024-10-23] 2024-10-23 hour 15: 274972 events in 0 files, snapshot none (task 10681 ms: download 7779 ms overlapping gunzip 1940 ms, parse 7205 ms, sort 0 ms, write 0 ms, index 935 ms: 6 candidates, 115946 repo-hours, 1498 releases; waiting 319 ms; commit 0 ms)
2026-11-08T08:29:34Z [load_day 2024-10-23] 2024-10-23 hour 16: 250976 events in 0 files, snapshot none (task 8740 ms: download 6028 ms overlapping gunzip 1474 ms, parse 5647 ms, sort 0 ms, write 0 ms, index 817 ms: 9 candidates, 105717 repo-hours, 1190 releases; waiting 493 ms; commit 0 ms)
2026-11-08T08:29:36Z [load_day 2024-10-23] 2024-10-23 hour 17: 242695 events in 0 files, snapshot none (task 9595 ms: download 7218 ms overlapping gunzip 1255 ms, parse 4878 ms, sort 0 ms, write 0 ms, index 700 ms: 14 candidates, 98815 repo-hours, 1280 releases; waiting 2416 ms; commit 0 ms)
2026-11-08T08:29:49Z [load_day 2024-10-23] 2024-10-23 hour 18: 253170 events in 0 files, snapshot none (task 8155 ms: download 5481 ms overlapping gunzip 1301 ms, parse 5426 ms, sort 0 ms, write 0 ms, index 880 ms: 14 candidates, 112163 repo-hours, 1251 releases; waiting 269 ms; commit 0 ms)
2026-11-08T08:29:49Z [load_day 2024-10-23] 2024-10-23 hour 19: 228479 events in 0 files, snapshot none (task 7693 ms: download 5236 ms overlapping gunzip 1284 ms, parse 4818 ms, sort 0 ms, write 0 ms, index 705 ms: 6 candidates, 89020 repo-hours, 1087 releases; waiting 609 ms; commit 0 ms)
2026-11-08T08:30:09Z [load_day 2024-10-23] 2024-10-23 hour 20: 219876 events in 0 files, snapshot none (task 8215 ms: download 5641 ms overlapping gunzip 1335 ms, parse 5384 ms, sort 0 ms, write 0 ms, index 629 ms: 12 candidates, 85098 repo-hours, 1129 releases; waiting 463 ms; commit 0 ms)
2026-11-08T08:30:09Z [load_day 2024-10-23] 2024-10-23 hour 21: 206821 events in 0 files, snapshot none (task 7454 ms: download 4820 ms overlapping gunzip 1207 ms, parse 4848 ms, sort 0 ms, write 0 ms, index 642 ms: 9 candidates, 81027 repo-hours, 1269 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:30:17Z [load_day 2024-10-23] 2024-10-23 hour 22: 185170 events in 0 files, snapshot none (task 6827 ms: download 4060 ms overlapping gunzip 1253 ms, parse 4526 ms, sort 0 ms, write 0 ms, index 530 ms: 9 candidates, 66866 repo-hours, 1090 releases; waiting 259 ms; commit 0 ms)
2026-11-08T08:30:17Z [load_day 2024-10-23] 2024-10-23 hour 23: 185255 events in 0 files, snapshot none (task 6397 ms: download 4327 ms overlapping gunzip 1081 ms, parse 3721 ms, sort 0 ms, write 0 ms, index 748 ms: 9 candidates, 73211 repo-hours, 837 releases; waiting 591 ms; commit 0 ms)
2026-11-08T08:30:27Z [load_day 2024-10-23] 2024-10-23: repo_hour merged from 24 files to 1 (2294357 rows, 10062 ms)
2026-11-08T08:30:30Z [load_day 2024-10-23] 2024-10-23: index committed in 12530 ms (24 + 1 + 24 files)
2026-11-08T08:30:30Z [load_day 2024-10-23] 2024-10-23: 5545307 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:30:30Z [load_day 2024-10-23] attempt 1 succeeded