orcaLog in

Runs · run 3059

load_day 2024-10-09, attempt 1 succeeded

Host
73ccef5e07c2:189482
Started
2026-11-08T08:16:24Z
Ended
2026-11-08T08:18:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
768 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
170.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3059/load_day/2024-10-09/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:16:24Z [load_day 2024-10-09] attempt 1 started
2026-11-08T08:16:25Z [load_day 2024-10-09] 2024-10-09: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:16:32Z [load_day 2024-10-09] 2024-10-09 hour 0: 194732 events in 0 files, snapshot none (task 7143 ms: download 4100 ms overlapping gunzip 1149 ms, parse 4235 ms, sort 0 ms, write 0 ms, index 862 ms: 10 candidates, 92075 repo-hours, 1104 releases; waiting 622 ms; commit 0 ms)
2026-11-08T08:16:32Z [load_day 2024-10-09] 2024-10-09 hour 1: 207653 events in 0 files, snapshot none (task 6932 ms: download 4126 ms overlapping gunzip 1003 ms, parse 4194 ms, sort 0 ms, write 0 ms, index 876 ms: 5 candidates, 109905 repo-hours, 870 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:16:40Z [load_day 2024-10-09] 2024-10-09 hour 2: 176084 events in 0 files, snapshot none (task 6580 ms: download 3388 ms overlapping gunzip 993 ms, parse 3960 ms, sort 0 ms, write 0 ms, index 771 ms: 3 candidates, 78978 repo-hours, 741 releases; waiting 555 ms; commit 0 ms)
2026-11-08T08:16:40Z [load_day 2024-10-09] 2024-10-09 hour 3: 203149 events in 0 files, snapshot none (task 6838 ms: download 3739 ms overlapping gunzip 1132 ms, parse 4255 ms, sort 0 ms, write 0 ms, index 664 ms: 7 candidates, 78946 repo-hours, 3988 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:16:45Z [load_day 2024-10-09] 2024-10-09 hour 4: 178860 events in 0 files, snapshot none (task 4820 ms: download 2528 ms overlapping gunzip 757 ms, parse 2802 ms, sort 0 ms, write 0 ms, index 485 ms: 4 candidates, 64681 repo-hours, 730 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:16:46Z [load_day 2024-10-09] 2024-10-09 hour 5: 192241 events in 0 files, snapshot none (task 5096 ms: download 3251 ms overlapping gunzip 817 ms, parse 2966 ms, sort 0 ms, write 0 ms, index 566 ms: 6 candidates, 69850 repo-hours, 877 releases; waiting 486 ms; commit 0 ms)
2026-11-08T08:16:52Z [load_day 2024-10-09] 2024-10-09 hour 6: 226022 events in 0 files, snapshot none (task 6306 ms: download 3934 ms overlapping gunzip 1052 ms, parse 3857 ms, sort 0 ms, write 0 ms, index 700 ms: 8 candidates, 96341 repo-hours, 1041 releases; waiting 413 ms; commit 0 ms)
2026-11-08T08:16:53Z [load_day 2024-10-09] 2024-10-09 hour 7: 238338 events in 0 files, snapshot none (task 7108 ms: download 4855 ms overlapping gunzip 1181 ms, parse 4394 ms, sort 0 ms, write 0 ms, index 648 ms: 5 candidates, 90008 repo-hours, 1106 releases; waiting 606 ms; commit 0 ms)
2026-11-08T08:17:00Z [load_day 2024-10-09] 2024-10-09 hour 8: 248883 events in 0 files, snapshot none (task 7787 ms: download 4304 ms overlapping gunzip 1300 ms, parse 4656 ms, sort 0 ms, write 0 ms, index 1000 ms: 10 candidates, 100609 repo-hours, 1371 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:17:01Z [load_day 2024-10-09] 2024-10-09 hour 9: 257404 events in 0 files, snapshot none (task 7628 ms: download 5221 ms overlapping gunzip 1337 ms, parse 4764 ms, sort 0 ms, write 0 ms, index 728 ms: 6 candidates, 104062 repo-hours, 1586 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:17:08Z [load_day 2024-10-09] 2024-10-09 hour 10: 242276 events in 0 files, snapshot none (task 7974 ms: download 4567 ms overlapping gunzip 1329 ms, parse 5058 ms, sort 0 ms, write 0 ms, index 818 ms: 6 candidates, 95289 repo-hours, 1523 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:17:10Z [load_day 2024-10-09] 2024-10-09 hour 11: 245444 events in 0 files, snapshot none (task 8097 ms: download 5539 ms overlapping gunzip 1310 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 751 ms: 4 candidates, 92864 repo-hours, 1299 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:17:17Z [load_day 2024-10-09] 2024-10-09 hour 12: 281938 events in 0 files, snapshot none (task 8580 ms: download 5434 ms overlapping gunzip 1297 ms, parse 5220 ms, sort 0 ms, write 0 ms, index 1255 ms: 7 candidates, 139469 repo-hours, 1463 releases; waiting 535 ms; commit 0 ms)
2026-11-08T08:17:21Z [load_day 2024-10-09] 2024-10-09 hour 13: 279901 events in 0 files, snapshot none (task 9878 ms: download 5943 ms overlapping gunzip 1533 ms, parse 5979 ms, sort 0 ms, write 0 ms, index 1770 ms: 11 candidates, 123646 repo-hours, 1335 releases; waiting 302 ms; commit 0 ms)
2026-11-08T08:17:27Z [load_day 2024-10-09] 2024-10-09 hour 14: 271397 events in 0 files, snapshot none (task 9568 ms: download 5732 ms overlapping gunzip 1524 ms, parse 5681 ms, sort 0 ms, write 0 ms, index 1596 ms: 8 candidates, 109460 repo-hours, 1327 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:17:30Z [load_day 2024-10-09] 2024-10-09 hour 15: 271828 events in 0 files, snapshot none (task 8556 ms: download 5692 ms overlapping gunzip 1379 ms, parse 5246 ms, sort 0 ms, write 0 ms, index 1131 ms: 6 candidates, 111883 repo-hours, 1457 releases; waiting 512 ms; commit 0 ms)
2026-11-08T08:17:36Z [load_day 2024-10-09] 2024-10-09 hour 16: 251508 events in 0 files, snapshot none (task 8261 ms: download 4915 ms overlapping gunzip 1357 ms, parse 5001 ms, sort 0 ms, write 0 ms, index 1057 ms: 7 candidates, 100651 repo-hours, 1171 releases; waiting 556 ms; commit 0 ms)
2026-11-08T08:17:38Z [load_day 2024-10-09] 2024-10-09 hour 17: 250436 events in 0 files, snapshot none (task 7530 ms: download 4830 ms overlapping gunzip 1251 ms, parse 4981 ms, sort 0 ms, write 0 ms, index 780 ms: 7 candidates, 92523 repo-hours, 1176 releases; waiting 251 ms; commit 0 ms)
2026-11-08T08:17:44Z [load_day 2024-10-09] 2024-10-09 hour 18: 249435 events in 0 files, snapshot none (task 7704 ms: download 4261 ms overlapping gunzip 1264 ms, parse 4720 ms, sort 0 ms, write 0 ms, index 906 ms: 5 candidates, 104464 repo-hours, 1333 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:17:46Z [load_day 2024-10-09] 2024-10-09 hour 19: 235120 events in 0 files, snapshot none (task 7110 ms: download 4479 ms overlapping gunzip 1153 ms, parse 4393 ms, sort 0 ms, write 0 ms, index 743 ms: 4 candidates, 84056 repo-hours, 1237 releases; waiting 535 ms; commit 0 ms)
2026-11-08T08:17:53Z [load_day 2024-10-09] 2024-10-09 hour 20: 224402 events in 0 files, snapshot none (task 8318 ms: download 4959 ms overlapping gunzip 1178 ms, parse 4558 ms, sort 0 ms, write 0 ms, index 1420 ms: 9 candidates, 82158 repo-hours, 1061 releases; waiting 802 ms; commit 0 ms)
2026-11-08T08:17:54Z [load_day 2024-10-09] 2024-10-09 hour 21: 215257 events in 0 files, snapshot none (task 7789 ms: download 4453 ms overlapping gunzip 1280 ms, parse 4878 ms, sort 0 ms, write 0 ms, index 855 ms: 5 candidates, 77678 repo-hours, 1294 releases; waiting 517 ms; commit 0 ms)
2026-11-08T08:18:00Z [load_day 2024-10-09] 2024-10-09 hour 22: 194044 events in 0 files, snapshot none (task 6216 ms: download 4145 ms overlapping gunzip 1030 ms, parse 3816 ms, sort 0 ms, write 0 ms, index 473 ms: 7 candidates, 64524 repo-hours, 1109 releases; waiting 555 ms; commit 0 ms)
2026-11-08T08:18:01Z [load_day 2024-10-09] 2024-10-09 hour 23: 185200 events in 0 files, snapshot none (task 6193 ms: download 3793 ms overlapping gunzip 971 ms, parse 3943 ms, sort 0 ms, write 0 ms, index 485 ms: 2 candidates, 61039 repo-hours, 912 releases; waiting 566 ms; commit 0 ms)
2026-11-08T08:18:11Z [load_day 2024-10-09] 2024-10-09: repo_hour merged from 24 files to 1 (2225159 rows, 10492 ms)
2026-11-08T08:18:14Z [load_day 2024-10-09] 2024-10-09: index committed in 13001 ms (24 + 1 + 24 files)
2026-11-08T08:18:14Z [load_day 2024-10-09] 2024-10-09: 5521552 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:18:14Z [load_day 2024-10-09] attempt 1 succeeded