orcaLog in

Runs · run 2217

load_day 2024-03-19, attempt 1 succeeded

Host
73ccef5e07c2:99595
Started
2026-11-08T05:10:26Z
Ended
2026-11-08T05:12:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
810 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
192.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2217/load_day/2024-03-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:10:26Z [load_day 2024-03-19] attempt 1 started
2026-11-08T05:10:27Z [load_day 2024-03-19] 2024-03-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:10:36Z [load_day 2024-03-19] 2024-03-19 hour 0: 220316 events in 0 files, snapshot none (task 8513 ms: download 5623 ms overlapping gunzip 1470 ms, parse 5400 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 107825 repo-hours, 1086 releases; waiting 464 ms; commit 0 ms)
2026-11-08T05:10:36Z [load_day 2024-03-19] 2024-03-19 hour 1: 212836 events in 0 files, snapshot none (task 7305 ms: download 4354 ms overlapping gunzip 1117 ms, parse 4565 ms, sort 0 ms, write 0 ms, index 914 ms: 7 candidates, 108635 repo-hours, 863 releases; waiting 385 ms; commit 0 ms)
2026-11-08T05:10:43Z [load_day 2024-03-19] 2024-03-19 hour 2: 186291 events in 0 files, snapshot none (task 6933 ms: download 4537 ms overlapping gunzip 1098 ms, parse 4426 ms, sort 0 ms, write 0 ms, index 505 ms: 5 candidates, 73129 repo-hours, 856 releases; waiting 555 ms; commit 0 ms)
2026-11-08T05:10:43Z [load_day 2024-03-19] 2024-03-19 hour 3: 177760 events in 0 files, snapshot none (task 6594 ms: download 4036 ms overlapping gunzip 1028 ms, parse 4163 ms, sort 0 ms, write 0 ms, index 620 ms: 9 candidates, 70005 repo-hours, 903 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:10:50Z [load_day 2024-03-19] 2024-03-19 hour 4: 175536 events in 0 files, snapshot none (task 6556 ms: download 3856 ms overlapping gunzip 1144 ms, parse 4450 ms, sort 0 ms, write 0 ms, index 505 ms: 5 candidates, 64926 repo-hours, 577 releases; waiting 213 ms; commit 0 ms)
2026-11-08T05:10:51Z [load_day 2024-03-19] 2024-03-19 hour 5: 185559 events in 0 files, snapshot none (task 7568 ms: download 4928 ms overlapping gunzip 1306 ms, parse 4907 ms, sort 0 ms, write 0 ms, index 572 ms: 9 candidates, 71414 repo-hours, 769 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:10:58Z [load_day 2024-03-19] 2024-03-19 hour 6: 204774 events in 0 files, snapshot none (task 8000 ms: download 4396 ms overlapping gunzip 1270 ms, parse 5061 ms, sort 0 ms, write 0 ms, index 835 ms: 9 candidates, 85478 repo-hours, 787 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:11:00Z [load_day 2024-03-19] 2024-03-19 hour 7: 209879 events in 0 files, snapshot none (task 8680 ms: download 5763 ms overlapping gunzip 1369 ms, parse 5664 ms, sort 0 ms, write 0 ms, index 781 ms: 3 candidates, 82816 repo-hours, 894 releases; waiting 536 ms; commit 0 ms)
2026-11-08T05:11:07Z [load_day 2024-03-19] 2024-03-19 hour 8: 228593 events in 0 files, snapshot none (task 8406 ms: download 4975 ms overlapping gunzip 1331 ms, parse 5370 ms, sort 0 ms, write 0 ms, index 1286 ms: 6 candidates, 93227 repo-hours, 1112 releases; waiting 188 ms; commit 0 ms)
2026-11-08T05:11:10Z [load_day 2024-03-19] 2024-03-19 hour 9: 240173 events in 0 files, snapshot none (task 9660 ms: download 6602 ms overlapping gunzip 1476 ms, parse 6344 ms, sort 0 ms, write 0 ms, index 1055 ms: 10 candidates, 97847 repo-hours, 1269 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:11:16Z [load_day 2024-03-19] 2024-03-19 hour 10: 238611 events in 0 files, snapshot none (task 8313 ms: download 5607 ms overlapping gunzip 1282 ms, parse 5527 ms, sort 0 ms, write 0 ms, index 757 ms: 7 candidates, 96954 repo-hours, 1204 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:11:20Z [load_day 2024-03-19] 2024-03-19 hour 11: 240443 events in 0 files, snapshot none (task 9029 ms: download 5329 ms overlapping gunzip 1403 ms, parse 5469 ms, sort 0 ms, write 0 ms, index 1318 ms: 6 candidates, 97045 repo-hours, 1055 releases; waiting 204 ms; commit 0 ms)
2026-11-08T05:11:26Z [load_day 2024-03-19] 2024-03-19 hour 12: 294415 events in 0 files, snapshot none (task 9443 ms: download 6140 ms overlapping gunzip 1376 ms, parse 6102 ms, sort 0 ms, write 0 ms, index 1143 ms: 7 candidates, 127696 repo-hours, 1363 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:11:30Z [load_day 2024-03-19] 2024-03-19 hour 13: 267926 events in 0 files, snapshot none (task 9757 ms: download 6319 ms overlapping gunzip 1477 ms, parse 6182 ms, sort 0 ms, write 0 ms, index 1225 ms: 11 candidates, 121271 repo-hours, 1295 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:11:37Z [load_day 2024-03-19] 2024-03-19 hour 14: 265276 events in 0 files, snapshot none (task 10040 ms: download 7238 ms overlapping gunzip 1647 ms, parse 6743 ms, sort 0 ms, write 0 ms, index 866 ms: 15 candidates, 111264 repo-hours, 1291 releases; waiting 543 ms; commit 0 ms)
2026-11-08T05:11:41Z [load_day 2024-03-19] 2024-03-19 hour 15: 267514 events in 0 files, snapshot none (task 10304 ms: download 6577 ms overlapping gunzip 1696 ms, parse 6788 ms, sort 0 ms, write 0 ms, index 1029 ms: 9 candidates, 111339 repo-hours, 1406 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:11:47Z [load_day 2024-03-19] 2024-03-19 hour 16: 252487 events in 0 files, snapshot none (task 9449 ms: download 6802 ms overlapping gunzip 1562 ms, parse 6299 ms, sort 0 ms, write 0 ms, index 810 ms: 16 candidates, 104585 repo-hours, 1140 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:11:51Z [load_day 2024-03-19] 2024-03-19 hour 17: 241853 events in 0 files, snapshot none (task 9063 ms: download 5638 ms overlapping gunzip 1472 ms, parse 5718 ms, sort 0 ms, write 0 ms, index 1104 ms: 11 candidates, 97856 repo-hours, 1172 releases; waiting 459 ms; commit 0 ms)
2026-11-08T05:11:57Z [load_day 2024-03-19] 2024-03-19 hour 18: 237180 events in 0 files, snapshot none (task 8859 ms: download 6251 ms overlapping gunzip 1432 ms, parse 5819 ms, sort 0 ms, write 0 ms, index 738 ms: 7 candidates, 98910 repo-hours, 1176 releases; waiting 572 ms; commit 0 ms)
2026-11-08T05:11:58Z [load_day 2024-03-19] 2024-03-19 hour 19: 217178 events in 0 files, snapshot none (task 7299 ms: download 4916 ms overlapping gunzip 1193 ms, parse 4722 ms, sort 0 ms, write 0 ms, index 712 ms: 12 candidates, 85225 repo-hours, 991 releases; waiting 463 ms; commit 0 ms)
2026-11-08T05:12:04Z [load_day 2024-03-19] 2024-03-19 hour 20: 214034 events in 0 files, snapshot none (task 7066 ms: download 4616 ms overlapping gunzip 1126 ms, parse 4460 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 88754 repo-hours, 1118 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:12:05Z [load_day 2024-03-19] 2024-03-19 hour 21: 198372 events in 0 files, snapshot none (task 6509 ms: download 4281 ms overlapping gunzip 1040 ms, parse 4026 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 75464 repo-hours, 1151 releases; waiting 649 ms; commit 0 ms)
2026-11-08T05:12:11Z [load_day 2024-03-19] 2024-03-19 hour 22: 183147 events in 0 files, snapshot none (task 6519 ms: download 3358 ms overlapping gunzip 961 ms, parse 4075 ms, sort 0 ms, write 0 ms, index 756 ms: 5 candidates, 68573 repo-hours, 1143 releases; waiting 524 ms; commit 0 ms)
2026-11-08T05:12:12Z [load_day 2024-03-19] 2024-03-19 hour 23: 167706 events in 0 files, snapshot none (task 6136 ms: download 3553 ms overlapping gunzip 949 ms, parse 3867 ms, sort 0 ms, write 0 ms, index 549 ms: 4 candidates, 63239 repo-hours, 849 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:12:22Z [load_day 2024-03-19] 2024-03-19: repo_hour merged from 24 files to 1 (2203477 rows, 9950 ms)
2026-11-08T05:12:24Z [load_day 2024-03-19] 2024-03-19: index committed in 12448 ms (24 + 1 + 24 files)
2026-11-08T05:12:24Z [load_day 2024-03-19] 2024-03-19: 5327859 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:12:24Z [load_day 2024-03-19] attempt 1 succeeded