orcaLog in

Runs · run 3078

load_day 2024-10-14, attempt 1 succeeded

Host
73ccef5e07c2:191541
Started
2026-11-08T08:20:04Z
Ended
2026-11-08T08:22:00Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
751 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
177.1 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3078/load_day/2024-10-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:20:04Z [load_day 2024-10-14] attempt 1 started
2026-11-08T08:20:05Z [load_day 2024-10-14] 2024-10-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:20:12Z [load_day 2024-10-14] 2024-10-14 hour 0: 169956 events in 0 files, snapshot none (task 5729 ms: download 3331 ms overlapping gunzip 952 ms, parse 3400 ms, sort 0 ms, write 0 ms, index 591 ms: 5 candidates, 78462 repo-hours, 1003 releases; waiting 518 ms; commit 0 ms)
2026-11-08T08:20:12Z [load_day 2024-10-14] 2024-10-14 hour 1: 197426 events in 0 files, snapshot none (task 6474 ms: download 4054 ms overlapping gunzip 1007 ms, parse 3740 ms, sort 0 ms, write 0 ms, index 762 ms: 11 candidates, 103396 repo-hours, 755 releases; waiting 739 ms; commit 0 ms)
2026-11-08T08:20:18Z [load_day 2024-10-14] 2024-10-14 hour 2: 172993 events in 0 files, snapshot none (task 5618 ms: download 3291 ms overlapping gunzip 866 ms, parse 3265 ms, sort 0 ms, write 0 ms, index 628 ms: 7 candidates, 75470 repo-hours, 766 releases; waiting 551 ms; commit 0 ms)
2026-11-08T08:20:20Z [load_day 2024-10-14] 2024-10-14 hour 3: 200288 events in 0 files, snapshot none (task 6772 ms: download 4203 ms overlapping gunzip 1146 ms, parse 4171 ms, sort 0 ms, write 0 ms, index 705 ms: 5 candidates, 77204 repo-hours, 3964 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:20:26Z [load_day 2024-10-14] 2024-10-14 hour 4: 177611 events in 0 files, snapshot none (task 7800 ms: download 5082 ms overlapping gunzip 1073 ms, parse 3664 ms, sort 0 ms, write 0 ms, index 651 ms: 4 candidates, 63410 repo-hours, 684 releases; waiting 1975 ms; commit 0 ms)
2026-11-08T08:20:27Z [load_day 2024-10-14] 2024-10-14 hour 5: 191705 events in 0 files, snapshot none (task 6737 ms: download 4313 ms overlapping gunzip 1208 ms, parse 4107 ms, sort 0 ms, write 0 ms, index 527 ms: 12 candidates, 69707 repo-hours, 781 releases; waiting 571 ms; commit 0 ms)
2026-11-08T08:20:34Z [load_day 2024-10-14] 2024-10-14 hour 6: 226347 events in 0 files, snapshot none (task 7751 ms: download 5123 ms overlapping gunzip 1259 ms, parse 4759 ms, sort 0 ms, write 0 ms, index 820 ms: 14 candidates, 98374 repo-hours, 1064 releases; waiting 616 ms; commit 0 ms)
2026-11-08T08:20:35Z [load_day 2024-10-14] 2024-10-14 hour 7: 233175 events in 0 files, snapshot none (task 8212 ms: download 5753 ms overlapping gunzip 1395 ms, parse 5181 ms, sort 0 ms, write 0 ms, index 829 ms: 8 candidates, 89921 repo-hours, 1043 releases; waiting 558 ms; commit 0 ms)
2026-11-08T08:20:43Z [load_day 2024-10-14] 2024-10-14 hour 8: 242374 events in 0 files, snapshot none (task 8359 ms: download 5496 ms overlapping gunzip 1464 ms, parse 5210 ms, sort 0 ms, write 0 ms, index 918 ms: 16 candidates, 98708 repo-hours, 1248 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:20:44Z [load_day 2024-10-14] 2024-10-14 hour 9: 252542 events in 0 files, snapshot none (task 7986 ms: download 5582 ms overlapping gunzip 1434 ms, parse 5006 ms, sort 0 ms, write 0 ms, index 711 ms: 12 candidates, 103712 repo-hours, 1243 releases; waiting 545 ms; commit 0 ms)
2026-11-08T08:20:52Z [load_day 2024-10-14] 2024-10-14 hour 10: 236531 events in 0 files, snapshot none (task 8166 ms: download 5507 ms overlapping gunzip 1440 ms, parse 5177 ms, sort 0 ms, write 0 ms, index 738 ms: 9 candidates, 93716 repo-hours, 1142 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:20:54Z [load_day 2024-10-14] 2024-10-14 hour 11: 246212 events in 0 files, snapshot none (task 9408 ms: download 6927 ms overlapping gunzip 1678 ms, parse 6055 ms, sort 0 ms, write 0 ms, index 844 ms: 8 candidates, 90769 repo-hours, 1122 releases; waiting 524 ms; commit 0 ms)
2026-11-08T08:21:03Z [load_day 2024-10-14] 2024-10-14 hour 12: 275929 events in 0 files, snapshot none (task 10669 ms: download 5989 ms overlapping gunzip 1652 ms, parse 6236 ms, sort 0 ms, write 0 ms, index 1977 ms: 7 candidates, 137830 repo-hours, 1426 releases; waiting 573 ms; commit 0 ms)
2026-11-08T08:21:04Z [load_day 2024-10-14] 2024-10-14 hour 13: 274973 events in 0 files, snapshot none (task 9957 ms: download 6857 ms overlapping gunzip 1734 ms, parse 6382 ms, sort 0 ms, write 0 ms, index 1020 ms: 11 candidates, 121080 repo-hours, 1326 releases; waiting 497 ms; commit 0 ms)
2026-11-08T08:21:13Z [load_day 2024-10-14] 2024-10-14 hour 14: 259311 events in 0 files, snapshot none (task 8434 ms: download 5975 ms overlapping gunzip 1418 ms, parse 5366 ms, sort 0 ms, write 0 ms, index 777 ms: 6 candidates, 106808 repo-hours, 1449 releases; waiting 532 ms; commit 0 ms)
2026-11-08T08:21:13Z [load_day 2024-10-14] 2024-10-14 hour 15: 263305 events in 0 files, snapshot none (task 8227 ms: download 5749 ms overlapping gunzip 1418 ms, parse 5201 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 109676 repo-hours, 1381 releases; waiting 477 ms; commit 0 ms)
2026-11-08T08:21:21Z [load_day 2024-10-14] 2024-10-14 hour 16: 244786 events in 0 files, snapshot none (task 6976 ms: download 4571 ms overlapping gunzip 1155 ms, parse 4344 ms, sort 0 ms, write 0 ms, index 700 ms: 13 candidates, 99363 repo-hours, 1144 releases; waiting 520 ms; commit 0 ms)
2026-11-08T08:21:21Z [load_day 2024-10-14] 2024-10-14 hour 17: 238132 events in 0 files, snapshot none (task 6539 ms: download 4190 ms overlapping gunzip 1133 ms, parse 4041 ms, sort 0 ms, write 0 ms, index 704 ms: 7 candidates, 91635 repo-hours, 1150 releases; waiting 392 ms; commit 0 ms)
2026-11-08T08:21:29Z [load_day 2024-10-14] 2024-10-14 hour 18: 250918 events in 0 files, snapshot none (task 8538 ms: download 6125 ms overlapping gunzip 1516 ms, parse 5604 ms, sort 0 ms, write 0 ms, index 842 ms: 14 candidates, 107638 repo-hours, 1133 releases; waiting 308 ms; commit 0 ms)
2026-11-08T08:21:29Z [load_day 2024-10-14] 2024-10-14 hour 19: 228271 events in 0 files, snapshot none (task 7982 ms: download 5790 ms overlapping gunzip 1383 ms, parse 5205 ms, sort 0 ms, write 0 ms, index 609 ms: 7 candidates, 83747 repo-hours, 1071 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:21:38Z [load_day 2024-10-14] 2024-10-14 hour 20: 226689 events in 0 files, snapshot none (task 7917 ms: download 5307 ms overlapping gunzip 1374 ms, parse 4896 ms, sort 0 ms, write 0 ms, index 710 ms: 18 candidates, 86011 repo-hours, 1056 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:21:38Z [load_day 2024-10-14] 2024-10-14 hour 21: 215844 events in 0 files, snapshot none (task 7485 ms: download 4863 ms overlapping gunzip 1304 ms, parse 4596 ms, sort 0 ms, write 0 ms, index 956 ms: 25 candidates, 78876 repo-hours, 1100 releases; waiting 412 ms; commit 0 ms)
2026-11-08T08:21:46Z [load_day 2024-10-14] 2024-10-14 hour 22: 188488 events in 0 files, snapshot none (task 7283 ms: download 4596 ms overlapping gunzip 1294 ms, parse 4563 ms, sort 0 ms, write 0 ms, index 571 ms: 14 candidates, 64744 repo-hours, 1071 releases; waiting 583 ms; commit 0 ms)
2026-11-08T08:21:46Z [load_day 2024-10-14] 2024-10-14 hour 23: 179877 events in 0 files, snapshot none (task 6330 ms: download 3300 ms overlapping gunzip 1061 ms, parse 3873 ms, sort 0 ms, write 0 ms, index 612 ms: 11 candidates, 61361 repo-hours, 870 releases; waiting 544 ms; commit 0 ms)
2026-11-08T08:21:57Z [load_day 2024-10-14] 2024-10-14: repo_hour merged from 24 files to 1 (2191618 rows, 11559 ms)
2026-11-08T08:22:00Z [load_day 2024-10-14] 2024-10-14: index committed in 14325 ms (24 + 1 + 24 files)
2026-11-08T08:22:00Z [load_day 2024-10-14] 2024-10-14: 5393683 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:22:00Z [load_day 2024-10-14] attempt 1 succeeded