orcaLog in

Runs · run 3872

load_day 2025-05-08, attempt 1 succeeded

Host
73ccef5e07c2:300376
Started
2026-11-08T11:49:24Z
Ended
2026-11-08T11:51:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
780 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
210.2 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3872/load_day/2025-05-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:49:24Z [load_day 2025-05-08] attempt 1 started
2026-11-08T11:49:25Z [load_day 2025-05-08] 2025-05-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:49:35Z [load_day 2025-05-08] 2025-05-08 hour 0: 202408 events in 0 files, snapshot none (task 8966 ms: download 5103 ms overlapping gunzip 1355 ms, parse 5794 ms, sort 0 ms, write 0 ms, index 828 ms: 16 candidates, 91728 repo-hours, 1446 releases; waiting 459 ms; commit 0 ms)
2026-11-08T11:49:35Z [load_day 2025-05-08] 2025-05-08 hour 1: 227612 events in 0 files, snapshot none (task 8794 ms: download 4843 ms overlapping gunzip 1302 ms, parse 5430 ms, sort 0 ms, write 0 ms, index 1279 ms: 8 candidates, 123475 repo-hours, 1114 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:49:43Z [load_day 2025-05-08] 2025-05-08 hour 2: 206314 events in 0 files, snapshot none (task 7310 ms: download 4574 ms overlapping gunzip 1083 ms, parse 4563 ms, sort 0 ms, write 0 ms, index 880 ms: 15 candidates, 91459 repo-hours, 1220 releases; waiting 487 ms; commit 0 ms)
2026-11-08T11:49:43Z [load_day 2025-05-08] 2025-05-08 hour 3: 215366 events in 0 files, snapshot none (task 7636 ms: download 4703 ms overlapping gunzip 1193 ms, parse 4931 ms, sort 0 ms, write 0 ms, index 946 ms: 6 candidates, 90051 repo-hours, 3157 releases; waiting 272 ms; commit 0 ms)
2026-11-08T11:49:53Z [load_day 2025-05-08] 2025-05-08 hour 4: 199560 events in 0 files, snapshot none (task 9433 ms: download 5836 ms overlapping gunzip 1509 ms, parse 6344 ms, sort 0 ms, write 0 ms, index 776 ms: 7 candidates, 77776 repo-hours, 1087 releases; waiting 518 ms; commit 0 ms)
2026-11-08T11:49:54Z [load_day 2025-05-08] 2025-05-08 hour 5: 209034 events in 0 files, snapshot none (task 10272 ms: download 7058 ms overlapping gunzip 1639 ms, parse 7097 ms, sort 0 ms, write 0 ms, index 705 ms: 15 candidates, 85917 repo-hours, 1101 releases; waiting 463 ms; commit 0 ms)
2026-11-08T11:50:05Z [load_day 2025-05-08] 2025-05-08 hour 6: 231801 events in 0 files, snapshot none (task 11424 ms: download 7118 ms overlapping gunzip 1787 ms, parse 7452 ms, sort 0 ms, write 0 ms, index 1309 ms: 8 candidates, 106341 repo-hours, 1286 releases; waiting 556 ms; commit 0 ms)
2026-11-08T11:50:07Z [load_day 2025-05-08] 2025-05-08 hour 7: 236675 events in 0 files, snapshot none (task 12422 ms: download 8882 ms overlapping gunzip 2042 ms, parse 8594 ms, sort 0 ms, write 0 ms, index 991 ms: 10 candidates, 100164 repo-hours, 1260 releases; waiting 467 ms; commit 0 ms)
2026-11-08T11:50:17Z [load_day 2025-05-08] 2025-05-08 hour 8: 245916 events in 0 files, snapshot none (task 11787 ms: download 7971 ms overlapping gunzip 1953 ms, parse 7596 ms, sort 0 ms, write 0 ms, index 1343 ms: 7 candidates, 107738 repo-hours, 1396 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:50:19Z [load_day 2025-05-08] 2025-05-08 hour 9: 250951 events in 0 files, snapshot none (task 11209 ms: download 7826 ms overlapping gunzip 1931 ms, parse 7644 ms, sort 0 ms, write 0 ms, index 904 ms: 11 candidates, 107576 repo-hours, 1567 releases; waiting 406 ms; commit 0 ms)
2026-11-08T11:50:28Z [load_day 2025-05-08] 2025-05-08 hour 10: 243859 events in 0 files, snapshot none (task 10593 ms: download 6151 ms overlapping gunzip 1698 ms, parse 7083 ms, sort 0 ms, write 0 ms, index 1050 ms: 10 candidates, 104271 repo-hours, 1284 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:50:30Z [load_day 2025-05-08] 2025-05-08 hour 11: 242279 events in 0 files, snapshot none (task 10116 ms: download 6776 ms overlapping gunzip 1732 ms, parse 6649 ms, sort 0 ms, write 0 ms, index 909 ms: 6 candidates, 98788 repo-hours, 1248 releases; waiting 372 ms; commit 0 ms)
2026-11-08T11:50:39Z [load_day 2025-05-08] 2025-05-08 hour 12: 279160 events in 0 files, snapshot none (task 9603 ms: download 5920 ms overlapping gunzip 1385 ms, parse 6231 ms, sort 0 ms, write 0 ms, index 1149 ms: 15 candidates, 144280 repo-hours, 1397 releases; waiting 526 ms; commit 0 ms)
2026-11-08T11:50:42Z [load_day 2025-05-08] 2025-05-08 hour 13: 274994 events in 0 files, snapshot none (task 11641 ms: download 8118 ms overlapping gunzip 1620 ms, parse 7034 ms, sort 0 ms, write 0 ms, index 1257 ms: 15 candidates, 132004 repo-hours, 1394 releases; waiting 1427 ms; commit 0 ms)
2026-11-08T11:50:48Z [load_day 2025-05-08] 2025-05-08 hour 14: 264646 events in 0 files, snapshot none (task 9273 ms: download 6521 ms overlapping gunzip 1463 ms, parse 6061 ms, sort 0 ms, write 0 ms, index 964 ms: 12 candidates, 115134 repo-hours, 1326 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:50:53Z [load_day 2025-05-08] 2025-05-08 hour 15: 263277 events in 0 files, snapshot none (task 10660 ms: download 6864 ms overlapping gunzip 1605 ms, parse 6881 ms, sort 0 ms, write 0 ms, index 1288 ms: 15 candidates, 119320 repo-hours, 1363 releases; waiting 584 ms; commit 0 ms)
2026-11-08T11:50:59Z [load_day 2025-05-08] 2025-05-08 hour 16: 254287 events in 0 files, snapshot none (task 9880 ms: download 6661 ms overlapping gunzip 1531 ms, parse 6556 ms, sort 0 ms, write 0 ms, index 1142 ms: 10 candidates, 110669 repo-hours, 1279 releases; waiting 317 ms; commit 0 ms)
2026-11-08T11:51:03Z [load_day 2025-05-08] 2025-05-08 hour 17: 241792 events in 0 files, snapshot none (task 8777 ms: download 5451 ms overlapping gunzip 1384 ms, parse 5778 ms, sort 0 ms, write 0 ms, index 878 ms: 9 candidates, 99056 repo-hours, 1165 releases; waiting 471 ms; commit 0 ms)
2026-11-08T11:51:08Z [load_day 2025-05-08] 2025-05-08 hour 18: 248871 events in 0 files, snapshot none (task 8792 ms: download 5982 ms overlapping gunzip 1346 ms, parse 5839 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 110471 repo-hours, 1284 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:51:11Z [load_day 2025-05-08] 2025-05-08 hour 19: 234477 events in 0 files, snapshot none (task 7628 ms: download 5200 ms overlapping gunzip 1209 ms, parse 4987 ms, sort 0 ms, write 0 ms, index 699 ms: 11 candidates, 91856 repo-hours, 1203 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:51:16Z [load_day 2025-05-08] 2025-05-08 hour 20: 231245 events in 0 files, snapshot none (task 7534 ms: download 4910 ms overlapping gunzip 1157 ms, parse 4825 ms, sort 0 ms, write 0 ms, index 725 ms: 9 candidates, 93554 repo-hours, 1226 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:51:18Z [load_day 2025-05-08] 2025-05-08 hour 21: 214600 events in 0 files, snapshot none (task 6952 ms: download 4483 ms overlapping gunzip 1058 ms, parse 4317 ms, sort 0 ms, write 0 ms, index 647 ms: 10 candidates, 84195 repo-hours, 1227 releases; waiting 626 ms; commit 0 ms)
2026-11-08T11:51:25Z [load_day 2025-05-08] 2025-05-08 hour 22: 200533 events in 0 files, snapshot none (task 7980 ms: download 4173 ms overlapping gunzip 1286 ms, parse 5279 ms, sort 0 ms, write 0 ms, index 800 ms: 12 candidates, 74066 repo-hours, 1303 releases; waiting 371 ms; commit 0 ms)
2026-11-08T11:51:27Z [load_day 2025-05-08] 2025-05-08 hour 23: 188907 events in 0 files, snapshot none (task 7365 ms: download 4762 ms overlapping gunzip 1146 ms, parse 4844 ms, sort 0 ms, write 0 ms, index 523 ms: 7 candidates, 71746 repo-hours, 1349 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:51:37Z [load_day 2025-05-08] 2025-05-08: repo_hour merged from 24 files to 1 (2431635 rows, 10250 ms)
2026-11-08T11:51:40Z [load_day 2025-05-08] 2025-05-08: index committed in 13338 ms (24 + 1 + 24 files)
2026-11-08T11:51:40Z [load_day 2025-05-08] 2025-05-08: 5608564 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:51:40Z [load_day 2025-05-08] attempt 1 succeeded