orcaLog in

Runs · run 3548

load_day 2025-02-11, attempt 1 succeeded

Host
73ccef5e07c2:253340
Started
2026-11-08T10:16:47Z
Ended
2026-11-08T10:19:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
825 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
216.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3548/load_day/2025-02-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:16:47Z [load_day 2025-02-11] attempt 1 started
2026-11-08T10:16:47Z [load_day 2025-02-11] 2025-02-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:16:58Z [load_day 2025-02-11] 2025-02-11 hour 0: 218204 events in 0 files, snapshot none (task 9986 ms: download 6370 ms overlapping gunzip 1647 ms, parse 6743 ms, sort 0 ms, write 0 ms, index 1039 ms: 18 candidates, 102787 repo-hours, 1361 releases; waiting 231 ms; commit 0 ms)
2026-11-08T10:16:58Z [load_day 2025-02-11] 2025-02-11 hour 1: 232498 events in 0 files, snapshot none (task 10286 ms: download 7042 ms overlapping gunzip 1611 ms, parse 7088 ms, sort 0 ms, write 0 ms, index 854 ms: 2 candidates, 118730 repo-hours, 1100 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:17:08Z [load_day 2025-02-11] 2025-02-11 hour 2: 205025 events in 0 files, snapshot none (task 9373 ms: download 5424 ms overlapping gunzip 1391 ms, parse 5799 ms, sort 0 ms, write 0 ms, index 1226 ms: 7 candidates, 88440 repo-hours, 1025 releases; waiting 567 ms; commit 0 ms)
2026-11-08T10:17:09Z [load_day 2025-02-11] 2025-02-11 hour 3: 220421 events in 0 files, snapshot none (task 9838 ms: download 5768 ms overlapping gunzip 1439 ms, parse 6340 ms, sort 0 ms, write 0 ms, index 1121 ms: 4 candidates, 86513 repo-hours, 4012 releases; waiting 737 ms; commit 0 ms)
2026-11-08T10:17:16Z [load_day 2025-02-11] 2025-02-11 hour 4: 204689 events in 0 files, snapshot none (task 7789 ms: download 5085 ms overlapping gunzip 1180 ms, parse 5132 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 74780 repo-hours, 862 releases; waiting 506 ms; commit 0 ms)
2026-11-08T10:17:18Z [load_day 2025-02-11] 2025-02-11 hour 5: 220059 events in 0 files, snapshot none (task 9154 ms: download 6003 ms overlapping gunzip 1570 ms, parse 6089 ms, sort 0 ms, write 0 ms, index 1045 ms: 6 candidates, 79991 repo-hours, 981 releases; waiting 181 ms; commit 0 ms)
2026-11-08T10:17:25Z [load_day 2025-02-11] 2025-02-11 hour 6: 240744 events in 0 files, snapshot none (task 8463 ms: download 5481 ms overlapping gunzip 1310 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 884 ms: 3 candidates, 103794 repo-hours, 1075 releases; waiting 505 ms; commit 0 ms)
2026-11-08T10:17:27Z [load_day 2025-02-11] 2025-02-11 hour 7: 239711 events in 0 files, snapshot none (task 8225 ms: download 5600 ms overlapping gunzip 1311 ms, parse 5330 ms, sort 0 ms, write 0 ms, index 742 ms: 9 candidates, 91311 repo-hours, 889 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:17:36Z [load_day 2025-02-11] 2025-02-11 hour 8: 258485 events in 0 files, snapshot none (task 10841 ms: download 7321 ms overlapping gunzip 1693 ms, parse 7286 ms, sort 0 ms, write 0 ms, index 1050 ms: 7 candidates, 101192 repo-hours, 1177 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:17:39Z [load_day 2025-02-11] 2025-02-11 hour 9: 274218 events in 0 files, snapshot none (task 10391 ms: download 7735 ms overlapping gunzip 1670 ms, parse 7172 ms, sort 0 ms, write 0 ms, index 811 ms: 15 candidates, 107688 repo-hours, 1286 releases; waiting 443 ms; commit 0 ms)
2026-11-08T10:17:46Z [load_day 2025-02-11] 2025-02-11 hour 10: 272329 events in 0 files, snapshot none (task 8817 ms: download 6211 ms overlapping gunzip 1382 ms, parse 5656 ms, sort 0 ms, write 0 ms, index 766 ms: 6 candidates, 104317 repo-hours, 1249 releases; waiting 769 ms; commit 0 ms)
2026-11-08T10:17:47Z [load_day 2025-02-11] 2025-02-11 hour 11: 268491 events in 0 files, snapshot none (task 8224 ms: download 5694 ms overlapping gunzip 1301 ms, parse 5415 ms, sort 0 ms, write 0 ms, index 711 ms: 9 candidates, 99682 repo-hours, 1227 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:17:55Z [load_day 2025-02-11] 2025-02-11 hour 12: 293998 events in 0 files, snapshot none (task 9376 ms: download 5531 ms overlapping gunzip 1309 ms, parse 5562 ms, sort 0 ms, write 0 ms, index 1695 ms: 7 candidates, 139400 repo-hours, 1254 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:17:58Z [load_day 2025-02-11] 2025-02-11 hour 13: 282111 events in 0 files, snapshot none (task 9822 ms: download 6229 ms overlapping gunzip 1382 ms, parse 6273 ms, sort 0 ms, write 0 ms, index 1432 ms: 12 candidates, 123613 repo-hours, 1304 releases; waiting 493 ms; commit 0 ms)
2026-11-08T10:18:08Z [load_day 2025-02-11] 2025-02-11 hour 14: 266868 events in 0 files, snapshot none (task 12063 ms: download 7336 ms overlapping gunzip 1883 ms, parse 8102 ms, sort 0 ms, write 0 ms, index 1341 ms: 9 candidates, 109968 repo-hours, 1324 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:18:12Z [load_day 2025-02-11] 2025-02-11 hour 15: 264593 events in 0 files, snapshot none (task 13802 ms: download 9159 ms overlapping gunzip 2200 ms, parse 9488 ms, sort 0 ms, write 0 ms, index 1646 ms: 5 candidates, 115598 repo-hours, 1392 releases; waiting 194 ms; commit 0 ms)
2026-11-08T10:18:22Z [load_day 2025-02-11] 2025-02-11 hour 16: 266223 events in 0 files, snapshot none (task 13260 ms: download 9706 ms overlapping gunzip 2254 ms, parse 9254 ms, sort 0 ms, write 0 ms, index 921 ms: 14 candidates, 112606 repo-hours, 1169 releases; waiting 497 ms; commit 0 ms)
2026-11-08T10:18:24Z [load_day 2025-02-11] 2025-02-11 hour 17: 274337 events in 0 files, snapshot none (task 11646 ms: download 8759 ms overlapping gunzip 1969 ms, parse 7878 ms, sort 0 ms, write 0 ms, index 912 ms: 9 candidates, 107582 repo-hours, 1210 releases; waiting 504 ms; commit 0 ms)
2026-11-08T10:18:34Z [load_day 2025-02-11] 2025-02-11 hour 18: 274366 events in 0 files, snapshot none (task 11106 ms: download 8130 ms overlapping gunzip 1739 ms, parse 7385 ms, sort 0 ms, write 0 ms, index 864 ms: 11 candidates, 115171 repo-hours, 1350 releases; waiting 838 ms; commit 0 ms)
2026-11-08T10:18:36Z [load_day 2025-02-11] 2025-02-11 hour 19: 264034 events in 0 files, snapshot none (task 11271 ms: download 7800 ms overlapping gunzip 1672 ms, parse 7303 ms, sort 0 ms, write 0 ms, index 1495 ms: 10 candidates, 98731 repo-hours, 1187 releases; waiting 535 ms; commit 0 ms)
2026-11-08T10:18:43Z [load_day 2025-02-11] 2025-02-11 hour 20: 248015 events in 0 files, snapshot none (task 8598 ms: download 6011 ms overlapping gunzip 1426 ms, parse 5840 ms, sort 0 ms, write 0 ms, index 701 ms: 7 candidates, 93542 repo-hours, 1122 releases; waiting 336 ms; commit 0 ms)
2026-11-08T10:18:52Z [load_day 2025-02-11] 2025-02-11 hour 21: 238006 events in 0 files, snapshot none (task 9745 ms: download 6809 ms overlapping gunzip 1593 ms, parse 6590 ms, sort 0 ms, write 0 ms, index 735 ms: 14 candidates, 90868 repo-hours, 1276 releases; waiting 545 ms; commit 0 ms)
2026-11-08T10:18:52Z [load_day 2025-02-11] 2025-02-11 hour 22: 225488 events in 0 files, snapshot none (task 9152 ms: download 6611 ms overlapping gunzip 1430 ms, parse 6147 ms, sort 0 ms, write 0 ms, index 624 ms: 12 candidates, 81839 repo-hours, 1145 releases; waiting 601 ms; commit 0 ms)
2026-11-08T10:19:00Z [load_day 2025-02-11] 2025-02-11 hour 23: 216463 events in 0 files, snapshot none (task 7638 ms: download 5079 ms overlapping gunzip 1164 ms, parse 4738 ms, sort 0 ms, write 0 ms, index 660 ms: 6 candidates, 76361 repo-hours, 1149 releases; waiting 812 ms; commit 0 ms)
2026-11-08T10:19:11Z [load_day 2025-02-11] 2025-02-11: repo_hour merged from 24 files to 1 (2424504 rows, 10820 ms)
2026-11-08T10:19:13Z [load_day 2025-02-11] 2025-02-11: index committed in 13537 ms (24 + 1 + 24 files)
2026-11-08T10:19:13Z [load_day 2025-02-11] 2025-02-11: 5969376 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:19:13Z [load_day 2025-02-11] attempt 1 succeeded