orcaLog in

Runs · run 3819

load_day 2025-04-23, attempt 1 succeeded

Host
73ccef5e07c2:292535
Started
2026-11-08T11:33:46Z
Ended
2026-11-08T11:35:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
812 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
208.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3819/load_day/2025-04-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:33:46Z [load_day 2025-04-23] attempt 1 started
2026-11-08T11:33:47Z [load_day 2025-04-23] 2025-04-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:33:56Z [load_day 2025-04-23] 2025-04-23 hour 0: 207818 events in 0 files, snapshot none (task 8236 ms: download 4860 ms overlapping gunzip 1185 ms, parse 5363 ms, sort 0 ms, write 0 ms, index 825 ms: 14 candidates, 95676 repo-hours, 1160 releases; waiting 576 ms; commit 0 ms)
2026-11-08T11:33:56Z [load_day 2025-04-23] 2025-04-23 hour 1: 231208 events in 0 files, snapshot none (task 8805 ms: download 4887 ms overlapping gunzip 1262 ms, parse 5545 ms, sort 0 ms, write 0 ms, index 1130 ms: 5 candidates, 126652 repo-hours, 1130 releases; waiting 477 ms; commit 0 ms)
2026-11-08T11:34:04Z [load_day 2025-04-23] 2025-04-23 hour 2: 204302 events in 0 files, snapshot none (task 7591 ms: download 4722 ms overlapping gunzip 1128 ms, parse 4915 ms, sort 0 ms, write 0 ms, index 784 ms: 7 candidates, 88455 repo-hours, 1074 releases; waiting 467 ms; commit 0 ms)
2026-11-08T11:34:04Z [load_day 2025-04-23] 2025-04-23 hour 3: 219588 events in 0 files, snapshot none (task 7629 ms: download 4957 ms overlapping gunzip 1259 ms, parse 4972 ms, sort 0 ms, write 0 ms, index 798 ms: 8 candidates, 90872 repo-hours, 2909 releases; waiting 379 ms; commit 0 ms)
2026-11-08T11:34:12Z [load_day 2025-04-23] 2025-04-23 hour 4: 202212 events in 0 files, snapshot none (task 8060 ms: download 4878 ms overlapping gunzip 1174 ms, parse 5375 ms, sort 0 ms, write 0 ms, index 644 ms: 2 candidates, 77781 repo-hours, 925 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:34:13Z [load_day 2025-04-23] 2025-04-23 hour 5: 217922 events in 0 files, snapshot none (task 8632 ms: download 5984 ms overlapping gunzip 1289 ms, parse 5939 ms, sort 0 ms, write 0 ms, index 619 ms: 8 candidates, 84062 repo-hours, 952 releases; waiting 498 ms; commit 0 ms)
2026-11-08T11:34:22Z [load_day 2025-04-23] 2025-04-23 hour 6: 235718 events in 0 files, snapshot none (task 9748 ms: download 6515 ms overlapping gunzip 1501 ms, parse 6449 ms, sort 0 ms, write 0 ms, index 821 ms: 3 candidates, 106676 repo-hours, 1196 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:34:23Z [load_day 2025-04-23] 2025-04-23 hour 7: 232815 events in 0 files, snapshot none (task 9391 ms: download 6548 ms overlapping gunzip 1442 ms, parse 6231 ms, sort 0 ms, write 0 ms, index 917 ms: 6 candidates, 97332 repo-hours, 958 releases; waiting 545 ms; commit 0 ms)
2026-11-08T11:34:31Z [load_day 2025-04-23] 2025-04-23 hour 8: 249664 events in 0 files, snapshot none (task 8520 ms: download 5966 ms overlapping gunzip 1363 ms, parse 5543 ms, sort 0 ms, write 0 ms, index 745 ms: 6 candidates, 107821 repo-hours, 1417 releases; waiting 588 ms; commit 0 ms)
2026-11-08T11:34:32Z [load_day 2025-04-23] 2025-04-23 hour 9: 256447 events in 0 files, snapshot none (task 8565 ms: download 5857 ms overlapping gunzip 1352 ms, parse 5599 ms, sort 0 ms, write 0 ms, index 784 ms: 9 candidates, 110526 repo-hours, 1466 releases; waiting 479 ms; commit 0 ms)
2026-11-08T11:34:40Z [load_day 2025-04-23] 2025-04-23 hour 10: 251360 events in 0 files, snapshot none (task 8250 ms: download 5652 ms overlapping gunzip 1283 ms, parse 5289 ms, sort 0 ms, write 0 ms, index 784 ms: 11 candidates, 103956 repo-hours, 1535 releases; waiting 606 ms; commit 0 ms)
2026-11-08T11:34:41Z [load_day 2025-04-23] 2025-04-23 hour 11: 248289 events in 0 files, snapshot none (task 7917 ms: download 5257 ms overlapping gunzip 1220 ms, parse 5143 ms, sort 0 ms, write 0 ms, index 761 ms: 10 candidates, 101070 repo-hours, 1263 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:34:50Z [load_day 2025-04-23] 2025-04-23 hour 12: 280206 events in 0 files, snapshot none (task 9994 ms: download 5733 ms overlapping gunzip 1424 ms, parse 6271 ms, sort 0 ms, write 0 ms, index 1551 ms: 17 candidates, 143953 repo-hours, 1420 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:34:52Z [load_day 2025-04-23] 2025-04-23 hour 13: 271277 events in 0 files, snapshot none (task 10608 ms: download 6943 ms overlapping gunzip 1654 ms, parse 6880 ms, sort 0 ms, write 0 ms, index 1204 ms: 8 candidates, 131463 repo-hours, 1454 releases; waiting 513 ms; commit 0 ms)
2026-11-08T11:35:03Z [load_day 2025-04-23] 2025-04-23 hour 14: 264587 events in 0 files, snapshot none (task 11903 ms: download 8787 ms overlapping gunzip 1955 ms, parse 8221 ms, sort 0 ms, write 0 ms, index 975 ms: 17 candidates, 117566 repo-hours, 1498 releases; waiting 480 ms; commit 0 ms)
2026-11-08T11:35:04Z [load_day 2025-04-23] 2025-04-23 hour 15: 267356 events in 0 files, snapshot none (task 11246 ms: download 8437 ms overlapping gunzip 1849 ms, parse 7695 ms, sort 0 ms, write 0 ms, index 884 ms: 9 candidates, 120336 repo-hours, 1578 releases; waiting 487 ms; commit 0 ms)
2026-11-08T11:35:15Z [load_day 2025-04-23] 2025-04-23 hour 16: 255602 events in 0 files, snapshot none (task 11157 ms: download 7430 ms overlapping gunzip 1566 ms, parse 7120 ms, sort 0 ms, write 0 ms, index 1720 ms: 10 candidates, 112430 repo-hours, 1369 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:35:15Z [load_day 2025-04-23] 2025-04-23 hour 17: 255806 events in 0 files, snapshot none (task 11165 ms: download 7210 ms overlapping gunzip 1639 ms, parse 7324 ms, sort 0 ms, write 0 ms, index 1288 ms: 3 candidates, 105786 repo-hours, 1455 releases; waiting 560 ms; commit 0 ms)
2026-11-08T11:35:25Z [load_day 2025-04-23] 2025-04-23 hour 18: 255408 events in 0 files, snapshot none (task 9988 ms: download 6481 ms overlapping gunzip 1478 ms, parse 6497 ms, sort 0 ms, write 0 ms, index 1305 ms: 10 candidates, 115114 repo-hours, 1348 releases; waiting 486 ms; commit 0 ms)
2026-11-08T11:35:26Z [load_day 2025-04-23] 2025-04-23 hour 19: 243721 events in 0 files, snapshot none (task 10276 ms: download 6894 ms overlapping gunzip 1574 ms, parse 6810 ms, sort 0 ms, write 0 ms, index 1062 ms: 9 candidates, 94982 repo-hours, 1226 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:35:36Z [load_day 2025-04-23] 2025-04-23 hour 20: 236919 events in 0 files, snapshot none (task 9714 ms: download 6483 ms overlapping gunzip 1581 ms, parse 6266 ms, sort 0 ms, write 0 ms, index 716 ms: 10 candidates, 95937 repo-hours, 1188 releases; waiting 579 ms; commit 0 ms)
2026-11-08T11:35:36Z [load_day 2025-04-23] 2025-04-23 hour 21: 223362 events in 0 files, snapshot none (task 8215 ms: download 5302 ms overlapping gunzip 1305 ms, parse 5595 ms, sort 0 ms, write 0 ms, index 777 ms: 7 candidates, 88448 repo-hours, 1402 releases; waiting 256 ms; commit 0 ms)
2026-11-08T11:35:45Z [load_day 2025-04-23] 2025-04-23 hour 22: 206449 events in 0 files, snapshot none (task 8414 ms: download 5599 ms overlapping gunzip 1450 ms, parse 5863 ms, sort 0 ms, write 0 ms, index 620 ms: 7 candidates, 77948 repo-hours, 1361 releases; waiting 177 ms; commit 0 ms)
2026-11-08T11:35:45Z [load_day 2025-04-23] 2025-04-23 hour 23: 196334 events in 0 files, snapshot none (task 7686 ms: download 5018 ms overlapping gunzip 1242 ms, parse 5338 ms, sort 0 ms, write 0 ms, index 636 ms: 5 candidates, 75124 repo-hours, 1192 releases; waiting 201 ms; commit 0 ms)
2026-11-08T11:35:55Z [load_day 2025-04-23] 2025-04-23: repo_hour merged from 24 files to 1 (2469966 rows, 10919 ms)
2026-11-08T11:35:59Z [load_day 2025-04-23] 2025-04-23: index committed in 14223 ms (24 + 1 + 24 files)
2026-11-08T11:35:59Z [load_day 2025-04-23] 2025-04-23: 5714370 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:35:59Z [load_day 2025-04-23] attempt 1 succeeded