orcaLog in

Runs · run 3512

load_day 2025-02-03, attempt 1 succeeded

Host
73ccef5e07c2:248250
Started
2026-11-08T10:08:12Z
Ended
2026-11-08T10:10:41Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
831 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
220.3 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3512/load_day/2025-02-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:08:12Z [load_day 2025-02-03] attempt 1 started
2026-11-08T10:08:13Z [load_day 2025-02-03] 2025-02-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:08:20Z [load_day 2025-02-03] 2025-02-03 hour 0: 189216 events in 0 files, snapshot none (task 7298 ms: download 5233 ms overlapping gunzip 1034 ms, parse 4284 ms, sort 0 ms, write 0 ms, index 707 ms: 10 candidates, 91111 repo-hours, 1262 releases; waiting 774 ms; commit 0 ms)
2026-11-08T10:08:21Z [load_day 2025-02-03] 2025-02-03 hour 1: 211317 events in 0 files, snapshot none (task 7685 ms: download 4784 ms overlapping gunzip 1195 ms, parse 4782 ms, sort 0 ms, write 0 ms, index 858 ms: 11 candidates, 110522 repo-hours, 1030 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:08:29Z [load_day 2025-02-03] 2025-02-03 hour 2: 177113 events in 0 files, snapshot none (task 8373 ms: download 5711 ms overlapping gunzip 1037 ms, parse 4342 ms, sort 0 ms, write 0 ms, index 679 ms: 6 candidates, 75224 repo-hours, 967 releases; waiting 2005 ms; commit 0 ms)
2026-11-08T10:08:29Z [load_day 2025-02-03] 2025-02-03 hour 3: 191360 events in 0 files, snapshot none (task 6355 ms: download 4012 ms overlapping gunzip 994 ms, parse 4042 ms, sort 0 ms, write 0 ms, index 573 ms: 3 candidates, 73852 repo-hours, 3931 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:08:37Z [load_day 2025-02-03] 2025-02-03 hour 4: 184017 events in 0 files, snapshot none (task 7655 ms: download 4310 ms overlapping gunzip 1265 ms, parse 4852 ms, sort 0 ms, write 0 ms, index 855 ms: 7 candidates, 67132 repo-hours, 801 releases; waiting 367 ms; commit 0 ms)
2026-11-08T10:08:37Z [load_day 2025-02-03] 2025-02-03 hour 5: 197795 events in 0 files, snapshot none (task 7289 ms: download 4307 ms overlapping gunzip 1196 ms, parse 4528 ms, sort 0 ms, write 0 ms, index 817 ms: 4 candidates, 72599 repo-hours, 914 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:08:47Z [load_day 2025-02-03] 2025-02-03 hour 6: 210589 events in 0 files, snapshot none (task 9629 ms: download 6192 ms overlapping gunzip 1603 ms, parse 6258 ms, sort 0 ms, write 0 ms, index 990 ms: 4 candidates, 89956 repo-hours, 1067 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:08:48Z [load_day 2025-02-03] 2025-02-03 hour 7: 207586 events in 0 files, snapshot none (task 9786 ms: download 6165 ms overlapping gunzip 1535 ms, parse 6244 ms, sort 0 ms, write 0 ms, index 828 ms: 9 candidates, 77675 repo-hours, 972 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:09:02Z [load_day 2025-02-03] 2025-02-03 hour 8: 227398 events in 0 files, snapshot none (task 14451 ms: download 11658 ms overlapping gunzip 1723 ms, parse 7130 ms, sort 0 ms, write 0 ms, index 710 ms: 4 candidates, 89953 repo-hours, 1189 releases; waiting 4593 ms; commit 0 ms)
2026-11-08T10:09:02Z [load_day 2025-02-03] 2025-02-03 hour 9: 243252 events in 0 files, snapshot none (task 14081 ms: download 11153 ms overlapping gunzip 1684 ms, parse 6948 ms, sort 0 ms, write 0 ms, index 863 ms: 4 candidates, 99720 repo-hours, 1414 releases; waiting 4303 ms; commit 0 ms)
2026-11-08T10:09:12Z [load_day 2025-02-03] 2025-02-03 hour 10: 240068 events in 0 files, snapshot none (task 8961 ms: download 6488 ms overlapping gunzip 1464 ms, parse 6011 ms, sort 0 ms, write 0 ms, index 710 ms: 6 candidates, 96904 repo-hours, 1273 releases; waiting 522 ms; commit 0 ms)
2026-11-08T10:09:12Z [load_day 2025-02-03] 2025-02-03 hour 11: 239686 events in 0 files, snapshot none (task 8613 ms: download 6148 ms overlapping gunzip 1415 ms, parse 5798 ms, sort 0 ms, write 0 ms, index 716 ms: 9 candidates, 92028 repo-hours, 1222 releases; waiting 451 ms; commit 0 ms)
2026-11-08T10:09:24Z [load_day 2025-02-03] 2025-02-03 hour 12: 282149 events in 0 files, snapshot none (task 11208 ms: download 7924 ms overlapping gunzip 1713 ms, parse 7430 ms, sort 0 ms, write 0 ms, index 1147 ms: 8 candidates, 139243 repo-hours, 1357 releases; waiting 617 ms; commit 0 ms)
2026-11-08T10:09:24Z [load_day 2025-02-03] 2025-02-03 hour 13: 270346 events in 0 files, snapshot none (task 10823 ms: download 7780 ms overlapping gunzip 1832 ms, parse 7266 ms, sort 0 ms, write 0 ms, index 1043 ms: 11 candidates, 121028 repo-hours, 1426 releases; waiting 455 ms; commit 0 ms)
2026-11-08T10:09:36Z [load_day 2025-02-03] 2025-02-03 hour 14: 262352 events in 0 files, snapshot none (task 12110 ms: download 8839 ms overlapping gunzip 1918 ms, parse 8243 ms, sort 0 ms, write 0 ms, index 1453 ms: 5 candidates, 108465 repo-hours, 1403 releases; waiting 181 ms; commit 0 ms)
2026-11-08T10:09:37Z [load_day 2025-02-03] 2025-02-03 hour 15: 268029 events in 0 files, snapshot none (task 12596 ms: download 9019 ms overlapping gunzip 1952 ms, parse 8262 ms, sort 0 ms, write 0 ms, index 1495 ms: 3 candidates, 114785 repo-hours, 1666 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:09:50Z [load_day 2025-02-03] 2025-02-03 hour 16: 261112 events in 0 files, snapshot none (task 13541 ms: download 10372 ms overlapping gunzip 2300 ms, parse 9488 ms, sort 0 ms, write 0 ms, index 821 ms: 7 candidates, 109907 repo-hours, 1406 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:09:51Z [load_day 2025-02-03] 2025-02-03 hour 17: 254206 events in 0 files, snapshot none (task 13547 ms: download 10397 ms overlapping gunzip 2094 ms, parse 8587 ms, sort 0 ms, write 0 ms, index 827 ms: 10 candidates, 103735 repo-hours, 1549 releases; waiting 1450 ms; commit 0 ms)
2026-11-08T10:10:03Z [load_day 2025-02-03] 2025-02-03 hour 18: 259482 events in 0 files, snapshot none (task 12471 ms: download 9524 ms overlapping gunzip 2160 ms, parse 8652 ms, sort 0 ms, write 0 ms, index 818 ms: 5 candidates, 118023 repo-hours, 1356 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:10:03Z [load_day 2025-02-03] 2025-02-03 hour 19: 235471 events in 0 files, snapshot none (task 11260 ms: download 8158 ms overlapping gunzip 1893 ms, parse 7712 ms, sort 0 ms, write 0 ms, index 913 ms: 4 candidates, 93049 repo-hours, 1304 releases; waiting 461 ms; commit 0 ms)
2026-11-08T10:10:15Z [load_day 2025-02-03] 2025-02-03 hour 20: 233601 events in 0 files, snapshot none (task 11363 ms: download 8914 ms overlapping gunzip 1877 ms, parse 8058 ms, sort 0 ms, write 0 ms, index 669 ms: 8 candidates, 91834 repo-hours, 1253 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:10:15Z [load_day 2025-02-03] 2025-02-03 hour 21: 232756 events in 0 files, snapshot none (task 10661 ms: download 8219 ms overlapping gunzip 1804 ms, parse 7340 ms, sort 0 ms, write 0 ms, index 666 ms: 10 candidates, 91966 repo-hours, 1331 releases; waiting 520 ms; commit 0 ms)
2026-11-08T10:10:26Z [load_day 2025-02-03] 2025-02-03 hour 22: 217851 events in 0 files, snapshot none (task 9882 ms: download 7429 ms overlapping gunzip 1592 ms, parse 6896 ms, sort 0 ms, write 0 ms, index 608 ms: 9 candidates, 80516 repo-hours, 1446 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:10:26Z [load_day 2025-02-03] 2025-02-03 hour 23: 201194 events in 0 files, snapshot none (task 8499 ms: download 5732 ms overlapping gunzip 1428 ms, parse 5631 ms, sort 0 ms, write 0 ms, index 576 ms: 8 candidates, 71946 repo-hours, 1309 releases; waiting 551 ms; commit 0 ms)
2026-11-08T10:10:38Z [load_day 2025-02-03] 2025-02-03: repo_hour merged from 24 files to 1 (2281173 rows, 12066 ms)
2026-11-08T10:10:41Z [load_day 2025-02-03] 2025-02-03: index committed in 15005 ms (24 + 1 + 24 files)
2026-11-08T10:10:41Z [load_day 2025-02-03] 2025-02-03: 5497946 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:10:41Z [load_day 2025-02-03] attempt 1 succeeded