orcaLog in

Runs · run 3630

load_day 2025-03-03, attempt 1 succeeded

Host
73ccef5e07c2:264544
Started
2026-11-08T10:38:02Z
Ended
2026-11-08T10:40:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
883 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
236.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3630/load_day/2025-03-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:38:02Z [load_day 2025-03-03] attempt 1 started
2026-11-08T10:38:03Z [load_day 2025-03-03] 2025-03-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:38:11Z [load_day 2025-03-03] 2025-03-03 hour 0: 194691 events in 0 files, snapshot none (task 7375 ms: download 3720 ms overlapping gunzip 1144 ms, parse 4643 ms, sort 0 ms, write 0 ms, index 743 ms: 8 candidates, 88622 repo-hours, 1318 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:38:12Z [load_day 2025-03-03] 2025-03-03 hour 1: 229481 events in 0 files, snapshot none (task 8458 ms: download 5124 ms overlapping gunzip 1372 ms, parse 5357 ms, sort 0 ms, write 0 ms, index 902 ms: 3 candidates, 121228 repo-hours, 997 releases; waiting 517 ms; commit 0 ms)
2026-11-08T10:38:20Z [load_day 2025-03-03] 2025-03-03 hour 2: 204879 events in 0 files, snapshot none (task 8250 ms: download 4872 ms overlapping gunzip 1474 ms, parse 5450 ms, sort 0 ms, write 0 ms, index 727 ms: 9 candidates, 88619 repo-hours, 892 releases; waiting 323 ms; commit 0 ms)
2026-11-08T10:38:21Z [load_day 2025-03-03] 2025-03-03 hour 3: 221954 events in 0 files, snapshot none (task 8313 ms: download 5401 ms overlapping gunzip 1423 ms, parse 5443 ms, sort 0 ms, write 0 ms, index 638 ms: 5 candidates, 88748 repo-hours, 3831 releases; waiting 540 ms; commit 0 ms)
2026-11-08T10:38:29Z [load_day 2025-03-03] 2025-03-03 hour 4: 193186 events in 0 files, snapshot none (task 8196 ms: download 4617 ms overlapping gunzip 1346 ms, parse 5203 ms, sort 0 ms, write 0 ms, index 731 ms: 6 candidates, 74206 repo-hours, 764 releases; waiting 625 ms; commit 0 ms)
2026-11-08T10:38:31Z [load_day 2025-03-03] 2025-03-03 hour 5: 202984 events in 0 files, snapshot none (task 8988 ms: download 6480 ms overlapping gunzip 1465 ms, parse 5392 ms, sort 0 ms, write 0 ms, index 612 ms: 6 candidates, 79610 repo-hours, 834 releases; waiting 1122 ms; commit 0 ms)
2026-11-08T10:38:39Z [load_day 2025-03-03] 2025-03-03 hour 6: 227135 events in 0 files, snapshot none (task 9332 ms: download 6059 ms overlapping gunzip 1556 ms, parse 6085 ms, sort 0 ms, write 0 ms, index 879 ms: 6 candidates, 101932 repo-hours, 1061 releases; waiting 419 ms; commit 0 ms)
2026-11-08T10:38:41Z [load_day 2025-03-03] 2025-03-03 hour 7: 230125 events in 0 files, snapshot none (task 9583 ms: download 6899 ms overlapping gunzip 1623 ms, parse 6302 ms, sort 0 ms, write 0 ms, index 843 ms: 6 candidates, 90672 repo-hours, 981 releases; waiting 519 ms; commit 0 ms)
2026-11-08T10:38:49Z [load_day 2025-03-03] 2025-03-03 hour 8: 244241 events in 0 files, snapshot none (task 9928 ms: download 7229 ms overlapping gunzip 1703 ms, parse 6655 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 100993 repo-hours, 1026 releases; waiting 511 ms; commit 0 ms)
2026-11-08T10:38:51Z [load_day 2025-03-03] 2025-03-03 hour 9: 263341 events in 0 files, snapshot none (task 9721 ms: download 7183 ms overlapping gunzip 1633 ms, parse 6503 ms, sort 0 ms, write 0 ms, index 787 ms: 12 candidates, 110435 repo-hours, 2010 releases; waiting 476 ms; commit 0 ms)
2026-11-08T10:38:59Z [load_day 2025-03-03] 2025-03-03 hour 10: 265032 events in 0 files, snapshot none (task 8947 ms: download 6198 ms overlapping gunzip 1506 ms, parse 5928 ms, sort 0 ms, write 0 ms, index 845 ms: 11 candidates, 106388 repo-hours, 1214 releases; waiting 276 ms; commit 0 ms)
2026-11-08T10:39:01Z [load_day 2025-03-03] 2025-03-03 hour 11: 261354 events in 0 files, snapshot none (task 9304 ms: download 6598 ms overlapping gunzip 1565 ms, parse 6039 ms, sort 0 ms, write 0 ms, index 984 ms: 11 candidates, 100971 repo-hours, 1126 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:39:10Z [load_day 2025-03-03] 2025-03-03 hour 12: 289450 events in 0 files, snapshot none (task 11131 ms: download 8084 ms overlapping gunzip 1799 ms, parse 7366 ms, sort 0 ms, write 0 ms, index 1090 ms: 7 candidates, 143354 repo-hours, 1374 releases; waiting 547 ms; commit 0 ms)
2026-11-08T10:39:13Z [load_day 2025-03-03] 2025-03-03 hour 13: 280936 events in 0 files, snapshot none (task 11336 ms: download 8144 ms overlapping gunzip 1803 ms, parse 7426 ms, sort 0 ms, write 0 ms, index 1315 ms: 10 candidates, 127045 repo-hours, 1266 releases; waiting 442 ms; commit 0 ms)
2026-11-08T10:39:25Z [load_day 2025-03-03] 2025-03-03 hour 14: 275212 events in 0 files, snapshot none (task 13533 ms: download 9853 ms overlapping gunzip 2253 ms, parse 9188 ms, sort 0 ms, write 0 ms, index 1208 ms: 13 candidates, 114757 repo-hours, 1386 releases; waiting 518 ms; commit 0 ms)
2026-11-08T10:39:27Z [load_day 2025-03-03] 2025-03-03 hour 15: 280870 events in 0 files, snapshot none (task 12969 ms: download 10159 ms overlapping gunzip 2302 ms, parse 9117 ms, sort 0 ms, write 0 ms, index 935 ms: 6 candidates, 122704 repo-hours, 1355 releases; waiting 347 ms; commit 0 ms)
2026-11-08T10:39:39Z [load_day 2025-03-03] 2025-03-03 hour 16: 275359 events in 0 files, snapshot none (task 13241 ms: download 10294 ms overlapping gunzip 2260 ms, parse 9034 ms, sort 0 ms, write 0 ms, index 1056 ms: 9 candidates, 117245 repo-hours, 1576 releases; waiting 644 ms; commit 0 ms)
2026-11-08T10:39:40Z [load_day 2025-03-03] 2025-03-03 hour 17: 270868 events in 0 files, snapshot none (task 12516 ms: download 9548 ms overlapping gunzip 2141 ms, parse 8656 ms, sort 0 ms, write 0 ms, index 1218 ms: 20 candidates, 109138 repo-hours, 1271 releases; waiting 181 ms; commit 0 ms)
2026-11-08T10:39:51Z [load_day 2025-03-03] 2025-03-03 hour 18: 272568 events in 0 files, snapshot none (task 11642 ms: download 8080 ms overlapping gunzip 1848 ms, parse 7764 ms, sort 0 ms, write 0 ms, index 1320 ms: 11 candidates, 117512 repo-hours, 1330 releases; waiting 203 ms; commit 0 ms)
2026-11-08T10:39:51Z [load_day 2025-03-03] 2025-03-03 hour 19: 255678 events in 0 files, snapshot none (task 10565 ms: download 7955 ms overlapping gunzip 1756 ms, parse 7358 ms, sort 0 ms, write 0 ms, index 732 ms: 13 candidates, 98267 repo-hours, 1094 releases; waiting 490 ms; commit 0 ms)
2026-11-08T10:40:02Z [load_day 2025-03-03] 2025-03-03 hour 20: 249099 events in 0 files, snapshot none (task 10633 ms: download 7728 ms overlapping gunzip 1680 ms, parse 7132 ms, sort 0 ms, write 0 ms, index 1040 ms: 14 candidates, 98289 repo-hours, 1141 releases; waiting 514 ms; commit 0 ms)
2026-11-08T10:40:02Z [load_day 2025-03-03] 2025-03-03 hour 21: 239701 events in 0 files, snapshot none (task 10024 ms: download 7434 ms overlapping gunzip 1734 ms, parse 6741 ms, sort 0 ms, write 0 ms, index 788 ms: 15 candidates, 95868 repo-hours, 1411 releases; waiting 449 ms; commit 0 ms)
2026-11-08T10:40:12Z [load_day 2025-03-03] 2025-03-03 hour 22: 226086 events in 0 files, snapshot none (task 10167 ms: download 7441 ms overlapping gunzip 1686 ms, parse 6893 ms, sort 0 ms, write 0 ms, index 713 ms: 13 candidates, 85772 repo-hours, 1232 releases; waiting 473 ms; commit 0 ms)
2026-11-08T10:40:12Z [load_day 2025-03-03] 2025-03-03 hour 23: 214985 events in 0 files, snapshot none (task 9352 ms: download 6898 ms overlapping gunzip 1620 ms, parse 6246 ms, sort 0 ms, write 0 ms, index 713 ms: 13 candidates, 79499 repo-hours, 1062 releases; waiting 478 ms; commit 0 ms)
2026-11-08T10:40:24Z [load_day 2025-03-03] 2025-03-03: repo_hour merged from 24 files to 1 (2461874 rows, 11355 ms)
2026-11-08T10:40:27Z [load_day 2025-03-03] 2025-03-03: index committed in 14277 ms (24 + 1 + 24 files)
2026-11-08T10:40:27Z [load_day 2025-03-03] 2025-03-03: 5869215 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:40:27Z [load_day 2025-03-03] attempt 1 succeeded