orcaLog in

Runs · run 4645

load_day 2025-11-23, attempt 1 succeeded

Host
73ccef5e07c2:408053
Started
2026-11-08T14:33:16Z
Ended
2026-11-08T14:34:15Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
663 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
67.4 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4645/load_day/2025-11-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:33:16Z [load_day 2025-11-23] attempt 1 started
2026-11-08T14:33:17Z [load_day 2025-11-23] 2025-11-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:33:21Z [load_day 2025-11-23] 2025-11-23 hour 0: 138339 events in 0 files, snapshot none (task 3470 ms: download 2225 ms overlapping gunzip 501 ms, parse 1564 ms, sort 0 ms, write 0 ms, index 489 ms: 7 candidates, 63589 repo-hours, 833 releases; waiting 602 ms; commit 0 ms)
2026-11-08T14:33:21Z [load_day 2025-11-23] 2025-11-23 hour 1: 149011 events in 0 files, snapshot none (task 3375 ms: download 2026 ms overlapping gunzip 473 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 654 ms: 8 candidates, 85855 repo-hours, 660 releases; waiting 440 ms; commit 0 ms)
2026-11-08T14:33:25Z [load_day 2025-11-23] 2025-11-23 hour 2: 143085 events in 0 files, snapshot none (task 3670 ms: download 2162 ms overlapping gunzip 490 ms, parse 1501 ms, sort 0 ms, write 0 ms, index 599 ms: 10 candidates, 71510 repo-hours, 658 releases; waiting 621 ms; commit 0 ms)
2026-11-08T14:33:25Z [load_day 2025-11-23] 2025-11-23 hour 3: 139908 events in 0 files, snapshot none (task 3244 ms: download 1965 ms overlapping gunzip 474 ms, parse 1477 ms, sort 0 ms, write 0 ms, index 535 ms: 3 candidates, 64010 repo-hours, 793 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:33:29Z [load_day 2025-11-23] 2025-11-23 hour 4: 142340 events in 0 files, snapshot none (task 3273 ms: download 2147 ms overlapping gunzip 425 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 472 ms: 9 candidates, 63332 repo-hours, 1314 releases; waiting 547 ms; commit 0 ms)
2026-11-08T14:33:29Z [load_day 2025-11-23] 2025-11-23 hour 5: 144061 events in 0 files, snapshot none (task 2922 ms: download 1916 ms overlapping gunzip 372 ms, parse 1142 ms, sort 0 ms, write 0 ms, index 590 ms: 8 candidates, 60001 repo-hours, 534 releases; waiting 551 ms; commit 0 ms)
2026-11-08T14:33:33Z [load_day 2025-11-23] 2025-11-23 hour 6: 143664 events in 0 files, snapshot none (task 3424 ms: download 2105 ms overlapping gunzip 459 ms, parse 1484 ms, sort 0 ms, write 0 ms, index 539 ms: 8 candidates, 68203 repo-hours, 589 releases; waiting 688 ms; commit 0 ms)
2026-11-08T14:33:33Z [load_day 2025-11-23] 2025-11-23 hour 7: 143858 events in 0 files, snapshot none (task 3300 ms: download 1988 ms overlapping gunzip 436 ms, parse 1493 ms, sort 0 ms, write 0 ms, index 445 ms: 7 candidates, 62327 repo-hours, 514 releases; waiting 645 ms; commit 0 ms)
2026-11-08T14:33:36Z [load_day 2025-11-23] 2025-11-23 hour 8: 144126 events in 0 files, snapshot none (task 3301 ms: download 1858 ms overlapping gunzip 437 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 645 ms: 4 candidates, 66357 repo-hours, 522 releases; waiting 540 ms; commit 0 ms)
2026-11-08T14:33:37Z [load_day 2025-11-23] 2025-11-23 hour 9: 149570 events in 0 files, snapshot none (task 3523 ms: download 2285 ms overlapping gunzip 476 ms, parse 1648 ms, sort 0 ms, write 0 ms, index 497 ms: 3 candidates, 64291 repo-hours, 567 releases; waiting 682 ms; commit 0 ms)
2026-11-08T14:33:41Z [load_day 2025-11-23] 2025-11-23 hour 10: 150637 events in 0 files, snapshot none (task 3656 ms: download 1811 ms overlapping gunzip 551 ms, parse 1849 ms, sort 0 ms, write 0 ms, index 485 ms: 4 candidates, 66346 repo-hours, 518 releases; waiting 112 ms; commit 0 ms)
2026-11-08T14:33:41Z [load_day 2025-11-23] 2025-11-23 hour 11: 147956 events in 0 files, snapshot none (task 3660 ms: download 2310 ms overlapping gunzip 553 ms, parse 1820 ms, sort 0 ms, write 0 ms, index 521 ms: 4 candidates, 64692 repo-hours, 515 releases; waiting 523 ms; commit 0 ms)
2026-11-08T14:33:45Z [load_day 2025-11-23] 2025-11-23 hour 12: 160774 events in 0 files, snapshot none (task 3962 ms: download 2261 ms overlapping gunzip 405 ms, parse 1384 ms, sort 0 ms, write 0 ms, index 1177 ms: 8 candidates, 93418 repo-hours, 492 releases; waiting 674 ms; commit 0 ms)
2026-11-08T14:33:45Z [load_day 2025-11-23] 2025-11-23 hour 13: 152491 events in 0 files, snapshot none (task 3371 ms: download 1844 ms overlapping gunzip 413 ms, parse 1338 ms, sort 0 ms, write 0 ms, index 581 ms: 6 candidates, 81332 repo-hours, 443 releases; waiting 390 ms; commit 0 ms)
2026-11-08T14:33:49Z [load_day 2025-11-23] 2025-11-23 hour 14: 151047 events in 0 files, snapshot none (task 3687 ms: download 1859 ms overlapping gunzip 570 ms, parse 1832 ms, sort 0 ms, write 0 ms, index 558 ms: 7 candidates, 70427 repo-hours, 621 releases; waiting 365 ms; commit 0 ms)
2026-11-08T14:33:49Z [load_day 2025-11-23] 2025-11-23 hour 15: 157571 events in 0 files, snapshot none (task 3801 ms: download 2224 ms overlapping gunzip 484 ms, parse 1621 ms, sort 0 ms, write 0 ms, index 813 ms: 9 candidates, 76802 repo-hours, 644 releases; waiting 535 ms; commit 0 ms)
2026-11-08T14:33:53Z [load_day 2025-11-23] 2025-11-23 hour 16: 149805 events in 0 files, snapshot none (task 3172 ms: download 1963 ms overlapping gunzip 404 ms, parse 1294 ms, sort 0 ms, write 0 ms, index 637 ms: 11 candidates, 74173 repo-hours, 630 releases; waiting 487 ms; commit 0 ms)
2026-11-08T14:33:53Z [load_day 2025-11-23] 2025-11-23 hour 17: 149352 events in 0 files, snapshot none (task 3502 ms: download 2300 ms overlapping gunzip 449 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 561 ms: 9 candidates, 71158 repo-hours, 602 releases; waiting 636 ms; commit 0 ms)
2026-11-08T14:33:57Z [load_day 2025-11-23] 2025-11-23 hour 18: 149752 events in 0 files, snapshot none (task 3639 ms: download 2098 ms overlapping gunzip 356 ms, parse 1188 ms, sort 0 ms, write 0 ms, index 1025 ms: 7 candidates, 76247 repo-hours, 680 releases; waiting 788 ms; commit 0 ms)
2026-11-08T14:33:57Z [load_day 2025-11-23] 2025-11-23 hour 19: 149692 events in 0 files, snapshot none (task 3556 ms: download 2142 ms overlapping gunzip 439 ms, parse 1363 ms, sort 0 ms, write 0 ms, index 621 ms: 11 candidates, 68067 repo-hours, 550 releases; waiting 820 ms; commit 0 ms)
2026-11-08T14:34:01Z [load_day 2025-11-23] 2025-11-23 hour 20: 150303 events in 0 files, snapshot none (task 3245 ms: download 2163 ms overlapping gunzip 389 ms, parse 1275 ms, sort 0 ms, write 0 ms, index 537 ms: 5 candidates, 69611 repo-hours, 629 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:34:01Z [load_day 2025-11-23] 2025-11-23 hour 21: 148984 events in 0 files, snapshot none (task 3196 ms: download 2121 ms overlapping gunzip 375 ms, parse 1226 ms, sort 0 ms, write 0 ms, index 511 ms: 7 candidates, 67237 repo-hours, 670 releases; waiting 763 ms; commit 0 ms)
2026-11-08T14:34:04Z [load_day 2025-11-23] 2025-11-23 hour 22: 145706 events in 0 files, snapshot none (task 3145 ms: download 1800 ms overlapping gunzip 373 ms, parse 1253 ms, sort 0 ms, write 0 ms, index 514 ms: 8 candidates, 62498 repo-hours, 637 releases; waiting 662 ms; commit 0 ms)
2026-11-08T14:34:05Z [load_day 2025-11-23] 2025-11-23 hour 23: 146514 events in 0 files, snapshot none (task 3449 ms: download 2356 ms overlapping gunzip 378 ms, parse 1313 ms, sort 0 ms, write 0 ms, index 489 ms: 6 candidates, 60465 repo-hours, 539 releases; waiting 938 ms; commit 0 ms)
2026-11-08T14:34:12Z [load_day 2025-11-23] 2025-11-23: repo_hour merged from 24 files to 1 (1671948 rows, 7295 ms)
2026-11-08T14:34:15Z [load_day 2025-11-23] 2025-11-23: index committed in 10093 ms (24 + 1 + 24 files)
2026-11-08T14:34:15Z [load_day 2025-11-23] 2025-11-23: 3548546 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:34:15Z [load_day 2025-11-23] attempt 1 succeeded