orcaLog in

Runs · run 4657

load_day 2025-11-27, attempt 1 succeeded

Host
73ccef5e07c2:409575
Started
2026-11-08T14:35:30Z
Ended
2026-11-08T14:36:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
713 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
68.8 s, up to 2.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4657/load_day/2025-11-27/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:35:30Z [load_day 2025-11-27] attempt 1 started
2026-11-08T14:35:31Z [load_day 2025-11-27] 2025-11-27: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:35:35Z [load_day 2025-11-27] 2025-11-27 hour 0: 144691 events in 0 files, snapshot none (task 3622 ms: download 2370 ms overlapping gunzip 554 ms, parse 1653 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 72333 repo-hours, 695 releases; waiting 543 ms; commit 0 ms)
2026-11-08T14:35:35Z [load_day 2025-11-27] 2025-11-27 hour 1: 153657 events in 0 files, snapshot none (task 3542 ms: download 1994 ms overlapping gunzip 457 ms, parse 1536 ms, sort 0 ms, write 0 ms, index 681 ms: 8 candidates, 90984 repo-hours, 693 releases; waiting 509 ms; commit 0 ms)
2026-11-08T14:35:39Z [load_day 2025-11-27] 2025-11-27 hour 2: 145938 events in 0 files, snapshot none (task 3527 ms: download 2638 ms overlapping gunzip 474 ms, parse 1376 ms, sort 0 ms, write 0 ms, index 530 ms: 6 candidates, 70721 repo-hours, 599 releases; waiting 834 ms; commit 0 ms)
2026-11-08T14:35:39Z [load_day 2025-11-27] 2025-11-27 hour 3: 146678 events in 0 files, snapshot none (task 3155 ms: download 1695 ms overlapping gunzip 476 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 643 ms: 10 candidates, 72904 repo-hours, 1574 releases; waiting 335 ms; commit 0 ms)
2026-11-08T14:35:43Z [load_day 2025-11-27] 2025-11-27 hour 4: 146490 events in 0 files, snapshot none (task 3669 ms: download 2515 ms overlapping gunzip 525 ms, parse 1618 ms, sort 0 ms, write 0 ms, index 566 ms: 4 candidates, 68128 repo-hours, 539 releases; waiting 683 ms; commit 0 ms)
2026-11-08T14:35:43Z [load_day 2025-11-27] 2025-11-27 hour 5: 146581 events in 0 files, snapshot none (task 3600 ms: download 2042 ms overlapping gunzip 516 ms, parse 1607 ms, sort 0 ms, write 0 ms, index 601 ms: 4 candidates, 67130 repo-hours, 601 releases; waiting 532 ms; commit 0 ms)
2026-11-08T14:35:48Z [load_day 2025-11-27] 2025-11-27 hour 6: 149350 events in 0 files, snapshot none (task 4164 ms: download 2602 ms overlapping gunzip 675 ms, parse 1896 ms, sort 0 ms, write 0 ms, index 700 ms: 7 candidates, 76909 repo-hours, 613 releases; waiting 508 ms; commit 0 ms)
2026-11-08T14:35:49Z [load_day 2025-11-27] 2025-11-27 hour 7: 149259 events in 0 files, snapshot none (task 4690 ms: download 2983 ms overlapping gunzip 483 ms, parse 1684 ms, sort 0 ms, write 0 ms, index 628 ms: 5 candidates, 74118 repo-hours, 597 releases; waiting 1593 ms; commit 0 ms)
2026-11-08T14:35:53Z [load_day 2025-11-27] 2025-11-27 hour 8: 150804 events in 0 files, snapshot none (task 3977 ms: download 2118 ms overlapping gunzip 575 ms, parse 1765 ms, sort 0 ms, write 0 ms, index 748 ms: 7 candidates, 78964 repo-hours, 590 releases; waiting 576 ms; commit 0 ms)
2026-11-08T14:35:53Z [load_day 2025-11-27] 2025-11-27 hour 9: 151926 events in 0 files, snapshot none (task 3895 ms: download 2495 ms overlapping gunzip 601 ms, parse 1724 ms, sort 0 ms, write 0 ms, index 568 ms: 4 candidates, 78806 repo-hours, 601 releases; waiting 582 ms; commit 0 ms)
2026-11-08T14:35:57Z [load_day 2025-11-27] 2025-11-27 hour 10: 149051 events in 0 files, snapshot none (task 3962 ms: download 2478 ms overlapping gunzip 554 ms, parse 1605 ms, sort 0 ms, write 0 ms, index 720 ms: 5 candidates, 78633 repo-hours, 625 releases; waiting 733 ms; commit 0 ms)
2026-11-08T14:35:57Z [load_day 2025-11-27] 2025-11-27 hour 11: 145797 events in 0 files, snapshot none (task 4150 ms: download 2280 ms overlapping gunzip 617 ms, parse 1863 ms, sort 0 ms, write 0 ms, index 675 ms: 5 candidates, 76483 repo-hours, 595 releases; waiting 710 ms; commit 0 ms)
2026-11-08T14:36:01Z [load_day 2025-11-27] 2025-11-27 hour 12: 157079 events in 0 files, snapshot none (task 3447 ms: download 1454 ms overlapping gunzip 324 ms, parse 1227 ms, sort 0 ms, write 0 ms, index 1300 ms: 2 candidates, 100526 repo-hours, 251 releases; waiting 313 ms; commit 0 ms)
2026-11-08T14:36:01Z [load_day 2025-11-27] 2025-11-27 hour 13: 159240 events in 0 files, snapshot none (task 3434 ms: download 2086 ms overlapping gunzip 379 ms, parse 1302 ms, sort 0 ms, write 0 ms, index 931 ms: 9 candidates, 97772 repo-hours, 198 releases; waiting 520 ms; commit 0 ms)
2026-11-08T14:36:05Z [load_day 2025-11-27] 2025-11-27 hour 14: 154936 events in 0 files, snapshot none (task 3716 ms: download 2220 ms overlapping gunzip 412 ms, parse 1414 ms, sort 0 ms, write 0 ms, index 793 ms: 5 candidates, 88102 repo-hours, 242 releases; waiting 704 ms; commit 0 ms)
2026-11-08T14:36:06Z [load_day 2025-11-27] 2025-11-27 hour 15: 156816 events in 0 files, snapshot none (task 3927 ms: download 1988 ms overlapping gunzip 501 ms, parse 1828 ms, sort 0 ms, write 0 ms, index 679 ms: 6 candidates, 89492 repo-hours, 278 releases; waiting 541 ms; commit 0 ms)
2026-11-08T14:36:09Z [load_day 2025-11-27] 2025-11-27 hour 16: 161261 events in 0 files, snapshot none (task 3131 ms: download 1813 ms overlapping gunzip 323 ms, parse 1000 ms, sort 0 ms, write 0 ms, index 784 ms: 10 candidates, 90786 repo-hours, 261 releases; waiting 671 ms; commit 0 ms)
2026-11-08T14:36:09Z [load_day 2025-11-27] 2025-11-27 hour 17: 158618 events in 0 files, snapshot none (task 3273 ms: download 2151 ms overlapping gunzip 330 ms, parse 1133 ms, sort 0 ms, write 0 ms, index 633 ms: 5 candidates, 85231 repo-hours, 282 releases; waiting 842 ms; commit 0 ms)
2026-11-08T14:36:13Z [load_day 2025-11-27] 2025-11-27 hour 18: 154287 events in 0 files, snapshot none (task 3317 ms: download 1917 ms overlapping gunzip 355 ms, parse 1196 ms, sort 0 ms, write 0 ms, index 614 ms: 8 candidates, 81505 repo-hours, 630 releases; waiting 864 ms; commit 0 ms)
2026-11-08T14:36:14Z [load_day 2025-11-27] 2025-11-27 hour 19: 149315 events in 0 files, snapshot none (task 3914 ms: download 2970 ms overlapping gunzip 374 ms, parse 1167 ms, sort 0 ms, write 0 ms, index 532 ms: 5 candidates, 70052 repo-hours, 585 releases; waiting 1551 ms; commit 0 ms)
2026-11-08T14:36:16Z [load_day 2025-11-27] 2025-11-27 hour 20: 154490 events in 0 files, snapshot none (task 2878 ms: download 1887 ms overlapping gunzip 344 ms, parse 1188 ms, sort 0 ms, write 0 ms, index 535 ms: 6 candidates, 72623 repo-hours, 551 releases; waiting 559 ms; commit 0 ms)
2026-11-08T14:36:17Z [load_day 2025-11-27] 2025-11-27 hour 21: 150411 events in 0 files, snapshot none (task 3018 ms: download 2097 ms overlapping gunzip 351 ms, parse 1139 ms, sort 0 ms, write 0 ms, index 539 ms: 12 candidates, 69219 repo-hours, 717 releases; waiting 656 ms; commit 0 ms)
2026-11-08T14:36:20Z [load_day 2025-11-27] 2025-11-27 hour 22: 144701 events in 0 files, snapshot none (task 3271 ms: download 2233 ms overlapping gunzip 340 ms, parse 1160 ms, sort 0 ms, write 0 ms, index 519 ms: 11 candidates, 65884 repo-hours, 681 releases; waiting 918 ms; commit 0 ms)
2026-11-08T14:36:21Z [load_day 2025-11-27] 2025-11-27 hour 23: 142812 events in 0 files, snapshot none (task 3156 ms: download 1942 ms overlapping gunzip 364 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 587 ms: 6 candidates, 62881 repo-hours, 656 releases; waiting 685 ms; commit 0 ms)
2026-11-08T14:36:30Z [load_day 2025-11-27] 2025-11-27: repo_hour merged from 24 files to 1 (1880186 rows, 8701 ms)
2026-11-08T14:36:33Z [load_day 2025-11-27] 2025-11-27: index committed in 11747 ms (24 + 1 + 24 files)
2026-11-08T14:36:33Z [load_day 2025-11-27] 2025-11-27: 3624188 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:36:33Z [load_day 2025-11-27] attempt 1 succeeded