orcaLog in

Runs · run 4065

load_day 2025-06-24, attempt 1 succeeded

Host
73ccef5e07c2:330254
Started
2026-11-08T12:37:50Z
Ended
2026-11-08T12:40:01Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
722 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.7 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4065/load_day/2025-06-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T12:37:50Z [load_day 2025-06-24] attempt 1 started
2026-11-08T12:37:51Z [load_day 2025-06-24] 2025-06-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T12:37:59Z [load_day 2025-06-24] 2025-06-24 hour 0: 145776 events in 0 files, snapshot none (task 7830 ms: download 5463 ms overlapping gunzip 1368 ms, parse 4920 ms, sort 0 ms, write 0 ms, index 525 ms: 16 candidates, 70476 repo-hours, 933 releases; waiting 526 ms; commit 0 ms)
2026-11-08T12:37:59Z [load_day 2025-06-24] 2025-06-24 hour 1: 156465 events in 0 files, snapshot none (task 7006 ms: download 4501 ms overlapping gunzip 1154 ms, parse 4374 ms, sort 0 ms, write 0 ms, index 647 ms: 12 candidates, 87000 repo-hours, 670 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:38:06Z [load_day 2025-06-24] 2025-06-24 hour 2: 150799 events in 0 files, snapshot none (task 6493 ms: download 4263 ms overlapping gunzip 1126 ms, parse 3930 ms, sort 0 ms, write 0 ms, index 629 ms: 8 candidates, 72117 repo-hours, 747 releases; waiting 485 ms; commit 0 ms)
2026-11-08T12:38:06Z [load_day 2025-06-24] 2025-06-24 hour 3: 151402 events in 0 files, snapshot none (task 6574 ms: download 4552 ms overlapping gunzip 1098 ms, parse 3862 ms, sort 0 ms, write 0 ms, index 546 ms: 8 candidates, 69313 repo-hours, 1524 releases; waiting 705 ms; commit 0 ms)
2026-11-08T12:38:14Z [load_day 2025-06-24] 2025-06-24 hour 4: 150810 events in 0 files, snapshot none (task 6759 ms: download 4450 ms overlapping gunzip 1201 ms, parse 4363 ms, sort 0 ms, write 0 ms, index 559 ms: 13 candidates, 68046 repo-hours, 1085 releases; waiting 351 ms; commit 0 ms)
2026-11-08T12:38:16Z [load_day 2025-06-24] 2025-06-24 hour 5: 159542 events in 0 files, snapshot none (task 8902 ms: download 5869 ms overlapping gunzip 1521 ms, parse 5582 ms, sort 0 ms, write 0 ms, index 1151 ms: 14 candidates, 84970 repo-hours, 528 releases; waiting 289 ms; commit 0 ms)
2026-11-08T12:38:28Z [load_day 2025-06-24] 2025-06-24 hour 6: 167773 events in 0 files, snapshot none (task 13541 ms: download 9709 ms overlapping gunzip 2360 ms, parse 8985 ms, sort 0 ms, write 0 ms, index 1367 ms: 8 candidates, 102510 repo-hours, 604 releases; waiting 512 ms; commit 0 ms)
2026-11-08T12:38:29Z [load_day 2025-06-24] 2025-06-24 hour 7: 167210 events in 0 files, snapshot none (task 12249 ms: download 8556 ms overlapping gunzip 2155 ms, parse 8319 ms, sort 0 ms, write 0 ms, index 913 ms: 8 candidates, 98536 repo-hours, 624 releases; waiting 493 ms; commit 0 ms)
2026-11-08T12:38:39Z [load_day 2025-06-24] 2025-06-24 hour 8: 169096 events in 0 files, snapshot none (task 10649 ms: download 6957 ms overlapping gunzip 1874 ms, parse 7080 ms, sort 0 ms, write 0 ms, index 949 ms: 16 candidates, 90076 repo-hours, 699 releases; waiting 529 ms; commit 0 ms)
2026-11-08T12:38:40Z [load_day 2025-06-24] 2025-06-24 hour 9: 169309 events in 0 files, snapshot none (task 10112 ms: download 7489 ms overlapping gunzip 1851 ms, parse 6855 ms, sort 0 ms, write 0 ms, index 675 ms: 8 candidates, 94812 repo-hours, 777 releases; waiting 492 ms; commit 0 ms)
2026-11-08T12:38:50Z [load_day 2025-06-24] 2025-06-24 hour 10: 163422 events in 0 files, snapshot none (task 10096 ms: download 7399 ms overlapping gunzip 1875 ms, parse 6737 ms, sort 0 ms, write 0 ms, index 634 ms: 7 candidates, 88179 repo-hours, 677 releases; waiting 527 ms; commit 0 ms)
2026-11-08T12:38:50Z [load_day 2025-06-24] 2025-06-24 hour 11: 162489 events in 0 files, snapshot none (task 9215 ms: download 6570 ms overlapping gunzip 1608 ms, parse 5999 ms, sort 0 ms, write 0 ms, index 555 ms: 9 candidates, 75401 repo-hours, 852 releases; waiting 627 ms; commit 0 ms)
2026-11-08T12:38:58Z [load_day 2025-06-24] 2025-06-24 hour 12: 171925 events in 0 files, snapshot none (task 8035 ms: download 4726 ms overlapping gunzip 1298 ms, parse 5211 ms, sort 0 ms, write 0 ms, index 755 ms: 9 candidates, 98316 repo-hours, 873 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:38:59Z [load_day 2025-06-24] 2025-06-24 hour 13: 163094 events in 0 files, snapshot none (task 8698 ms: download 6303 ms overlapping gunzip 1405 ms, parse 5454 ms, sort 0 ms, write 0 ms, index 710 ms: 11 candidates, 90826 repo-hours, 825 releases; waiting 825 ms; commit 0 ms)
2026-11-08T12:39:08Z [load_day 2025-06-24] 2025-06-24 hour 14: 164332 events in 0 files, snapshot none (task 9644 ms: download 6936 ms overlapping gunzip 1614 ms, parse 6366 ms, sort 0 ms, write 0 ms, index 697 ms: 11 candidates, 85011 repo-hours, 892 releases; waiting 659 ms; commit 0 ms)
2026-11-08T12:39:09Z [load_day 2025-06-24] 2025-06-24 hour 15: 162478 events in 0 files, snapshot none (task 9411 ms: download 6736 ms overlapping gunzip 1593 ms, parse 6092 ms, sort 0 ms, write 0 ms, index 748 ms: 8 candidates, 83165 repo-hours, 952 releases; waiting 662 ms; commit 0 ms)
2026-11-08T12:39:18Z [load_day 2025-06-24] 2025-06-24 hour 16: 163340 events in 0 files, snapshot none (task 9598 ms: download 6373 ms overlapping gunzip 1658 ms, parse 6231 ms, sort 0 ms, write 0 ms, index 907 ms: 14 candidates, 81479 repo-hours, 884 releases; waiting 523 ms; commit 0 ms)
2026-11-08T12:39:19Z [load_day 2025-06-24] 2025-06-24 hour 17: 159062 events in 0 files, snapshot none (task 9637 ms: download 6776 ms overlapping gunzip 1694 ms, parse 6244 ms, sort 0 ms, write 0 ms, index 869 ms: 10 candidates, 77723 repo-hours, 703 releases; waiting 534 ms; commit 0 ms)
2026-11-08T12:39:29Z [load_day 2025-06-24] 2025-06-24 hour 18: 164826 events in 0 files, snapshot none (task 10170 ms: download 6933 ms overlapping gunzip 1734 ms, parse 6547 ms, sort 0 ms, write 0 ms, index 911 ms: 16 candidates, 83108 repo-hours, 795 releases; waiting 579 ms; commit 0 ms)
2026-11-08T12:39:30Z [load_day 2025-06-24] 2025-06-24 hour 19: 155864 events in 0 files, snapshot none (task 10327 ms: download 7640 ms overlapping gunzip 1912 ms, parse 6984 ms, sort 0 ms, write 0 ms, index 637 ms: 9 candidates, 71247 repo-hours, 795 releases; waiting 525 ms; commit 0 ms)
2026-11-08T12:39:39Z [load_day 2025-06-24] 2025-06-24 hour 20: 156136 events in 0 files, snapshot none (task 9502 ms: download 7314 ms overlapping gunzip 1677 ms, parse 6494 ms, sort 0 ms, write 0 ms, index 646 ms: 14 candidates, 71419 repo-hours, 833 releases; waiting 470 ms; commit 0 ms)
2026-11-08T12:39:39Z [load_day 2025-06-24] 2025-06-24 hour 21: 149959 events in 0 files, snapshot none (task 9006 ms: download 6754 ms overlapping gunzip 1599 ms, parse 6083 ms, sort 0 ms, write 0 ms, index 529 ms: 10 candidates, 65892 repo-hours, 815 releases; waiting 480 ms; commit 0 ms)
2026-11-08T12:39:48Z [load_day 2025-06-24] 2025-06-24 hour 22: 146267 events in 0 files, snapshot none (task 8732 ms: download 6454 ms overlapping gunzip 1579 ms, parse 5876 ms, sort 0 ms, write 0 ms, index 475 ms: 2 candidates, 61339 repo-hours, 936 releases; waiting 488 ms; commit 0 ms)
2026-11-08T12:39:48Z [load_day 2025-06-24] 2025-06-24 hour 23: 143067 events in 0 files, snapshot none (task 8213 ms: download 6191 ms overlapping gunzip 1530 ms, parse 5554 ms, sort 0 ms, write 0 ms, index 454 ms: 10 candidates, 59323 repo-hours, 876 releases; waiting 474 ms; commit 0 ms)
2026-11-08T12:39:58Z [load_day 2025-06-24] 2025-06-24: repo_hour merged from 24 files to 1 (1930284 rows, 9420 ms)
2026-11-08T12:40:01Z [load_day 2025-06-24] 2025-06-24: index committed in 12537 ms (24 + 1 + 24 files)
2026-11-08T12:40:01Z [load_day 2025-06-24] 2025-06-24: 3814443 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T12:40:01Z [load_day 2025-06-24] attempt 1 succeeded