orcaLog in

Runs · run 4867

load_day 2026-01-26, attempt 1 succeeded

Host
73ccef5e07c2:434875
Started
2026-11-08T15:08:30Z
Ended
2026-11-08T15:09:33Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
741 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.2 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4867/load_day/2026-01-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:08:30Z [load_day 2026-01-26] attempt 1 started
2026-11-08T15:08:31Z [load_day 2026-01-26] 2026-01-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:08:36Z [load_day 2026-01-26] 2026-01-26 hour 0: 141814 events in 0 files, snapshot none (task 4087 ms: download 2737 ms overlapping gunzip 516 ms, parse 1553 ms, sort 0 ms, write 0 ms, index 517 ms: 4 candidates, 64480 repo-hours, 942 releases; waiting 1200 ms; commit 0 ms)
2026-11-08T15:08:36Z [load_day 2026-01-26] 2026-01-26 hour 1: 150223 events in 0 files, snapshot none (task 4295 ms: download 2781 ms overlapping gunzip 383 ms, parse 1288 ms, sort 0 ms, write 0 ms, index 735 ms: 10 candidates, 87704 repo-hours, 655 releases; waiting 1582 ms; commit 0 ms)
2026-11-08T15:08:39Z [load_day 2026-01-26] 2026-01-26 hour 2: 144020 events in 0 files, snapshot none (task 3454 ms: download 2248 ms overlapping gunzip 451 ms, parse 1412 ms, sort 0 ms, write 0 ms, index 665 ms: 10 candidates, 76670 repo-hours, 622 releases; waiting 604 ms; commit 0 ms)
2026-11-08T15:08:40Z [load_day 2026-01-26] 2026-01-26 hour 3: 138113 events in 0 files, snapshot none (task 3542 ms: download 2397 ms overlapping gunzip 475 ms, parse 1424 ms, sort 0 ms, write 0 ms, index 614 ms: 11 candidates, 65970 repo-hours, 751 releases; waiting 739 ms; commit 0 ms)
2026-11-08T15:08:44Z [load_day 2026-01-26] 2026-01-26 hour 4: 140242 events in 0 files, snapshot none (task 4216 ms: download 2624 ms overlapping gunzip 609 ms, parse 1657 ms, sort 0 ms, write 0 ms, index 688 ms: 4 candidates, 68195 repo-hours, 1531 releases; waiting 794 ms; commit 0 ms)
2026-11-08T15:08:44Z [load_day 2026-01-26] 2026-01-26 hour 5: 142159 events in 0 files, snapshot none (task 3831 ms: download 2465 ms overlapping gunzip 523 ms, parse 1631 ms, sort 0 ms, write 0 ms, index 714 ms: 5 candidates, 70024 repo-hours, 681 releases; waiting 602 ms; commit 0 ms)
2026-11-08T15:08:49Z [load_day 2026-01-26] 2026-01-26 hour 6: 146633 events in 0 files, snapshot none (task 4259 ms: download 2281 ms overlapping gunzip 640 ms, parse 1940 ms, sort 0 ms, write 0 ms, index 697 ms: 9 candidates, 77374 repo-hours, 661 releases; waiting 595 ms; commit 0 ms)
2026-11-08T15:08:49Z [load_day 2026-01-26] 2026-01-26 hour 7: 142322 events in 0 files, snapshot none (task 4100 ms: download 2687 ms overlapping gunzip 620 ms, parse 1839 ms, sort 0 ms, write 0 ms, index 658 ms: 11 candidates, 70839 repo-hours, 621 releases; waiting 654 ms; commit 0 ms)
2026-11-08T15:08:53Z [load_day 2026-01-26] 2026-01-26 hour 8: 142601 events in 0 files, snapshot none (task 3400 ms: download 2106 ms overlapping gunzip 502 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 610 ms: 9 candidates, 76007 repo-hours, 678 releases; waiting 540 ms; commit 0 ms)
2026-11-08T15:08:53Z [load_day 2026-01-26] 2026-01-26 hour 9: 144000 events in 0 files, snapshot none (task 3254 ms: download 2075 ms overlapping gunzip 551 ms, parse 1458 ms, sort 0 ms, write 0 ms, index 567 ms: 6 candidates, 79555 repo-hours, 609 releases; waiting 377 ms; commit 0 ms)
2026-11-08T15:08:57Z [load_day 2026-01-26] 2026-01-26 hour 10: 142654 events in 0 files, snapshot none (task 3667 ms: download 2609 ms overlapping gunzip 461 ms, parse 1268 ms, sort 0 ms, write 0 ms, index 593 ms: 6 candidates, 79268 repo-hours, 543 releases; waiting 1040 ms; commit 0 ms)
2026-11-08T15:08:57Z [load_day 2026-01-26] 2026-01-26 hour 11: 145358 events in 0 files, snapshot none (task 3550 ms: download 2558 ms overlapping gunzip 485 ms, parse 1431 ms, sort 0 ms, write 0 ms, index 648 ms: 12 candidates, 74995 repo-hours, 638 releases; waiting 690 ms; commit 0 ms)
2026-11-08T15:09:01Z [load_day 2026-01-26] 2026-01-26 hour 12: 155014 events in 0 files, snapshot none (task 3118 ms: download 1911 ms overlapping gunzip 322 ms, parse 1014 ms, sort 0 ms, write 0 ms, index 782 ms: 9 candidates, 96126 repo-hours, 353 releases; waiting 765 ms; commit 0 ms)
2026-11-08T15:09:01Z [load_day 2026-01-26] 2026-01-26 hour 13: 157970 events in 0 files, snapshot none (task 3271 ms: download 1896 ms overlapping gunzip 318 ms, parse 960 ms, sort 0 ms, write 0 ms, index 713 ms: 11 candidates, 95052 repo-hours, 316 releases; waiting 889 ms; commit 0 ms)
2026-11-08T15:09:04Z [load_day 2026-01-26] 2026-01-26 hour 14: 148720 events in 0 files, snapshot none (task 3337 ms: download 2119 ms overlapping gunzip 387 ms, parse 1149 ms, sort 0 ms, write 0 ms, index 655 ms: 8 candidates, 84021 repo-hours, 403 releases; waiting 807 ms; commit 0 ms)
2026-11-08T15:09:05Z [load_day 2026-01-26] 2026-01-26 hour 15: 147807 events in 0 files, snapshot none (task 3038 ms: download 1806 ms overlapping gunzip 379 ms, parse 1077 ms, sort 0 ms, write 0 ms, index 685 ms: 10 candidates, 81780 repo-hours, 462 releases; waiting 576 ms; commit 0 ms)
2026-11-08T15:09:09Z [load_day 2026-01-26] 2026-01-26 hour 16: 144412 events in 0 files, snapshot none (task 3888 ms: download 2041 ms overlapping gunzip 511 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 779 ms: 13 candidates, 81735 repo-hours, 412 releases; waiting 652 ms; commit 0 ms)
2026-11-08T15:09:09Z [load_day 2026-01-26] 2026-01-26 hour 17: 146345 events in 0 files, snapshot none (task 3572 ms: download 1547 ms overlapping gunzip 509 ms, parse 1531 ms, sort 0 ms, write 0 ms, index 899 ms: 15 candidates, 80726 repo-hours, 461 releases; waiting 324 ms; commit 0 ms)
2026-11-08T15:09:13Z [load_day 2026-01-26] 2026-01-26 hour 18: 146518 events in 0 files, snapshot none (task 3531 ms: download 1814 ms overlapping gunzip 446 ms, parse 1311 ms, sort 0 ms, write 0 ms, index 904 ms: 7 candidates, 83752 repo-hours, 458 releases; waiting 532 ms; commit 0 ms)
2026-11-08T15:09:13Z [load_day 2026-01-26] 2026-01-26 hour 19: 143696 events in 0 files, snapshot none (task 3148 ms: download 1755 ms overlapping gunzip 423 ms, parse 1329 ms, sort 0 ms, write 0 ms, index 800 ms: 12 candidates, 74126 repo-hours, 528 releases; waiting 342 ms; commit 0 ms)
2026-11-08T15:09:17Z [load_day 2026-01-26] 2026-01-26 hour 20: 145850 events in 0 files, snapshot none (task 3382 ms: download 2187 ms overlapping gunzip 450 ms, parse 1334 ms, sort 0 ms, write 0 ms, index 675 ms: 10 candidates, 73112 repo-hours, 501 releases; waiting 594 ms; commit 0 ms)
2026-11-08T15:09:17Z [load_day 2026-01-26] 2026-01-26 hour 21: 146742 events in 0 files, snapshot none (task 3898 ms: download 2464 ms overlapping gunzip 468 ms, parse 1390 ms, sort 0 ms, write 0 ms, index 796 ms: 14 candidates, 75138 repo-hours, 525 releases; waiting 934 ms; commit 0 ms)
2026-11-08T15:09:22Z [load_day 2026-01-26] 2026-01-26 hour 22: 144848 events in 0 files, snapshot none (task 4504 ms: download 2904 ms overlapping gunzip 539 ms, parse 1690 ms, sort 0 ms, write 0 ms, index 537 ms: 7 candidates, 71097 repo-hours, 741 releases; waiting 1151 ms; commit 0 ms)
2026-11-08T15:09:22Z [load_day 2026-01-26] 2026-01-26 hour 23: 139185 events in 0 files, snapshot none (task 3787 ms: download 2524 ms overlapping gunzip 552 ms, parse 1676 ms, sort 0 ms, write 0 ms, index 620 ms: 16 candidates, 66192 repo-hours, 854 releases; waiting 628 ms; commit 0 ms)
2026-11-08T15:09:30Z [load_day 2026-01-26] 2026-01-26: repo_hour merged from 24 files to 1 (1853938 rows, 8121 ms)
2026-11-08T15:09:33Z [load_day 2026-01-26] 2026-01-26: index committed in 11049 ms (24 + 1 + 24 files)
2026-11-08T15:09:33Z [load_day 2026-01-26] 2026-01-26: 3487246 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:09:33Z [load_day 2026-01-26] attempt 1 succeeded