orcaLog in

Runs · run 4798

load_day 2026-01-07, attempt 1 succeeded

Host
73ccef5e07c2:426569
Started
2026-11-08T14:58:09Z
Ended
2026-11-08T14:59:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
709 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.4 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4798/load_day/2026-01-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T14:58:09Z [load_day 2026-01-07] attempt 1 started
2026-11-08T14:58:10Z [load_day 2026-01-07] 2026-01-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T14:58:14Z [load_day 2026-01-07] 2026-01-07 hour 0: 144748 events in 0 files, snapshot none (task 3231 ms: download 2026 ms overlapping gunzip 402 ms, parse 1304 ms, sort 0 ms, write 0 ms, index 570 ms: 9 candidates, 72924 repo-hours, 992 releases; waiting 645 ms; commit 0 ms)
2026-11-08T14:58:14Z [load_day 2026-01-07] 2026-01-07 hour 1: 152486 events in 0 files, snapshot none (task 3380 ms: download 2206 ms overlapping gunzip 399 ms, parse 1261 ms, sort 0 ms, write 0 ms, index 773 ms: 9 candidates, 91998 repo-hours, 843 releases; waiting 696 ms; commit 0 ms)
2026-11-08T14:58:18Z [load_day 2026-01-07] 2026-01-07 hour 2: 144084 events in 0 files, snapshot none (task 3778 ms: download 2659 ms overlapping gunzip 477 ms, parse 1579 ms, sort 0 ms, write 0 ms, index 619 ms: 16 candidates, 76439 repo-hours, 716 releases; waiting 771 ms; commit 0 ms)
2026-11-08T14:58:18Z [load_day 2026-01-07] 2026-01-07 hour 3: 141932 events in 0 files, snapshot none (task 2807 ms: download 1573 ms overlapping gunzip 403 ms, parse 1162 ms, sort 0 ms, write 0 ms, index 624 ms: 9 candidates, 70582 repo-hours, 806 releases; waiting 297 ms; commit 0 ms)
2026-11-08T14:58:22Z [load_day 2026-01-07] 2026-01-07 hour 4: 143214 events in 0 files, snapshot none (task 3497 ms: download 2307 ms overlapping gunzip 373 ms, parse 1185 ms, sort 0 ms, write 0 ms, index 583 ms: 7 candidates, 73494 repo-hours, 1497 releases; waiting 926 ms; commit 0 ms)
2026-11-08T14:58:22Z [load_day 2026-01-07] 2026-01-07 hour 5: 150995 events in 0 files, snapshot none (task 3063 ms: download 1982 ms overlapping gunzip 410 ms, parse 1228 ms, sort 0 ms, write 0 ms, index 570 ms: 6 candidates, 72946 repo-hours, 731 releases; waiting 549 ms; commit 0 ms)
2026-11-08T14:58:26Z [load_day 2026-01-07] 2026-01-07 hour 6: 143623 events in 0 files, snapshot none (task 3141 ms: download 2047 ms overlapping gunzip 386 ms, parse 1195 ms, sort 0 ms, write 0 ms, index 561 ms: 8 candidates, 75616 repo-hours, 752 releases; waiting 713 ms; commit 0 ms)
2026-11-08T14:58:26Z [load_day 2026-01-07] 2026-01-07 hour 7: 147463 events in 0 files, snapshot none (task 3277 ms: download 2104 ms overlapping gunzip 411 ms, parse 1258 ms, sort 0 ms, write 0 ms, index 554 ms: 6 candidates, 75600 repo-hours, 679 releases; waiting 672 ms; commit 0 ms)
2026-11-08T14:58:30Z [load_day 2026-01-07] 2026-01-07 hour 8: 144736 events in 0 files, snapshot none (task 3931 ms: download 2487 ms overlapping gunzip 579 ms, parse 1705 ms, sort 0 ms, write 0 ms, index 650 ms: 10 candidates, 77158 repo-hours, 760 releases; waiting 698 ms; commit 0 ms)
2026-11-08T14:58:30Z [load_day 2026-01-07] 2026-01-07 hour 9: 145636 events in 0 files, snapshot none (task 3554 ms: download 2412 ms overlapping gunzip 561 ms, parse 1571 ms, sort 0 ms, write 0 ms, index 687 ms: 5 candidates, 78360 repo-hours, 743 releases; waiting 472 ms; commit 0 ms)
2026-11-08T14:58:35Z [load_day 2026-01-07] 2026-01-07 hour 10: 146663 events in 0 files, snapshot none (task 4335 ms: download 2567 ms overlapping gunzip 697 ms, parse 1867 ms, sort 0 ms, write 0 ms, index 677 ms: 3 candidates, 80086 repo-hours, 707 releases; waiting 617 ms; commit 0 ms)
2026-11-08T14:58:35Z [load_day 2026-01-07] 2026-01-07 hour 11: 147137 events in 0 files, snapshot none (task 4311 ms: download 2526 ms overlapping gunzip 721 ms, parse 1881 ms, sort 0 ms, write 0 ms, index 686 ms: 3 candidates, 74294 repo-hours, 692 releases; waiting 679 ms; commit 0 ms)
2026-11-08T14:58:39Z [load_day 2026-01-07] 2026-01-07 hour 12: 157411 events in 0 files, snapshot none (task 4000 ms: download 2252 ms overlapping gunzip 552 ms, parse 1818 ms, sort 0 ms, write 0 ms, index 781 ms: 7 candidates, 97521 repo-hours, 515 releases; waiting 581 ms; commit 0 ms)
2026-11-08T14:58:39Z [load_day 2026-01-07] 2026-01-07 hour 13: 153670 events in 0 files, snapshot none (task 3798 ms: download 2299 ms overlapping gunzip 547 ms, parse 1622 ms, sort 0 ms, write 0 ms, index 811 ms: 8 candidates, 92071 repo-hours, 461 releases; waiting 524 ms; commit 0 ms)
2026-11-08T14:58:44Z [load_day 2026-01-07] 2026-01-07 hour 14: 151147 events in 0 files, snapshot none (task 4154 ms: download 2591 ms overlapping gunzip 614 ms, parse 1982 ms, sort 0 ms, write 0 ms, index 791 ms: 11 candidates, 83259 repo-hours, 636 releases; waiting 462 ms; commit 0 ms)
2026-11-08T14:58:44Z [load_day 2026-01-07] 2026-01-07 hour 15: 148352 events in 0 files, snapshot none (task 4190 ms: download 2764 ms overlapping gunzip 660 ms, parse 1818 ms, sort 0 ms, write 0 ms, index 726 ms: 12 candidates, 80971 repo-hours, 788 releases; waiting 689 ms; commit 0 ms)
2026-11-08T14:58:49Z [load_day 2026-01-07] 2026-01-07 hour 16: 147490 events in 0 files, snapshot none (task 4254 ms: download 2182 ms overlapping gunzip 559 ms, parse 1628 ms, sort 0 ms, write 0 ms, index 1065 ms: 6 candidates, 82672 repo-hours, 526 releases; waiting 510 ms; commit 0 ms)
2026-11-08T14:58:49Z [load_day 2026-01-07] 2026-01-07 hour 17: 149997 events in 0 files, snapshot none (task 4755 ms: download 3033 ms overlapping gunzip 535 ms, parse 1757 ms, sort 0 ms, write 0 ms, index 692 ms: 7 candidates, 79495 repo-hours, 714 releases; waiting 1265 ms; commit 0 ms)
2026-11-08T14:58:54Z [load_day 2026-01-07] 2026-01-07 hour 18: 148668 events in 0 files, snapshot none (task 4735 ms: download 2407 ms overlapping gunzip 770 ms, parse 2265 ms, sort 0 ms, write 0 ms, index 862 ms: 5 candidates, 81547 repo-hours, 796 releases; waiting 471 ms; commit 0 ms)
2026-11-08T14:58:54Z [load_day 2026-01-07] 2026-01-07 hour 19: 147126 events in 0 files, snapshot none (task 4641 ms: download 2415 ms overlapping gunzip 746 ms, parse 2379 ms, sort 0 ms, write 0 ms, index 631 ms: 5 candidates, 74551 repo-hours, 747 releases; waiting 519 ms; commit 0 ms)
2026-11-08T14:58:59Z [load_day 2026-01-07] 2026-01-07 hour 20: 144355 events in 0 files, snapshot none (task 4347 ms: download 2576 ms overlapping gunzip 702 ms, parse 2143 ms, sort 0 ms, write 0 ms, index 823 ms: 7 candidates, 69931 repo-hours, 776 releases; waiting 379 ms; commit 0 ms)
2026-11-08T14:59:00Z [load_day 2026-01-07] 2026-01-07 hour 21: 145830 events in 0 files, snapshot none (task 4938 ms: download 2388 ms overlapping gunzip 841 ms, parse 2531 ms, sort 0 ms, write 0 ms, index 796 ms: 6 candidates, 72795 repo-hours, 922 releases; waiting 487 ms; commit 0 ms)
2026-11-08T14:59:04Z [load_day 2026-01-07] 2026-01-07 hour 22: 142800 events in 0 files, snapshot none (task 4400 ms: download 2450 ms overlapping gunzip 707 ms, parse 2255 ms, sort 0 ms, write 0 ms, index 632 ms: 7 candidates, 68127 repo-hours, 1000 releases; waiting 507 ms; commit 0 ms)
2026-11-08T14:59:04Z [load_day 2026-01-07] 2026-01-07 hour 23: 144292 events in 0 files, snapshot none (task 3837 ms: download 2349 ms overlapping gunzip 768 ms, parse 2062 ms, sort 0 ms, write 0 ms, index 516 ms: 4 candidates, 66148 repo-hours, 928 releases; waiting 239 ms; commit 0 ms)
2026-11-08T14:59:13Z [load_day 2026-01-07] 2026-01-07: repo_hour merged from 24 files to 1 (1868585 rows, 8463 ms)
2026-11-08T14:59:16Z [load_day 2026-01-07] 2026-01-07: index committed in 11574 ms (24 + 1 + 24 files)
2026-11-08T14:59:16Z [load_day 2026-01-07] 2026-01-07: 3533855 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T14:59:16Z [load_day 2026-01-07] attempt 1 succeeded