orcaLog in

Runs · run 4839

load_day 2026-01-18, attempt 1 succeeded

Host
73ccef5e07c2:431553
Started
2026-11-08T15:04:09Z
Ended
2026-11-08T15:05:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
666 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
69.7 s, up to 1.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4839/load_day/2026-01-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:04:09Z [load_day 2026-01-18] attempt 1 started
2026-11-08T15:04:10Z [load_day 2026-01-18] 2026-01-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:04:14Z [load_day 2026-01-18] 2026-01-18 hour 0: 140307 events in 0 files, snapshot none (task 3404 ms: download 2271 ms overlapping gunzip 369 ms, parse 1104 ms, sort 0 ms, write 0 ms, index 662 ms: 8 candidates, 67456 repo-hours, 916 releases; waiting 893 ms; commit 0 ms)
2026-11-08T15:04:14Z [load_day 2026-01-18] 2026-01-18 hour 1: 145659 events in 0 files, snapshot none (task 3577 ms: download 2262 ms overlapping gunzip 374 ms, parse 1187 ms, sort 0 ms, write 0 ms, index 614 ms: 0 candidates, 86830 repo-hours, 735 releases; waiting 1035 ms; commit 0 ms)
2026-11-08T15:04:18Z [load_day 2026-01-18] 2026-01-18 hour 2: 141214 events in 0 files, snapshot none (task 3523 ms: download 2052 ms overlapping gunzip 485 ms, parse 1516 ms, sort 0 ms, write 0 ms, index 554 ms: 1 candidates, 69256 repo-hours, 734 releases; waiting 631 ms; commit 0 ms)
2026-11-08T15:04:18Z [load_day 2026-01-18] 2026-01-18 hour 3: 139763 events in 0 files, snapshot none (task 3225 ms: download 1514 ms overlapping gunzip 495 ms, parse 1530 ms, sort 0 ms, write 0 ms, index 650 ms: 15 candidates, 65803 repo-hours, 852 releases; waiting 218 ms; commit 0 ms)
2026-11-08T15:04:22Z [load_day 2026-01-18] 2026-01-18 hour 4: 140978 events in 0 files, snapshot none (task 3437 ms: download 2177 ms overlapping gunzip 441 ms, parse 1365 ms, sort 0 ms, write 0 ms, index 531 ms: 1 candidates, 67681 repo-hours, 1629 releases; waiting 615 ms; commit 0 ms)
2026-11-08T15:04:22Z [load_day 2026-01-18] 2026-01-18 hour 5: 143964 events in 0 files, snapshot none (task 2936 ms: download 1772 ms overlapping gunzip 407 ms, parse 1307 ms, sort 0 ms, write 0 ms, index 627 ms: 6 candidates, 64980 repo-hours, 658 releases; waiting 329 ms; commit 0 ms)
2026-11-08T15:04:27Z [load_day 2026-01-18] 2026-01-18 hour 6: 145016 events in 0 files, snapshot none (task 3943 ms: download 2769 ms overlapping gunzip 431 ms, parse 1319 ms, sort 0 ms, write 0 ms, index 574 ms: 8 candidates, 68022 repo-hours, 731 releases; waiting 1341 ms; commit 0 ms)
2026-11-08T15:04:27Z [load_day 2026-01-18] 2026-01-18 hour 7: 149111 events in 0 files, snapshot none (task 3794 ms: download 2313 ms overlapping gunzip 482 ms, parse 1382 ms, sort 0 ms, write 0 ms, index 566 ms: 6 candidates, 66802 repo-hours, 597 releases; waiting 1054 ms; commit 0 ms)
2026-11-08T15:04:31Z [load_day 2026-01-18] 2026-01-18 hour 8: 143907 events in 0 files, snapshot none (task 3698 ms: download 2714 ms overlapping gunzip 493 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 559 ms: 9 candidates, 68017 repo-hours, 612 releases; waiting 849 ms; commit 0 ms)
2026-11-08T15:04:31Z [load_day 2026-01-18] 2026-01-18 hour 9: 150297 events in 0 files, snapshot none (task 3410 ms: download 2199 ms overlapping gunzip 436 ms, parse 1406 ms, sort 0 ms, write 0 ms, index 693 ms: 2 candidates, 70072 repo-hours, 754 releases; waiting 572 ms; commit 0 ms)
2026-11-08T15:04:34Z [load_day 2026-01-18] 2026-01-18 hour 10: 147375 events in 0 files, snapshot none (task 3154 ms: download 1527 ms overlapping gunzip 456 ms, parse 1423 ms, sort 0 ms, write 0 ms, index 695 ms: 7 candidates, 68597 repo-hours, 703 releases; waiting 222 ms; commit 0 ms)
2026-11-08T15:04:35Z [load_day 2026-01-18] 2026-01-18 hour 11: 149548 events in 0 files, snapshot none (task 3702 ms: download 2649 ms overlapping gunzip 440 ms, parse 1575 ms, sort 0 ms, write 0 ms, index 565 ms: 4 candidates, 71679 repo-hours, 658 releases; waiting 818 ms; commit 0 ms)
2026-11-08T15:04:38Z [load_day 2026-01-18] 2026-01-18 hour 12: 154188 events in 0 files, snapshot none (task 3386 ms: download 1844 ms overlapping gunzip 356 ms, parse 1176 ms, sort 0 ms, write 0 ms, index 831 ms: 6 candidates, 92706 repo-hours, 617 releases; waiting 702 ms; commit 0 ms)
2026-11-08T15:04:39Z [load_day 2026-01-18] 2026-01-18 hour 13: 155228 events in 0 files, snapshot none (task 3468 ms: download 2139 ms overlapping gunzip 350 ms, parse 1134 ms, sort 0 ms, write 0 ms, index 618 ms: 4 candidates, 85797 repo-hours, 576 releases; waiting 802 ms; commit 0 ms)
2026-11-08T15:04:42Z [load_day 2026-01-18] 2026-01-18 hour 14: 150074 events in 0 files, snapshot none (task 2939 ms: download 1894 ms overlapping gunzip 346 ms, parse 1066 ms, sort 0 ms, write 0 ms, index 595 ms: 6 candidates, 73726 repo-hours, 806 releases; waiting 610 ms; commit 0 ms)
2026-11-08T15:04:43Z [load_day 2026-01-18] 2026-01-18 hour 15: 150709 events in 0 files, snapshot none (task 3594 ms: download 2527 ms overlapping gunzip 416 ms, parse 1254 ms, sort 0 ms, write 0 ms, index 580 ms: 3 candidates, 77203 repo-hours, 773 releases; waiting 1072 ms; commit 0 ms)
2026-11-08T15:04:45Z [load_day 2026-01-18] 2026-01-18 hour 16: 152179 events in 0 files, snapshot none (task 2897 ms: download 1779 ms overlapping gunzip 351 ms, parse 1089 ms, sort 0 ms, write 0 ms, index 694 ms: 1 candidates, 78131 repo-hours, 792 releases; waiting 389 ms; commit 0 ms)
2026-11-08T15:04:47Z [load_day 2026-01-18] 2026-01-18 hour 17: 153803 events in 0 files, snapshot none (task 3883 ms: download 2451 ms overlapping gunzip 398 ms, parse 1186 ms, sort 0 ms, write 0 ms, index 732 ms: 8 candidates, 74975 repo-hours, 726 releases; waiting 1201 ms; commit 0 ms)
2026-11-08T15:04:49Z [load_day 2026-01-18] 2026-01-18 hour 18: 151609 events in 0 files, snapshot none (task 3213 ms: download 1979 ms overlapping gunzip 366 ms, parse 1118 ms, sort 0 ms, write 0 ms, index 855 ms: 8 candidates, 79555 repo-hours, 893 releases; waiting 592 ms; commit 0 ms)
2026-11-08T15:04:52Z [load_day 2026-01-18] 2026-01-18 hour 19: 151772 events in 0 files, snapshot none (task 3741 ms: download 2435 ms overlapping gunzip 405 ms, parse 1364 ms, sort 0 ms, write 0 ms, index 671 ms: 9 candidates, 70497 repo-hours, 877 releases; waiting 948 ms; commit 0 ms)
2026-11-08T15:04:53Z [load_day 2026-01-18] 2026-01-18 hour 20: 146049 events in 0 files, snapshot none (task 3311 ms: download 2051 ms overlapping gunzip 357 ms, parse 1135 ms, sort 0 ms, write 0 ms, index 651 ms: 5 candidates, 70215 repo-hours, 888 releases; waiting 791 ms; commit 0 ms)
2026-11-08T15:04:55Z [load_day 2026-01-18] 2026-01-18 hour 21: 151703 events in 0 files, snapshot none (task 3132 ms: download 1971 ms overlapping gunzip 410 ms, parse 1289 ms, sort 0 ms, write 0 ms, index 511 ms: 13 candidates, 65329 repo-hours, 894 releases; waiting 541 ms; commit 0 ms)
2026-11-08T15:04:57Z [load_day 2026-01-18] 2026-01-18 hour 22: 145657 events in 0 files, snapshot none (task 3394 ms: download 2119 ms overlapping gunzip 378 ms, parse 1202 ms, sort 0 ms, write 0 ms, index 625 ms: 13 candidates, 65342 repo-hours, 826 releases; waiting 704 ms; commit 0 ms)
2026-11-08T15:04:59Z [load_day 2026-01-18] 2026-01-18 hour 23: 144444 events in 0 files, snapshot none (task 3290 ms: download 2310 ms overlapping gunzip 376 ms, parse 1264 ms, sort 0 ms, write 0 ms, index 468 ms: 8 candidates, 64249 repo-hours, 776 releases; waiting 814 ms; commit 0 ms)
2026-11-08T15:05:07Z [load_day 2026-01-18] 2026-01-18: repo_hour merged from 24 files to 1 (1732920 rows, 8221 ms)
2026-11-08T15:05:11Z [load_day 2026-01-18] 2026-01-18: index committed in 11335 ms (23 + 1 + 24 files)
2026-11-08T15:05:11Z [load_day 2026-01-18] 2026-01-18: 3544554 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:05:11Z [load_day 2026-01-18] attempt 1 succeeded