orcaLog in

Runs · run 4897

load_day 2026-02-03, attempt 1 succeeded

Host
73ccef5e07c2:438797
Started
2026-11-08T15:13:13Z
Ended
2026-11-08T15:14:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
712 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
72.7 s, up to 2.4 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4897/load_day/2026-02-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:13:13Z [load_day 2026-02-03] attempt 1 started
2026-11-08T15:13:14Z [load_day 2026-02-03] 2026-02-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:13:18Z [load_day 2026-02-03] 2026-02-03 hour 0: 147225 events in 0 files, snapshot none (task 3519 ms: download 2544 ms overlapping gunzip 444 ms, parse 1315 ms, sort 0 ms, write 0 ms, index 508 ms: 16 candidates, 67452 repo-hours, 800 releases; waiting 947 ms; commit 0 ms)
2026-11-08T15:13:18Z [load_day 2026-02-03] 2026-02-03 hour 1: 148070 events in 0 files, snapshot none (task 3001 ms: download 1803 ms overlapping gunzip 386 ms, parse 1159 ms, sort 0 ms, write 0 ms, index 621 ms: 8 candidates, 85228 repo-hours, 611 releases; waiting 517 ms; commit 0 ms)
2026-11-08T15:13:22Z [load_day 2026-02-03] 2026-02-03 hour 2: 151914 events in 0 files, snapshot none (task 3979 ms: download 2546 ms overlapping gunzip 389 ms, parse 1172 ms, sort 0 ms, write 0 ms, index 966 ms: 13 candidates, 85162 repo-hours, 613 releases; waiting 1156 ms; commit 0 ms)
2026-11-08T15:13:22Z [load_day 2026-02-03] 2026-02-03 hour 3: 146290 events in 0 files, snapshot none (task 3734 ms: download 2444 ms overlapping gunzip 439 ms, parse 1283 ms, sort 0 ms, write 0 ms, index 728 ms: 12 candidates, 69589 repo-hours, 757 releases; waiting 933 ms; commit 0 ms)
2026-11-08T15:13:27Z [load_day 2026-02-03] 2026-02-03 hour 4: 146961 events in 0 files, snapshot none (task 4052 ms: download 2120 ms overlapping gunzip 494 ms, parse 1520 ms, sort 0 ms, write 0 ms, index 1126 ms: 10 candidates, 69325 repo-hours, 1483 releases; waiting 535 ms; commit 0 ms)
2026-11-08T15:13:27Z [load_day 2026-02-03] 2026-02-03 hour 5: 147240 events in 0 files, snapshot none (task 4556 ms: download 2616 ms overlapping gunzip 500 ms, parse 1511 ms, sort 0 ms, write 0 ms, index 1227 ms: 9 candidates, 75248 repo-hours, 700 releases; waiting 912 ms; commit 0 ms)
2026-11-08T15:13:31Z [load_day 2026-02-03] 2026-02-03 hour 6: 147303 events in 0 files, snapshot none (task 4097 ms: download 2907 ms overlapping gunzip 506 ms, parse 1431 ms, sort 0 ms, write 0 ms, index 648 ms: 9 candidates, 77892 repo-hours, 652 releases; waiting 1145 ms; commit 0 ms)
2026-11-08T15:13:32Z [load_day 2026-02-03] 2026-02-03 hour 7: 148820 events in 0 files, snapshot none (task 3954 ms: download 2373 ms overlapping gunzip 600 ms, parse 1922 ms, sort 0 ms, write 0 ms, index 581 ms: 6 candidates, 79217 repo-hours, 636 releases; waiting 553 ms; commit 0 ms)
2026-11-08T15:13:36Z [load_day 2026-02-03] 2026-02-03 hour 8: 150487 events in 0 files, snapshot none (task 3815 ms: download 1965 ms overlapping gunzip 533 ms, parse 1541 ms, sort 0 ms, write 0 ms, index 856 ms: 11 candidates, 80265 repo-hours, 603 releases; waiting 603 ms; commit 0 ms)
2026-11-08T15:13:37Z [load_day 2026-02-03] 2026-02-03 hour 9: 143681 events in 0 files, snapshot none (task 4439 ms: download 2773 ms overlapping gunzip 412 ms, parse 1263 ms, sort 0 ms, write 0 ms, index 537 ms: 4 candidates, 78858 repo-hours, 633 releases; waiting 1913 ms; commit 0 ms)
2026-11-08T15:13:40Z [load_day 2026-02-03] 2026-02-03 hour 10: 147149 events in 0 files, snapshot none (task 3809 ms: download 2501 ms overlapping gunzip 529 ms, parse 1483 ms, sort 0 ms, write 0 ms, index 686 ms: 3 candidates, 82209 repo-hours, 482 releases; waiting 799 ms; commit 0 ms)
2026-11-08T15:13:41Z [load_day 2026-02-03] 2026-02-03 hour 11: 148939 events in 0 files, snapshot none (task 3288 ms: download 2001 ms overlapping gunzip 434 ms, parse 1280 ms, sort 0 ms, write 0 ms, index 596 ms: 11 candidates, 80800 repo-hours, 635 releases; waiting 628 ms; commit 0 ms)
2026-11-08T15:13:44Z [load_day 2026-02-03] 2026-02-03 hour 12: 152715 events in 0 files, snapshot none (task 3518 ms: download 1856 ms overlapping gunzip 444 ms, parse 1439 ms, sort 0 ms, write 0 ms, index 815 ms: 8 candidates, 91850 repo-hours, 407 releases; waiting 485 ms; commit 0 ms)
2026-11-08T15:13:44Z [load_day 2026-02-03] 2026-02-03 hour 13: 153640 events in 0 files, snapshot none (task 3030 ms: download 1677 ms overlapping gunzip 324 ms, parse 1102 ms, sort 0 ms, write 0 ms, index 705 ms: 10 candidates, 94343 repo-hours, 304 releases; waiting 539 ms; commit 0 ms)
2026-11-08T15:13:48Z [load_day 2026-02-03] 2026-02-03 hour 14: 148741 events in 0 files, snapshot none (task 3705 ms: download 2354 ms overlapping gunzip 468 ms, parse 1355 ms, sort 0 ms, write 0 ms, index 634 ms: 8 candidates, 85114 repo-hours, 407 releases; waiting 928 ms; commit 0 ms)
2026-11-08T15:13:48Z [load_day 2026-02-03] 2026-02-03 hour 15: 150912 events in 0 files, snapshot none (task 3473 ms: download 2037 ms overlapping gunzip 490 ms, parse 1421 ms, sort 0 ms, write 0 ms, index 715 ms: 3 candidates, 87034 repo-hours, 378 releases; waiting 546 ms; commit 0 ms)
2026-11-08T15:13:52Z [load_day 2026-02-03] 2026-02-03 hour 16: 147662 events in 0 files, snapshot none (task 3658 ms: download 2309 ms overlapping gunzip 476 ms, parse 1471 ms, sort 0 ms, write 0 ms, index 761 ms: 6 candidates, 84753 repo-hours, 417 releases; waiting 594 ms; commit 0 ms)
2026-11-08T15:13:52Z [load_day 2026-02-03] 2026-02-03 hour 17: 146147 events in 0 files, snapshot none (task 3624 ms: download 2325 ms overlapping gunzip 464 ms, parse 1459 ms, sort 0 ms, write 0 ms, index 782 ms: 8 candidates, 83570 repo-hours, 433 releases; waiting 610 ms; commit 0 ms)
2026-11-08T15:13:57Z [load_day 2026-02-03] 2026-02-03 hour 18: 150023 events in 0 files, snapshot none (task 3732 ms: download 2199 ms overlapping gunzip 530 ms, parse 1634 ms, sort 0 ms, write 0 ms, index 739 ms: 10 candidates, 84226 repo-hours, 530 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:13:57Z [load_day 2026-02-03] 2026-02-03 hour 19: 147473 events in 0 files, snapshot none (task 3750 ms: download 2122 ms overlapping gunzip 528 ms, parse 1655 ms, sort 0 ms, write 0 ms, index 667 ms: 7 candidates, 79174 repo-hours, 503 releases; waiting 606 ms; commit 0 ms)
2026-11-08T15:14:01Z [load_day 2026-02-03] 2026-02-03 hour 20: 147289 events in 0 files, snapshot none (task 3775 ms: download 2240 ms overlapping gunzip 565 ms, parse 1716 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 78380 repo-hours, 577 releases; waiting 529 ms; commit 0 ms)
2026-11-08T15:14:01Z [load_day 2026-02-03] 2026-02-03 hour 21: 144557 events in 0 files, snapshot none (task 4087 ms: download 2901 ms overlapping gunzip 619 ms, parse 1939 ms, sort 0 ms, write 0 ms, index 625 ms: 12 candidates, 73843 repo-hours, 708 releases; waiting 575 ms; commit 0 ms)
2026-11-08T15:14:05Z [load_day 2026-02-03] 2026-02-03 hour 22: 149556 events in 0 files, snapshot none (task 3540 ms: download 2358 ms overlapping gunzip 436 ms, parse 1475 ms, sort 0 ms, write 0 ms, index 699 ms: 7 candidates, 75402 repo-hours, 566 releases; waiting 617 ms; commit 0 ms)
2026-11-08T15:14:06Z [load_day 2026-02-03] 2026-02-03 hour 23: 151417 events in 0 files, snapshot none (task 4179 ms: download 2811 ms overlapping gunzip 574 ms, parse 1794 ms, sort 0 ms, write 0 ms, index 657 ms: 5 candidates, 71181 repo-hours, 760 releases; waiting 620 ms; commit 0 ms)
2026-11-08T15:14:14Z [load_day 2026-02-03] 2026-02-03: repo_hour merged from 24 files to 1 (1920115 rows, 8634 ms)
2026-11-08T15:14:17Z [load_day 2026-02-03] 2026-02-03: index committed in 11382 ms (24 + 1 + 24 files)
2026-11-08T15:14:17Z [load_day 2026-02-03] 2026-02-03: 3564211 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:14:17Z [load_day 2026-02-03] attempt 1 succeeded