orcaLog in

Runs · run 2155

load_day 2024-03-03, attempt 1 succeeded

Host
73ccef5e07c2:94023
Started
2026-11-08T04:56:23Z
Ended
2026-11-08T04:57:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
614 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
114.0 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2155/load_day/2024-03-03/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:56:23Z [load_day 2024-03-03] attempt 1 started
2026-11-08T04:56:24Z [load_day 2024-03-03] 2024-03-03: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:56:30Z [load_day 2024-03-03] 2024-03-03 hour 0: 184453 events in 0 files, snapshot none (task 5301 ms: download 2556 ms overlapping gunzip 750 ms, parse 3205 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 80174 repo-hours, 993 releases; waiting 471 ms; commit 0 ms)
2026-11-08T04:56:30Z [load_day 2024-03-03] 2024-03-03 hour 1: 183102 events in 0 files, snapshot none (task 4951 ms: download 2376 ms overlapping gunzip 650 ms, parse 2953 ms, sort 0 ms, write 0 ms, index 590 ms: 6 candidates, 82010 repo-hours, 805 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:56:35Z [load_day 2024-03-03] 2024-03-03 hour 2: 152033 events in 0 files, snapshot none (task 4746 ms: download 2570 ms overlapping gunzip 658 ms, parse 2904 ms, sort 0 ms, write 0 ms, index 390 ms: 2 candidates, 46643 repo-hours, 563 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:56:35Z [load_day 2024-03-03] 2024-03-03 hour 3: 156654 events in 0 files, snapshot none (task 4447 ms: download 2229 ms overlapping gunzip 585 ms, parse 2726 ms, sort 0 ms, write 0 ms, index 355 ms: 0 candidates, 46903 repo-hours, 626 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:56:39Z [load_day 2024-03-03] 2024-03-03 hour 4: 159258 events in 0 files, snapshot none (task 4054 ms: download 1817 ms overlapping gunzip 528 ms, parse 2363 ms, sort 0 ms, write 0 ms, index 412 ms: 5 candidates, 48409 repo-hours, 466 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:56:40Z [load_day 2024-03-03] 2024-03-03 hour 5: 160370 events in 0 files, snapshot none (task 4315 ms: download 2200 ms overlapping gunzip 568 ms, parse 2393 ms, sort 0 ms, write 0 ms, index 538 ms: 6 candidates, 49787 repo-hours, 581 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:56:44Z [load_day 2024-03-03] 2024-03-03 hour 6: 174183 events in 0 files, snapshot none (task 4167 ms: download 2140 ms overlapping gunzip 587 ms, parse 2583 ms, sort 0 ms, write 0 ms, index 434 ms: 8 candidates, 58815 repo-hours, 604 releases; waiting 350 ms; commit 0 ms)
2026-11-08T04:56:44Z [load_day 2024-03-03] 2024-03-03 hour 7: 172889 events in 0 files, snapshot none (task 4061 ms: download 1783 ms overlapping gunzip 537 ms, parse 2443 ms, sort 0 ms, write 0 ms, index 395 ms: 8 candidates, 54070 repo-hours, 540 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:56:49Z [load_day 2024-03-03] 2024-03-03 hour 8: 170649 events in 0 files, snapshot none (task 5011 ms: download 2555 ms overlapping gunzip 746 ms, parse 3110 ms, sort 0 ms, write 0 ms, index 389 ms: 9 candidates, 55819 repo-hours, 728 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:56:50Z [load_day 2024-03-03] 2024-03-03 hour 9: 197636 events in 0 files, snapshot none (task 5492 ms: download 2784 ms overlapping gunzip 778 ms, parse 3344 ms, sort 0 ms, write 0 ms, index 499 ms: 8 candidates, 69869 repo-hours, 775 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:56:56Z [load_day 2024-03-03] 2024-03-03 hour 10: 189802 events in 0 files, snapshot none (task 5751 ms: download 3155 ms overlapping gunzip 811 ms, parse 3675 ms, sort 0 ms, write 0 ms, index 438 ms: 8 candidates, 62035 repo-hours, 649 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:56:56Z [load_day 2024-03-03] 2024-03-03 hour 11: 193016 events in 0 files, snapshot none (task 5210 ms: download 2596 ms overlapping gunzip 742 ms, parse 3264 ms, sort 0 ms, write 0 ms, index 437 ms: 5 candidates, 63045 repo-hours, 652 releases; waiting 456 ms; commit 0 ms)
2026-11-08T04:57:03Z [load_day 2024-03-03] 2024-03-03 hour 12: 277697 events in 0 files, snapshot none (task 6772 ms: download 3772 ms overlapping gunzip 947 ms, parse 4421 ms, sort 0 ms, write 0 ms, index 676 ms: 10 candidates, 98090 repo-hours, 1020 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:57:03Z [load_day 2024-03-03] 2024-03-03 hour 13: 227072 events in 0 files, snapshot none (task 5860 ms: download 3030 ms overlapping gunzip 874 ms, parse 3756 ms, sort 0 ms, write 0 ms, index 706 ms: 10 candidates, 88794 repo-hours, 759 releases; waiting 221 ms; commit 0 ms)
2026-11-08T04:57:09Z [load_day 2024-03-03] 2024-03-03 hour 14: 213311 events in 0 files, snapshot none (task 5312 ms: download 2786 ms overlapping gunzip 713 ms, parse 3223 ms, sort 0 ms, write 0 ms, index 610 ms: 6 candidates, 76362 repo-hours, 732 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:57:09Z [load_day 2024-03-03] 2024-03-03 hour 15: 226812 events in 0 files, snapshot none (task 5045 ms: download 2607 ms overlapping gunzip 730 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 565 ms: 2 candidates, 81306 repo-hours, 915 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:57:14Z [load_day 2024-03-03] 2024-03-03 hour 16: 216961 events in 0 files, snapshot none (task 4947 ms: download 2551 ms overlapping gunzip 701 ms, parse 2977 ms, sort 0 ms, write 0 ms, index 541 ms: 5 candidates, 73189 repo-hours, 913 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:57:14Z [load_day 2024-03-03] 2024-03-03 hour 17: 209425 events in 0 files, snapshot none (task 4647 ms: download 2440 ms overlapping gunzip 605 ms, parse 2719 ms, sort 0 ms, write 0 ms, index 500 ms: 3 candidates, 68888 repo-hours, 853 releases; waiting 532 ms; commit 0 ms)
2026-11-08T04:57:21Z [load_day 2024-03-03] 2024-03-03 hour 18: 217817 events in 0 files, snapshot none (task 6225 ms: download 3523 ms overlapping gunzip 822 ms, parse 3974 ms, sort 0 ms, write 0 ms, index 602 ms: 4 candidates, 76766 repo-hours, 1044 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:57:21Z [load_day 2024-03-03] 2024-03-03 hour 19: 202230 events in 0 files, snapshot none (task 5564 ms: download 3272 ms overlapping gunzip 844 ms, parse 3534 ms, sort 0 ms, write 0 ms, index 433 ms: 4 candidates, 62937 repo-hours, 859 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:57:27Z [load_day 2024-03-03] 2024-03-03 hour 20: 194086 events in 0 files, snapshot none (task 5748 ms: download 3358 ms overlapping gunzip 863 ms, parse 3763 ms, sort 0 ms, write 0 ms, index 425 ms: 10 candidates, 61681 repo-hours, 810 releases; waiting 462 ms; commit 0 ms)
2026-11-08T04:57:27Z [load_day 2024-03-03] 2024-03-03 hour 21: 187612 events in 0 files, snapshot none (task 5684 ms: download 3211 ms overlapping gunzip 840 ms, parse 3591 ms, sort 0 ms, write 0 ms, index 452 ms: 2 candidates, 58739 repo-hours, 880 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:57:33Z [load_day 2024-03-03] 2024-03-03 hour 22: 179206 events in 0 files, snapshot none (task 5803 ms: download 3303 ms overlapping gunzip 877 ms, parse 3753 ms, sort 0 ms, write 0 ms, index 368 ms: 5 candidates, 54010 repo-hours, 877 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:57:33Z [load_day 2024-03-03] 2024-03-03 hour 23: 167810 events in 0 files, snapshot none (task 5713 ms: download 2800 ms overlapping gunzip 788 ms, parse 3617 ms, sort 0 ms, write 0 ms, index 488 ms: 4 candidates, 52326 repo-hours, 709 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:57:40Z [load_day 2024-03-03] 2024-03-03: repo_hour merged from 24 files to 1 (1570667 rows, 7175 ms)
2026-11-08T04:57:42Z [load_day 2024-03-03] 2024-03-03: index committed in 9368 ms (23 + 1 + 24 files)
2026-11-08T04:57:42Z [load_day 2024-03-03] 2024-03-03: 4614084 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:57:42Z [load_day 2024-03-03] attempt 1 succeeded