orcaLog in

Runs · run 2099

load_day 2024-02-18, attempt 1 succeeded

Host
73ccef5e07c2:88164
Started
2026-11-08T04:42:34Z
Ended
2026-11-08T04:43:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
605 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
126.8 s, up to 3.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2099/load_day/2024-02-18/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:42:34Z [load_day 2024-02-18] attempt 1 started
2026-11-08T04:42:35Z [load_day 2024-02-18] 2024-02-18: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:42:40Z [load_day 2024-02-18] 2024-02-18 hour 0: 213697 events in 0 files, snapshot none (task 4753 ms: download 2264 ms overlapping gunzip 604 ms, parse 2847 ms, sort 0 ms, write 0 ms, index 580 ms: 7 candidates, 76334 repo-hours, 1139 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:42:40Z [load_day 2024-02-18] 2024-02-18 hour 1: 224096 events in 0 files, snapshot none (task 4736 ms: download 2177 ms overlapping gunzip 608 ms, parse 2832 ms, sort 0 ms, write 0 ms, index 537 ms: 17 candidates, 82749 repo-hours, 737 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:42:45Z [load_day 2024-02-18] 2024-02-18 hour 2: 196744 events in 0 files, snapshot none (task 4490 ms: download 2192 ms overlapping gunzip 612 ms, parse 2725 ms, sort 0 ms, write 0 ms, index 383 ms: 6 candidates, 49268 repo-hours, 585 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:42:46Z [load_day 2024-02-18] 2024-02-18 hour 3: 200021 events in 0 files, snapshot none (task 4796 ms: download 2276 ms overlapping gunzip 635 ms, parse 3007 ms, sort 0 ms, write 0 ms, index 406 ms: 2 candidates, 49000 repo-hours, 706 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:42:50Z [load_day 2024-02-18] 2024-02-18 hour 4: 200619 events in 0 files, snapshot none (task 4433 ms: download 1630 ms overlapping gunzip 627 ms, parse 2973 ms, sort 0 ms, write 0 ms, index 373 ms: 6 candidates, 45099 repo-hours, 520 releases; waiting 179 ms; commit 0 ms)
2026-11-08T04:42:51Z [load_day 2024-02-18] 2024-02-18 hour 5: 203815 events in 0 files, snapshot none (task 4620 ms: download 2793 ms overlapping gunzip 638 ms, parse 2845 ms, sort 0 ms, write 0 ms, index 348 ms: 6 candidates, 49255 repo-hours, 530 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:42:55Z [load_day 2024-02-18] 2024-02-18 hour 6: 209910 events in 0 files, snapshot none (task 4185 ms: download 2109 ms overlapping gunzip 557 ms, parse 2477 ms, sort 0 ms, write 0 ms, index 435 ms: 6 candidates, 61894 repo-hours, 704 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:42:56Z [load_day 2024-02-18] 2024-02-18 hour 7: 197952 events in 0 files, snapshot none (task 4411 ms: download 2637 ms overlapping gunzip 603 ms, parse 2601 ms, sort 0 ms, write 0 ms, index 417 ms: 3 candidates, 55026 repo-hours, 603 releases; waiting 554 ms; commit 0 ms)
2026-11-08T04:43:00Z [load_day 2024-02-18] 2024-02-18 hour 8: 201647 events in 0 files, snapshot none (task 4543 ms: download 2024 ms overlapping gunzip 641 ms, parse 2691 ms, sort 0 ms, write 0 ms, index 481 ms: 6 candidates, 58367 repo-hours, 641 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:43:01Z [load_day 2024-02-18] 2024-02-18 hour 9: 211072 events in 0 files, snapshot none (task 4571 ms: download 2499 ms overlapping gunzip 635 ms, parse 2718 ms, sort 0 ms, write 0 ms, index 463 ms: 6 candidates, 61387 repo-hours, 808 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:43:05Z [load_day 2024-02-18] 2024-02-18 hour 10: 211159 events in 0 files, snapshot none (task 4977 ms: download 3413 ms overlapping gunzip 638 ms, parse 2798 ms, sort 0 ms, write 0 ms, index 439 ms: 1 candidates, 61351 repo-hours, 609 releases; waiting 828 ms; commit 0 ms)
2026-11-08T04:43:06Z [load_day 2024-02-18] 2024-02-18 hour 11: 207990 events in 0 files, snapshot none (task 4454 ms: download 2115 ms overlapping gunzip 604 ms, parse 2699 ms, sort 0 ms, write 0 ms, index 436 ms: 7 candidates, 58798 repo-hours, 627 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:43:11Z [load_day 2024-02-18] 2024-02-18 hour 12: 288706 events in 0 files, snapshot none (task 5837 ms: download 2936 ms overlapping gunzip 738 ms, parse 3571 ms, sort 0 ms, write 0 ms, index 728 ms: 7 candidates, 94140 repo-hours, 850 releases; waiting 380 ms; commit 0 ms)
2026-11-08T04:43:11Z [load_day 2024-02-18] 2024-02-18 hour 13: 247414 events in 0 files, snapshot none (task 4885 ms: download 2429 ms overlapping gunzip 640 ms, parse 2912 ms, sort 0 ms, write 0 ms, index 596 ms: 7 candidates, 82138 repo-hours, 715 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:43:17Z [load_day 2024-02-18] 2024-02-18 hour 14: 241854 events in 0 files, snapshot none (task 5032 ms: download 2749 ms overlapping gunzip 691 ms, parse 3036 ms, sort 0 ms, write 0 ms, index 518 ms: 7 candidates, 70020 repo-hours, 879 releases; waiting 554 ms; commit 0 ms)
2026-11-08T04:43:17Z [load_day 2024-02-18] 2024-02-18 hour 15: 246176 events in 0 files, snapshot none (task 5307 ms: download 2838 ms overlapping gunzip 742 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 548 ms: 5 candidates, 72723 repo-hours, 970 releases; waiting 498 ms; commit 0 ms)
2026-11-08T04:43:23Z [load_day 2024-02-18] 2024-02-18 hour 16: 248802 events in 0 files, snapshot none (task 5514 ms: download 3081 ms overlapping gunzip 772 ms, parse 3410 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 71793 repo-hours, 804 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:43:23Z [load_day 2024-02-18] 2024-02-18 hour 17: 240343 events in 0 files, snapshot none (task 4961 ms: download 2505 ms overlapping gunzip 654 ms, parse 2971 ms, sort 0 ms, write 0 ms, index 543 ms: 4 candidates, 68788 repo-hours, 782 releases; waiting 540 ms; commit 0 ms)
2026-11-08T04:43:28Z [load_day 2024-02-18] 2024-02-18 hour 18: 247443 events in 0 files, snapshot none (task 4941 ms: download 2501 ms overlapping gunzip 668 ms, parse 2997 ms, sort 0 ms, write 0 ms, index 542 ms: 4 candidates, 75542 repo-hours, 1005 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:43:28Z [load_day 2024-02-18] 2024-02-18 hour 19: 221182 events in 0 files, snapshot none (task 4851 ms: download 2531 ms overlapping gunzip 670 ms, parse 2918 ms, sort 0 ms, write 0 ms, index 470 ms: 5 candidates, 62008 repo-hours, 740 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:43:34Z [load_day 2024-02-18] 2024-02-18 hour 20: 215611 events in 0 files, snapshot none (task 4969 ms: download 2406 ms overlapping gunzip 643 ms, parse 2993 ms, sort 0 ms, write 0 ms, index 543 ms: 2 candidates, 62551 repo-hours, 851 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:43:34Z [load_day 2024-02-18] 2024-02-18 hour 21: 231141 events in 0 files, snapshot none (task 5020 ms: download 2690 ms overlapping gunzip 663 ms, parse 3036 ms, sort 0 ms, write 0 ms, index 498 ms: 9 candidates, 67113 repo-hours, 880 releases; waiting 545 ms; commit 0 ms)
2026-11-08T04:43:38Z [load_day 2024-02-18] 2024-02-18 hour 22: 217417 events in 0 files, snapshot none (task 4423 ms: download 2176 ms overlapping gunzip 599 ms, parse 2708 ms, sort 0 ms, write 0 ms, index 391 ms: 2 candidates, 54754 repo-hours, 819 releases; waiting 467 ms; commit 0 ms)
2026-11-08T04:43:38Z [load_day 2024-02-18] 2024-02-18 hour 23: 177422 events in 0 files, snapshot none (task 4139 ms: download 1990 ms overlapping gunzip 534 ms, parse 2431 ms, sort 0 ms, write 0 ms, index 413 ms: 4 candidates, 49478 repo-hours, 594 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:43:46Z [load_day 2024-02-18] 2024-02-18: repo_hour merged from 24 files to 1 (1539576 rows, 7360 ms)
2026-11-08T04:43:48Z [load_day 2024-02-18] 2024-02-18: index committed in 9850 ms (24 + 1 + 24 files)
2026-11-08T04:43:48Z [load_day 2024-02-18] 2024-02-18: 5302233 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:43:48Z [load_day 2024-02-18] attempt 1 succeeded