orcaLog in

Runs · run 2667

load_day 2024-07-02, attempt 1 succeeded

Host
73ccef5e07c2:144280
Started
2026-11-08T06:47:58Z
Ended
2026-11-08T06:49:57Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
723 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
188.4 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2667/load_day/2024-07-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:47:58Z [load_day 2024-07-02] attempt 1 started
2026-11-08T06:47:58Z [load_day 2024-07-02] 2024-07-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:48:07Z [load_day 2024-07-02] 2024-07-02 hour 0: 193516 events in 0 files, snapshot none (task 7769 ms: download 4836 ms overlapping gunzip 1200 ms, parse 4876 ms, sort 0 ms, write 0 ms, index 757 ms: 13 candidates, 97754 repo-hours, 2261 releases; waiting 538 ms; commit 0 ms)
2026-11-08T06:48:07Z [load_day 2024-07-02] 2024-07-02 hour 1: 198338 events in 0 files, snapshot none (task 7690 ms: download 4222 ms overlapping gunzip 1120 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 994 ms: 19 candidates, 110750 repo-hours, 2028 releases; waiting 447 ms; commit 0 ms)
2026-11-08T06:48:14Z [load_day 2024-07-02] 2024-07-02 hour 2: 157721 events in 0 files, snapshot none (task 6650 ms: download 3396 ms overlapping gunzip 981 ms, parse 4024 ms, sort 0 ms, write 0 ms, index 880 ms: 9 candidates, 67790 repo-hours, 2004 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:48:14Z [load_day 2024-07-02] 2024-07-02 hour 3: 181205 events in 0 files, snapshot none (task 6711 ms: download 3818 ms overlapping gunzip 959 ms, parse 4299 ms, sort 0 ms, write 0 ms, index 656 ms: 6 candidates, 79692 repo-hours, 6765 releases; waiting 529 ms; commit 0 ms)
2026-11-08T06:48:20Z [load_day 2024-07-02] 2024-07-02 hour 4: 153131 events in 0 files, snapshot none (task 5425 ms: download 2822 ms overlapping gunzip 754 ms, parse 3291 ms, sort 0 ms, write 0 ms, index 482 ms: 4 candidates, 61433 repo-hours, 1879 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:48:21Z [load_day 2024-07-02] 2024-07-02 hour 5: 172953 events in 0 files, snapshot none (task 6526 ms: download 3952 ms overlapping gunzip 1005 ms, parse 4031 ms, sort 0 ms, write 0 ms, index 671 ms: 14 candidates, 69201 repo-hours, 2105 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:48:29Z [load_day 2024-07-02] 2024-07-02 hour 6: 206053 events in 0 files, snapshot none (task 8778 ms: download 5546 ms overlapping gunzip 1357 ms, parse 5779 ms, sort 0 ms, write 0 ms, index 856 ms: 13 candidates, 96477 repo-hours, 2192 releases; waiting 499 ms; commit 0 ms)
2026-11-08T06:48:31Z [load_day 2024-07-02] 2024-07-02 hour 7: 212986 events in 0 files, snapshot none (task 9085 ms: download 6513 ms overlapping gunzip 1450 ms, parse 6014 ms, sort 0 ms, write 0 ms, index 628 ms: 10 candidates, 87615 repo-hours, 2284 releases; waiting 638 ms; commit 0 ms)
2026-11-08T06:48:40Z [load_day 2024-07-02] 2024-07-02 hour 8: 237760 events in 0 files, snapshot none (task 10639 ms: download 6692 ms overlapping gunzip 1785 ms, parse 6968 ms, sort 0 ms, write 0 ms, index 1124 ms: 12 candidates, 98771 repo-hours, 2348 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:48:42Z [load_day 2024-07-02] 2024-07-02 hour 9: 244185 events in 0 files, snapshot none (task 11264 ms: download 8395 ms overlapping gunzip 1795 ms, parse 7702 ms, sort 0 ms, write 0 ms, index 955 ms: 17 candidates, 105878 repo-hours, 2440 releases; waiting 503 ms; commit 0 ms)
2026-11-08T06:48:49Z [load_day 2024-07-02] 2024-07-02 hour 10: 224985 events in 0 files, snapshot none (task 8710 ms: download 5405 ms overlapping gunzip 1406 ms, parse 5620 ms, sort 0 ms, write 0 ms, index 923 ms: 9 candidates, 93820 repo-hours, 2320 releases; waiting 491 ms; commit 0 ms)
2026-11-08T06:48:51Z [load_day 2024-07-02] 2024-07-02 hour 11: 226856 events in 0 files, snapshot none (task 8751 ms: download 5769 ms overlapping gunzip 1306 ms, parse 5803 ms, sort 0 ms, write 0 ms, index 973 ms: 6 candidates, 98858 repo-hours, 2199 releases; waiting 369 ms; commit 0 ms)
2026-11-08T06:48:59Z [load_day 2024-07-02] 2024-07-02 hour 12: 288845 events in 0 files, snapshot none (task 9342 ms: download 5287 ms overlapping gunzip 1413 ms, parse 5677 ms, sort 0 ms, write 0 ms, index 1488 ms: 19 candidates, 151326 repo-hours, 2327 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:49:03Z [load_day 2024-07-02] 2024-07-02 hour 13: 259682 events in 0 files, snapshot none (task 10761 ms: download 6682 ms overlapping gunzip 1525 ms, parse 6474 ms, sort 0 ms, write 0 ms, index 1901 ms: 15 candidates, 123475 repo-hours, 2386 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:49:11Z [load_day 2024-07-02] 2024-07-02 hour 14: 261703 events in 0 files, snapshot none (task 11401 ms: download 6848 ms overlapping gunzip 1700 ms, parse 7211 ms, sort 0 ms, write 0 ms, index 1596 ms: 10 candidates, 127997 repo-hours, 2279 releases; waiting 522 ms; commit 0 ms)
2026-11-08T06:49:14Z [load_day 2024-07-02] 2024-07-02 hour 15: 258655 events in 0 files, snapshot none (task 11019 ms: download 7273 ms overlapping gunzip 1759 ms, parse 7423 ms, sort 0 ms, write 0 ms, index 1361 ms: 30 candidates, 118214 repo-hours, 2362 releases; waiting 259 ms; commit 0 ms)
2026-11-08T06:49:20Z [load_day 2024-07-02] 2024-07-02 hour 16: 232885 events in 0 files, snapshot none (task 8391 ms: download 5050 ms overlapping gunzip 1325 ms, parse 5330 ms, sort 0 ms, write 0 ms, index 944 ms: 9 candidates, 99546 repo-hours, 2258 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:49:24Z [load_day 2024-07-02] 2024-07-02 hour 17: 217842 events in 0 files, snapshot none (task 9165 ms: download 6243 ms overlapping gunzip 1350 ms, parse 5680 ms, sort 0 ms, write 0 ms, index 759 ms: 9 candidates, 90467 repo-hours, 2009 releases; waiting 1086 ms; commit 0 ms)
2026-11-08T06:49:28Z [load_day 2024-07-02] 2024-07-02 hour 18: 228210 events in 0 files, snapshot none (task 7557 ms: download 4915 ms overlapping gunzip 1156 ms, parse 4831 ms, sort 0 ms, write 0 ms, index 757 ms: 8 candidates, 103178 repo-hours, 2210 releases; waiting 475 ms; commit 0 ms)
2026-11-08T06:49:31Z [load_day 2024-07-02] 2024-07-02 hour 19: 196876 events in 0 files, snapshot none (task 6374 ms: download 3987 ms overlapping gunzip 986 ms, parse 4062 ms, sort 0 ms, write 0 ms, index 589 ms: 3 candidates, 77887 repo-hours, 2153 releases; waiting 471 ms; commit 0 ms)
2026-11-08T06:49:36Z [load_day 2024-07-02] 2024-07-02 hour 20: 191949 events in 0 files, snapshot none (task 6724 ms: download 4268 ms overlapping gunzip 1020 ms, parse 4291 ms, sort 0 ms, write 0 ms, index 578 ms: 10 candidates, 76050 repo-hours, 3013 releases; waiting 512 ms; commit 0 ms)
2026-11-08T06:49:37Z [load_day 2024-07-02] 2024-07-02 hour 21: 186481 events in 0 files, snapshot none (task 5907 ms: download 3479 ms overlapping gunzip 891 ms, parse 3653 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 75511 repo-hours, 3179 releases; waiting 491 ms; commit 0 ms)
2026-11-08T06:49:44Z [load_day 2024-07-02] 2024-07-02 hour 22: 160195 events in 0 files, snapshot none (task 7716 ms: download 4973 ms overlapping gunzip 1173 ms, parse 4649 ms, sort 0 ms, write 0 ms, index 470 ms: 15 candidates, 59964 repo-hours, 3091 releases; waiting 1153 ms; commit 0 ms)
2026-11-08T06:49:45Z [load_day 2024-07-02] 2024-07-02 hour 23: 161248 events in 0 files, snapshot none (task 6817 ms: download 4063 ms overlapping gunzip 1083 ms, parse 4525 ms, sort 0 ms, write 0 ms, index 464 ms: 7 candidates, 65732 repo-hours, 2245 releases; waiting 490 ms; commit 0 ms)
2026-11-08T06:49:55Z [load_day 2024-07-02] 2024-07-02: repo_hour merged from 24 files to 1 (2237386 rows, 10016 ms)
2026-11-08T06:49:57Z [load_day 2024-07-02] 2024-07-02: index committed in 12381 ms (24 + 1 + 24 files)
2026-11-08T06:49:57Z [load_day 2024-07-02] 2024-07-02: 5054260 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:49:57Z [load_day 2024-07-02] attempt 1 succeeded