orcaLog in

Runs · run 2144

load_day 2024-02-29, attempt 1 succeeded

Host
73ccef5e07c2:93073
Started
2026-11-08T04:53:50Z
Ended
2026-11-08T04:55:48Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
743 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
182.1 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2144/load_day/2024-02-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:53:50Z [load_day 2024-02-29] attempt 1 started
2026-11-08T04:53:51Z [load_day 2024-02-29] 2024-02-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:53:59Z [load_day 2024-02-29] 2024-02-29 hour 0: 227526 events in 0 files, snapshot none (task 7901 ms: download 5256 ms overlapping gunzip 1227 ms, parse 5157 ms, sort 0 ms, write 0 ms, index 714 ms: 7 candidates, 100159 repo-hours, 1083 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:53:59Z [load_day 2024-02-29] 2024-02-29 hour 1: 227328 events in 0 files, snapshot none (task 7952 ms: download 5357 ms overlapping gunzip 1236 ms, parse 5199 ms, sort 0 ms, write 0 ms, index 716 ms: 8 candidates, 101817 repo-hours, 925 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:54:07Z [load_day 2024-02-29] 2024-02-29 hour 2: 196119 events in 0 files, snapshot none (task 7315 ms: download 4586 ms overlapping gunzip 1153 ms, parse 4854 ms, sort 0 ms, write 0 ms, index 544 ms: 8 candidates, 68665 repo-hours, 720 releases; waiting 476 ms; commit 0 ms)
2026-11-08T04:54:07Z [load_day 2024-02-29] 2024-02-29 hour 3: 199785 events in 0 files, snapshot none (task 7027 ms: download 4464 ms overlapping gunzip 1122 ms, parse 4612 ms, sort 0 ms, write 0 ms, index 574 ms: 8 candidates, 65782 repo-hours, 939 releases; waiting 459 ms; commit 0 ms)
2026-11-08T04:54:14Z [load_day 2024-02-29] 2024-02-29 hour 4: 198130 events in 0 files, snapshot none (task 7074 ms: download 4262 ms overlapping gunzip 1105 ms, parse 4710 ms, sort 0 ms, write 0 ms, index 441 ms: 7 candidates, 61856 repo-hours, 555 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:54:15Z [load_day 2024-02-29] 2024-02-29 hour 5: 206767 events in 0 files, snapshot none (task 7172 ms: download 4389 ms overlapping gunzip 1156 ms, parse 4764 ms, sort 0 ms, write 0 ms, index 507 ms: 9 candidates, 66741 repo-hours, 622 releases; waiting 203 ms; commit 0 ms)
2026-11-08T04:54:20Z [load_day 2024-02-29] 2024-02-29 hour 6: 225076 events in 0 files, snapshot none (task 5704 ms: download 3598 ms overlapping gunzip 845 ms, parse 3397 ms, sort 0 ms, write 0 ms, index 650 ms: 5 candidates, 82285 repo-hours, 805 releases; waiting 568 ms; commit 0 ms)
2026-11-08T04:54:21Z [load_day 2024-02-29] 2024-02-29 hour 7: 227293 events in 0 files, snapshot none (task 6355 ms: download 3898 ms overlapping gunzip 947 ms, parse 4024 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 80147 repo-hours, 994 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:54:27Z [load_day 2024-02-29] 2024-02-29 hour 8: 232504 events in 0 files, snapshot none (task 6423 ms: download 3950 ms overlapping gunzip 953 ms, parse 4000 ms, sort 0 ms, write 0 ms, index 685 ms: 15 candidates, 87528 repo-hours, 948 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:54:29Z [load_day 2024-02-29] 2024-02-29 hour 9: 239319 events in 0 files, snapshot none (task 6718 ms: download 4252 ms overlapping gunzip 1044 ms, parse 4304 ms, sort 0 ms, write 0 ms, index 623 ms: 7 candidates, 91105 repo-hours, 1169 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:54:37Z [load_day 2024-02-29] 2024-02-29 hour 10: 234566 events in 0 files, snapshot none (task 8790 ms: download 5786 ms overlapping gunzip 1388 ms, parse 5894 ms, sort 0 ms, write 0 ms, index 725 ms: 10 candidates, 88719 repo-hours, 1101 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:54:37Z [load_day 2024-02-29] 2024-02-29 hour 11: 203965 events in 0 files, snapshot none (task 8220 ms: download 5325 ms overlapping gunzip 1332 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 636 ms: 14 candidates, 76692 repo-hours, 962 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:54:47Z [load_day 2024-02-29] 2024-02-29 hour 12: 300399 events in 0 files, snapshot none (task 10168 ms: download 7010 ms overlapping gunzip 1541 ms, parse 6979 ms, sort 0 ms, write 0 ms, index 837 ms: 11 candidates, 118823 repo-hours, 1136 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:54:48Z [load_day 2024-02-29] 2024-02-29 hour 13: 273118 events in 0 files, snapshot none (task 10417 ms: download 7412 ms overlapping gunzip 1631 ms, parse 6987 ms, sort 0 ms, write 0 ms, index 1043 ms: 7 candidates, 113887 repo-hours, 1231 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:55:00Z [load_day 2024-02-29] 2024-02-29 hour 14: 272545 events in 0 files, snapshot none (task 11624 ms: download 7717 ms overlapping gunzip 1887 ms, parse 7917 ms, sort 0 ms, write 0 ms, index 1052 ms: 11 candidates, 102777 repo-hours, 1372 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:55:00Z [load_day 2024-02-29] 2024-02-29 hour 15: 272616 events in 0 files, snapshot none (task 11018 ms: download 7457 ms overlapping gunzip 1788 ms, parse 7355 ms, sort 0 ms, write 0 ms, index 1046 ms: 14 candidates, 104914 repo-hours, 1232 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:55:10Z [load_day 2024-02-29] 2024-02-29 hour 16: 274308 events in 0 files, snapshot none (task 9702 ms: download 6591 ms overlapping gunzip 1525 ms, parse 6476 ms, sort 0 ms, write 0 ms, index 872 ms: 14 candidates, 100964 repo-hours, 1215 releases; waiting 353 ms; commit 0 ms)
2026-11-08T04:55:10Z [load_day 2024-02-29] 2024-02-29 hour 17: 263100 events in 0 files, snapshot none (task 9960 ms: download 7037 ms overlapping gunzip 1595 ms, parse 6862 ms, sort 0 ms, write 0 ms, index 780 ms: 16 candidates, 95630 repo-hours, 1133 releases; waiting 475 ms; commit 0 ms)
2026-11-08T04:55:18Z [load_day 2024-02-29] 2024-02-29 hour 18: 256812 events in 0 files, snapshot none (task 8333 ms: download 5144 ms overlapping gunzip 1207 ms, parse 5504 ms, sort 0 ms, write 0 ms, index 806 ms: 8 candidates, 96290 repo-hours, 1501 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:55:19Z [load_day 2024-02-29] 2024-02-29 hour 19: 252037 events in 0 files, snapshot none (task 8611 ms: download 5491 ms overlapping gunzip 1268 ms, parse 5707 ms, sort 0 ms, write 0 ms, index 719 ms: 13 candidates, 96026 repo-hours, 1368 releases; waiting 661 ms; commit 0 ms)
2026-11-08T04:55:27Z [load_day 2024-02-29] 2024-02-29 hour 20: 260954 events in 0 files, snapshot none (task 8531 ms: download 5619 ms overlapping gunzip 1284 ms, parse 5639 ms, sort 0 ms, write 0 ms, index 856 ms: 12 candidates, 94129 repo-hours, 1019 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:55:27Z [load_day 2024-02-29] 2024-02-29 hour 21: 221805 events in 0 files, snapshot none (task 7324 ms: download 4247 ms overlapping gunzip 1141 ms, parse 4756 ms, sort 0 ms, write 0 ms, index 668 ms: 8 candidates, 73506 repo-hours, 1141 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:55:35Z [load_day 2024-02-29] 2024-02-29 hour 22: 211826 events in 0 files, snapshot none (task 7314 ms: download 4466 ms overlapping gunzip 1098 ms, parse 4668 ms, sort 0 ms, write 0 ms, index 762 ms: 9 candidates, 67563 repo-hours, 1055 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:55:35Z [load_day 2024-02-29] 2024-02-29 hour 23: 196719 events in 0 files, snapshot none (task 7028 ms: download 3484 ms overlapping gunzip 1056 ms, parse 4162 ms, sort 0 ms, write 0 ms, index 592 ms: 10 candidates, 63249 repo-hours, 854 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:55:45Z [load_day 2024-02-29] 2024-02-29: repo_hour merged from 24 files to 1 (2099254 rows, 9461 ms)
2026-11-08T04:55:48Z [load_day 2024-02-29] 2024-02-29: index committed in 12809 ms (24 + 1 + 24 files)
2026-11-08T04:55:48Z [load_day 2024-02-29] 2024-02-29: 5674617 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:55:48Z [load_day 2024-02-29] attempt 1 succeeded