orcaLog in

Runs · run 2663

load_day 2024-07-01, attempt 1 succeeded

Host
73ccef5e07c2:144000
Started
2026-11-08T06:47:21Z
Ended
2026-11-08T06:49:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
735 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
210.4 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2663/load_day/2024-07-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:47:21Z [load_day 2024-07-01] attempt 1 started
2026-11-08T06:47:22Z [load_day 2024-07-01] 2024-07-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:47:33Z [load_day 2024-07-01] 2024-07-01 hour 0: 166667 events in 0 files, snapshot none (task 10886 ms: download 4465 ms overlapping gunzip 1104 ms, parse 4427 ms, sort 0 ms, write 0 ms, index 4604 ms: 8 candidates, 80671 repo-hours, 2275 releases; waiting 481 ms; commit 0 ms)
2026-11-08T06:47:33Z [load_day 2024-07-01] 2024-07-01 hour 1: 194562 events in 0 files, snapshot none (task 10923 ms: download 4842 ms overlapping gunzip 1190 ms, parse 4639 ms, sort 0 ms, write 0 ms, index 4265 ms: 8 candidates, 102143 repo-hours, 2382 releases; waiting 502 ms; commit 0 ms)
2026-11-08T06:47:42Z [load_day 2024-07-01] 2024-07-01 hour 2: 173019 events in 0 files, snapshot none (task 7530 ms: download 5315 ms overlapping gunzip 1259 ms, parse 5002 ms, sort 0 ms, write 0 ms, index 525 ms: 8 candidates, 70929 repo-hours, 2225 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:47:42Z [load_day 2024-07-01] 2024-07-01 hour 3: 187229 events in 0 files, snapshot none (task 7271 ms: download 4904 ms overlapping gunzip 1216 ms, parse 4664 ms, sort 0 ms, write 0 ms, index 566 ms: 9 candidates, 75077 repo-hours, 6701 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:47:48Z [load_day 2024-07-01] 2024-07-01 hour 4: 163284 events in 0 files, snapshot none (task 6165 ms: download 3987 ms overlapping gunzip 1017 ms, parse 3958 ms, sort 0 ms, write 0 ms, index 421 ms: 14 candidates, 60253 repo-hours, 2146 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:47:49Z [load_day 2024-07-01] 2024-07-01 hour 5: 176484 events in 0 files, snapshot none (task 7030 ms: download 4646 ms overlapping gunzip 1158 ms, parse 4461 ms, sort 0 ms, write 0 ms, index 599 ms: 14 candidates, 67926 repo-hours, 2186 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:47:56Z [load_day 2024-07-01] 2024-07-01 hour 6: 211360 events in 0 files, snapshot none (task 7564 ms: download 5129 ms overlapping gunzip 1212 ms, parse 4678 ms, sort 0 ms, write 0 ms, index 659 ms: 16 candidates, 92850 repo-hours, 2271 releases; waiting 722 ms; commit 0 ms)
2026-11-08T06:47:58Z [load_day 2024-07-01] 2024-07-01 hour 7: 216963 events in 0 files, snapshot none (task 7975 ms: download 5506 ms overlapping gunzip 1350 ms, parse 5307 ms, sort 0 ms, write 0 ms, index 690 ms: 18 candidates, 86706 repo-hours, 2245 releases; waiting 365 ms; commit 0 ms)
2026-11-08T06:48:07Z [load_day 2024-07-01] 2024-07-01 hour 8: 228407 events in 0 files, snapshot none (task 10542 ms: download 7586 ms overlapping gunzip 1748 ms, parse 6872 ms, sort 0 ms, write 0 ms, index 683 ms: 16 candidates, 93992 repo-hours, 2442 releases; waiting 496 ms; commit 0 ms)
2026-11-08T06:48:08Z [load_day 2024-07-01] 2024-07-01 hour 9: 230361 events in 0 files, snapshot none (task 10202 ms: download 7506 ms overlapping gunzip 1732 ms, parse 6847 ms, sort 0 ms, write 0 ms, index 778 ms: 9 candidates, 99774 repo-hours, 2326 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:48:18Z [load_day 2024-07-01] 2024-07-01 hour 10: 224477 events in 0 files, snapshot none (task 10059 ms: download 6851 ms overlapping gunzip 1647 ms, parse 6850 ms, sort 0 ms, write 0 ms, index 1088 ms: 9 candidates, 91856 repo-hours, 2392 releases; waiting 213 ms; commit 0 ms)
2026-11-08T06:48:18Z [load_day 2024-07-01] 2024-07-01 hour 11: 223309 events in 0 files, snapshot none (task 9178 ms: download 6103 ms overlapping gunzip 1534 ms, parse 6296 ms, sort 0 ms, write 0 ms, index 838 ms: 13 candidates, 87752 repo-hours, 2241 releases; waiting 228 ms; commit 0 ms)
2026-11-08T06:48:30Z [load_day 2024-07-01] 2024-07-01 hour 12: 269497 events in 0 files, snapshot none (task 11562 ms: download 8228 ms overlapping gunzip 1816 ms, parse 7724 ms, sort 0 ms, write 0 ms, index 1030 ms: 14 candidates, 132063 repo-hours, 2257 releases; waiting 672 ms; commit 0 ms)
2026-11-08T06:48:30Z [load_day 2024-07-01] 2024-07-01 hour 13: 257849 events in 0 files, snapshot none (task 11693 ms: download 8850 ms overlapping gunzip 1930 ms, parse 7983 ms, sort 0 ms, write 0 ms, index 908 ms: 12 candidates, 119306 repo-hours, 2304 releases; waiting 526 ms; commit 0 ms)
2026-11-08T06:48:42Z [load_day 2024-07-01] 2024-07-01 hour 14: 251748 events in 0 files, snapshot none (task 11911 ms: download 8886 ms overlapping gunzip 2025 ms, parse 8064 ms, sort 0 ms, write 0 ms, index 1048 ms: 17 candidates, 107913 repo-hours, 2453 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:48:42Z [load_day 2024-07-01] 2024-07-01 hour 15: 254744 events in 0 files, snapshot none (task 11515 ms: download 8743 ms overlapping gunzip 1915 ms, parse 7838 ms, sort 0 ms, write 0 ms, index 944 ms: 18 candidates, 115801 repo-hours, 2432 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:48:54Z [load_day 2024-07-01] 2024-07-01 hour 16: 235259 events in 0 files, snapshot none (task 11579 ms: download 8818 ms overlapping gunzip 1698 ms, parse 6701 ms, sort 0 ms, write 0 ms, index 818 ms: 12 candidates, 99960 repo-hours, 2348 releases; waiting 2118 ms; commit 0 ms)
2026-11-08T06:48:54Z [load_day 2024-07-01] 2024-07-01 hour 17: 224180 events in 0 files, snapshot none (task 9449 ms: download 6207 ms overlapping gunzip 1446 ms, parse 6118 ms, sort 0 ms, write 0 ms, index 1145 ms: 20 candidates, 91550 repo-hours, 2269 releases; waiting 472 ms; commit 0 ms)
2026-11-08T06:49:06Z [load_day 2024-07-01] 2024-07-01 hour 18: 236610 events in 0 files, snapshot none (task 10852 ms: download 7583 ms overlapping gunzip 1785 ms, parse 6877 ms, sort 0 ms, write 0 ms, index 998 ms: 23 candidates, 105359 repo-hours, 2415 releases; waiting 823 ms; commit 0 ms)
2026-11-08T06:49:06Z [load_day 2024-07-01] 2024-07-01 hour 19: 215306 events in 0 files, snapshot none (task 10360 ms: download 7227 ms overlapping gunzip 1751 ms, parse 6877 ms, sort 0 ms, write 0 ms, index 993 ms: 12 candidates, 85079 repo-hours, 2204 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:49:16Z [load_day 2024-07-01] 2024-07-01 hour 20: 206704 events in 0 files, snapshot none (task 9827 ms: download 7280 ms overlapping gunzip 1696 ms, parse 6640 ms, sort 0 ms, write 0 ms, index 675 ms: 20 candidates, 82612 repo-hours, 2143 releases; waiting 499 ms; commit 0 ms)
2026-11-08T06:49:16Z [load_day 2024-07-01] 2024-07-01 hour 21: 203407 events in 0 files, snapshot none (task 9258 ms: download 6333 ms overlapping gunzip 1563 ms, parse 6175 ms, sort 0 ms, write 0 ms, index 671 ms: 16 candidates, 88483 repo-hours, 2412 releases; waiting 542 ms; commit 0 ms)
2026-11-08T06:49:24Z [load_day 2024-07-01] 2024-07-01 hour 22: 169608 events in 0 files, snapshot none (task 7194 ms: download 4824 ms overlapping gunzip 1190 ms, parse 4740 ms, sort 0 ms, write 0 ms, index 424 ms: 22 candidates, 61006 repo-hours, 2099 releases; waiting 529 ms; commit 0 ms)
2026-11-08T06:49:24Z [load_day 2024-07-01] 2024-07-01 hour 23: 172181 events in 0 files, snapshot none (task 7225 ms: download 5234 ms overlapping gunzip 1203 ms, parse 4662 ms, sort 0 ms, write 0 ms, index 531 ms: 14 candidates, 67107 repo-hours, 2003 releases; waiting 536 ms; commit 0 ms)
2026-11-08T06:49:33Z [load_day 2024-07-01] 2024-07-01: repo_hour merged from 24 files to 1 (2166168 rows, 9269 ms)
2026-11-08T06:49:36Z [load_day 2024-07-01] 2024-07-01: index committed in 11813 ms (24 + 1 + 24 files)
2026-11-08T06:49:36Z [load_day 2024-07-01] 2024-07-01: 5093215 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:49:36Z [load_day 2024-07-01] attempt 1 succeeded