orcaLog in

Runs · run 2226

load_day 2024-03-22, attempt 1 succeeded

Host
73ccef5e07c2:100563
Started
2026-11-08T05:15:37Z
Ended
2026-11-08T05:17:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
170.2 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2226/load_day/2024-03-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:15:37Z [load_day 2024-03-22] attempt 1 started
2026-11-08T05:15:38Z [load_day 2024-03-22] 2024-03-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:15:45Z [load_day 2024-03-22] 2024-03-22 hour 0: 194929 events in 0 files, snapshot none (task 5823 ms: download 3242 ms overlapping gunzip 833 ms, parse 3469 ms, sort 0 ms, write 0 ms, index 724 ms: 8 candidates, 101056 repo-hours, 1195 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:15:45Z [load_day 2024-03-22] 2024-03-22 hour 1: 196866 events in 0 files, snapshot none (task 5643 ms: download 3044 ms overlapping gunzip 782 ms, parse 3377 ms, sort 0 ms, write 0 ms, index 712 ms: 7 candidates, 102163 repo-hours, 750 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:15:51Z [load_day 2024-03-22] 2024-03-22 hour 2: 162622 events in 0 files, snapshot none (task 5878 ms: download 3328 ms overlapping gunzip 843 ms, parse 3458 ms, sort 0 ms, write 0 ms, index 588 ms: 9 candidates, 67517 repo-hours, 706 releases; waiting 563 ms; commit 0 ms)
2026-11-08T05:15:51Z [load_day 2024-03-22] 2024-03-22 hour 3: 160432 events in 0 files, snapshot none (task 5179 ms: download 2950 ms overlapping gunzip 839 ms, parse 3470 ms, sort 0 ms, write 0 ms, index 466 ms: 5 candidates, 65191 repo-hours, 872 releases; waiting 203 ms; commit 0 ms)
2026-11-08T05:15:56Z [load_day 2024-03-22] 2024-03-22 hour 4: 150952 events in 0 files, snapshot none (task 4653 ms: download 2855 ms overlapping gunzip 667 ms, parse 2724 ms, sort 0 ms, write 0 ms, index 453 ms: 3 candidates, 58608 repo-hours, 688 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:15:57Z [load_day 2024-03-22] 2024-03-22 hour 5: 158814 events in 0 files, snapshot none (task 5801 ms: download 4833 ms overlapping gunzip 762 ms, parse 2944 ms, sort 0 ms, write 0 ms, index 450 ms: 4 candidates, 63655 repo-hours, 660 releases; waiting 1357 ms; commit 0 ms)
2026-11-08T05:16:01Z [load_day 2024-03-22] 2024-03-22 hour 6: 184096 events in 0 files, snapshot none (task 5123 ms: download 2728 ms overlapping gunzip 741 ms, parse 3000 ms, sort 0 ms, write 0 ms, index 610 ms: 4 candidates, 78702 repo-hours, 804 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:16:05Z [load_day 2024-03-22] 2024-03-22 hour 7: 186380 events in 0 files, snapshot none (task 7761 ms: download 5522 ms overlapping gunzip 915 ms, parse 3722 ms, sort 0 ms, write 0 ms, index 1104 ms: 8 candidates, 76509 repo-hours, 831 releases; waiting 1588 ms; commit 0 ms)
2026-11-08T05:16:09Z [load_day 2024-03-22] 2024-03-22 hour 8: 204957 events in 0 files, snapshot none (task 7481 ms: download 4804 ms overlapping gunzip 1194 ms, parse 4863 ms, sort 0 ms, write 0 ms, index 681 ms: 10 candidates, 85998 repo-hours, 1033 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:16:14Z [load_day 2024-03-22] 2024-03-22 hour 9: 215807 events in 0 files, snapshot none (task 8161 ms: download 4752 ms overlapping gunzip 1272 ms, parse 5342 ms, sort 0 ms, write 0 ms, index 754 ms: 4 candidates, 89325 repo-hours, 1242 releases; waiting 483 ms; commit 0 ms)
2026-11-08T05:16:18Z [load_day 2024-03-22] 2024-03-22 hour 10: 218570 events in 0 files, snapshot none (task 8351 ms: download 4982 ms overlapping gunzip 1302 ms, parse 5292 ms, sort 0 ms, write 0 ms, index 951 ms: 9 candidates, 89592 repo-hours, 1077 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:16:22Z [load_day 2024-03-22] 2024-03-22 hour 11: 205930 events in 0 files, snapshot none (task 7902 ms: download 4817 ms overlapping gunzip 1159 ms, parse 4813 ms, sort 0 ms, write 0 ms, index 1178 ms: 4 candidates, 83361 repo-hours, 935 releases; waiting 448 ms; commit 0 ms)
2026-11-08T05:16:27Z [load_day 2024-03-22] 2024-03-22 hour 12: 276122 events in 0 files, snapshot none (task 8581 ms: download 5255 ms overlapping gunzip 1200 ms, parse 5173 ms, sort 0 ms, write 0 ms, index 1307 ms: 12 candidates, 121183 repo-hours, 1103 releases; waiting 629 ms; commit 0 ms)
2026-11-08T05:16:31Z [load_day 2024-03-22] 2024-03-22 hour 13: 240780 events in 0 files, snapshot none (task 8277 ms: download 5616 ms overlapping gunzip 1335 ms, parse 5363 ms, sort 0 ms, write 0 ms, index 760 ms: 6 candidates, 110118 repo-hours, 1147 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:16:37Z [load_day 2024-03-22] 2024-03-22 hour 14: 242261 events in 0 files, snapshot none (task 9379 ms: download 6599 ms overlapping gunzip 1614 ms, parse 6186 ms, sort 0 ms, write 0 ms, index 737 ms: 14 candidates, 99975 repo-hours, 1238 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:16:41Z [load_day 2024-03-22] 2024-03-22 hour 15: 234371 events in 0 files, snapshot none (task 9950 ms: download 6184 ms overlapping gunzip 1625 ms, parse 6645 ms, sort 0 ms, write 0 ms, index 901 ms: 11 candidates, 97814 repo-hours, 1363 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:16:47Z [load_day 2024-03-22] 2024-03-22 hour 16: 223590 events in 0 files, snapshot none (task 9426 ms: download 5601 ms overlapping gunzip 1539 ms, parse 6264 ms, sort 0 ms, write 0 ms, index 835 ms: 9 candidates, 92199 repo-hours, 1096 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:16:50Z [load_day 2024-03-22] 2024-03-22 hour 17: 213459 events in 0 files, snapshot none (task 7633 ms: download 5017 ms overlapping gunzip 1265 ms, parse 5093 ms, sort 0 ms, write 0 ms, index 838 ms: 15 candidates, 86928 repo-hours, 940 releases; waiting 169 ms; commit 0 ms)
2026-11-08T05:16:56Z [load_day 2024-03-22] 2024-03-22 hour 18: 218329 events in 0 files, snapshot none (task 8097 ms: download 4980 ms overlapping gunzip 1257 ms, parse 5016 ms, sort 0 ms, write 0 ms, index 907 ms: 8 candidates, 91943 repo-hours, 1167 releases; waiting 547 ms; commit 0 ms)
2026-11-08T05:16:59Z [load_day 2024-03-22] 2024-03-22 hour 19: 196935 events in 0 files, snapshot none (task 8606 ms: download 5005 ms overlapping gunzip 1279 ms, parse 5076 ms, sort 0 ms, write 0 ms, index 1154 ms: 7 candidates, 75485 repo-hours, 929 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:17:04Z [load_day 2024-03-22] 2024-03-22 hour 20: 188249 events in 0 files, snapshot none (task 7555 ms: download 4841 ms overlapping gunzip 1256 ms, parse 4716 ms, sort 0 ms, write 0 ms, index 529 ms: 4 candidates, 73533 repo-hours, 979 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:17:06Z [load_day 2024-03-22] 2024-03-22 hour 21: 177306 events in 0 files, snapshot none (task 6483 ms: download 3725 ms overlapping gunzip 969 ms, parse 3869 ms, sort 0 ms, write 0 ms, index 876 ms: 2 candidates, 66079 repo-hours, 1035 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:17:09Z [load_day 2024-03-22] 2024-03-22 hour 22: 167936 events in 0 files, snapshot none (task 5503 ms: download 3503 ms overlapping gunzip 816 ms, parse 3319 ms, sort 0 ms, write 0 ms, index 613 ms: 5 candidates, 61081 repo-hours, 987 releases; waiting 465 ms; commit 0 ms)
2026-11-08T05:17:11Z [load_day 2024-03-22] 2024-03-22 hour 23: 147463 events in 0 files, snapshot none (task 5199 ms: download 2910 ms overlapping gunzip 868 ms, parse 3172 ms, sort 0 ms, write 0 ms, index 415 ms: 4 candidates, 55682 repo-hours, 814 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:17:20Z [load_day 2024-03-22] 2024-03-22: repo_hour merged from 24 files to 1 (1993697 rows, 8151 ms)
2026-11-08T05:17:22Z [load_day 2024-03-22] 2024-03-22: index committed in 10722 ms (24 + 1 + 24 files)
2026-11-08T05:17:22Z [load_day 2024-03-22] 2024-03-22: 4767156 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:17:22Z [load_day 2024-03-22] attempt 1 succeeded