orcaLog in

Runs · run 2642

load_day 2024-06-26, attempt 1 succeeded

Host
73ccef5e07c2:141763
Started
2026-11-08T06:42:54Z
Ended
2026-11-08T06:44:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
718 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.0 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2642/load_day/2024-06-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:42:54Z [load_day 2024-06-26] attempt 1 started
2026-11-08T06:42:54Z [load_day 2024-06-26] 2024-06-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:43:02Z [load_day 2024-06-26] 2024-06-26 hour 0: 215335 events in 0 files, snapshot none (task 7111 ms: download 4133 ms overlapping gunzip 994 ms, parse 4302 ms, sort 0 ms, write 0 ms, index 969 ms: 17 candidates, 133624 repo-hours, 1397 releases; waiting 495 ms; commit 0 ms)
2026-11-08T06:43:02Z [load_day 2024-06-26] 2024-06-26 hour 1: 191385 events in 0 files, snapshot none (task 7114 ms: download 4036 ms overlapping gunzip 1059 ms, parse 4534 ms, sort 0 ms, write 0 ms, index 769 ms: 7 candidates, 107509 repo-hours, 1341 releases; waiting 372 ms; commit 0 ms)
2026-11-08T06:43:09Z [load_day 2024-06-26] 2024-06-26 hour 2: 157776 events in 0 files, snapshot none (task 6530 ms: download 3526 ms overlapping gunzip 988 ms, parse 4178 ms, sort 0 ms, write 0 ms, index 582 ms: 7 candidates, 67168 repo-hours, 1460 releases; waiting 506 ms; commit 0 ms)
2026-11-08T06:43:10Z [load_day 2024-06-26] 2024-06-26 hour 3: 184067 events in 0 files, snapshot none (task 7292 ms: download 4191 ms overlapping gunzip 1130 ms, parse 4707 ms, sort 0 ms, write 0 ms, index 619 ms: 4 candidates, 77478 repo-hours, 6075 releases; waiting 492 ms; commit 0 ms)
2026-11-08T06:43:16Z [load_day 2024-06-26] 2024-06-26 hour 4: 155537 events in 0 files, snapshot none (task 6536 ms: download 3726 ms overlapping gunzip 982 ms, parse 3877 ms, sort 0 ms, write 0 ms, index 449 ms: 7 candidates, 61312 repo-hours, 1075 releases; waiting 769 ms; commit 0 ms)
2026-11-08T06:43:18Z [load_day 2024-06-26] 2024-06-26 hour 5: 177602 events in 0 files, snapshot none (task 7778 ms: download 5204 ms overlapping gunzip 1277 ms, parse 5108 ms, sort 0 ms, write 0 ms, index 546 ms: 9 candidates, 69420 repo-hours, 1444 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:43:23Z [load_day 2024-06-26] 2024-06-26 hour 6: 207686 events in 0 files, snapshot none (task 6108 ms: download 3445 ms overlapping gunzip 886 ms, parse 3679 ms, sort 0 ms, write 0 ms, index 741 ms: 12 candidates, 94936 repo-hours, 1463 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:43:26Z [load_day 2024-06-26] 2024-06-26 hour 7: 213454 events in 0 files, snapshot none (task 7531 ms: download 5251 ms overlapping gunzip 1064 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 759 ms: 7 candidates, 87199 repo-hours, 1427 releases; waiting 816 ms; commit 0 ms)
2026-11-08T06:43:31Z [load_day 2024-06-26] 2024-06-26 hour 8: 228264 events in 0 files, snapshot none (task 7607 ms: download 4821 ms overlapping gunzip 1172 ms, parse 4901 ms, sort 0 ms, write 0 ms, index 681 ms: 13 candidates, 94853 repo-hours, 2584 releases; waiting 468 ms; commit 0 ms)
2026-11-08T06:43:34Z [load_day 2024-06-26] 2024-06-26 hour 9: 236389 events in 0 files, snapshot none (task 7819 ms: download 4466 ms overlapping gunzip 1158 ms, parse 5010 ms, sort 0 ms, write 0 ms, index 1135 ms: 12 candidates, 104089 repo-hours, 3249 releases; waiting 185 ms; commit 0 ms)
2026-11-08T06:43:40Z [load_day 2024-06-26] 2024-06-26 hour 10: 219824 events in 0 files, snapshot none (task 9269 ms: download 6082 ms overlapping gunzip 1444 ms, parse 6286 ms, sort 0 ms, write 0 ms, index 710 ms: 9 candidates, 90013 repo-hours, 3003 releases; waiting 518 ms; commit 0 ms)
2026-11-08T06:43:43Z [load_day 2024-06-26] 2024-06-26 hour 11: 218547 events in 0 files, snapshot none (task 8300 ms: download 5189 ms overlapping gunzip 1278 ms, parse 5272 ms, sort 0 ms, write 0 ms, index 1010 ms: 9 candidates, 89278 repo-hours, 3022 releases; waiting 476 ms; commit 0 ms)
2026-11-08T06:43:50Z [load_day 2024-06-26] 2024-06-26 hour 12: 277284 events in 0 files, snapshot none (task 8587 ms: download 5074 ms overlapping gunzip 1239 ms, parse 5305 ms, sort 0 ms, write 0 ms, index 1265 ms: 14 candidates, 134328 repo-hours, 3000 releases; waiting 476 ms; commit 0 ms)
2026-11-08T06:43:53Z [load_day 2024-06-26] 2024-06-26 hour 13: 257744 events in 0 files, snapshot none (task 8937 ms: download 6155 ms overlapping gunzip 1388 ms, parse 5746 ms, sort 0 ms, write 0 ms, index 900 ms: 17 candidates, 117412 repo-hours, 3098 releases; waiting 588 ms; commit 0 ms)
2026-11-08T06:43:58Z [load_day 2024-06-26] 2024-06-26 hour 14: 243587 events in 0 files, snapshot none (task 7843 ms: download 5169 ms overlapping gunzip 1228 ms, parse 5110 ms, sort 0 ms, write 0 ms, index 764 ms: 9 candidates, 102765 repo-hours, 3017 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:44:01Z [load_day 2024-06-26] 2024-06-26 hour 15: 246528 events in 0 files, snapshot none (task 7587 ms: download 4861 ms overlapping gunzip 1212 ms, parse 4967 ms, sort 0 ms, write 0 ms, index 770 ms: 12 candidates, 110380 repo-hours, 3193 releases; waiting 272 ms; commit 0 ms)
2026-11-08T06:44:06Z [load_day 2024-06-26] 2024-06-26 hour 16: 226773 events in 0 files, snapshot none (task 7123 ms: download 4484 ms overlapping gunzip 1114 ms, parse 4814 ms, sort 0 ms, write 0 ms, index 680 ms: 12 candidates, 94154 repo-hours, 3117 releases; waiting 222 ms; commit 0 ms)
2026-11-08T06:44:08Z [load_day 2024-06-26] 2024-06-26 hour 17: 212776 events in 0 files, snapshot none (task 6431 ms: download 3945 ms overlapping gunzip 950 ms, parse 4004 ms, sort 0 ms, write 0 ms, index 659 ms: 7 candidates, 85333 repo-hours, 3023 releases; waiting 558 ms; commit 0 ms)
2026-11-08T06:44:13Z [load_day 2024-06-26] 2024-06-26 hour 18: 225251 events in 0 files, snapshot none (task 7135 ms: download 4507 ms overlapping gunzip 1078 ms, parse 4439 ms, sort 0 ms, write 0 ms, index 746 ms: 5 candidates, 99767 repo-hours, 3051 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:44:15Z [load_day 2024-06-26] 2024-06-26 hour 19: 204216 events in 0 files, snapshot none (task 7020 ms: download 4437 ms overlapping gunzip 1065 ms, parse 4363 ms, sort 0 ms, write 0 ms, index 747 ms: 9 candidates, 79222 repo-hours, 3026 releases; waiting 566 ms; commit 0 ms)
2026-11-08T06:44:21Z [load_day 2024-06-26] 2024-06-26 hour 20: 194439 events in 0 files, snapshot none (task 7092 ms: download 5554 ms overlapping gunzip 958 ms, parse 3876 ms, sort 0 ms, write 0 ms, index 618 ms: 7 candidates, 78529 repo-hours, 2832 releases; waiting 1336 ms; commit 0 ms)
2026-11-08T06:44:22Z [load_day 2024-06-26] 2024-06-26 hour 21: 178459 events in 0 files, snapshot none (task 5836 ms: download 3446 ms overlapping gunzip 859 ms, parse 3569 ms, sort 0 ms, write 0 ms, index 566 ms: 10 candidates, 72788 repo-hours, 2535 releases; waiting 520 ms; commit 0 ms)
2026-11-08T06:44:26Z [load_day 2024-06-26] 2024-06-26 hour 22: 163536 events in 0 files, snapshot none (task 5561 ms: download 2991 ms overlapping gunzip 843 ms, parse 3492 ms, sort 0 ms, write 0 ms, index 430 ms: 6 candidates, 61169 repo-hours, 2849 releases; waiting 514 ms; commit 0 ms)
2026-11-08T06:44:27Z [load_day 2024-06-26] 2024-06-26 hour 23: 152414 events in 0 files, snapshot none (task 5207 ms: download 2961 ms overlapping gunzip 743 ms, parse 3004 ms, sort 0 ms, write 0 ms, index 378 ms: 5 candidates, 56092 repo-hours, 2585 releases; waiting 704 ms; commit 0 ms)
2026-11-08T06:44:37Z [load_day 2024-06-26] 2024-06-26: repo_hour merged from 24 files to 1 (2168818 rows, 9496 ms)
2026-11-08T06:44:39Z [load_day 2024-06-26] 2024-06-26: index committed in 11871 ms (24 + 1 + 24 files)
2026-11-08T06:44:39Z [load_day 2024-06-26] 2024-06-26: 4988873 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:44:39Z [load_day 2024-06-26] attempt 1 succeeded