orcaLog in

Runs · run 2271

load_day 2024-04-02, attempt 1 succeeded

Host
73ccef5e07c2:104645
Started
2026-11-08T05:24:30Z
Ended
2026-11-08T05:26:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
778 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.8 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2271/load_day/2024-04-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:24:30Z [load_day 2024-04-02] attempt 1 started
2026-11-08T05:24:30Z [load_day 2024-04-02] 2024-04-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:24:39Z [load_day 2024-04-02] 2024-04-02 hour 0: 236934 events in 0 files, snapshot none (task 7858 ms: download 4964 ms overlapping gunzip 1213 ms, parse 5105 ms, sort 0 ms, write 0 ms, index 743 ms: 15 candidates, 94665 repo-hours, 1021 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:24:39Z [load_day 2024-04-02] 2024-04-02 hour 1: 243315 events in 0 files, snapshot none (task 7598 ms: download 4446 ms overlapping gunzip 1087 ms, parse 4867 ms, sort 0 ms, write 0 ms, index 805 ms: 4 candidates, 103583 repo-hours, 770 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:24:46Z [load_day 2024-04-02] 2024-04-02 hour 2: 211692 events in 0 files, snapshot none (task 7096 ms: download 4468 ms overlapping gunzip 1077 ms, parse 4512 ms, sort 0 ms, write 0 ms, index 585 ms: 5 candidates, 70103 repo-hours, 780 releases; waiting 605 ms; commit 0 ms)
2026-11-08T05:24:46Z [load_day 2024-04-02] 2024-04-02 hour 3: 210388 events in 0 files, snapshot none (task 6412 ms: download 3882 ms overlapping gunzip 962 ms, parse 3874 ms, sort 0 ms, write 0 ms, index 638 ms: 12 candidates, 68250 repo-hours, 933 releases; waiting 625 ms; commit 0 ms)
2026-11-08T05:24:53Z [load_day 2024-04-02] 2024-04-02 hour 4: 209620 events in 0 files, snapshot none (task 6548 ms: download 3196 ms overlapping gunzip 900 ms, parse 4054 ms, sort 0 ms, write 0 ms, index 814 ms: 10 candidates, 66800 repo-hours, 665 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:24:54Z [load_day 2024-04-02] 2024-04-02 hour 5: 220587 events in 0 files, snapshot none (task 7473 ms: download 4312 ms overlapping gunzip 1171 ms, parse 4777 ms, sort 0 ms, write 0 ms, index 706 ms: 9 candidates, 71564 repo-hours, 746 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:25:04Z [load_day 2024-04-02] 2024-04-02 hour 6: 258310 events in 0 files, snapshot none (task 10254 ms: download 6323 ms overlapping gunzip 1538 ms, parse 6699 ms, sort 0 ms, write 0 ms, index 979 ms: 10 candidates, 104598 repo-hours, 1033 releases; waiting 755 ms; commit 0 ms)
2026-11-08T05:25:05Z [load_day 2024-04-02] 2024-04-02 hour 7: 250229 events in 0 files, snapshot none (task 10201 ms: download 7037 ms overlapping gunzip 1703 ms, parse 6911 ms, sort 0 ms, write 0 ms, index 727 ms: 15 candidates, 87605 repo-hours, 963 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:25:14Z [load_day 2024-04-02] 2024-04-02 hour 8: 266377 events in 0 files, snapshot none (task 9848 ms: download 6513 ms overlapping gunzip 1606 ms, parse 6379 ms, sort 0 ms, write 0 ms, index 994 ms: 10 candidates, 94606 repo-hours, 1261 releases; waiting 446 ms; commit 0 ms)
2026-11-08T05:25:15Z [load_day 2024-04-02] 2024-04-02 hour 9: 274187 events in 0 files, snapshot none (task 9624 ms: download 6211 ms overlapping gunzip 1588 ms, parse 6388 ms, sort 0 ms, write 0 ms, index 894 ms: 4 candidates, 94327 repo-hours, 1184 releases; waiting 430 ms; commit 0 ms)
2026-11-08T05:25:24Z [load_day 2024-04-02] 2024-04-02 hour 10: 263930 events in 0 files, snapshot none (task 9142 ms: download 6224 ms overlapping gunzip 1390 ms, parse 5846 ms, sort 0 ms, write 0 ms, index 987 ms: 9 candidates, 89621 repo-hours, 1147 releases; waiting 645 ms; commit 0 ms)
2026-11-08T05:25:24Z [load_day 2024-04-02] 2024-04-02 hour 11: 264330 events in 0 files, snapshot none (task 8334 ms: download 5481 ms overlapping gunzip 1294 ms, parse 5342 ms, sort 0 ms, write 0 ms, index 910 ms: 7 candidates, 86794 repo-hours, 1083 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:25:34Z [load_day 2024-04-02] 2024-04-02 hour 12: 307228 events in 0 files, snapshot none (task 9273 ms: download 6120 ms overlapping gunzip 1455 ms, parse 5957 ms, sort 0 ms, write 0 ms, index 994 ms: 20 candidates, 122729 repo-hours, 1281 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:25:35Z [load_day 2024-04-02] 2024-04-02 hour 13: 295092 events in 0 files, snapshot none (task 9776 ms: download 6881 ms overlapping gunzip 1559 ms, parse 6464 ms, sort 0 ms, write 0 ms, index 897 ms: 12 candidates, 117637 repo-hours, 1360 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:25:45Z [load_day 2024-04-02] 2024-04-02 hour 14: 290066 events in 0 files, snapshot none (task 10126 ms: download 7333 ms overlapping gunzip 1602 ms, parse 6672 ms, sort 0 ms, write 0 ms, index 883 ms: 13 candidates, 105881 repo-hours, 1362 releases; waiting 699 ms; commit 0 ms)
2026-11-08T05:25:45Z [load_day 2024-04-02] 2024-04-02 hour 15: 279883 events in 0 files, snapshot none (task 10215 ms: download 7193 ms overlapping gunzip 1605 ms, parse 6570 ms, sort 0 ms, write 0 ms, index 1028 ms: 16 candidates, 105459 repo-hours, 1371 releases; waiting 625 ms; commit 0 ms)
2026-11-08T05:25:55Z [load_day 2024-04-02] 2024-04-02 hour 16: 271657 events in 0 files, snapshot none (task 9589 ms: download 6497 ms overlapping gunzip 1494 ms, parse 6371 ms, sort 0 ms, write 0 ms, index 883 ms: 10 candidates, 99127 repo-hours, 1287 releases; waiting 535 ms; commit 0 ms)
2026-11-08T05:25:55Z [load_day 2024-04-02] 2024-04-02 hour 17: 249771 events in 0 files, snapshot none (task 8652 ms: download 5731 ms overlapping gunzip 1403 ms, parse 5803 ms, sort 0 ms, write 0 ms, index 720 ms: 13 candidates, 89892 repo-hours, 1007 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:26:03Z [load_day 2024-04-02] 2024-04-02 hour 18: 274988 events in 0 files, snapshot none (task 7379 ms: download 4633 ms overlapping gunzip 1103 ms, parse 4697 ms, sort 0 ms, write 0 ms, index 784 ms: 16 candidates, 96207 repo-hours, 1198 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:26:03Z [load_day 2024-04-02] 2024-04-02 hour 19: 268297 events in 0 files, snapshot none (task 7084 ms: download 4681 ms overlapping gunzip 1097 ms, parse 4494 ms, sort 0 ms, write 0 ms, index 645 ms: 13 candidates, 83627 repo-hours, 1092 releases; waiting 566 ms; commit 0 ms)
2026-11-08T05:26:10Z [load_day 2024-04-02] 2024-04-02 hour 20: 267044 events in 0 files, snapshot none (task 6995 ms: download 4560 ms overlapping gunzip 1088 ms, parse 4515 ms, sort 0 ms, write 0 ms, index 626 ms: 25 candidates, 88877 repo-hours, 990 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:26:10Z [load_day 2024-04-02] 2024-04-02 hour 21: 247288 events in 0 files, snapshot none (task 6673 ms: download 4276 ms overlapping gunzip 1031 ms, parse 4288 ms, sort 0 ms, write 0 ms, index 564 ms: 19 candidates, 75946 repo-hours, 1085 releases; waiting 504 ms; commit 0 ms)
2026-11-08T05:26:18Z [load_day 2024-04-02] 2024-04-02 hour 22: 233444 events in 0 files, snapshot none (task 7265 ms: download 4380 ms overlapping gunzip 1060 ms, parse 4634 ms, sort 0 ms, write 0 ms, index 654 ms: 15 candidates, 68767 repo-hours, 979 releases; waiting 548 ms; commit 0 ms)
2026-11-08T05:26:18Z [load_day 2024-04-02] 2024-04-02 hour 23: 222460 events in 0 files, snapshot none (task 7330 ms: download 3870 ms overlapping gunzip 1161 ms, parse 4916 ms, sort 0 ms, write 0 ms, index 519 ms: 6 candidates, 63912 repo-hours, 900 releases; waiting 482 ms; commit 0 ms)
2026-11-08T05:26:28Z [load_day 2024-04-02] 2024-04-02: repo_hour merged from 24 files to 1 (2150577 rows, 9950 ms)
2026-11-08T05:26:31Z [load_day 2024-04-02] 2024-04-02: index committed in 12834 ms (24 + 1 + 24 files)
2026-11-08T05:26:31Z [load_day 2024-04-02] 2024-04-02: 6117117 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:26:31Z [load_day 2024-04-02] attempt 1 succeeded