orcaLog in

Runs · run 2914

load_day 2024-09-02, attempt 1 succeeded

Host
73ccef5e07c2:172009
Started
2026-11-08T07:42:48Z
Ended
2026-11-08T07:45:52Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
794 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.5 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2914/load_day/2024-09-02/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:42:48Z [load_day 2024-09-02] attempt 1 started
2026-11-08T07:42:49Z [load_day 2024-09-02] 2024-09-02: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:42:55Z [load_day 2024-09-02] 2024-09-02 hour 0: 170538 events in 0 files, snapshot none (task 6218 ms: download 3598 ms overlapping gunzip 916 ms, parse 3762 ms, sort 0 ms, write 0 ms, index 750 ms: 4 candidates, 86031 repo-hours, 1030 releases; waiting 487 ms; commit 0 ms)
2026-11-08T07:42:57Z [load_day 2024-09-02] 2024-09-02 hour 1: 192436 events in 0 files, snapshot none (task 7857 ms: download 4831 ms overlapping gunzip 1130 ms, parse 4486 ms, sort 0 ms, write 0 ms, index 984 ms: 2 candidates, 102526 repo-hours, 806 releases; waiting 892 ms; commit 0 ms)
2026-11-08T07:43:03Z [load_day 2024-09-02] 2024-09-02 hour 2: 162674 events in 0 files, snapshot none (task 6578 ms: download 3741 ms overlapping gunzip 1062 ms, parse 4100 ms, sort 0 ms, write 0 ms, index 611 ms: 2 candidates, 71865 repo-hours, 764 releases; waiting 546 ms; commit 0 ms)
2026-11-08T07:43:05Z [load_day 2024-09-02] 2024-09-02 hour 3: 178362 events in 0 files, snapshot none (task 6978 ms: download 4521 ms overlapping gunzip 1125 ms, parse 4521 ms, sort 0 ms, write 0 ms, index 573 ms: 2 candidates, 72453 repo-hours, 4797 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:43:10Z [load_day 2024-09-02] 2024-09-02 hour 4: 159750 events in 0 files, snapshot none (task 6803 ms: download 3791 ms overlapping gunzip 1087 ms, parse 4096 ms, sort 0 ms, write 0 ms, index 573 ms: 1 candidates, 60270 repo-hours, 711 releases; waiting 691 ms; commit 0 ms)
2026-11-08T07:43:12Z [load_day 2024-09-02] 2024-09-02 hour 5: 173575 events in 0 files, snapshot none (task 6912 ms: download 4517 ms overlapping gunzip 1133 ms, parse 4429 ms, sort 0 ms, write 0 ms, index 597 ms: 11 candidates, 66743 repo-hours, 818 releases; waiting 490 ms; commit 0 ms)
2026-11-08T07:43:18Z [load_day 2024-09-02] 2024-09-02 hour 6: 208692 events in 0 files, snapshot none (task 7606 ms: download 4796 ms overlapping gunzip 1215 ms, parse 4919 ms, sort 0 ms, write 0 ms, index 674 ms: 3 candidates, 92365 repo-hours, 1005 releases; waiting 478 ms; commit 0 ms)
2026-11-08T07:43:22Z [load_day 2024-09-02] 2024-09-02 hour 7: 214467 events in 0 files, snapshot none (task 9117 ms: download 5406 ms overlapping gunzip 1459 ms, parse 5805 ms, sort 0 ms, write 0 ms, index 863 ms: 12 candidates, 84215 repo-hours, 1063 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:43:28Z [load_day 2024-09-02] 2024-09-02 hour 8: 222327 events in 0 files, snapshot none (task 9731 ms: download 6268 ms overlapping gunzip 1595 ms, parse 6244 ms, sort 0 ms, write 0 ms, index 1083 ms: 17 candidates, 90964 repo-hours, 1257 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:43:33Z [load_day 2024-09-02] 2024-09-02 hour 9: 234344 events in 0 files, snapshot none (task 10102 ms: download 7034 ms overlapping gunzip 1724 ms, parse 6790 ms, sort 0 ms, write 0 ms, index 747 ms: 10 candidates, 97713 repo-hours, 1404 releases; waiting 550 ms; commit 0 ms)
2026-11-08T07:43:38Z [load_day 2024-09-02] 2024-09-02 hour 10: 220237 events in 0 files, snapshot none (task 9337 ms: download 5975 ms overlapping gunzip 1557 ms, parse 6347 ms, sort 0 ms, write 0 ms, index 679 ms: 13 candidates, 88122 repo-hours, 1066 releases; waiting 484 ms; commit 0 ms)
2026-11-08T07:43:43Z [load_day 2024-09-02] 2024-09-02 hour 11: 217046 events in 0 files, snapshot none (task 9813 ms: download 5683 ms overlapping gunzip 1540 ms, parse 6141 ms, sort 0 ms, write 0 ms, index 883 ms: 8 candidates, 85020 repo-hours, 1154 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:43:50Z [load_day 2024-09-02] 2024-09-02 hour 12: 265411 events in 0 files, snapshot none (task 11529 ms: download 6546 ms overlapping gunzip 1670 ms, parse 7052 ms, sort 0 ms, write 0 ms, index 1483 ms: 7 candidates, 131669 repo-hours, 1363 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:43:53Z [load_day 2024-09-02] 2024-09-02 hour 13: 251383 events in 0 files, snapshot none (task 9445 ms: download 6305 ms overlapping gunzip 1437 ms, parse 6074 ms, sort 0 ms, write 0 ms, index 1140 ms: 9 candidates, 113256 repo-hours, 1272 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:43:59Z [load_day 2024-09-02] 2024-09-02 hour 14: 238361 events in 0 files, snapshot none (task 8913 ms: download 6319 ms overlapping gunzip 1480 ms, parse 5901 ms, sort 0 ms, write 0 ms, index 709 ms: 16 candidates, 96920 repo-hours, 1212 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:44:02Z [load_day 2024-09-02] 2024-09-02 hour 15: 239758 events in 0 files, snapshot none (task 8385 ms: download 5911 ms overlapping gunzip 1219 ms, parse 4916 ms, sort 0 ms, write 0 ms, index 725 ms: 11 candidates, 100903 repo-hours, 1324 releases; waiting 1277 ms; commit 0 ms)
2026-11-08T07:44:07Z [load_day 2024-09-02] 2024-09-02 hour 16: 229633 events in 0 files, snapshot none (task 7241 ms: download 4851 ms overlapping gunzip 1084 ms, parse 4269 ms, sort 0 ms, write 0 ms, index 594 ms: 4 candidates, 85820 repo-hours, 1096 releases; waiting 1041 ms; commit 0 ms)
2026-11-08T07:44:08Z [load_day 2024-09-02] 2024-09-02 hour 17: 215451 events in 0 files, snapshot none (task 5962 ms: download 3621 ms overlapping gunzip 918 ms, parse 3704 ms, sort 0 ms, write 0 ms, index 552 ms: 5 candidates, 78540 repo-hours, 963 releases; waiting 500 ms; commit 0 ms)
2026-11-08T07:44:18Z [load_day 2024-09-02] 2024-09-02 hour 18: 218095 events in 0 files, snapshot none (task 10941 ms: download 5320 ms overlapping gunzip 1187 ms, parse 5208 ms, sort 0 ms, write 0 ms, index 3732 ms: 10 candidates, 94051 repo-hours, 1051 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:44:19Z [load_day 2024-09-02] 2024-09-02 hour 19: 195793 events in 0 files, snapshot none (task 10035 ms: download 4861 ms overlapping gunzip 1177 ms, parse 4733 ms, sort 0 ms, write 0 ms, index 3245 ms: 9 candidates, 73207 repo-hours, 958 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:44:30Z [load_day 2024-09-02] 2024-09-02 hour 20: 187737 events in 0 files, snapshot none (task 10766 ms: download 4086 ms overlapping gunzip 1066 ms, parse 4271 ms, sort 0 ms, write 0 ms, index 4610 ms: 5 candidates, 69666 repo-hours, 966 releases; waiting 357 ms; commit 0 ms)
2026-11-08T07:45:35Z [load_day 2024-09-02] 2024-09-02 hour 21: 176219 events in 0 files, snapshot none (task 75278 ms: download 74536 ms overlapping gunzip 1399 ms, parse 5669 ms, sort 0 ms, write 0 ms, index 498 ms: 9 candidates, 67573 repo-hours, 1054 releases; waiting 67486 ms; commit 0 ms)
2026-11-08T07:45:35Z [load_day 2024-09-02] 2024-09-02 hour 22: 157278 events in 0 files, snapshot none (task 5229 ms: download 2963 ms overlapping gunzip 845 ms, parse 3566 ms, sort 0 ms, write 0 ms, index 409 ms: 3 candidates, 56141 repo-hours, 1019 releases; waiting 193 ms; commit 0 ms)
2026-11-08T07:45:40Z [load_day 2024-09-02] 2024-09-02 hour 23: 155428 events in 0 files, snapshot none (task 5052 ms: download 2807 ms overlapping gunzip 760 ms, parse 3103 ms, sort 0 ms, write 0 ms, index 428 ms: 2 candidates, 57186 repo-hours, 846 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:45:49Z [load_day 2024-09-02] 2024-09-02: repo_hour merged from 24 files to 1 (2023219 rows, 8374 ms)
2026-11-08T07:45:52Z [load_day 2024-09-02] 2024-09-02: index committed in 11538 ms (24 + 1 + 24 files)
2026-11-08T07:45:52Z [load_day 2024-09-02] 2024-09-02: 4884995 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:45:52Z [load_day 2024-09-02] attempt 1 succeeded