orcaLog in

Runs · run 2878

load_day 2024-08-23, attempt 1 succeeded

Host
73ccef5e07c2:168123
Started
2026-11-08T07:34:24Z
Ended
2026-11-08T07:36:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
703 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
166.8 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2878/load_day/2024-08-23/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:34:24Z [load_day 2024-08-23] attempt 1 started
2026-11-08T07:34:25Z [load_day 2024-08-23] 2024-08-23: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:34:34Z [load_day 2024-08-23] 2024-08-23 hour 0: 182692 events in 0 files, snapshot none (task 8494 ms: download 4834 ms overlapping gunzip 1224 ms, parse 5573 ms, sort 0 ms, write 0 ms, index 889 ms: 5 candidates, 89984 repo-hours, 1227 releases; waiting 473 ms; commit 0 ms)
2026-11-08T07:34:34Z [load_day 2024-08-23] 2024-08-23 hour 1: 192209 events in 0 files, snapshot none (task 8824 ms: download 5118 ms overlapping gunzip 1321 ms, parse 5629 ms, sort 0 ms, write 0 ms, index 1150 ms: 4 candidates, 104369 repo-hours, 847 releases; waiting 483 ms; commit 0 ms)
2026-11-08T07:34:41Z [load_day 2024-08-23] 2024-08-23 hour 2: 163563 events in 0 files, snapshot none (task 6362 ms: download 3317 ms overlapping gunzip 986 ms, parse 3963 ms, sort 0 ms, write 0 ms, index 638 ms: 6 candidates, 67808 repo-hours, 765 releases; waiting 509 ms; commit 0 ms)
2026-11-08T07:34:41Z [load_day 2024-08-23] 2024-08-23 hour 3: 180616 events in 0 files, snapshot none (task 5852 ms: download 2890 ms overlapping gunzip 848 ms, parse 3559 ms, sort 0 ms, write 0 ms, index 650 ms: 4 candidates, 73660 repo-hours, 4795 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:34:47Z [load_day 2024-08-23] 2024-08-23 hour 4: 153850 events in 0 files, snapshot none (task 5824 ms: download 3409 ms overlapping gunzip 914 ms, parse 3638 ms, sort 0 ms, write 0 ms, index 497 ms: 3 candidates, 58726 repo-hours, 712 releases; waiting 466 ms; commit 0 ms)
2026-11-08T07:34:48Z [load_day 2024-08-23] 2024-08-23 hour 5: 166928 events in 0 files, snapshot none (task 6372 ms: download 4003 ms overlapping gunzip 959 ms, parse 4147 ms, sort 0 ms, write 0 ms, index 487 ms: 9 candidates, 65190 repo-hours, 993 releases; waiting 494 ms; commit 0 ms)
2026-11-08T07:34:56Z [load_day 2024-08-23] 2024-08-23 hour 6: 194768 events in 0 files, snapshot none (task 8381 ms: download 5647 ms overlapping gunzip 1097 ms, parse 4959 ms, sort 0 ms, write 0 ms, index 660 ms: 4 candidates, 88875 repo-hours, 1074 releases; waiting 1387 ms; commit 0 ms)
2026-11-08T07:34:57Z [load_day 2024-08-23] 2024-08-23 hour 7: 196266 events in 0 files, snapshot none (task 8282 ms: download 5761 ms overlapping gunzip 1360 ms, parse 5518 ms, sort 0 ms, write 0 ms, index 595 ms: 4 candidates, 78791 repo-hours, 1064 releases; waiting 501 ms; commit 0 ms)
2026-11-08T07:35:05Z [load_day 2024-08-23] 2024-08-23 hour 8: 208160 events in 0 files, snapshot none (task 8270 ms: download 5661 ms overlapping gunzip 1412 ms, parse 5628 ms, sort 0 ms, write 0 ms, index 622 ms: 10 candidates, 85007 repo-hours, 1263 releases; waiting 313 ms; commit 0 ms)
2026-11-08T07:35:06Z [load_day 2024-08-23] 2024-08-23 hour 9: 221038 events in 0 files, snapshot none (task 9244 ms: download 6553 ms overlapping gunzip 1507 ms, parse 6278 ms, sort 0 ms, write 0 ms, index 690 ms: 5 candidates, 93601 repo-hours, 1323 releases; waiting 536 ms; commit 0 ms)
2026-11-08T07:35:14Z [load_day 2024-08-23] 2024-08-23 hour 10: 202028 events in 0 files, snapshot none (task 8556 ms: download 5237 ms overlapping gunzip 1231 ms, parse 5690 ms, sort 0 ms, write 0 ms, index 816 ms: 7 candidates, 81793 repo-hours, 1235 releases; waiting 554 ms; commit 0 ms)
2026-11-08T07:35:15Z [load_day 2024-08-23] 2024-08-23 hour 11: 200698 events in 0 files, snapshot none (task 7998 ms: download 5594 ms overlapping gunzip 1293 ms, parse 5512 ms, sort 0 ms, write 0 ms, index 619 ms: 8 candidates, 78274 repo-hours, 1094 releases; waiting 373 ms; commit 0 ms)
2026-11-08T07:35:24Z [load_day 2024-08-23] 2024-08-23 hour 12: 262014 events in 0 files, snapshot none (task 10278 ms: download 6450 ms overlapping gunzip 1603 ms, parse 6952 ms, sort 0 ms, write 0 ms, index 906 ms: 10 candidates, 126294 repo-hours, 1379 releases; waiting 530 ms; commit 0 ms)
2026-11-08T07:35:25Z [load_day 2024-08-23] 2024-08-23 hour 13: 240884 events in 0 files, snapshot none (task 9617 ms: download 7039 ms overlapping gunzip 1550 ms, parse 6757 ms, sort 0 ms, write 0 ms, index 776 ms: 11 candidates, 110706 repo-hours, 1355 releases; waiting 314 ms; commit 0 ms)
2026-11-08T07:35:32Z [load_day 2024-08-23] 2024-08-23 hour 14: 229681 events in 0 files, snapshot none (task 7345 ms: download 4798 ms overlapping gunzip 1145 ms, parse 4627 ms, sort 0 ms, write 0 ms, index 711 ms: 8 candidates, 95293 repo-hours, 1281 releases; waiting 621 ms; commit 0 ms)
2026-11-08T07:35:33Z [load_day 2024-08-23] 2024-08-23 hour 15: 224037 events in 0 files, snapshot none (task 7261 ms: download 4675 ms overlapping gunzip 1072 ms, parse 4658 ms, sort 0 ms, write 0 ms, index 721 ms: 10 candidates, 97560 repo-hours, 1399 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:35:39Z [load_day 2024-08-23] 2024-08-23 hour 16: 210429 events in 0 files, snapshot none (task 6660 ms: download 4112 ms overlapping gunzip 1034 ms, parse 4163 ms, sort 0 ms, write 0 ms, index 692 ms: 6 candidates, 86070 repo-hours, 1193 releases; waiting 486 ms; commit 0 ms)
2026-11-08T07:35:40Z [load_day 2024-08-23] 2024-08-23 hour 17: 203511 events in 0 files, snapshot none (task 6409 ms: download 3938 ms overlapping gunzip 974 ms, parse 3974 ms, sort 0 ms, write 0 ms, index 652 ms: 10 candidates, 79388 repo-hours, 998 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:35:48Z [load_day 2024-08-23] 2024-08-23 hour 18: 212463 events in 0 files, snapshot none (task 7772 ms: download 4662 ms overlapping gunzip 1140 ms, parse 5082 ms, sort 0 ms, write 0 ms, index 1009 ms: 5 candidates, 92825 repo-hours, 1125 releases; waiting 208 ms; commit 0 ms)
2026-11-08T07:35:48Z [load_day 2024-08-23] 2024-08-23 hour 19: 192715 events in 0 files, snapshot none (task 7231 ms: download 4467 ms overlapping gunzip 1094 ms, parse 4642 ms, sort 0 ms, write 0 ms, index 690 ms: 3 candidates, 70232 repo-hours, 988 releases; waiting 485 ms; commit 0 ms)
2026-11-08T07:35:55Z [load_day 2024-08-23] 2024-08-23 hour 20: 188283 events in 0 files, snapshot none (task 6945 ms: download 4410 ms overlapping gunzip 1014 ms, parse 4482 ms, sort 0 ms, write 0 ms, index 565 ms: 13 candidates, 70154 repo-hours, 936 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:35:55Z [load_day 2024-08-23] 2024-08-23 hour 21: 178752 events in 0 files, snapshot none (task 6900 ms: download 4536 ms overlapping gunzip 1077 ms, parse 4551 ms, sort 0 ms, write 0 ms, index 490 ms: 4 candidates, 69760 repo-hours, 1093 releases; waiting 527 ms; commit 0 ms)
2026-11-08T07:36:02Z [load_day 2024-08-23] 2024-08-23 hour 22: 161242 events in 0 files, snapshot none (task 6532 ms: download 4282 ms overlapping gunzip 1052 ms, parse 4287 ms, sort 0 ms, write 0 ms, index 402 ms: 6 candidates, 58421 repo-hours, 986 releases; waiting 491 ms; commit 0 ms)
2026-11-08T07:36:02Z [load_day 2024-08-23] 2024-08-23 hour 23: 150826 events in 0 files, snapshot none (task 6099 ms: download 3862 ms overlapping gunzip 1009 ms, parse 4049 ms, sort 0 ms, write 0 ms, index 416 ms: 6 candidates, 53362 repo-hours, 888 releases; waiting 394 ms; commit 0 ms)
2026-11-08T07:36:10Z [load_day 2024-08-23] 2024-08-23: repo_hour merged from 24 files to 1 (1976143 rows, 7998 ms)
2026-11-08T07:36:13Z [load_day 2024-08-23] 2024-08-23: index committed in 10649 ms (24 + 1 + 24 files)
2026-11-08T07:36:13Z [load_day 2024-08-23] 2024-08-23: 4717653 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:36:13Z [load_day 2024-08-23] attempt 1 succeeded