orcaLog in

Runs · run 852

load_day 2023-02-25, attempt 1 succeeded

Host
caf251265124:95020
Started
2026-11-07T16:08:09Z
Ended
2026-11-07T16:10:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/852/load_day/2023-02-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:08:09Z [load_day 2023-02-25] attempt 1 started
2026-11-07T16:08:10Z [load_day 2023-02-25] 2023-02-25: 2 hours in flight, about 1200 MB
2026-11-07T16:08:26Z [load_day 2023-02-25] 2023-02-25 hour 0: 157369 events in 4 files, snapshot 1200844394679440179 (task 13054 ms: download 6008 ms overlapping gunzip 789 ms, parse 3521 ms, sort 95 ms, write 7177 ms, index 466 ms: 7 candidates, 75095 repo-hours, 1950 releases; waiting 667 ms; commit 1470 ms)
2026-11-07T16:08:27Z [load_day 2023-02-25] 2023-02-25 hour 1: 159613 events in 4 files, snapshot 6113288385867547981 (task 11089 ms: download 4516 ms overlapping gunzip 610 ms, parse 2914 ms, sort 93 ms, write 6295 ms, index 529 ms: 4 candidates, 89703 repo-hours, 1876 releases; waiting 323 ms; commit 1346 ms)
2026-11-07T16:08:36Z [load_day 2023-02-25] 2023-02-25 hour 2: 130335 events in 3 files, snapshot 3753341063552916730 (task 10058 ms: download 4466 ms overlapping gunzip 617 ms, parse 2658 ms, sort 76 ms, write 5188 ms, index 374 ms: 3 candidates, 60599 repo-hours, 1721 releases; waiting 809 ms; commit 1284 ms)
2026-11-07T16:08:38Z [load_day 2023-02-25] 2023-02-25 hour 3: 112715 events in 3 files, snapshot 2862570212684989068 (task 8148 ms: download 2311 ms overlapping gunzip 476 ms, parse 2161 ms, sort 76 ms, write 4233 ms, index 317 ms: 2 candidates, 47494 repo-hours, 957 releases; waiting 500 ms; commit 1306 ms)
2026-11-07T16:08:45Z [load_day 2023-02-25] 2023-02-25 hour 4: 105216 events in 3 files, snapshot 1262548640164268780 (task 7342 ms: download 2053 ms overlapping gunzip 410 ms, parse 1809 ms, sort 58 ms, write 3932 ms, index 311 ms: 2 candidates, 44943 repo-hours, 526 releases; waiting 489 ms; commit 1429 ms)
2026-11-07T16:08:46Z [load_day 2023-02-25] 2023-02-25 hour 5: 107014 events in 3 files, snapshot 2241038536951027491 (task 7297 ms: download 2476 ms overlapping gunzip 391 ms, parse 1810 ms, sort 70 ms, write 3778 ms, index 359 ms: 1 candidates, 46484 repo-hours, 606 releases; waiting 535 ms; commit 1479 ms)
2026-11-07T16:08:53Z [load_day 2023-02-25] 2023-02-25 hour 6: 116200 events in 3 files, snapshot 7257259088723232147 (task 7590 ms: download 2068 ms overlapping gunzip 449 ms, parse 1987 ms, sort 72 ms, write 4237 ms, index 351 ms: 2 candidates, 53452 repo-hours, 624 releases; waiting 203 ms; commit 1304 ms)
2026-11-07T16:08:55Z [load_day 2023-02-25] 2023-02-25 hour 7: 113571 events in 3 files, snapshot 6830460170562756415 (task 8450 ms: download 3446 ms overlapping gunzip 440 ms, parse 1981 ms, sort 62 ms, write 4186 ms, index 320 ms: 1 candidates, 48982 repo-hours, 535 releases; waiting 1014 ms; commit 1386 ms)
2026-11-07T16:09:02Z [load_day 2023-02-25] 2023-02-25 hour 8: 118769 events in 3 files, snapshot 7329734869008533602 (task 8121 ms: download 2378 ms overlapping gunzip 460 ms, parse 2051 ms, sort 68 ms, write 4337 ms, index 339 ms: 4 candidates, 52405 repo-hours, 560 releases; waiting 510 ms; commit 1432 ms)
2026-11-07T16:09:04Z [load_day 2023-02-25] 2023-02-25 hour 9: 125192 events in 3 files, snapshot 1333945000967355615 (task 8503 ms: download 2362 ms overlapping gunzip 477 ms, parse 2138 ms, sort 65 ms, write 4514 ms, index 427 ms: 3 candidates, 55046 repo-hours, 783 releases; waiting 527 ms; commit 1336 ms)
2026-11-07T16:09:11Z [load_day 2023-02-25] 2023-02-25 hour 10: 134031 events in 3 files, snapshot 5903431617247087401 (task 8609 ms: download 2189 ms overlapping gunzip 479 ms, parse 2201 ms, sort 70 ms, write 4587 ms, index 402 ms: 2 candidates, 64612 repo-hours, 709 releases; waiting 510 ms; commit 1330 ms)
2026-11-07T16:09:14Z [load_day 2023-02-25] 2023-02-25 hour 11: 130520 events in 3 files, snapshot 5962427270718006563 (task 8592 ms: download 3303 ms overlapping gunzip 502 ms, parse 2244 ms, sort 67 ms, write 4697 ms, index 408 ms: 4 candidates, 55757 repo-hours, 685 releases; waiting 388 ms; commit 1268 ms)
2026-11-07T16:09:22Z [load_day 2023-02-25] 2023-02-25 hour 12: 174682 events in 4 files, snapshot 6298024322698576806 (task 10062 ms: download 3686 ms overlapping gunzip 543 ms, parse 2500 ms, sort 89 ms, write 5357 ms, index 534 ms: 9 candidates, 83950 repo-hours, 755 releases; waiting 682 ms; commit 1440 ms)
2026-11-07T16:09:24Z [load_day 2023-02-25] 2023-02-25 hour 13: 161887 events in 4 files, snapshot 1142003702146679870 (task 9698 ms: download 3535 ms overlapping gunzip 539 ms, parse 2494 ms, sort 89 ms, write 5221 ms, index 501 ms: 3 candidates, 83663 repo-hours, 830 releases; waiting 553 ms; commit 1456 ms)
2026-11-07T16:09:32Z [load_day 2023-02-25] 2023-02-25 hour 14: 144232 events in 3 files, snapshot 5348107600501298354 (task 9320 ms: download 3627 ms overlapping gunzip 567 ms, parse 2511 ms, sort 89 ms, write 4855 ms, index 435 ms: 3 candidates, 64368 repo-hours, 910 releases; waiting 502 ms; commit 1343 ms)
2026-11-07T16:09:35Z [load_day 2023-02-25] 2023-02-25 hour 15: 155786 events in 4 files, snapshot 3181519079116031445 (task 9604 ms: download 3718 ms overlapping gunzip 558 ms, parse 2471 ms, sort 99 ms, write 5189 ms, index 475 ms: 2 candidates, 75399 repo-hours, 1075 releases; waiting 514 ms; commit 1420 ms)
2026-11-07T16:09:45Z [load_day 2023-02-25] 2023-02-25 hour 16: 145986 events in 3 files, snapshot 8874372820693138830 (task 9253 ms: download 3353 ms overlapping gunzip 516 ms, parse 2377 ms, sort 83 ms, write 5008 ms, index 414 ms: 5 candidates, 64111 repo-hours, 885 releases; waiting 529 ms; commit 4144 ms)
2026-11-07T16:09:46Z [load_day 2023-02-25] 2023-02-25 hour 17: 145997 events in 3 files, snapshot 8327915633756306724 (task 9118 ms: download 3364 ms overlapping gunzip 534 ms, parse 2360 ms, sort 77 ms, write 5062 ms, index 400 ms: 2 candidates, 62257 repo-hours, 749 releases; waiting 355 ms; commit 1144 ms)
2026-11-07T16:09:53Z [load_day 2023-02-25] 2023-02-25 hour 18: 145621 events in 3 files, snapshot 7095718267299618412 (task 9326 ms: download 3559 ms overlapping gunzip 527 ms, parse 2372 ms, sort 77 ms, write 5114 ms, index 417 ms: 6 candidates, 65380 repo-hours, 859 releases; waiting 510 ms; commit 1395 ms)
2026-11-07T16:09:56Z [load_day 2023-02-25] 2023-02-25 hour 19: 128925 events in 3 files, snapshot 4774565729492372553 (task 8436 ms: download 2604 ms overlapping gunzip 473 ms, parse 2188 ms, sort 77 ms, write 4471 ms, index 360 ms: 3 candidates, 55085 repo-hours, 702 releases; waiting 571 ms; commit 1303 ms)
2026-11-07T16:10:02Z [load_day 2023-02-25] 2023-02-25 hour 20: 125856 events in 3 files, snapshot 2916890594556496291 (task 7924 ms: download 1511 ms overlapping gunzip 460 ms, parse 2125 ms, sort 65 ms, write 4413 ms, index 358 ms: 3 candidates, 54663 repo-hours, 665 releases; waiting 202 ms; commit 1417 ms)
2026-11-07T16:10:05Z [load_day 2023-02-25] 2023-02-25 hour 21: 116257 events in 3 files, snapshot 1538620444150736340 (task 7899 ms: download 2179 ms overlapping gunzip 431 ms, parse 1969 ms, sort 83 ms, write 4252 ms, index 331 ms: 3 candidates, 48833 repo-hours, 726 releases; waiting 522 ms; commit 1965 ms)
2026-11-07T16:10:12Z [load_day 2023-02-25] 2023-02-25 hour 22: 109103 events in 3 files, snapshot 1712550283650859845 (task 9441 ms: download 3469 ms overlapping gunzip 449 ms, parse 1976 ms, sort 71 ms, write 3875 ms, index 321 ms: 4 candidates, 46543 repo-hours, 677 releases; waiting 2393 ms; commit 1593 ms)
2026-11-07T16:10:13Z [load_day 2023-02-25] 2023-02-25 hour 23: 101845 events in 3 files, snapshot 7746210450970010674 (task 7084 ms: download 1997 ms overlapping gunzip 385 ms, parse 1774 ms, sort 67 ms, write 3650 ms, index 314 ms: 2 candidates, 44593 repo-hours, 691 releases; waiting 570 ms; commit 1284 ms)
2026-11-07T16:10:19Z [load_day 2023-02-25] 2023-02-25: repo_hour merged from 24 files to 1 (1443417 rows, 5977 ms)
2026-11-07T16:10:21Z [load_day 2023-02-25] 2023-02-25: index committed in 8015 ms (24 + 1 + 24 files)
2026-11-07T16:10:21Z [load_day 2023-02-25] 2023-02-25: 3166722 events in 24 hours
2026-11-07T16:10:21Z [load_day 2023-02-25] attempt 1 succeeded