orcaLog in

Runs · run 1125

load_day 2023-05-27, attempt 1 succeeded

Host
caf251265124:408598
Started
2026-11-07T20:43:12Z
Ended
2026-11-07T20:45:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1125/load_day/2023-05-27/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:43:12Z [load_day 2023-05-27] attempt 1 started
2026-11-07T20:43:14Z [load_day 2023-05-27] 2023-05-27: 2 hours in flight, about 1200 MB
2026-11-07T20:43:26Z [load_day 2023-05-27] 2023-05-27 hour 0: 123921 events in 3 files, snapshot 6193503545145389960 (task 8817 ms: download 1932 ms overlapping gunzip 503 ms, parse 2385 ms, sort 91 ms, write 4720 ms, index 399 ms: 6 candidates, 65151 repo-hours, 865 releases; waiting 492 ms; commit 1679 ms)
2026-11-07T20:43:27Z [load_day 2023-05-27] 2023-05-27 hour 1: 132413 events in 3 files, snapshot 1665016723949365374 (task 8310 ms: download 2441 ms overlapping gunzip 450 ms, parse 2157 ms, sort 61 ms, write 4350 ms, index 480 ms: 5 candidates, 75551 repo-hours, 826 releases; waiting 514 ms; commit 1647 ms)
2026-11-07T20:43:34Z [load_day 2023-05-27] 2023-05-27 hour 2: 102937 events in 3 files, snapshot 1440945956304640081 (task 7453 ms: download 2767 ms overlapping gunzip 417 ms, parse 1812 ms, sort 63 ms, write 3558 ms, index 305 ms: 6 candidates, 44972 repo-hours, 595 releases; waiting 997 ms; commit 1783 ms)
2026-11-07T20:43:36Z [load_day 2023-05-27] 2023-05-27 hour 3: 97685 events in 2 files, snapshot 6377948880619697826 (task 6484 ms: download 2060 ms overlapping gunzip 360 ms, parse 1650 ms, sort 53 ms, write 3194 ms, index 301 ms: 2 candidates, 41347 repo-hours, 798 releases; waiting 572 ms; commit 1685 ms)
2026-11-07T20:43:41Z [load_day 2023-05-27] 2023-05-27 hour 4: 94163 events in 2 files, snapshot 4404677115108679060 (task 6066 ms: download 1816 ms overlapping gunzip 333 ms, parse 1499 ms, sort 61 ms, write 3099 ms, index 259 ms: 3 candidates, 40614 repo-hours, 496 releases; waiting 505 ms; commit 1662 ms)
2026-11-07T20:43:43Z [load_day 2023-05-27] 2023-05-27 hour 5: 98957 events in 2 files, snapshot 1217876187329810383 (task 6434 ms: download 1362 ms overlapping gunzip 353 ms, parse 1632 ms, sort 54 ms, write 3319 ms, index 320 ms: 4 candidates, 42976 repo-hours, 618 releases; waiting 154 ms; commit 1677 ms)
2026-11-07T20:43:49Z [load_day 2023-05-27] 2023-05-27 hour 6: 112310 events in 3 files, snapshot 144473858163290607 (task 7514 ms: download 2913 ms overlapping gunzip 393 ms, parse 1771 ms, sort 61 ms, write 3794 ms, index 371 ms: 8 candidates, 52341 repo-hours, 662 releases; waiting 712 ms; commit 1710 ms)
2026-11-07T20:43:51Z [load_day 2023-05-27] 2023-05-27 hour 7: 111838 events in 3 files, snapshot 6620293143380493993 (task 7362 ms: download 1784 ms overlapping gunzip 403 ms, parse 1814 ms, sort 69 ms, write 3904 ms, index 354 ms: 3 candidates, 48320 repo-hours, 559 releases; waiting 531 ms; commit 1807 ms)
2026-11-07T20:43:59Z [load_day 2023-05-27] 2023-05-27 hour 8: 119881 events in 3 files, snapshot 3062446897540138154 (task 8553 ms: download 2828 ms overlapping gunzip 442 ms, parse 1954 ms, sort 76 ms, write 4326 ms, index 331 ms: 8 candidates, 53642 repo-hours, 557 releases; waiting 1111 ms; commit 1899 ms)
2026-11-07T20:44:00Z [load_day 2023-05-27] 2023-05-27 hour 9: 124285 events in 3 files, snapshot 5141193203060284864 (task 7766 ms: download 1797 ms overlapping gunzip 438 ms, parse 1951 ms, sort 63 ms, write 4140 ms, index 347 ms: 8 candidates, 53904 repo-hours, 771 releases; waiting 535 ms; commit 1753 ms)
2026-11-07T20:44:11Z [load_day 2023-05-27] 2023-05-27 hour 10: 125753 events in 3 files, snapshot 5381769154982029117 (task 8020 ms: download 2315 ms overlapping gunzip 432 ms, parse 1936 ms, sort 69 ms, write 4382 ms, index 396 ms: 10 candidates, 56007 repo-hours, 668 releases; waiting 499 ms; commit 5576 ms)
2026-11-07T20:44:13Z [load_day 2023-05-27] 2023-05-27 hour 11: 118863 events in 3 files, snapshot 8643738971773332827 (task 7791 ms: download 1755 ms overlapping gunzip 414 ms, parse 1933 ms, sort 83 ms, write 4212 ms, index 353 ms: 3 candidates, 51053 repo-hours, 613 releases; waiting 495 ms; commit 1636 ms)
2026-11-07T20:44:18Z [load_day 2023-05-27] 2023-05-27 hour 12: 192742 events in 4 files, snapshot 3138051883676972751 (task 10501 ms: download 3927 ms overlapping gunzip 558 ms, parse 2724 ms, sort 101 ms, write 5324 ms, index 536 ms: 7 candidates, 85203 repo-hours, 724 releases; waiting 1037 ms; commit 1634 ms)
2026-11-07T20:44:23Z [load_day 2023-05-27] 2023-05-27 hour 13: 150936 events in 4 files, snapshot 652679128877291548 (task 9188 ms: download 2883 ms overlapping gunzip 510 ms, parse 2364 ms, sort 98 ms, write 5159 ms, index 559 ms: 8 candidates, 77748 repo-hours, 637 releases; waiting 203 ms; commit 1592 ms)
2026-11-07T20:44:29Z [load_day 2023-05-27] 2023-05-27 hour 14: 137911 events in 3 files, snapshot 3956014813966507130 (task 9104 ms: download 3525 ms overlapping gunzip 513 ms, parse 2230 ms, sort 79 ms, write 5020 ms, index 390 ms: 8 candidates, 61877 repo-hours, 685 releases; waiting 589 ms; commit 1878 ms)
2026-11-07T20:44:34Z [load_day 2023-05-27] 2023-05-27 hour 15: 141733 events in 3 files, snapshot 6740230638643707498 (task 9549 ms: download 3811 ms overlapping gunzip 507 ms, parse 2336 ms, sort 93 ms, write 4874 ms, index 413 ms: 7 candidates, 62019 repo-hours, 881 releases; waiting 948 ms; commit 2509 ms)
2026-11-07T20:44:37Z [load_day 2023-05-27] 2023-05-27 hour 16: 133926 events in 3 files, snapshot 1297210065011309509 (task 8417 ms: download 1996 ms overlapping gunzip 478 ms, parse 2177 ms, sort 77 ms, write 4583 ms, index 400 ms: 4 candidates, 61467 repo-hours, 1090 releases; waiting 390 ms; commit 1644 ms)
2026-11-07T20:44:42Z [load_day 2023-05-27] 2023-05-27 hour 17: 126382 events in 3 files, snapshot 342456929530899146 (task 8222 ms: download 1953 ms overlapping gunzip 433 ms, parse 2003 ms, sort 84 ms, write 4402 ms, index 372 ms: 1 candidates, 55737 repo-hours, 678 releases; waiting 506 ms; commit 1765 ms)
2026-11-07T20:44:47Z [load_day 2023-05-27] 2023-05-27 hour 18: 132737 events in 3 files, snapshot 8816041182808606475 (task 8454 ms: download 2484 ms overlapping gunzip 457 ms, parse 2077 ms, sort 85 ms, write 4570 ms, index 436 ms: 3 candidates, 60793 repo-hours, 820 releases; waiting 510 ms; commit 1594 ms)
2026-11-07T20:44:50Z [load_day 2023-05-27] 2023-05-27 hour 19: 115155 events in 3 files, snapshot 304839267085236108 (task 7566 ms: download 1764 ms overlapping gunzip 400 ms, parse 1893 ms, sort 70 ms, write 3939 ms, index 327 ms: 6 candidates, 49181 repo-hours, 696 releases; waiting 657 ms; commit 1663 ms)
2026-11-07T20:44:55Z [load_day 2023-05-27] 2023-05-27 hour 20: 111794 events in 3 files, snapshot 6595705727362785988 (task 7093 ms: download 1888 ms overlapping gunzip 380 ms, parse 1751 ms, sort 62 ms, write 3824 ms, index 328 ms: 4 candidates, 49464 repo-hours, 677 releases; waiting 415 ms; commit 1722 ms)
2026-11-07T20:44:58Z [load_day 2023-05-27] 2023-05-27 hour 21: 102774 events in 3 files, snapshot 2413723720434838174 (task 6816 ms: download 2703 ms overlapping gunzip 357 ms, parse 1664 ms, sort 64 ms, write 3331 ms, index 333 ms: 3 candidates, 42708 repo-hours, 764 releases; waiting 720 ms; commit 1944 ms)
2026-11-07T20:45:02Z [load_day 2023-05-27] 2023-05-27 hour 22: 89400 events in 2 files, snapshot 7736149146414539177 (task 5998 ms: download 1824 ms overlapping gunzip 328 ms, parse 1505 ms, sort 74 ms, write 2987 ms, index 282 ms: 4 candidates, 38018 repo-hours, 650 releases; waiting 514 ms; commit 1741 ms)
2026-11-07T20:45:04Z [load_day 2023-05-27] 2023-05-27 hour 23: 84243 events in 2 files, snapshot 2149657246712815394 (task 5688 ms: download 1574 ms overlapping gunzip 300 ms, parse 1391 ms, sort 50 ms, write 2871 ms, index 261 ms: 3 candidates, 36862 repo-hours, 556 releases; waiting 513 ms; commit 1724 ms)
2026-11-07T20:45:10Z [load_day 2023-05-27] 2023-05-27: repo_hour merged from 24 files to 1 (1306955 rows, 5874 ms)
2026-11-07T20:45:13Z [load_day 2023-05-27] 2023-05-27: index committed in 8210 ms (24 + 1 + 24 files)
2026-11-07T20:45:13Z [load_day 2023-05-27] 2023-05-27: 2882739 events in 24 hours
2026-11-07T20:45:13Z [load_day 2023-05-27] attempt 1 succeeded