orcaLog in

Runs · run 981

load_day 2023-04-09, attempt 1 succeeded

Host
caf251265124:248970
Started
2026-11-07T18:22:56Z
Ended
2026-11-07T18:24:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/981/load_day/2023-04-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:22:56Z [load_day 2023-04-09] attempt 1 started
2026-11-07T18:22:58Z [load_day 2023-04-09] 2023-04-09: 2 hours in flight, about 1200 MB
2026-11-07T18:23:08Z [load_day 2023-04-09] 2023-04-09 hour 0: 118428 events in 3 files, snapshot 3804799789932276763 (task 7942 ms: download 1933 ms overlapping gunzip 432 ms, parse 1909 ms, sort 70 ms, write 4162 ms, index 398 ms: 3 candidates, 61815 repo-hours, 871 releases; waiting 561 ms; commit 1400 ms)
2026-11-07T18:23:10Z [load_day 2023-04-09] 2023-04-09 hour 1: 123551 events in 3 files, snapshot 803096410696824053 (task 7532 ms: download 1917 ms overlapping gunzip 400 ms, parse 1890 ms, sort 77 ms, write 3938 ms, index 486 ms: 4 candidates, 70395 repo-hours, 687 releases; waiting 497 ms; commit 1578 ms)
2026-11-07T18:23:16Z [load_day 2023-04-09] 2023-04-09 hour 2: 99014 events in 2 files, snapshot 7362165924491673259 (task 6719 ms: download 2029 ms overlapping gunzip 360 ms, parse 1628 ms, sort 70 ms, write 3204 ms, index 282 ms: 1 candidates, 43297 repo-hours, 554 releases; waiting 730 ms; commit 1389 ms)
2026-11-07T18:23:17Z [load_day 2023-04-09] 2023-04-09 hour 3: 98961 events in 2 files, snapshot 3496811953883706661 (task 6183 ms: download 1970 ms overlapping gunzip 341 ms, parse 1570 ms, sort 54 ms, write 3103 ms, index 274 ms: 2 candidates, 40626 repo-hours, 679 releases; waiting 520 ms; commit 1405 ms)
2026-11-07T18:23:22Z [load_day 2023-04-09] 2023-04-09 hour 4: 99963 events in 2 files, snapshot 7230036990182997903 (task 5620 ms: download 1596 ms overlapping gunzip 337 ms, parse 1454 ms, sort 64 ms, write 2999 ms, index 270 ms: 2 candidates, 40796 repo-hours, 546 releases; waiting 194 ms; commit 1496 ms)
2026-11-07T18:23:25Z [load_day 2023-04-09] 2023-04-09 hour 5: 102530 events in 3 files, snapshot 1456908393237150088 (task 6354 ms: download 1836 ms overlapping gunzip 328 ms, parse 1486 ms, sort 61 ms, write 3171 ms, index 388 ms: 2 candidates, 44099 repo-hours, 594 releases; waiting 524 ms; commit 1700 ms)
2026-11-07T18:23:30Z [load_day 2023-04-09] 2023-04-09 hour 6: 115515 events in 3 files, snapshot 3446505013806385338 (task 6875 ms: download 1643 ms overlapping gunzip 380 ms, parse 1672 ms, sort 65 ms, write 3611 ms, index 340 ms: 4 candidates, 51586 repo-hours, 693 releases; waiting 511 ms; commit 1351 ms)
2026-11-07T18:23:32Z [load_day 2023-04-09] 2023-04-09 hour 7: 114889 events in 3 files, snapshot 5502670601807605270 (task 7239 ms: download 2033 ms overlapping gunzip 404 ms, parse 1804 ms, sort 72 ms, write 3754 ms, index 336 ms: 4 candidates, 49078 repo-hours, 603 releases; waiting 526 ms; commit 1532 ms)
2026-11-07T18:23:38Z [load_day 2023-04-09] 2023-04-09 hour 8: 125490 events in 3 files, snapshot 1142074513317670361 (task 7806 ms: download 2626 ms overlapping gunzip 446 ms, parse 1969 ms, sort 73 ms, write 4219 ms, index 350 ms: 3 candidates, 55526 repo-hours, 642 releases; waiting 514 ms; commit 1535 ms)
2026-11-07T18:23:41Z [load_day 2023-04-09] 2023-04-09 hour 9: 122136 events in 3 files, snapshot 4721803891641418363 (task 7945 ms: download 2047 ms overlapping gunzip 432 ms, parse 1913 ms, sort 76 ms, write 4388 ms, index 332 ms: 3 candidates, 51699 repo-hours, 766 releases; waiting 507 ms; commit 1565 ms)
2026-11-07T18:23:47Z [load_day 2023-04-09] 2023-04-09 hour 10: 125136 events in 3 files, snapshot 3019802524424708586 (task 7735 ms: download 2469 ms overlapping gunzip 431 ms, parse 1942 ms, sort 62 ms, write 4084 ms, index 356 ms: 2 candidates, 55519 repo-hours, 648 releases; waiting 541 ms; commit 1972 ms)
2026-11-07T18:23:50Z [load_day 2023-04-09] 2023-04-09 hour 11: 123337 events in 3 files, snapshot 972342261740080654 (task 7696 ms: download 2565 ms overlapping gunzip 413 ms, parse 1857 ms, sort 69 ms, write 4036 ms, index 414 ms: 3 candidates, 52132 repo-hours, 728 releases; waiting 600 ms; commit 1618 ms)
2026-11-07T18:23:58Z [load_day 2023-04-09] 2023-04-09 hour 12: 192884 events in 4 files, snapshot 8340035007722360833 (task 9963 ms: download 3408 ms overlapping gunzip 539 ms, parse 2618 ms, sort 100 ms, write 5437 ms, index 501 ms: 4 candidates, 84712 repo-hours, 768 releases; waiting 516 ms; commit 1514 ms)
2026-11-07T18:24:00Z [load_day 2023-04-09] 2023-04-09 hour 13: 162747 events in 4 files, snapshot 7186471018068794019 (task 9308 ms: download 3023 ms overlapping gunzip 499 ms, parse 2290 ms, sort 94 ms, write 4987 ms, index 524 ms: 5 candidates, 83719 repo-hours, 686 releases; waiting 503 ms; commit 1449 ms)
2026-11-07T18:24:08Z [load_day 2023-04-09] 2023-04-09 hour 14: 155003 events in 4 files, snapshot 3449257203664797053 (task 9816 ms: download 3653 ms overlapping gunzip 562 ms, parse 2499 ms, sort 97 ms, write 5332 ms, index 440 ms: 7 candidates, 69399 repo-hours, 744 releases; waiting 576 ms; commit 1517 ms)
2026-11-07T18:24:10Z [load_day 2023-04-09] 2023-04-09 hour 15: 153101 events in 4 files, snapshot 8118859954557126010 (task 9708 ms: download 3573 ms overlapping gunzip 543 ms, parse 2410 ms, sort 92 ms, write 5278 ms, index 516 ms: 3 candidates, 67948 repo-hours, 889 releases; waiting 514 ms; commit 1468 ms)
2026-11-07T18:24:18Z [load_day 2023-04-09] 2023-04-09 hour 16: 148012 events in 3 files, snapshot 1253181759077320058 (task 9221 ms: download 3585 ms overlapping gunzip 551 ms, parse 2437 ms, sort 113 ms, write 4890 ms, index 395 ms: 0 candidates, 64059 repo-hours, 753 releases; waiting 508 ms; commit 1446 ms)
2026-11-07T18:24:20Z [load_day 2023-04-09] 2023-04-09 hour 17: 143147 events in 3 files, snapshot 1685705573687139509 (task 8973 ms: download 3431 ms overlapping gunzip 510 ms, parse 2270 ms, sort 96 ms, write 4760 ms, index 534 ms: 4 candidates, 62535 repo-hours, 765 releases; waiting 509 ms; commit 1413 ms)
2026-11-07T18:24:28Z [load_day 2023-04-09] 2023-04-09 hour 18: 147051 events in 3 files, snapshot 8382805067613080214 (task 9122 ms: download 3362 ms overlapping gunzip 496 ms, parse 2258 ms, sort 92 ms, write 4987 ms, index 451 ms: 2 candidates, 67105 repo-hours, 836 releases; waiting 512 ms; commit 1314 ms)
2026-11-07T18:24:30Z [load_day 2023-04-09] 2023-04-09 hour 19: 130270 events in 3 files, snapshot 3097203475505055059 (task 7984 ms: download 1873 ms overlapping gunzip 449 ms, parse 2061 ms, sort 63 ms, write 4275 ms, index 356 ms: 3 candidates, 55415 repo-hours, 805 releases; waiting 515 ms; commit 1541 ms)
2026-11-07T18:24:37Z [load_day 2023-04-09] 2023-04-09 hour 20: 129219 events in 3 files, snapshot 7703535892457036187 (task 7847 ms: download 1765 ms overlapping gunzip 455 ms, parse 2092 ms, sort 64 ms, write 4206 ms, index 358 ms: 2 candidates, 54262 repo-hours, 707 releases; waiting 452 ms; commit 1642 ms)
2026-11-07T18:24:39Z [load_day 2023-04-09] 2023-04-09 hour 21: 121121 events in 3 files, snapshot 729180199069496113 (task 7387 ms: download 2465 ms overlapping gunzip 425 ms, parse 1937 ms, sort 59 ms, write 3890 ms, index 319 ms: 1 candidates, 51344 repo-hours, 742 releases; waiting 512 ms; commit 1488 ms)
2026-11-07T18:24:45Z [load_day 2023-04-09] 2023-04-09 hour 22: 108766 events in 3 files, snapshot 5990795926442133029 (task 6934 ms: download 1701 ms overlapping gunzip 383 ms, parse 1728 ms, sort 66 ms, write 3679 ms, index 297 ms: 2 candidates, 45164 repo-hours, 643 releases; waiting 511 ms; commit 2296 ms)
2026-11-07T18:24:47Z [load_day 2023-04-09] 2023-04-09 hour 23: 106493 events in 3 files, snapshot 3584624968975035998 (task 6968 ms: download 1799 ms overlapping gunzip 396 ms, parse 1823 ms, sort 64 ms, write 3589 ms, index 323 ms: 1 candidates, 44603 repo-hours, 575 releases; waiting 461 ms; commit 1812 ms)
2026-11-07T18:24:53Z [load_day 2023-04-09] 2023-04-09: repo_hour merged from 24 files to 1 (1366833 rows, 6099 ms)
2026-11-07T18:24:55Z [load_day 2023-04-09] 2023-04-09: index committed in 8078 ms (23 + 1 + 24 files)
2026-11-07T18:24:55Z [load_day 2023-04-09] 2023-04-09: 3066764 events in 24 hours
2026-11-07T18:24:55Z [load_day 2023-04-09] attempt 1 succeeded