orcaLog in

Runs · run 1002

load_day 2023-04-16, attempt 1 succeeded

Host
caf251265124:273908
Started
2026-11-07T18:44:05Z
Ended
2026-11-07T18:46:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1002/load_day/2023-04-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:44:05Z [load_day 2023-04-16] attempt 1 started
2026-11-07T18:44:06Z [load_day 2023-04-16] 2023-04-16: 2 hours in flight, about 1200 MB
2026-11-07T18:44:18Z [load_day 2023-04-16] 2023-04-16 hour 0: 119513 events in 3 files, snapshot 5343504219528271771 (task 8798 ms: download 2885 ms overlapping gunzip 459 ms, parse 2098 ms, sort 52 ms, write 3876 ms, index 385 ms: 8 candidates, 63074 repo-hours, 916 releases; waiting 1624 ms; commit 1484 ms)
2026-11-07T18:44:19Z [load_day 2023-04-16] 2023-04-16 hour 1: 121303 events in 3 files, snapshot 2133301516698281382 (task 7483 ms: download 1752 ms overlapping gunzip 408 ms, parse 1938 ms, sort 75 ms, write 3851 ms, index 442 ms: 5 candidates, 67309 repo-hours, 727 releases; waiting 510 ms; commit 1762 ms)
2026-11-07T18:44:25Z [load_day 2023-04-16] 2023-04-16 hour 2: 99963 events in 2 files, snapshot 3404876212274932305 (task 6320 ms: download 1818 ms overlapping gunzip 341 ms, parse 1536 ms, sort 64 ms, write 3178 ms, index 299 ms: 3 candidates, 46844 repo-hours, 618 releases; waiting 514 ms; commit 1590 ms)
2026-11-07T18:44:26Z [load_day 2023-04-16] 2023-04-16 hour 3: 96432 events in 2 files, snapshot 3743765496031487479 (task 6388 ms: download 2802 ms overlapping gunzip 356 ms, parse 1532 ms, sort 62 ms, write 3174 ms, index 269 ms: 2 candidates, 40926 repo-hours, 722 releases; waiting 446 ms; commit 1467 ms)
2026-11-07T18:44:37Z [load_day 2023-04-16] 2023-04-16 hour 4: 95935 events in 2 files, snapshot 3240593861027862423 (task 7057 ms: download 2329 ms overlapping gunzip 347 ms, parse 1558 ms, sort 59 ms, write 2985 ms, index 285 ms: 3 candidates, 40105 repo-hours, 521 releases; waiting 1464 ms; commit 5394 ms)
2026-11-07T18:44:38Z [load_day 2023-04-16] 2023-04-16 hour 5: 100415 events in 3 files, snapshot 6260467002947797891 (task 6314 ms: download 1814 ms overlapping gunzip 337 ms, parse 1512 ms, sort 79 ms, write 3297 ms, index 289 ms: 0 candidates, 42287 repo-hours, 611 releases; waiting 506 ms; commit 1514 ms)
2026-11-07T18:44:40Z [load_day 2023-04-16] 2023-04-16 hour 6: 112431 events in 3 files, snapshot 109221030151698341 (task 6618 ms: download 1831 ms overlapping gunzip 358 ms, parse 1640 ms, sort 75 ms, write 3415 ms, index 322 ms: 1 candidates, 50367 repo-hours, 673 releases; waiting 522 ms; commit 1568 ms)
2026-11-07T18:44:46Z [load_day 2023-04-16] 2023-04-16 hour 7: 113916 events in 3 files, snapshot 4209970995888600894 (task 7408 ms: download 1799 ms overlapping gunzip 431 ms, parse 2001 ms, sort 74 ms, write 3767 ms, index 340 ms: 0 candidates, 49357 repo-hours, 617 releases; waiting 567 ms; commit 1404 ms)
2026-11-07T18:44:49Z [load_day 2023-04-16] 2023-04-16 hour 8: 120516 events in 3 files, snapshot 5216458379524337952 (task 7755 ms: download 2917 ms overlapping gunzip 412 ms, parse 1859 ms, sort 61 ms, write 3875 ms, index 362 ms: 2 candidates, 52521 repo-hours, 688 releases; waiting 808 ms; commit 1620 ms)
2026-11-07T18:44:57Z [load_day 2023-04-16] 2023-04-16 hour 9: 124922 events in 3 files, snapshot 4093120785795433009 (task 9619 ms: download 2988 ms overlapping gunzip 487 ms, parse 2170 ms, sort 74 ms, write 4250 ms, index 378 ms: 4 candidates, 54095 repo-hours, 731 releases; waiting 1887 ms; commit 1577 ms)
2026-11-07T18:44:59Z [load_day 2023-04-16] 2023-04-16 hour 10: 127782 events in 3 files, snapshot 1812792717149353047 (task 8284 ms: download 1946 ms overlapping gunzip 458 ms, parse 2087 ms, sort 77 ms, write 4441 ms, index 384 ms: 1 candidates, 55668 repo-hours, 641 releases; waiting 531 ms; commit 1792 ms)
2026-11-07T18:45:07Z [load_day 2023-04-16] 2023-04-16 hour 11: 128784 events in 3 files, snapshot 5601495369857334136 (task 8898 ms: download 2539 ms overlapping gunzip 462 ms, parse 2114 ms, sort 73 ms, write 4692 ms, index 405 ms: 1 candidates, 56107 repo-hours, 732 releases; waiting 536 ms; commit 1611 ms)
2026-11-07T18:45:11Z [load_day 2023-04-16] 2023-04-16 hour 12: 194976 events in 4 files, snapshot 5744298010281169422 (task 11226 ms: download 3879 ms overlapping gunzip 574 ms, parse 2763 ms, sort 107 ms, write 5983 ms, index 609 ms: 5 candidates, 87053 repo-hours, 779 releases; waiting 781 ms; commit 1631 ms)
2026-11-07T18:45:18Z [load_day 2023-04-16] 2023-04-16 hour 13: 165818 events in 4 files, snapshot 4225082988084203246 (task 10611 ms: download 3751 ms overlapping gunzip 586 ms, parse 2682 ms, sort 98 ms, write 5720 ms, index 633 ms: 4 candidates, 83613 repo-hours, 784 releases; waiting 541 ms; commit 1506 ms)
2026-11-07T18:45:22Z [load_day 2023-04-16] 2023-04-16 hour 14: 155471 events in 4 files, snapshot 8708136256911589341 (task 10757 ms: download 4266 ms overlapping gunzip 603 ms, parse 2636 ms, sort 112 ms, write 5733 ms, index 477 ms: 4 candidates, 69435 repo-hours, 732 releases; waiting 905 ms; commit 1749 ms)
2026-11-07T18:45:29Z [load_day 2023-04-16] 2023-04-16 hour 15: 159524 events in 4 files, snapshot 484015765019579542 (task 10507 ms: download 3944 ms overlapping gunzip 608 ms, parse 2728 ms, sort 104 ms, write 5765 ms, index 487 ms: 4 candidates, 71712 repo-hours, 951 releases; waiting 509 ms; commit 1550 ms)
2026-11-07T18:45:33Z [load_day 2023-04-16] 2023-04-16 hour 16: 151561 events in 4 files, snapshot 7071001886248288222 (task 9934 ms: download 3616 ms overlapping gunzip 580 ms, parse 2597 ms, sort 112 ms, write 5268 ms, index 499 ms: 3 candidates, 68142 repo-hours, 806 releases; waiting 515 ms; commit 1556 ms)
2026-11-07T18:45:41Z [load_day 2023-04-16] 2023-04-16 hour 17: 150737 events in 4 files, snapshot 1945038751767909801 (task 10213 ms: download 4013 ms overlapping gunzip 544 ms, parse 2430 ms, sort 91 ms, write 5642 ms, index 417 ms: 2 candidates, 65528 repo-hours, 734 releases; waiting 781 ms; commit 1703 ms)
2026-11-07T18:45:44Z [load_day 2023-04-16] 2023-04-16 hour 18: 156436 events in 4 files, snapshot 9041498623882385136 (task 10034 ms: download 3525 ms overlapping gunzip 543 ms, parse 2491 ms, sort 106 ms, write 5540 ms, index 584 ms: 4 candidates, 70369 repo-hours, 929 releases; waiting 462 ms; commit 1676 ms)
2026-11-07T18:45:50Z [load_day 2023-04-16] 2023-04-16 hour 19: 142189 events in 3 files, snapshot 9187632921145541385 (task 8971 ms: download 3301 ms overlapping gunzip 494 ms, parse 2250 ms, sort 84 ms, write 5004 ms, index 402 ms: 4 candidates, 63522 repo-hours, 813 releases; waiting 515 ms; commit 1637 ms)
2026-11-07T18:45:53Z [load_day 2023-04-16] 2023-04-16 hour 20: 136402 events in 3 files, snapshot 1821440166641245860 (task 8874 ms: download 2174 ms overlapping gunzip 485 ms, parse 2222 ms, sort 78 ms, write 4843 ms, index 460 ms: 4 candidates, 60402 repo-hours, 688 releases; waiting 502 ms; commit 1690 ms)
2026-11-07T18:46:01Z [load_day 2023-04-16] 2023-04-16 hour 21: 125191 events in 3 files, snapshot 3647835276762896422 (task 9455 ms: download 2973 ms overlapping gunzip 490 ms, parse 2206 ms, sort 81 ms, write 4290 ms, index 353 ms: 5 candidates, 53325 repo-hours, 828 releases; waiting 1772 ms; commit 1690 ms)
2026-11-07T18:46:02Z [load_day 2023-04-16] 2023-04-16 hour 22: 114572 events in 3 files, snapshot 1041645582400975636 (task 7385 ms: download 2003 ms overlapping gunzip 424 ms, parse 1871 ms, sort 69 ms, write 3881 ms, index 333 ms: 0 candidates, 48069 repo-hours, 718 releases; waiting 462 ms; commit 1580 ms)
2026-11-07T18:46:09Z [load_day 2023-04-16] 2023-04-16 hour 23: 108987 events in 3 files, snapshot 3797636727154485009 (task 7357 ms: download 1989 ms overlapping gunzip 400 ms, parse 1837 ms, sort 67 ms, write 3934 ms, index 336 ms: 2 candidates, 47158 repo-hours, 644 releases; waiting 502 ms; commit 1558 ms)
2026-11-07T18:46:15Z [load_day 2023-04-16] 2023-04-16: repo_hour merged from 24 files to 1 (1406988 rows, 6210 ms)
2026-11-07T18:46:17Z [load_day 2023-04-16] 2023-04-16: index committed in 8078 ms (21 + 1 + 24 files)
2026-11-07T18:46:17Z [load_day 2023-04-16] 2023-04-16: 3123776 events in 24 hours
2026-11-07T18:46:17Z [load_day 2023-04-16] attempt 1 succeeded