orcaLog in

Runs · run 978

load_day 2023-04-08, attempt 1 succeeded

Host
caf251265124:246962
Started
2026-11-07T18:20:54Z
Ended
2026-11-07T18:22:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/978/load_day/2023-04-08/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:20:54Z [load_day 2023-04-08] attempt 1 started
2026-11-07T18:20:56Z [load_day 2023-04-08] 2023-04-08: 2 hours in flight, about 1200 MB
2026-11-07T18:21:08Z [load_day 2023-04-08] 2023-04-08 hour 0: 131782 events in 3 files, snapshot 8729486036628034412 (task 9755 ms: download 3463 ms overlapping gunzip 533 ms, parse 2463 ms, sort 77 ms, write 4907 ms, index 434 ms: 7 candidates, 68988 repo-hours, 895 releases; waiting 980 ms; commit 1693 ms)
2026-11-07T18:21:10Z [load_day 2023-04-08] 2023-04-08 hour 1: 131336 events in 3 files, snapshot 7664693894946415603 (task 8962 ms: download 2475 ms overlapping gunzip 514 ms, parse 2334 ms, sort 79 ms, write 4731 ms, index 477 ms: 4 candidates, 74293 repo-hours, 672 releases; waiting 524 ms; commit 1496 ms)
2026-11-07T18:21:16Z [load_day 2023-04-08] 2023-04-08 hour 2: 104939 events in 3 files, snapshot 6135760773673332038 (task 7669 ms: download 2724 ms overlapping gunzip 419 ms, parse 1771 ms, sort 70 ms, write 3863 ms, index 449 ms: 1 candidates, 44943 repo-hours, 620 releases; waiting 787 ms; commit 1509 ms)
2026-11-07T18:21:18Z [load_day 2023-04-08] 2023-04-08 hour 3: 103635 events in 3 files, snapshot 350866480797898974 (task 6781 ms: download 2368 ms overlapping gunzip 406 ms, parse 1719 ms, sort 65 ms, write 3521 ms, index 281 ms: 1 candidates, 43919 repo-hours, 660 releases; waiting 505 ms; commit 1860 ms)
2026-11-07T18:21:25Z [load_day 2023-04-08] 2023-04-08 hour 4: 105280 events in 3 files, snapshot 3346093740310253279 (task 7489 ms: download 2673 ms overlapping gunzip 414 ms, parse 1794 ms, sort 77 ms, write 3641 ms, index 288 ms: 2 candidates, 43798 repo-hours, 545 releases; waiting 958 ms; commit 1962 ms)
2026-11-07T18:21:27Z [load_day 2023-04-08] 2023-04-08 hour 5: 108738 events in 3 files, snapshot 5868830695497362268 (task 7540 ms: download 2669 ms overlapping gunzip 409 ms, parse 1784 ms, sort 51 ms, write 3655 ms, index 334 ms: 1 candidates, 46568 repo-hours, 657 releases; waiting 1002 ms; commit 1616 ms)
2026-11-07T18:21:34Z [load_day 2023-04-08] 2023-04-08 hour 6: 119955 events in 3 files, snapshot 9156604137041153273 (task 7918 ms: download 2114 ms overlapping gunzip 433 ms, parse 1918 ms, sort 68 ms, write 4187 ms, index 354 ms: 4 candidates, 53812 repo-hours, 715 releases; waiting 634 ms; commit 1646 ms)
2026-11-07T18:21:36Z [load_day 2023-04-08] 2023-04-08 hour 7: 118650 events in 3 files, snapshot 3430745471453054631 (task 7643 ms: download 2393 ms overlapping gunzip 423 ms, parse 1858 ms, sort 75 ms, write 4090 ms, index 329 ms: 2 candidates, 50843 repo-hours, 590 releases; waiting 511 ms; commit 1618 ms)
2026-11-07T18:21:42Z [load_day 2023-04-08] 2023-04-08 hour 8: 126099 events in 3 files, snapshot 575697537823219014 (task 7921 ms: download 2133 ms overlapping gunzip 443 ms, parse 1963 ms, sort 62 ms, write 4213 ms, index 372 ms: 4 candidates, 55854 repo-hours, 586 releases; waiting 506 ms; commit 1575 ms)
2026-11-07T18:21:44Z [load_day 2023-04-08] 2023-04-08 hour 9: 124945 events in 3 files, snapshot 5271135476357234564 (task 7910 ms: download 2416 ms overlapping gunzip 444 ms, parse 1954 ms, sort 72 ms, write 4237 ms, index 359 ms: 2 candidates, 54759 repo-hours, 737 releases; waiting 509 ms; commit 1475 ms)
2026-11-07T18:21:51Z [load_day 2023-04-08] 2023-04-08 hour 10: 128042 events in 3 files, snapshot 4466120428734144624 (task 7873 ms: download 2115 ms overlapping gunzip 454 ms, parse 2055 ms, sort 76 ms, write 4166 ms, index 405 ms: 1 candidates, 57125 repo-hours, 592 releases; waiting 367 ms; commit 1647 ms)
2026-11-07T18:21:53Z [load_day 2023-04-08] 2023-04-08 hour 11: 125468 events in 3 files, snapshot 921086417677636480 (task 8073 ms: download 2210 ms overlapping gunzip 466 ms, parse 2062 ms, sort 72 ms, write 4229 ms, index 432 ms: 1 candidates, 55383 repo-hours, 644 releases; waiting 500 ms; commit 1493 ms)
2026-11-07T18:22:02Z [load_day 2023-04-08] 2023-04-08 hour 12: 189970 events in 4 files, snapshot 6285360894851971552 (task 9889 ms: download 3469 ms overlapping gunzip 539 ms, parse 2607 ms, sort 96 ms, write 5509 ms, index 530 ms: 2 candidates, 85480 repo-hours, 739 releases; waiting 375 ms; commit 1685 ms)
2026-11-07T18:22:04Z [load_day 2023-04-08] 2023-04-08 hour 13: 153673 events in 4 files, snapshot 1405730886830175755 (task 9629 ms: download 3210 ms overlapping gunzip 520 ms, parse 2265 ms, sort 92 ms, write 5496 ms, index 820 ms: 5 candidates, 78883 repo-hours, 715 releases; waiting 179 ms; commit 2043 ms)
2026-11-07T18:22:12Z [load_day 2023-04-08] 2023-04-08 hour 14: 147843 events in 3 files, snapshot 5953163873162229058 (task 9541 ms: download 3779 ms overlapping gunzip 525 ms, parse 2403 ms, sort 91 ms, write 5122 ms, index 458 ms: 4 candidates, 65668 repo-hours, 700 releases; waiting 607 ms; commit 1548 ms)
2026-11-07T18:22:15Z [load_day 2023-04-08] 2023-04-08 hour 15: 146909 events in 3 files, snapshot 352111881249957986 (task 9690 ms: download 3838 ms overlapping gunzip 543 ms, parse 2390 ms, sort 87 ms, write 5140 ms, index 445 ms: 6 candidates, 65595 repo-hours, 840 releases; waiting 825 ms; commit 1739 ms)
2026-11-07T18:22:22Z [load_day 2023-04-08] 2023-04-08 hour 16: 141105 events in 3 files, snapshot 4019004423286870748 (task 9243 ms: download 3583 ms overlapping gunzip 510 ms, parse 2296 ms, sort 87 ms, write 5048 ms, index 447 ms: 1 candidates, 63336 repo-hours, 747 releases; waiting 552 ms; commit 1557 ms)
2026-11-07T18:22:24Z [load_day 2023-04-08] 2023-04-08 hour 17: 139627 events in 3 files, snapshot 2253225146436118188 (task 8917 ms: download 3446 ms overlapping gunzip 523 ms, parse 2315 ms, sort 104 ms, write 4756 ms, index 443 ms: 6 candidates, 59410 repo-hours, 663 releases; waiting 501 ms; commit 1551 ms)
2026-11-07T18:22:31Z [load_day 2023-04-08] 2023-04-08 hour 18: 141172 events in 3 files, snapshot 171668041530874407 (task 8657 ms: download 1882 ms overlapping gunzip 477 ms, parse 2129 ms, sort 80 ms, write 4773 ms, index 406 ms: 2 candidates, 63589 repo-hours, 791 releases; waiting 513 ms; commit 1573 ms)
2026-11-07T18:22:33Z [load_day 2023-04-08] 2023-04-08 hour 19: 126053 events in 3 files, snapshot 7054433443838993913 (task 8202 ms: download 2521 ms overlapping gunzip 439 ms, parse 1999 ms, sort 69 ms, write 4242 ms, index 415 ms: 1 candidates, 53907 repo-hours, 678 releases; waiting 773 ms; commit 1508 ms)
2026-11-07T18:22:40Z [load_day 2023-04-08] 2023-04-08 hour 20: 127869 events in 3 files, snapshot 7097553751619148924 (task 7575 ms: download 1433 ms overlapping gunzip 432 ms, parse 1949 ms, sort 64 ms, write 4299 ms, index 374 ms: 2 candidates, 56408 repo-hours, 662 releases; waiting 188 ms; commit 1718 ms)
2026-11-07T18:22:41Z [load_day 2023-04-08] 2023-04-08 hour 21: 118777 events in 3 files, snapshot 1527603855479123494 (task 7382 ms: download 2406 ms overlapping gunzip 420 ms, parse 1907 ms, sort 81 ms, write 3810 ms, index 330 ms: 1 candidates, 51854 repo-hours, 738 releases; waiting 421 ms; commit 1575 ms)
2026-11-07T18:22:47Z [load_day 2023-04-08] 2023-04-08 hour 22: 107082 events in 3 files, snapshot 986364516324494252 (task 7136 ms: download 1892 ms overlapping gunzip 391 ms, parse 1731 ms, sort 86 ms, write 3602 ms, index 305 ms: 7 candidates, 45085 repo-hours, 677 releases; waiting 803 ms; commit 1511 ms)
2026-11-07T18:22:49Z [load_day 2023-04-08] 2023-04-08 hour 23: 97608 events in 2 files, snapshot 6773087678737360237 (task 6246 ms: download 1591 ms overlapping gunzip 362 ms, parse 1561 ms, sort 55 ms, write 3183 ms, index 277 ms: 4 candidates, 40189 repo-hours, 554 releases; waiting 523 ms; commit 1331 ms)
2026-11-07T18:22:55Z [load_day 2023-04-08] 2023-04-08: repo_hour merged from 24 files to 1 (1379689 rows, 5998 ms)
2026-11-07T18:22:56Z [load_day 2023-04-08] 2023-04-08: index committed in 7555 ms (24 + 1 + 24 files)
2026-11-07T18:22:56Z [load_day 2023-04-08] 2023-04-08: 3066557 events in 24 hours
2026-11-07T18:22:56Z [load_day 2023-04-08] attempt 1 succeeded