orcaLog in

Runs · run 1245

load_day 2023-06-28, attempt 1 succeeded

Host
3c2b29713ce8:56202
Started
2026-11-07T22:16:12Z
Ended
2026-11-07T22:21:43Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1245/load_day/2023-06-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:16:12Z [load_day 2023-06-28] attempt 1 started
2026-11-07T22:16:13Z [load_day 2023-06-28] 2023-06-28: 1 hours in flight, about 750 MB
2026-11-07T22:16:26Z [load_day 2023-06-28] 2023-06-28 hour 0: 141047 events in 3 files, snapshot 5267255778239913956 (task 9823 ms: download 4436 ms overlapping gunzip 658 ms, parse 2995 ms, sort 87 ms, write 4848 ms, index 440 ms: 2 candidates, 69453 repo-hours, 818 releases; waiting 498 ms; commit 1790 ms)
2026-11-07T22:16:47Z [load_day 2023-06-28] 2023-06-28 hour 1: 154966 events in 4 files, snapshot 8323929206248179526 (task 10129 ms: download 4453 ms overlapping gunzip 633 ms, parse 2820 ms, sort 67 ms, write 5197 ms, index 533 ms: 1 candidates, 87794 repo-hours, 826 releases; waiting 582 ms; commit 11669 ms)
2026-11-07T22:16:59Z [load_day 2023-06-28] 2023-06-28 hour 2: 149054 events in 3 files, snapshot 8620389869551885931 (task 9983 ms: download 4548 ms overlapping gunzip 666 ms, parse 2916 ms, sort 91 ms, write 5084 ms, index 465 ms: 2 candidates, 77368 repo-hours, 843 releases; waiting 516 ms; commit 1787 ms)
2026-11-07T22:17:08Z [load_day 2023-06-28] 2023-06-28 hour 3: 131506 events in 3 files, snapshot 8911750376555389748 (task 8713 ms: download 3733 ms overlapping gunzip 565 ms, parse 2521 ms, sort 69 ms, write 4371 ms, index 376 ms: 1 candidates, 59140 repo-hours, 818 releases; waiting 522 ms; commit 1830 ms)
2026-11-07T22:17:17Z [load_day 2023-06-28] 2023-06-28 hour 4: 123057 events in 3 files, snapshot 6431756440816626850 (task 8140 ms: download 2039 ms overlapping gunzip 544 ms, parse 2405 ms, sort 74 ms, write 4002 ms, index 332 ms: 2 candidates, 53270 repo-hours, 565 releases; waiting 202 ms; commit 1886 ms)
2026-11-07T22:17:27Z [load_day 2023-06-28] 2023-06-28 hour 5: 140033 events in 3 files, snapshot 6510982811414274377 (task 9243 ms: download 3965 ms overlapping gunzip 614 ms, parse 2737 ms, sort 81 ms, write 4589 ms, index 380 ms: 5 candidates, 61612 repo-hours, 789 releases; waiting 503 ms; commit 1818 ms)
2026-11-07T22:17:40Z [load_day 2023-06-28] 2023-06-28 hour 6: 166101 events in 4 files, snapshot 7977785562361280757 (task 11970 ms: download 5449 ms overlapping gunzip 732 ms, parse 3305 ms, sort 73 ms, write 6024 ms, index 516 ms: 3 candidates, 77674 repo-hours, 923 releases; waiting 885 ms; commit 1930 ms)
2026-11-07T22:17:53Z [load_day 2023-06-28] 2023-06-28 hour 7: 180096 events in 4 files, snapshot 1039917178435839679 (task 12547 ms: download 7137 ms overlapping gunzip 834 ms, parse 3754 ms, sort 106 ms, write 6550 ms, index 507 ms: 11 candidates, 79981 repo-hours, 1034 releases; waiting 503 ms; commit 1669 ms)
2026-11-07T22:18:08Z [load_day 2023-06-28] 2023-06-28 hour 8: 185052 events in 4 files, snapshot 3025397101921934719 (task 13636 ms: download 7635 ms overlapping gunzip 918 ms, parse 4025 ms, sort 105 ms, write 7100 ms, index 557 ms: 9 candidates, 85368 repo-hours, 1000 releases; waiting 637 ms; commit 2118 ms)
2026-11-07T22:18:23Z [load_day 2023-06-28] 2023-06-28 hour 9: 181289 events in 4 files, snapshot 6005210508536217346 (task 14247 ms: download 8303 ms overlapping gunzip 905 ms, parse 4016 ms, sort 109 ms, write 7788 ms, index 552 ms: 5 candidates, 84279 repo-hours, 1200 releases; waiting 583 ms; commit 1813 ms)
2026-11-07T22:18:38Z [load_day 2023-06-28] 2023-06-28 hour 10: 176064 events in 4 files, snapshot 6931991075533144701 (task 12691 ms: download 7312 ms overlapping gunzip 832 ms, parse 3752 ms, sort 93 ms, write 6650 ms, index 553 ms: 8 candidates, 79512 repo-hours, 1134 releases; waiting 516 ms; commit 2442 ms)
2026-11-07T22:18:51Z [load_day 2023-06-28] 2023-06-28 hour 11: 178712 events in 4 files, snapshot 1912923998868561296 (task 13281 ms: download 7548 ms overlapping gunzip 886 ms, parse 3892 ms, sort 100 ms, write 6931 ms, index 605 ms: 9 candidates, 77829 repo-hours, 963 releases; waiting 505 ms; commit 2211 ms)
2026-11-07T22:19:06Z [load_day 2023-06-28] 2023-06-28 hour 12: 202044 events in 5 files, snapshot 3598013508674010920 (task 13979 ms: download 7529 ms overlapping gunzip 894 ms, parse 4030 ms, sort 118 ms, write 7480 ms, index 650 ms: 9 candidates, 104399 repo-hours, 1076 releases; waiting 517 ms; commit 1811 ms)
2026-11-07T22:19:23Z [load_day 2023-06-28] 2023-06-28 hour 13: 189348 events in 4 files, snapshot 7280380050913210983 (task 14706 ms: download 7673 ms overlapping gunzip 909 ms, parse 4120 ms, sort 117 ms, write 8049 ms, index 727 ms: 10 candidates, 98813 repo-hours, 1045 releases; waiting 512 ms; commit 3409 ms)
2026-11-07T22:19:38Z [load_day 2023-06-28] 2023-06-28 hour 14: 175205 events in 4 files, snapshot 6982503154948105840 (task 13691 ms: download 8080 ms overlapping gunzip 902 ms, parse 4072 ms, sort 92 ms, write 7205 ms, index 625 ms: 4 candidates, 84198 repo-hours, 1079 releases; waiting 525 ms; commit 1866 ms)
2026-11-07T22:19:52Z [load_day 2023-06-28] 2023-06-28 hour 15: 166630 events in 4 files, snapshot 8376656992869177691 (task 13642 ms: download 8417 ms overlapping gunzip 844 ms, parse 3714 ms, sort 84 ms, write 7476 ms, index 518 ms: 6 candidates, 80977 repo-hours, 1102 releases; waiting 679 ms; commit 1693 ms)
2026-11-07T22:20:05Z [load_day 2023-06-28] 2023-06-28 hour 16: 165852 events in 4 files, snapshot 8338538221235260620 (task 12126 ms: download 6937 ms overlapping gunzip 831 ms, parse 3656 ms, sort 96 ms, write 6504 ms, index 560 ms: 6 candidates, 78116 repo-hours, 956 releases; waiting 184 ms; commit 1749 ms)
2026-11-07T22:20:19Z [load_day 2023-06-28] 2023-06-28 hour 17: 166056 events in 4 files, snapshot 2051309154988384107 (task 12790 ms: download 7659 ms overlapping gunzip 871 ms, parse 3816 ms, sort 97 ms, write 6643 ms, index 492 ms: 7 candidates, 75252 repo-hours, 867 releases; waiting 533 ms; commit 1808 ms)
2026-11-07T22:20:32Z [load_day 2023-06-28] 2023-06-28 hour 18: 170815 events in 4 files, snapshot 6403744226649479036 (task 11909 ms: download 6735 ms overlapping gunzip 808 ms, parse 3582 ms, sort 92 ms, write 6462 ms, index 504 ms: 4 candidates, 79710 repo-hours, 926 releases; waiting 184 ms; commit 2058 ms)
2026-11-07T22:20:46Z [load_day 2023-06-28] 2023-06-28 hour 19: 165150 events in 4 files, snapshot 3897094943038858705 (task 13286 ms: download 7491 ms overlapping gunzip 819 ms, parse 3702 ms, sort 113 ms, write 6912 ms, index 682 ms: 5 candidates, 70750 repo-hours, 1045 releases; waiting 575 ms; commit 2125 ms)
2026-11-07T22:20:59Z [load_day 2023-06-28] 2023-06-28 hour 20: 163130 events in 4 files, snapshot 6374289029738370982 (task 12192 ms: download 7433 ms overlapping gunzip 814 ms, parse 3599 ms, sort 93 ms, write 6067 ms, index 456 ms: 7 candidates, 71288 repo-hours, 962 releases; waiting 805 ms; commit 2359 ms)
2026-11-07T22:21:12Z [load_day 2023-06-28] 2023-06-28 hour 21: 149845 events in 3 files, snapshot 1050162218579879091 (task 11447 ms: download 5112 ms overlapping gunzip 784 ms, parse 3446 ms, sort 102 ms, write 5958 ms, index 379 ms: 7 candidates, 61660 repo-hours, 1007 releases; waiting 483 ms; commit 1713 ms)
2026-11-07T22:21:22Z [load_day 2023-06-28] 2023-06-28 hour 22: 139180 events in 3 files, snapshot 2865440638216731161 (task 9909 ms: download 4332 ms overlapping gunzip 644 ms, parse 2809 ms, sort 72 ms, write 5135 ms, index 407 ms: 4 candidates, 61213 repo-hours, 946 releases; waiting 514 ms; commit 1745 ms)
2026-11-07T22:21:33Z [load_day 2023-06-28] 2023-06-28 hour 23: 130959 events in 3 files, snapshot 7649935339178594196 (task 9393 ms: download 3699 ms overlapping gunzip 603 ms, parse 2673 ms, sort 74 ms, write 4848 ms, index 365 ms: 1 candidates, 58865 repo-hours, 744 releases; waiting 217 ms; commit 1689 ms)
2026-11-07T22:21:40Z [load_day 2023-06-28] 2023-06-28: repo_hour merged from 24 files to 1 (1818521 rows, 7630 ms)
2026-11-07T22:21:43Z [load_day 2023-06-28] 2023-06-28: index committed in 10151 ms (24 + 1 + 24 files)
2026-11-07T22:21:43Z [load_day 2023-06-28] 2023-06-28: 3891191 events in 24 hours
2026-11-07T22:21:43Z [load_day 2023-06-28] attempt 1 succeeded