orcaLog in

Runs · run 846

load_day 2023-02-23, attempt 1 succeeded

Host
caf251265124:87068
Started
2026-11-07T16:01:28Z
Ended
2026-11-07T16:04:54Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/846/load_day/2023-02-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:01:28Z [load_day 2023-02-23] attempt 1 started
2026-11-07T16:01:30Z [load_day 2023-02-23] 2023-02-23: 2 hours in flight, about 1200 MB
2026-11-07T16:01:46Z [load_day 2023-02-23] 2023-02-23 hour 0: 157182 events in 4 files, snapshot 1060467716689536615 (task 13269 ms: download 6142 ms overlapping gunzip 802 ms, parse 3520 ms, sort 105 ms, write 7130 ms, index 487 ms: 7 candidates, 77255 repo-hours, 905 releases; waiting 842 ms; commit 1501 ms)
2026-11-07T16:01:47Z [load_day 2023-02-23] 2023-02-23 hour 1: 159622 events in 4 files, snapshot 5765002750272555186 (task 12304 ms: download 5040 ms overlapping gunzip 726 ms, parse 3203 ms, sort 88 ms, write 6892 ms, index 565 ms: 10 candidates, 81774 repo-hours, 915 releases; waiting 505 ms; commit 1309 ms)
2026-11-07T16:01:58Z [load_day 2023-02-23] 2023-02-23 hour 2: 151522 events in 4 files, snapshot 5557193951495613113 (task 11555 ms: download 4392 ms overlapping gunzip 716 ms, parse 2918 ms, sort 92 ms, write 6724 ms, index 515 ms: 6 candidates, 75445 repo-hours, 718 releases; waiting 208 ms; commit 1312 ms)
2026-11-07T16:01:59Z [load_day 2023-02-23] 2023-02-23 hour 3: 143039 events in 3 files, snapshot 8008369619168882213 (task 11277 ms: download 4843 ms overlapping gunzip 689 ms, parse 2953 ms, sort 97 ms, write 6266 ms, index 421 ms: 5 candidates, 64540 repo-hours, 854 releases; waiting 523 ms; commit 1445 ms)
2026-11-07T16:02:09Z [load_day 2023-02-23] 2023-02-23 hour 4: 135353 events in 3 files, snapshot 802660964423637102 (task 10430 ms: download 4104 ms overlapping gunzip 664 ms, parse 2764 ms, sort 75 ms, write 5903 ms, index 388 ms: 3 candidates, 60648 repo-hours, 642 releases; waiting 27 ms; commit 1676 ms)
2026-11-07T16:02:12Z [load_day 2023-02-23] 2023-02-23 hour 5: 137969 events in 3 files, snapshot 977747745798285463 (task 11967 ms: download 5991 ms overlapping gunzip 651 ms, parse 2799 ms, sort 79 ms, write 5671 ms, index 393 ms: 4 candidates, 62742 repo-hours, 737 releases; waiting 2057 ms; commit 1447 ms)
2026-11-07T16:02:22Z [load_day 2023-02-23] 2023-02-23 hour 6: 154819 events in 4 files, snapshot 2938150005283029234 (task 11454 ms: download 4629 ms overlapping gunzip 688 ms, parse 2915 ms, sort 90 ms, write 6481 ms, index 455 ms: 5 candidates, 71252 repo-hours, 833 releases; waiting 499 ms; commit 1489 ms)
2026-11-07T16:02:26Z [load_day 2023-02-23] 2023-02-23 hour 7: 158955 events in 4 files, snapshot 7031543513579293207 (task 13138 ms: download 5704 ms overlapping gunzip 772 ms, parse 3323 ms, sort 103 ms, write 7036 ms, index 473 ms: 4 candidates, 71707 repo-hours, 766 releases; waiting 1109 ms; commit 1651 ms)
2026-11-07T16:02:38Z [load_day 2023-02-23] 2023-02-23 hour 8: 182915 events in 4 files, snapshot 5086221306889604554 (task 15647 ms: download 8962 ms overlapping gunzip 1007 ms, parse 4306 ms, sort 102 ms, write 8819 ms, index 530 ms: 10 candidates, 84110 repo-hours, 876 releases; waiting 525 ms; commit 1402 ms)
2026-11-07T16:02:44Z [load_day 2023-02-23] 2023-02-23 hour 9: 197990 events in 4 files, snapshot 2621776706129081770 (task 17293 ms: download 9950 ms overlapping gunzip 1056 ms, parse 4517 ms, sort 113 ms, write 9420 ms, index 612 ms: 7 candidates, 93286 repo-hours, 1099 releases; waiting 1241 ms; commit 1419 ms)
2026-11-07T16:02:55Z [load_day 2023-02-23] 2023-02-23 hour 10: 202363 events in 5 files, snapshot 4845812252964325476 (task 15776 ms: download 8792 ms overlapping gunzip 952 ms, parse 4100 ms, sort 127 ms, write 9287 ms, index 620 ms: 3 candidates, 102931 repo-hours, 1002 releases; waiting 410 ms; commit 1371 ms)
2026-11-07T16:03:00Z [load_day 2023-02-23] 2023-02-23 hour 11: 195568 events in 4 files, snapshot 639080046217040408 (task 16165 ms: download 9182 ms overlapping gunzip 993 ms, parse 4264 ms, sort 124 ms, write 9329 ms, index 572 ms: 8 candidates, 86579 repo-hours, 985 releases; waiting 539 ms; commit 1287 ms)
2026-11-07T16:03:12Z [load_day 2023-02-23] 2023-02-23 hour 12: 221409 events in 5 files, snapshot 3750237911523722301 (task 17065 ms: download 8072 ms overlapping gunzip 915 ms, parse 4100 ms, sort 131 ms, write 10672 ms, index 725 ms: 8 candidates, 110657 repo-hours, 1037 releases; waiting 240 ms; commit 1324 ms)
2026-11-07T16:03:22Z [load_day 2023-02-23] 2023-02-23 hour 13: 227808 events in 5 files, snapshot 4262240089648881860 (task 20947 ms: download 14596 ms overlapping gunzip 1162 ms, parse 5012 ms, sort 135 ms, write 12988 ms, index 695 ms: 11 candidates, 109084 repo-hours, 1100 releases; waiting 580 ms; commit 1333 ms)
2026-11-07T16:03:31Z [load_day 2023-02-23] 2023-02-23 hour 14: 210339 events in 5 files, snapshot 7869884934354172417 (task 17445 ms: download 9294 ms overlapping gunzip 1047 ms, parse 4707 ms, sort 145 ms, write 10055 ms, index 612 ms: 11 candidates, 96737 repo-hours, 1233 releases; waiting 555 ms; commit 1322 ms)
2026-11-07T16:03:42Z [load_day 2023-02-23] 2023-02-23 hour 15: 221874 events in 5 files, snapshot 7789306575759309317 (task 18734 ms: download 12398 ms overlapping gunzip 1133 ms, parse 5021 ms, sort 127 ms, write 10759 ms, index 664 ms: 3 candidates, 105801 repo-hours, 1296 releases; waiting 668 ms; commit 1593 ms)
2026-11-07T16:03:49Z [load_day 2023-02-23] 2023-02-23 hour 16: 212753 events in 5 files, snapshot 8955928427461851110 (task 17234 ms: download 11426 ms overlapping gunzip 1039 ms, parse 4493 ms, sort 122 ms, write 10302 ms, index 665 ms: 4 candidates, 102197 repo-hours, 1170 releases; waiting 281 ms; commit 1350 ms)
2026-11-07T16:04:00Z [load_day 2023-02-23] 2023-02-23 hour 17: 201331 events in 5 files, snapshot 501200187399221993 (task 16931 ms: download 9526 ms overlapping gunzip 999 ms, parse 4415 ms, sort 132 ms, write 9484 ms, index 595 ms: 4 candidates, 88336 repo-hours, 1082 releases; waiting 938 ms; commit 1451 ms)
2026-11-07T16:04:06Z [load_day 2023-02-23] 2023-02-23 hour 18: 202252 events in 5 files, snapshot 506682027567398527 (task 16184 ms: download 8848 ms overlapping gunzip 937 ms, parse 4115 ms, sort 129 ms, write 9227 ms, index 650 ms: 5 candidates, 95887 repo-hours, 1139 releases; waiting 834 ms; commit 1453 ms)
2026-11-07T16:04:16Z [load_day 2023-02-23] 2023-02-23 hour 19: 186901 events in 4 files, snapshot 2079245713862894709 (task 16002 ms: download 9507 ms overlapping gunzip 942 ms, parse 4112 ms, sort 121 ms, write 8727 ms, index 514 ms: 3 candidates, 79363 repo-hours, 968 releases; waiting 1281 ms; commit 1321 ms)
2026-11-07T16:04:21Z [load_day 2023-02-23] 2023-02-23 hour 20: 176427 events in 4 files, snapshot 2051731641088038116 (task 14527 ms: download 8446 ms overlapping gunzip 867 ms, parse 3787 ms, sort 103 ms, write 8354 ms, index 519 ms: 10 candidates, 76579 repo-hours, 1004 releases; waiting 572 ms; commit 1491 ms)
2026-11-07T16:04:31Z [load_day 2023-02-23] 2023-02-23 hour 21: 173683 events in 4 files, snapshot 7817599226324668135 (task 14346 ms: download 8484 ms overlapping gunzip 914 ms, parse 3911 ms, sort 112 ms, write 8331 ms, index 495 ms: 15 candidates, 71288 repo-hours, 1013 releases; waiting 265 ms; commit 1434 ms)
2026-11-07T16:04:35Z [load_day 2023-02-23] 2023-02-23 hour 22: 180155 events in 4 files, snapshot 5533399411310290079 (task 13744 ms: download 7537 ms overlapping gunzip 816 ms, parse 3516 ms, sort 110 ms, write 7831 ms, index 524 ms: 5 candidates, 88790 repo-hours, 985 releases; waiting 639 ms; commit 1347 ms)
2026-11-07T16:04:45Z [load_day 2023-02-23] 2023-02-23 hour 23: 151218 events in 4 files, snapshot 308220550882157963 (task 12405 ms: download 5496 ms overlapping gunzip 778 ms, parse 3393 ms, sort 90 ms, write 6893 ms, index 402 ms: 3 candidates, 62957 repo-hours, 794 releases; waiting 521 ms; commit 1470 ms)
2026-11-07T16:04:53Z [load_day 2023-02-23] 2023-02-23: repo_hour merged from 24 files to 1 (2019945 rows, 8000 ms)
2026-11-07T16:04:54Z [load_day 2023-02-23] 2023-02-23: index committed in 9804 ms (24 + 1 + 24 files)
2026-11-07T16:04:54Z [load_day 2023-02-23] 2023-02-23: 4343447 events in 24 hours
2026-11-07T16:04:54Z [load_day 2023-02-23] attempt 1 succeeded