orcaLog in

Runs · run 990

load_day 2023-04-12, attempt 1 succeeded

Host
caf251265124:258538
Started
2026-11-07T18:31:35Z
Ended
2026-11-07T18:35:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/990/load_day/2023-04-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:31:35Z [load_day 2023-04-12] attempt 1 started
2026-11-07T18:31:36Z [load_day 2023-04-12] 2023-04-12: 2 hours in flight, about 1200 MB
2026-11-07T18:32:04Z [load_day 2023-04-12] 2023-04-12 hour 0: 209024 events in 5 files, snapshot 1527924921961953941 (task 24978 ms: download 18827 ms overlapping gunzip 1993 ms, parse 8139 ms, sort 104 ms, write 13079 ms, index 523 ms: 9 candidates, 89285 repo-hours, 679 releases; waiting 715 ms; commit 1547 ms)
2026-11-07T18:32:09Z [load_day 2023-04-12] 2023-04-12 hour 1: 218431 events in 5 files, snapshot 3557331207083562373 (task 25056 ms: download 18553 ms overlapping gunzip 2006 ms, parse 8148 ms, sort 98 ms, write 13385 ms, index 597 ms: 5 candidates, 99389 repo-hours, 555 releases; waiting 513 ms; commit 5062 ms)
2026-11-07T18:32:32Z [load_day 2023-04-12] 2023-04-12 hour 2: 225244 events in 5 files, snapshot 2566946603547077006 (task 27267 ms: download 19994 ms overlapping gunzip 2189 ms, parse 9023 ms, sort 118 ms, write 14506 ms, index 541 ms: 10 candidates, 86332 repo-hours, 600 releases; waiting 656 ms; commit 1527 ms)
2026-11-07T18:32:34Z [load_day 2023-04-12] 2023-04-12 hour 3: 222186 events in 5 files, snapshot 5111964620814154178 (task 26299 ms: download 19363 ms overlapping gunzip 2154 ms, parse 8984 ms, sort 124 ms, write 13989 ms, index 515 ms: 5 candidates, 81634 repo-hours, 749 releases; waiting 317 ms; commit 1563 ms)
2026-11-07T18:32:59Z [load_day 2023-04-12] 2023-04-12 hour 4: 224197 events in 5 files, snapshot 4627309268999867492 (task 26659 ms: download 19462 ms overlapping gunzip 2121 ms, parse 8852 ms, sort 120 ms, write 14187 ms, index 525 ms: 7 candidates, 81300 repo-hours, 542 releases; waiting 555 ms; commit 1647 ms)
2026-11-07T18:33:01Z [load_day 2023-04-12] 2023-04-12 hour 5: 211453 events in 5 files, snapshot 4864021194105286591 (task 24340 ms: download 18375 ms overlapping gunzip 2035 ms, parse 7695 ms, sort 120 ms, write 13002 ms, index 493 ms: 5 candidates, 80920 repo-hours, 639 releases; waiting 527 ms; commit 1443 ms)
2026-11-07T18:33:17Z [load_day 2023-04-12] 2023-04-12 hour 6: 190371 events in 4 files, snapshot 2165138746501240976 (task 16901 ms: download 10451 ms overlapping gunzip 1202 ms, parse 4557 ms, sort 102 ms, write 9471 ms, index 574 ms: 6 candidates, 89035 repo-hours, 843 releases; waiting 671 ms; commit 1564 ms)
2026-11-07T18:33:19Z [load_day 2023-04-12] 2023-04-12 hour 7: 175983 events in 4 files, snapshot 6659288964951794175 (task 14633 ms: download 8769 ms overlapping gunzip 904 ms, parse 3859 ms, sort 111 ms, write 8016 ms, index 537 ms: 7 candidates, 84284 repo-hours, 818 releases; waiting 843 ms; commit 1655 ms)
2026-11-07T18:33:34Z [load_day 2023-04-12] 2023-04-12 hour 8: 182220 events in 4 files, snapshot 4452404450594935730 (task 16695 ms: download 10293 ms overlapping gunzip 978 ms, parse 4042 ms, sort 113 ms, write 8810 ms, index 538 ms: 5 candidates, 86977 repo-hours, 972 releases; waiting 1886 ms; commit 1650 ms)
2026-11-07T18:33:36Z [load_day 2023-04-12] 2023-04-12 hour 9: 178501 events in 4 files, snapshot 8916924282622378123 (task 15090 ms: download 9098 ms overlapping gunzip 946 ms, parse 4010 ms, sort 99 ms, write 8674 ms, index 544 ms: 4 candidates, 85164 repo-hours, 987 releases; waiting 531 ms; commit 1597 ms)
2026-11-07T18:33:51Z [load_day 2023-04-12] 2023-04-12 hour 10: 178791 events in 4 files, snapshot 7598892817075150602 (task 15894 ms: download 9962 ms overlapping gunzip 959 ms, parse 4074 ms, sort 111 ms, write 8193 ms, index 532 ms: 5 candidates, 84226 repo-hours, 912 releases; waiting 1738 ms; commit 1562 ms)
2026-11-07T18:33:53Z [load_day 2023-04-12] 2023-04-12 hour 11: 180168 events in 4 files, snapshot 4045148984797411490 (task 14388 ms: download 8297 ms overlapping gunzip 869 ms, parse 3827 ms, sort 110 ms, write 8123 ms, index 525 ms: 5 candidates, 83514 repo-hours, 1049 releases; waiting 576 ms; commit 1529 ms)
2026-11-07T18:34:08Z [load_day 2023-04-12] 2023-04-12 hour 12: 218266 events in 5 files, snapshot 2891108272984053423 (task 16091 ms: download 8541 ms overlapping gunzip 918 ms, parse 4080 ms, sort 143 ms, write 9031 ms, index 702 ms: 11 candidates, 113947 repo-hours, 1054 releases; waiting 921 ms; commit 1568 ms)
2026-11-07T18:34:10Z [load_day 2023-04-12] 2023-04-12 hour 13: 185489 events in 4 files, snapshot 2663144414273647322 (task 15073 ms: download 8343 ms overlapping gunzip 874 ms, parse 3875 ms, sort 112 ms, write 8756 ms, index 584 ms: 9 candidates, 98365 repo-hours, 898 releases; waiting 559 ms; commit 1535 ms)
2026-11-07T18:34:27Z [load_day 2023-04-12] 2023-04-12 hour 14: 213188 events in 5 files, snapshot 4846934249345810144 (task 18266 ms: download 10339 ms overlapping gunzip 1076 ms, parse 4666 ms, sort 121 ms, write 10252 ms, index 660 ms: 5 candidates, 105009 repo-hours, 1016 releases; waiting 1078 ms; commit 1593 ms)
2026-11-07T18:34:29Z [load_day 2023-04-12] 2023-04-12 hour 15: 198995 events in 4 files, snapshot 6119894114516302252 (task 16487 ms: download 9140 ms overlapping gunzip 976 ms, parse 4196 ms, sort 122 ms, write 9545 ms, index 644 ms: 1 candidates, 101159 repo-hours, 1093 releases; waiting 695 ms; commit 1585 ms)
2026-11-07T18:34:44Z [load_day 2023-04-12] 2023-04-12 hour 16: 202378 events in 5 files, snapshot 2805416640607502402 (task 16242 ms: download 8757 ms overlapping gunzip 948 ms, parse 4099 ms, sort 132 ms, write 9404 ms, index 669 ms: 2 candidates, 100401 repo-hours, 1019 releases; waiting 659 ms; commit 1581 ms)
2026-11-07T18:34:46Z [load_day 2023-04-12] 2023-04-12 hour 17: 205327 events in 5 files, snapshot 5545377116226670892 (task 16883 ms: download 9266 ms overlapping gunzip 1008 ms, parse 4487 ms, sort 136 ms, write 9668 ms, index 703 ms: 5 candidates, 90426 repo-hours, 1019 releases; waiting 618 ms; commit 1617 ms)
2026-11-07T18:35:01Z [load_day 2023-04-12] 2023-04-12 hour 18: 196529 events in 4 files, snapshot 2150202259589800748 (task 15628 ms: download 8623 ms overlapping gunzip 949 ms, parse 4114 ms, sort 117 ms, write 9047 ms, index 579 ms: 7 candidates, 89889 repo-hours, 1106 releases; waiting 510 ms; commit 1621 ms)
2026-11-07T18:35:03Z [load_day 2023-04-12] 2023-04-12 hour 19: 193350 events in 4 files, snapshot 3837032299413597241 (task 15096 ms: download 8381 ms overlapping gunzip 907 ms, parse 4114 ms, sort 129 ms, write 8595 ms, index 563 ms: 7 candidates, 84628 repo-hours, 979 releases; waiting 516 ms; commit 1817 ms)
2026-11-07T18:35:18Z [load_day 2023-04-12] 2023-04-12 hour 20: 190714 events in 4 files, snapshot 5434475065699879534 (task 16271 ms: download 9453 ms overlapping gunzip 996 ms, parse 4268 ms, sort 116 ms, write 9320 ms, index 536 ms: 3 candidates, 85262 repo-hours, 960 releases; waiting 747 ms; commit 1541 ms)
2026-11-07T18:35:19Z [load_day 2023-04-12] 2023-04-12 hour 21: 174718 events in 4 files, snapshot 6602047776261939931 (task 14422 ms: download 8581 ms overlapping gunzip 930 ms, parse 3967 ms, sort 102 ms, write 8359 ms, index 469 ms: 6 candidates, 71185 repo-hours, 1056 releases; waiting 300 ms; commit 1585 ms)
2026-11-07T18:35:33Z [load_day 2023-04-12] 2023-04-12 hour 22: 156095 events in 4 files, snapshot 6880337015710072731 (task 14568 ms: download 7630 ms overlapping gunzip 798 ms, parse 3450 ms, sort 110 ms, write 6857 ms, index 400 ms: 5 candidates, 62747 repo-hours, 827 releases; waiting 2674 ms; commit 1471 ms)
2026-11-07T18:35:34Z [load_day 2023-04-12] 2023-04-12 hour 23: 142393 events in 3 files, snapshot 6563060260419921943 (task 11272 ms: download 5039 ms overlapping gunzip 660 ms, parse 2977 ms, sort 91 ms, write 6296 ms, index 397 ms: 3 candidates, 59604 repo-hours, 740 releases; waiting 609 ms; commit 1485 ms)
2026-11-07T18:35:43Z [load_day 2023-04-12] 2023-04-12: repo_hour merged from 24 files to 1 (2094682 rows, 8536 ms)
2026-11-07T18:35:45Z [load_day 2023-04-12] 2023-04-12: index committed in 10645 ms (24 + 1 + 24 files)
2026-11-07T18:35:45Z [load_day 2023-04-12] 2023-04-12: 4674011 events in 24 hours
2026-11-07T18:35:45Z [load_day 2023-04-12] attempt 1 succeeded