orcaLog in

Runs · run 858

load_day 2023-02-27, attempt 1 succeeded

Host
caf251265124:99464
Started
2026-11-07T16:12:26Z
Ended
2026-11-07T16:16:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/858/load_day/2023-02-27/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:12:26Z [load_day 2023-02-27] attempt 1 started
2026-11-07T16:12:27Z [load_day 2023-02-27] 2023-02-27: 2 hours in flight, about 1200 MB
2026-11-07T16:12:39Z [load_day 2023-02-27] 2023-02-27 hour 0: 135247 events in 3 files, snapshot 5228297686960103019 (task 9452 ms: download 2194 ms overlapping gunzip 543 ms, parse 2432 ms, sort 85 ms, write 5000 ms, index 501 ms: 2 candidates, 69887 repo-hours, 806 releases; waiting 508 ms; commit 1413 ms)
2026-11-07T16:12:41Z [load_day 2023-02-27] 2023-02-27 hour 1: 149826 events in 3 files, snapshot 1146625716028348559 (task 11804 ms: download 5020 ms overlapping gunzip 771 ms, parse 3110 ms, sort 92 ms, write 6355 ms, index 509 ms: 8 candidates, 77118 repo-hours, 766 releases; waiting 599 ms; commit 1665 ms)
2026-11-07T16:12:55Z [load_day 2023-02-27] 2023-02-27 hour 2: 161801 events in 4 files, snapshot 1327486330319269935 (task 15230 ms: download 9660 ms overlapping gunzip 1142 ms, parse 4380 ms, sort 103 ms, write 8368 ms, index 440 ms: 6 candidates, 70456 repo-hours, 748 releases; waiting 550 ms; commit 1518 ms)
2026-11-07T16:12:56Z [load_day 2023-02-27] 2023-02-27 hour 3: 150312 events in 4 files, snapshot 2369216791785703169 (task 13234 ms: download 6184 ms overlapping gunzip 924 ms, parse 3643 ms, sort 100 ms, write 7336 ms, index 387 ms: 8 candidates, 59016 repo-hours, 810 releases; waiting 544 ms; commit 1496 ms)
2026-11-07T16:13:09Z [load_day 2023-02-27] 2023-02-27 hour 4: 143755 events in 3 files, snapshot 5242736586388907254 (task 13943 ms: download 7463 ms overlapping gunzip 931 ms, parse 3729 ms, sort 99 ms, write 6984 ms, index 331 ms: 5 candidates, 54185 repo-hours, 548 releases; waiting 1483 ms; commit 1599 ms)
2026-11-07T16:13:12Z [load_day 2023-02-27] 2023-02-27 hour 5: 157823 events in 4 files, snapshot 5676095572151843658 (task 14796 ms: download 7334 ms overlapping gunzip 1035 ms, parse 4146 ms, sort 96 ms, write 8070 ms, index 401 ms: 1 candidates, 60350 repo-hours, 730 releases; waiting 749 ms; commit 1492 ms)
2026-11-07T16:13:27Z [load_day 2023-02-27] 2023-02-27 hour 6: 170435 events in 4 files, snapshot 1502052651586528708 (task 16537 ms: download 11215 ms overlapping gunzip 1062 ms, parse 4328 ms, sort 108 ms, write 7872 ms, index 459 ms: 4 candidates, 71712 repo-hours, 743 releases; waiting 2355 ms; commit 1561 ms)
2026-11-07T16:13:28Z [load_day 2023-02-27] 2023-02-27 hour 7: 173840 events in 4 files, snapshot 215155552841143120 (task 15054 ms: download 9421 ms overlapping gunzip 1016 ms, parse 4168 ms, sort 106 ms, write 8457 ms, index 465 ms: 4 candidates, 72851 repo-hours, 779 releases; waiting 554 ms; commit 1450 ms)
2026-11-07T16:13:44Z [load_day 2023-02-27] 2023-02-27 hour 8: 182678 events in 4 files, snapshot 7815935465513467891 (task 16831 ms: download 9661 ms overlapping gunzip 1094 ms, parse 4419 ms, sort 116 ms, write 9889 ms, index 573 ms: 4 candidates, 79280 repo-hours, 933 releases; waiting 106 ms; commit 1428 ms)
2026-11-07T16:13:49Z [load_day 2023-02-27] 2023-02-27 hour 9: 202995 events in 5 files, snapshot 1314751633767982551 (task 20057 ms: download 11922 ms overlapping gunzip 1313 ms, parse 5313 ms, sort 141 ms, write 11178 ms, index 571 ms: 14 candidates, 84754 repo-hours, 1220 releases; waiting 1235 ms; commit 1515 ms)
2026-11-07T16:14:03Z [load_day 2023-02-27] 2023-02-27 hour 10: 196249 events in 4 files, snapshot 2396246411956090465 (task 17893 ms: download 10327 ms overlapping gunzip 1127 ms, parse 4667 ms, sort 115 ms, write 10227 ms, index 574 ms: 9 candidates, 85020 repo-hours, 1018 releases; waiting 807 ms; commit 1509 ms)
2026-11-07T16:14:08Z [load_day 2023-02-27] 2023-02-27 hour 11: 210059 events in 5 files, snapshot 8747513991402117694 (task 18437 ms: download 10842 ms overlapping gunzip 1142 ms, parse 4685 ms, sort 135 ms, write 10858 ms, index 636 ms: 6 candidates, 101335 repo-hours, 893 releases; waiting 593 ms; commit 1426 ms)
2026-11-07T16:14:23Z [load_day 2023-02-27] 2023-02-27 hour 12: 233329 events in 5 files, snapshot 7662385243640588343 (task 20107 ms: download 13501 ms overlapping gunzip 1281 ms, parse 5259 ms, sort 136 ms, write 11637 ms, index 702 ms: 16 candidates, 109503 repo-hours, 1131 releases; waiting 687 ms; commit 1433 ms)
2026-11-07T16:14:30Z [load_day 2023-02-27] 2023-02-27 hour 13: 237340 events in 5 files, snapshot 2366815110049037710 (task 20169 ms: download 12898 ms overlapping gunzip 1247 ms, parse 5160 ms, sort 137 ms, write 11218 ms, index 1358 ms: 9 candidates, 119266 repo-hours, 1079 releases; waiting 723 ms; commit 2164 ms)
2026-11-07T16:14:47Z [load_day 2023-02-27] 2023-02-27 hour 14: 229327 events in 5 files, snapshot 2439395248740977841 (task 23293 ms: download 14348 ms overlapping gunzip 1352 ms, parse 5492 ms, sort 138 ms, write 14374 ms, index 635 ms: 6 candidates, 103990 repo-hours, 1189 releases; waiting 908 ms; commit 1398 ms)
2026-11-07T16:14:52Z [load_day 2023-02-27] 2023-02-27 hour 15: 227287 events in 5 files, snapshot 6983036474140588620 (task 22094 ms: download 15353 ms overlapping gunzip 1393 ms, parse 5635 ms, sort 137 ms, write 13403 ms, index 633 ms: 4 candidates, 98929 repo-hours, 1416 releases; waiting 435 ms; commit 1370 ms)
2026-11-07T16:15:09Z [load_day 2023-02-27] 2023-02-27 hour 16: 221203 events in 5 files, snapshot 758287854608223558 (task 20929 ms: download 14476 ms overlapping gunzip 1338 ms, parse 5434 ms, sort 133 ms, write 12309 ms, index 648 ms: 6 candidates, 99404 repo-hours, 1110 releases; waiting 755 ms; commit 1525 ms)
2026-11-07T16:15:13Z [load_day 2023-02-27] 2023-02-27 hour 17: 209349 events in 5 files, snapshot 8537218909542783934 (task 19653 ms: download 14070 ms overlapping gunzip 1260 ms, parse 5210 ms, sort 142 ms, write 11368 ms, index 530 ms: 6 candidates, 89407 repo-hours, 1002 releases; waiting 826 ms; commit 1646 ms)
2026-11-07T16:15:27Z [load_day 2023-02-27] 2023-02-27 hour 18: 187957 events in 4 files, snapshot 4745049065478956988 (task 17323 ms: download 10351 ms overlapping gunzip 1099 ms, parse 4522 ms, sort 95 ms, write 9948 ms, index 590 ms: 4 candidates, 84751 repo-hours, 944 releases; waiting 765 ms; commit 1374 ms)
2026-11-07T16:15:32Z [load_day 2023-02-27] 2023-02-27 hour 19: 171240 events in 4 files, snapshot 5268482692763899638 (task 18731 ms: download 12856 ms overlapping gunzip 1031 ms, parse 4185 ms, sort 104 ms, write 8846 ms, index 495 ms: 10 candidates, 75881 repo-hours, 835 releases; waiting 3743 ms; commit 1513 ms)
2026-11-07T16:15:47Z [load_day 2023-02-27] 2023-02-27 hour 20: 178901 events in 4 files, snapshot 4021792214893734691 (task 18482 ms: download 11735 ms overlapping gunzip 1223 ms, parse 4963 ms, sort 109 ms, write 9627 ms, index 501 ms: 11 candidates, 77417 repo-hours, 783 releases; waiting 1733 ms; commit 1760 ms)
2026-11-07T16:15:53Z [load_day 2023-02-27] 2023-02-27 hour 21: 200408 events in 5 files, snapshot 9174146497595072574 (task 20042 ms: download 14715 ms overlapping gunzip 1428 ms, parse 5642 ms, sort 136 ms, write 11404 ms, index 499 ms: 9 candidates, 77033 repo-hours, 925 releases; waiting 605 ms; commit 1345 ms)
2026-11-07T16:16:03Z [load_day 2023-02-27] 2023-02-27 hour 22: 172688 events in 4 files, snapshot 5229885727198835193 (task 15458 ms: download 9384 ms overlapping gunzip 1021 ms, parse 4119 ms, sort 107 ms, write 8740 ms, index 468 ms: 8 candidates, 70682 repo-hours, 960 releases; waiting 697 ms; commit 1630 ms)
2026-11-07T16:16:14Z [load_day 2023-02-27] 2023-02-27 hour 23: 163892 events in 4 files, snapshot 3943612612630829203 (task 18103 ms: download 12640 ms overlapping gunzip 1082 ms, parse 4376 ms, sort 102 ms, write 8589 ms, index 406 ms: 4 candidates, 65517 repo-hours, 877 releases; waiting 3126 ms; commit 4104 ms)
2026-11-07T16:16:22Z [load_day 2023-02-27] 2023-02-27: repo_hour merged from 24 files to 1 (1957744 rows, 7882 ms)
2026-11-07T16:16:24Z [load_day 2023-02-27] 2023-02-27: index committed in 10043 ms (24 + 1 + 24 files)
2026-11-07T16:16:24Z [load_day 2023-02-27] 2023-02-27: 4467941 events in 24 hours
2026-11-07T16:16:24Z [load_day 2023-02-27] attempt 1 succeeded