orcaLog in

Runs · run 843

load_day 2023-02-22, attempt 1 succeeded

Host
caf251265124:82992
Started
2026-11-07T15:57:54Z
Ended
2026-11-07T16:01:28Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/843/load_day/2023-02-22/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:57:54Z [load_day 2023-02-22] attempt 1 started
2026-11-07T15:57:56Z [load_day 2023-02-22] 2023-02-22: 2 hours in flight, about 1200 MB
2026-11-07T15:58:12Z [load_day 2023-02-22] 2023-02-22 hour 0: 164089 events in 4 files, snapshot 343866967662362947 (task 13907 ms: download 6843 ms overlapping gunzip 820 ms, parse 3571 ms, sort 101 ms, write 7213 ms, index 503 ms: 8 candidates, 77981 repo-hours, 961 releases; waiting 1316 ms; commit 1189 ms)
2026-11-07T15:58:13Z [load_day 2023-02-22] 2023-02-22 hour 1: 164285 events in 4 files, snapshot 6741617435112992344 (task 12408 ms: download 5196 ms overlapping gunzip 803 ms, parse 3419 ms, sort 91 ms, write 6929 ms, index 549 ms: 12 candidates, 82253 repo-hours, 806 releases; waiting 332 ms; commit 1458 ms)
2026-11-07T15:58:24Z [load_day 2023-02-22] 2023-02-22 hour 2: 156538 events in 4 files, snapshot 7342072978462350609 (task 11587 ms: download 4489 ms overlapping gunzip 724 ms, parse 3030 ms, sort 87 ms, write 6741 ms, index 485 ms: 9 candidates, 74449 repo-hours, 752 releases; waiting 234 ms; commit 1363 ms)
2026-11-07T15:58:27Z [load_day 2023-02-22] 2023-02-22 hour 3: 146069 events in 3 files, snapshot 6901238352821505670 (task 10953 ms: download 4636 ms overlapping gunzip 656 ms, parse 2870 ms, sort 81 ms, write 6101 ms, index 408 ms: 10 candidates, 61455 repo-hours, 864 releases; waiting 529 ms; commit 2244 ms)
2026-11-07T15:58:36Z [load_day 2023-02-22] 2023-02-22 hour 4: 137365 events in 3 files, snapshot 3745962067602079714 (task 10755 ms: download 4754 ms overlapping gunzip 651 ms, parse 2680 ms, sort 81 ms, write 6067 ms, index 361 ms: 12 candidates, 56374 repo-hours, 675 releases; waiting 516 ms; commit 1332 ms)
2026-11-07T15:58:38Z [load_day 2023-02-22] 2023-02-22 hour 5: 141128 events in 3 files, snapshot 8964242646034711544 (task 11175 ms: download 4733 ms overlapping gunzip 664 ms, parse 2918 ms, sort 85 ms, write 6255 ms, index 415 ms: 8 candidates, 60881 repo-hours, 708 releases; waiting 517 ms; commit 1392 ms)
2026-11-07T15:58:50Z [load_day 2023-02-22] 2023-02-22 hour 6: 159684 events in 4 files, snapshot 3309677956986469518 (task 13430 ms: download 6274 ms overlapping gunzip 775 ms, parse 3355 ms, sort 116 ms, write 6904 ms, index 477 ms: 16 candidates, 75651 repo-hours, 827 releases; waiting 1457 ms; commit 1556 ms)
2026-11-07T15:58:52Z [load_day 2023-02-22] 2023-02-22 hour 7: 164974 events in 4 files, snapshot 394047805001529745 (task 13159 ms: download 5318 ms overlapping gunzip 807 ms, parse 3548 ms, sort 97 ms, write 7533 ms, index 518 ms: 12 candidates, 73882 repo-hours, 949 releases; waiting 363 ms; commit 1539 ms)
2026-11-07T15:59:07Z [load_day 2023-02-22] 2023-02-22 hour 8: 184696 events in 4 files, snapshot 1527317317556765844 (task 16171 ms: download 9742 ms overlapping gunzip 937 ms, parse 4193 ms, sort 104 ms, write 8990 ms, index 528 ms: 10 candidates, 83882 repo-hours, 947 releases; waiting 1060 ms; commit 1528 ms)
2026-11-07T15:59:09Z [load_day 2023-02-22] 2023-02-22 hour 9: 197519 events in 4 files, snapshot 4774986759508398318 (task 16439 ms: download 9481 ms overlapping gunzip 978 ms, parse 4298 ms, sort 125 ms, write 9392 ms, index 544 ms: 5 candidates, 89746 repo-hours, 1136 releases; waiting 792 ms; commit 1463 ms)
2026-11-07T15:59:24Z [load_day 2023-02-22] 2023-02-22 hour 10: 192494 events in 4 files, snapshot 2080553572835459742 (task 15757 ms: download 8797 ms overlapping gunzip 970 ms, parse 4216 ms, sort 112 ms, write 8839 ms, index 539 ms: 9 candidates, 85052 repo-hours, 1123 releases; waiting 675 ms; commit 1318 ms)
2026-11-07T15:59:25Z [load_day 2023-02-22] 2023-02-22 hour 11: 184001 events in 4 files, snapshot 5281617650389697077 (task 14627 ms: download 8272 ms overlapping gunzip 894 ms, parse 3942 ms, sort 103 ms, write 8331 ms, index 559 ms: 7 candidates, 80337 repo-hours, 992 releases; waiting 502 ms; commit 1463 ms)
2026-11-07T15:59:43Z [load_day 2023-02-22] 2023-02-22 hour 12: 222066 events in 5 files, snapshot 5801821138826770839 (task 16854 ms: download 8686 ms overlapping gunzip 977 ms, parse 4309 ms, sort 121 ms, write 9644 ms, index 682 ms: 8 candidates, 109388 repo-hours, 1119 releases; waiting 652 ms; commit 3633 ms)
2026-11-07T15:59:45Z [load_day 2023-02-22] 2023-02-22 hour 13: 215864 events in 5 files, snapshot 6322046768616325145 (task 18532 ms: download 10934 ms overlapping gunzip 982 ms, parse 4407 ms, sort 119 ms, write 11448 ms, index 668 ms: 7 candidates, 106292 repo-hours, 1104 releases; waiting 505 ms; commit 1328 ms)
2026-11-07T16:00:02Z [load_day 2023-02-22] 2023-02-22 hour 14: 212320 events in 5 files, snapshot 5977223392167470558 (task 17509 ms: download 9485 ms overlapping gunzip 1044 ms, parse 4710 ms, sort 120 ms, write 10052 ms, index 673 ms: 10 candidates, 96185 repo-hours, 1220 releases; waiting 590 ms; commit 1275 ms)
2026-11-07T16:00:04Z [load_day 2023-02-22] 2023-02-22 hour 15: 216344 events in 5 files, snapshot 6303421700581279549 (task 18314 ms: download 12297 ms overlapping gunzip 1112 ms, parse 4930 ms, sort 118 ms, write 10576 ms, index 727 ms: 10 candidates, 97997 repo-hours, 1393 releases; waiting 503 ms; commit 1534 ms)
2026-11-07T16:00:20Z [load_day 2023-02-22] 2023-02-22 hour 16: 211127 events in 5 files, snapshot 7856508300724215785 (task 17356 ms: download 9372 ms overlapping gunzip 1036 ms, parse 4623 ms, sort 120 ms, write 10047 ms, index 657 ms: 15 candidates, 100495 repo-hours, 1297 releases; waiting 560 ms; commit 1494 ms)
2026-11-07T16:00:22Z [load_day 2023-02-22] 2023-02-22 hour 17: 198954 events in 4 files, snapshot 6229113878067558559 (task 17416 ms: download 9785 ms overlapping gunzip 1044 ms, parse 4593 ms, sort 113 ms, write 9399 ms, index 612 ms: 8 candidates, 87827 repo-hours, 1066 releases; waiting 1037 ms; commit 1238 ms)
2026-11-07T16:00:40Z [load_day 2023-02-22] 2023-02-22 hour 18: 195057 events in 4 files, snapshot 3349713192690350505 (task 19142 ms: download 11863 ms overlapping gunzip 957 ms, parse 4307 ms, sort 118 ms, write 12314 ms, index 560 ms: 7 candidates, 88072 repo-hours, 991 releases; waiting 523 ms; commit 1520 ms)
2026-11-07T16:00:42Z [load_day 2023-02-22] 2023-02-22 hour 19: 186053 events in 4 files, snapshot 6023638548666160325 (task 16810 ms: download 9982 ms overlapping gunzip 928 ms, parse 4088 ms, sort 112 ms, write 8998 ms, index 599 ms: 9 candidates, 81670 repo-hours, 1116 releases; waiting 1772 ms; commit 1469 ms)
2026-11-07T16:00:58Z [load_day 2023-02-22] 2023-02-22 hour 20: 182312 events in 4 files, snapshot 784383427247160145 (task 16902 ms: download 10354 ms overlapping gunzip 927 ms, parse 4031 ms, sort 103 ms, write 8511 ms, index 527 ms: 7 candidates, 80496 repo-hours, 974 releases; waiting 2401 ms; commit 1618 ms)
2026-11-07T16:00:59Z [load_day 2023-02-22] 2023-02-22 hour 21: 187254 events in 4 files, snapshot 8994271453953213388 (task 14695 ms: download 8013 ms overlapping gunzip 883 ms, parse 3762 ms, sort 111 ms, write 8810 ms, index 525 ms: 10 candidates, 87130 repo-hours, 969 releases; waiting 237 ms; commit 1373 ms)
2026-11-07T16:01:16Z [load_day 2023-02-22] 2023-02-22 hour 22: 161209 events in 4 files, snapshot 3989497961668077177 (task 17706 ms: download 12254 ms overlapping gunzip 927 ms, parse 3915 ms, sort 95 ms, write 7742 ms, index 466 ms: 5 candidates, 66612 repo-hours, 937 releases; waiting 4174 ms; commit 1459 ms)
2026-11-07T16:01:18Z [load_day 2023-02-22] 2023-02-22 hour 23: 145512 events in 3 files, snapshot 4415858539362200701 (task 12059 ms: download 5224 ms overlapping gunzip 761 ms, parse 3315 ms, sort 91 ms, write 6721 ms, index 419 ms: 3 candidates, 62781 repo-hours, 800 releases; waiting 383 ms; commit 1565 ms)
2026-11-07T16:01:26Z [load_day 2023-02-22] 2023-02-22: repo_hour merged from 24 files to 1 (1966888 rows, 8224 ms)
2026-11-07T16:01:28Z [load_day 2023-02-22] 2023-02-22: index committed in 10002 ms (24 + 1 + 24 files)
2026-11-07T16:01:28Z [load_day 2023-02-22] 2023-02-22: 4326914 events in 24 hours
2026-11-07T16:01:28Z [load_day 2023-02-22] attempt 1 succeeded