orcaLog in

Runs · run 915

load_day 2023-03-18, attempt 1 succeeded

Host
caf251265124:176248
Started
2026-11-07T17:18:07Z
Ended
2026-11-07T17:20:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/915/load_day/2023-03-18/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:18:07Z [load_day 2023-03-18] attempt 1 started
2026-11-07T17:18:08Z [load_day 2023-03-18] 2023-03-18: 2 hours in flight, about 1200 MB
2026-11-07T17:18:21Z [load_day 2023-03-18] 2023-03-18 hour 0: 150124 events in 4 files, snapshot 7658254239429036070 (task 9926 ms: download 3856 ms overlapping gunzip 546 ms, parse 2498 ms, sort 102 ms, write 5367 ms, index 509 ms: 7 candidates, 80648 repo-hours, 1274 releases; waiting 561 ms; commit 1663 ms)
2026-11-07T17:18:22Z [load_day 2023-03-18] 2023-03-18 hour 1: 135722 events in 3 files, snapshot 618662831195614810 (task 9177 ms: download 3768 ms overlapping gunzip 516 ms, parse 2274 ms, sort 78 ms, write 4812 ms, index 535 ms: 3 candidates, 69019 repo-hours, 1299 releases; waiting 602 ms; commit 1484 ms)
2026-11-07T17:18:30Z [load_day 2023-03-18] 2023-03-18 hour 2: 116303 events in 3 files, snapshot 503232947045153957 (task 8401 ms: download 2539 ms overlapping gunzip 432 ms, parse 1901 ms, sort 67 ms, write 4168 ms, index 355 ms: 5 candidates, 50505 repo-hours, 1063 releases; waiting 1130 ms; commit 1499 ms)
2026-11-07T17:18:31Z [load_day 2023-03-18] 2023-03-18 hour 3: 103905 events in 3 files, snapshot 1296503945157904907 (task 6822 ms: download 2216 ms overlapping gunzip 380 ms, parse 1691 ms, sort 74 ms, write 3442 ms, index 334 ms: 3 candidates, 42164 repo-hours, 1144 releases; waiting 517 ms; commit 1446 ms)
2026-11-07T17:18:38Z [load_day 2023-03-18] 2023-03-18 hour 4: 107567 events in 3 files, snapshot 6466163063578038594 (task 6994 ms: download 1774 ms overlapping gunzip 371 ms, parse 1618 ms, sort 76 ms, write 3771 ms, index 336 ms: 1 candidates, 48835 repo-hours, 940 releases; waiting 545 ms; commit 1633 ms)
2026-11-07T17:18:40Z [load_day 2023-03-18] 2023-03-18 hour 5: 103063 events in 3 files, snapshot 8089715245859111791 (task 6902 ms: download 2055 ms overlapping gunzip 381 ms, parse 1721 ms, sort 62 ms, write 3580 ms, index 293 ms: 1 candidates, 42704 repo-hours, 683 releases; waiting 549 ms; commit 1495 ms)
2026-11-07T17:18:46Z [load_day 2023-03-18] 2023-03-18 hour 6: 122255 events in 3 files, snapshot 5241007001492019089 (task 7384 ms: download 2117 ms overlapping gunzip 413 ms, parse 1825 ms, sort 70 ms, write 3936 ms, index 340 ms: 4 candidates, 55642 repo-hours, 612 releases; waiting 505 ms; commit 1584 ms)
2026-11-07T17:18:50Z [load_day 2023-03-18] 2023-03-18 hour 7: 114143 events in 3 files, snapshot 2825889674291452812 (task 7170 ms: download 1727 ms overlapping gunzip 399 ms, parse 1764 ms, sort 60 ms, write 3653 ms, index 317 ms: 5 candidates, 47251 repo-hours, 561 releases; waiting 649 ms; commit 4354 ms)
2026-11-07T17:18:55Z [load_day 2023-03-18] 2023-03-18 hour 8: 122704 events in 3 files, snapshot 7328789658973832123 (task 8049 ms: download 2052 ms overlapping gunzip 456 ms, parse 1957 ms, sort 72 ms, write 4405 ms, index 339 ms: 4 candidates, 51661 repo-hours, 654 releases; waiting 513 ms; commit 1402 ms)
2026-11-07T17:18:57Z [load_day 2023-03-18] 2023-03-18 hour 9: 126057 events in 3 files, snapshot 1467274870252761532 (task 8251 ms: download 2360 ms overlapping gunzip 481 ms, parse 2143 ms, sort 74 ms, write 4452 ms, index 358 ms: 11 candidates, 52876 repo-hours, 769 releases; waiting 445 ms; commit 1619 ms)
2026-11-07T17:19:05Z [load_day 2023-03-18] 2023-03-18 hour 10: 137847 events in 3 files, snapshot 652259097166590317 (task 9176 ms: download 3741 ms overlapping gunzip 510 ms, parse 2266 ms, sort 95 ms, write 4729 ms, index 411 ms: 4 candidates, 61325 repo-hours, 655 releases; waiting 843 ms; commit 1373 ms)
2026-11-07T17:19:06Z [load_day 2023-03-18] 2023-03-18 hour 11: 139295 events in 3 files, snapshot 4433527824575447742 (task 8086 ms: download 2484 ms overlapping gunzip 441 ms, parse 1995 ms, sort 84 ms, write 4288 ms, index 411 ms: 7 candidates, 69363 repo-hours, 634 releases; waiting 524 ms; commit 1553 ms)
2026-11-07T17:19:17Z [load_day 2023-03-18] 2023-03-18 hour 12: 183678 events in 4 files, snapshot 7396174208655512967 (task 10829 ms: download 4002 ms overlapping gunzip 620 ms, parse 2783 ms, sort 109 ms, write 5866 ms, index 521 ms: 3 candidates, 84834 repo-hours, 825 releases; waiting 595 ms; commit 1389 ms)
2026-11-07T17:19:18Z [load_day 2023-03-18] 2023-03-18 hour 13: 167928 events in 4 files, snapshot 1543038434262279302 (task 10865 ms: download 4144 ms overlapping gunzip 640 ms, parse 2775 ms, sort 96 ms, write 5908 ms, index 517 ms: 7 candidates, 83031 repo-hours, 722 releases; waiting 617 ms; commit 1382 ms)
2026-11-07T17:19:29Z [load_day 2023-03-18] 2023-03-18 hour 14: 156181 events in 4 files, snapshot 5955658072876612334 (task 11006 ms: download 4780 ms overlapping gunzip 648 ms, parse 2734 ms, sort 93 ms, write 5873 ms, index 430 ms: 4 candidates, 66965 repo-hours, 831 releases; waiting 757 ms; commit 1666 ms)
2026-11-07T17:19:30Z [load_day 2023-03-18] 2023-03-18 hour 15: 151873 events in 4 files, snapshot 876112797724871639 (task 9603 ms: download 3706 ms overlapping gunzip 532 ms, parse 2420 ms, sort 100 ms, write 5191 ms, index 434 ms: 4 candidates, 66484 repo-hours, 1000 releases; waiting 530 ms; commit 1446 ms)
2026-11-07T17:19:39Z [load_day 2023-03-18] 2023-03-18 hour 16: 151137 events in 4 files, snapshot 6769398567533065591 (task 10059 ms: download 3950 ms overlapping gunzip 554 ms, parse 2455 ms, sort 103 ms, write 5740 ms, index 471 ms: 4 candidates, 66081 repo-hours, 864 releases; waiting 507 ms; commit 1365 ms)
2026-11-07T17:19:40Z [load_day 2023-03-18] 2023-03-18 hour 17: 148095 events in 3 files, snapshot 1475626659295633122 (task 9829 ms: download 3833 ms overlapping gunzip 538 ms, parse 2422 ms, sort 111 ms, write 5359 ms, index 488 ms: 3 candidates, 61962 repo-hours, 785 releases; waiting 559 ms; commit 1291 ms)
2026-11-07T17:19:49Z [load_day 2023-03-18] 2023-03-18 hour 18: 146571 events in 3 files, snapshot 6950814765814859718 (task 9355 ms: download 3733 ms overlapping gunzip 533 ms, parse 2346 ms, sort 82 ms, write 5113 ms, index 429 ms: 8 candidates, 64906 repo-hours, 854 releases; waiting 533 ms; commit 1469 ms)
2026-11-07T17:19:51Z [load_day 2023-03-18] 2023-03-18 hour 19: 130720 events in 3 files, snapshot 1022437498243029524 (task 8420 ms: download 2290 ms overlapping gunzip 459 ms, parse 2106 ms, sort 79 ms, write 4568 ms, index 355 ms: 6 candidates, 54337 repo-hours, 704 releases; waiting 507 ms; commit 1349 ms)
2026-11-07T17:19:59Z [load_day 2023-03-18] 2023-03-18 hour 20: 133251 events in 3 files, snapshot 6484524207246730239 (task 8822 ms: download 2609 ms overlapping gunzip 490 ms, parse 2174 ms, sort 80 ms, write 4769 ms, index 370 ms: 1 candidates, 56793 repo-hours, 698 releases; waiting 558 ms; commit 1540 ms)
2026-11-07T17:20:01Z [load_day 2023-03-18] 2023-03-18 hour 21: 120071 events in 3 files, snapshot 5518742083272954560 (task 8152 ms: download 2579 ms overlapping gunzip 435 ms, parse 1973 ms, sort 79 ms, write 4208 ms, index 315 ms: 6 candidates, 48238 repo-hours, 770 releases; waiting 755 ms; commit 1493 ms)
2026-11-07T17:20:07Z [load_day 2023-03-18] 2023-03-18 hour 22: 111425 events in 3 files, snapshot 7712925108689515551 (task 7569 ms: download 2169 ms overlapping gunzip 418 ms, parse 1846 ms, sort 71 ms, write 4038 ms, index 319 ms: 2 candidates, 44649 repo-hours, 593 releases; waiting 517 ms; commit 1456 ms)
2026-11-07T17:20:09Z [load_day 2023-03-18] 2023-03-18 hour 23: 105918 events in 3 files, snapshot 8681645184957883903 (task 7390 ms: download 2319 ms overlapping gunzip 400 ms, parse 1828 ms, sort 70 ms, write 3692 ms, index 343 ms: 3 candidates, 42950 repo-hours, 552 releases; waiting 698 ms; commit 1652 ms)
2026-11-07T17:20:15Z [load_day 2023-03-18] 2023-03-18: repo_hour merged from 24 files to 1 (1413223 rows, 5916 ms)
2026-11-07T17:20:17Z [load_day 2023-03-18] 2023-03-18: index committed in 8146 ms (24 + 1 + 24 files)
2026-11-07T17:20:17Z [load_day 2023-03-18] 2023-03-18: 3185833 events in 24 hours
2026-11-07T17:20:17Z [load_day 2023-03-18] attempt 1 succeeded