orcaLog in

Runs · run 957

load_day 2023-04-01, attempt 1 succeeded

Host
caf251265124:223540
Started
2026-11-07T17:59:57Z
Ended
2026-11-07T18:02:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/957/load_day/2023-04-01/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:59:57Z [load_day 2023-04-01] attempt 1 started
2026-11-07T17:59:58Z [load_day 2023-04-01] 2023-04-01: 2 hours in flight, about 1200 MB
2026-11-07T18:00:14Z [load_day 2023-04-01] 2023-04-01 hour 0: 140840 events in 3 files, snapshot 8263077749111814091 (task 12411 ms: download 6080 ms overlapping gunzip 653 ms, parse 2897 ms, sort 96 ms, write 6175 ms, index 594 ms: 6 candidates, 70555 repo-hours, 1020 releases; waiting 1670 ms; commit 1688 ms)
2026-11-07T18:00:15Z [load_day 2023-04-01] 2023-04-01 hour 1: 144464 events in 3 files, snapshot 4519079716174177797 (task 11614 ms: download 5322 ms overlapping gunzip 608 ms, parse 2672 ms, sort 105 ms, write 5932 ms, index 521 ms: 5 candidates, 78305 repo-hours, 869 releases; waiting 1369 ms; commit 1572 ms)
2026-11-07T18:00:24Z [load_day 2023-04-01] 2023-04-01 hour 2: 120577 events in 3 files, snapshot 4093503220362967775 (task 9968 ms: download 4361 ms overlapping gunzip 584 ms, parse 2426 ms, sort 85 ms, write 5549 ms, index 355 ms: 1 candidates, 51655 repo-hours, 782 releases; waiting 529 ms; commit 1541 ms)
2026-11-07T18:00:26Z [load_day 2023-04-01] 2023-04-01 hour 3: 117249 events in 3 files, snapshot 3333445611184520294 (task 9651 ms: download 2721 ms overlapping gunzip 556 ms, parse 2347 ms, sort 78 ms, write 4899 ms, index 340 ms: 6 candidates, 47958 repo-hours, 757 releases; waiting 1075 ms; commit 1362 ms)
2026-11-07T18:00:34Z [load_day 2023-04-01] 2023-04-01 hour 4: 112175 events in 3 files, snapshot 4227619608175552810 (task 8383 ms: download 2239 ms overlapping gunzip 497 ms, parse 2096 ms, sort 80 ms, write 4538 ms, index 352 ms: 2 candidates, 46083 repo-hours, 552 releases; waiting 519 ms; commit 1514 ms)
2026-11-07T18:00:36Z [load_day 2023-04-01] 2023-04-01 hour 5: 118693 events in 3 files, snapshot 4315581329965436735 (task 9176 ms: download 2896 ms overlapping gunzip 517 ms, parse 2155 ms, sort 88 ms, write 4472 ms, index 381 ms: 3 candidates, 48186 repo-hours, 652 releases; waiting 1205 ms; commit 1649 ms)
2026-11-07T18:00:43Z [load_day 2023-04-01] 2023-04-01 hour 6: 124322 events in 3 files, snapshot 5416217227399954659 (task 8802 ms: download 2267 ms overlapping gunzip 482 ms, parse 2119 ms, sort 80 ms, write 4672 ms, index 389 ms: 4 candidates, 56366 repo-hours, 624 releases; waiting 702 ms; commit 1585 ms)
2026-11-07T18:00:46Z [load_day 2023-04-01] 2023-04-01 hour 7: 130690 events in 3 files, snapshot 281645245888311291 (task 9382 ms: download 3980 ms overlapping gunzip 548 ms, parse 2354 ms, sort 77 ms, write 5136 ms, index 363 ms: 2 candidates, 53790 repo-hours, 813 releases; waiting 606 ms; commit 1697 ms)
2026-11-07T18:00:54Z [load_day 2023-04-01] 2023-04-01 hour 8: 131595 events in 3 files, snapshot 7137503773859318623 (task 9751 ms: download 4022 ms overlapping gunzip 563 ms, parse 2368 ms, sort 92 ms, write 5491 ms, index 395 ms: 9 candidates, 57050 repo-hours, 740 releases; waiting 512 ms; commit 1632 ms)
2026-11-07T18:00:57Z [load_day 2023-04-01] 2023-04-01 hour 9: 134171 events in 3 files, snapshot 7358672087713221737 (task 9885 ms: download 4191 ms overlapping gunzip 558 ms, parse 2433 ms, sort 94 ms, write 5506 ms, index 392 ms: 3 candidates, 57186 repo-hours, 869 releases; waiting 532 ms; commit 1693 ms)
2026-11-07T18:01:06Z [load_day 2023-04-01] 2023-04-01 hour 10: 134995 events in 3 files, snapshot 5390619775230746856 (task 11024 ms: download 5108 ms overlapping gunzip 613 ms, parse 2596 ms, sort 94 ms, write 5444 ms, index 404 ms: 1 candidates, 57870 repo-hours, 812 releases; waiting 1548 ms; commit 1800 ms)
2026-11-07T18:01:09Z [load_day 2023-04-01] 2023-04-01 hour 11: 135103 events in 3 files, snapshot 5205170407878895846 (task 11546 ms: download 5519 ms overlapping gunzip 617 ms, parse 2615 ms, sort 100 ms, write 5678 ms, index 410 ms: 1 candidates, 56818 repo-hours, 790 releases; waiting 1768 ms; commit 1636 ms)
2026-11-07T18:01:19Z [load_day 2023-04-01] 2023-04-01 hour 12: 204757 events in 5 files, snapshot 7498448767930991640 (task 12389 ms: download 6368 ms overlapping gunzip 717 ms, parse 3207 ms, sort 110 ms, write 6953 ms, index 557 ms: 6 candidates, 88748 repo-hours, 993 releases; waiting 503 ms; commit 1601 ms)
2026-11-07T18:01:21Z [load_day 2023-04-01] 2023-04-01 hour 13: 169593 events in 4 files, snapshot 3441616025729876844 (task 11151 ms: download 4291 ms overlapping gunzip 644 ms, parse 2831 ms, sort 103 ms, write 6211 ms, index 534 ms: 3 candidates, 82947 repo-hours, 860 releases; waiting 540 ms; commit 1567 ms)
2026-11-07T18:01:32Z [load_day 2023-04-01] 2023-04-01 hour 14: 161174 events in 4 files, snapshot 7337578128462128555 (task 11750 ms: download 4708 ms overlapping gunzip 679 ms, parse 2857 ms, sort 105 ms, write 6766 ms, index 468 ms: 1 candidates, 70146 repo-hours, 867 releases; waiting 563 ms; commit 1538 ms)
2026-11-07T18:01:36Z [load_day 2023-04-01] 2023-04-01 hour 15: 162887 events in 4 files, snapshot 236731915523568705 (task 13424 ms: download 6368 ms overlapping gunzip 717 ms, parse 2986 ms, sort 104 ms, write 6640 ms, index 469 ms: 0 candidates, 71095 repo-hours, 1017 releases; waiting 2178 ms; commit 1644 ms)
2026-11-07T18:01:43Z [load_day 2023-04-01] 2023-04-01 hour 16: 154185 events in 4 files, snapshot 1888771055825356771 (task 10770 ms: download 4191 ms overlapping gunzip 633 ms, parse 2758 ms, sort 93 ms, write 5952 ms, index 479 ms: 5 candidates, 67431 repo-hours, 898 releases; waiting 510 ms; commit 1705 ms)
2026-11-07T18:01:47Z [load_day 2023-04-01] 2023-04-01 hour 17: 154759 events in 4 files, snapshot 7067578951098708838 (task 10672 ms: download 4263 ms overlapping gunzip 626 ms, parse 2735 ms, sort 99 ms, write 5941 ms, index 461 ms: 4 candidates, 63896 repo-hours, 719 releases; waiting 508 ms; commit 1435 ms)
2026-11-07T18:01:55Z [load_day 2023-04-01] 2023-04-01 hour 18: 152165 events in 4 files, snapshot 8610849059867502236 (task 10751 ms: download 4198 ms overlapping gunzip 624 ms, parse 2660 ms, sort 97 ms, write 6018 ms, index 508 ms: 3 candidates, 66082 repo-hours, 864 releases; waiting 500 ms; commit 1692 ms)
2026-11-07T18:01:58Z [load_day 2023-04-01] 2023-04-01 hour 19: 135011 events in 3 files, snapshot 1449278353424876405 (task 9798 ms: download 3995 ms overlapping gunzip 556 ms, parse 2526 ms, sort 99 ms, write 5305 ms, index 388 ms: 2 candidates, 56291 repo-hours, 721 releases; waiting 637 ms; commit 1401 ms)
2026-11-07T18:02:06Z [load_day 2023-04-01] 2023-04-01 hour 20: 136679 events in 3 files, snapshot 4539040671136438210 (task 10006 ms: download 4052 ms overlapping gunzip 587 ms, parse 2588 ms, sort 95 ms, write 5407 ms, index 392 ms: 3 candidates, 55581 repo-hours, 781 releases; waiting 576 ms; commit 1868 ms)
2026-11-07T18:02:08Z [load_day 2023-04-01] 2023-04-01 hour 21: 123611 events in 3 files, snapshot 3738417106968140434 (task 8905 ms: download 2847 ms overlapping gunzip 502 ms, parse 2214 ms, sort 74 ms, write 4896 ms, index 367 ms: 3 candidates, 49049 repo-hours, 876 releases; waiting 533 ms; commit 1679 ms)
2026-11-07T18:02:14Z [load_day 2023-04-01] 2023-04-01 hour 22: 109756 events in 3 files, snapshot 907229176116844434 (task 8237 ms: download 2266 ms overlapping gunzip 448 ms, parse 1988 ms, sort 73 ms, write 4354 ms, index 334 ms: 2 candidates, 44762 repo-hours, 644 releases; waiting 687 ms; commit 1498 ms)
2026-11-07T18:02:17Z [load_day 2023-04-01] 2023-04-01 hour 23: 104859 events in 3 files, snapshot 8547888270702275772 (task 7863 ms: download 2163 ms overlapping gunzip 449 ms, parse 1934 ms, sort 70 ms, write 4140 ms, index 299 ms: 3 candidates, 43129 repo-hours, 610 releases; waiting 536 ms; commit 1712 ms)
2026-11-07T18:02:23Z [load_day 2023-04-01] 2023-04-01: repo_hour merged from 24 files to 1 (1440979 rows, 6229 ms)
2026-11-07T18:02:25Z [load_day 2023-04-01] 2023-04-01: index committed in 8102 ms (23 + 1 + 24 files)
2026-11-07T18:02:25Z [load_day 2023-04-01] 2023-04-01: 3314310 events in 24 hours
2026-11-07T18:02:25Z [load_day 2023-04-01] attempt 1 succeeded