orcaLog in

Runs · run 1188

load_day 2023-06-17, attempt 1 succeeded

Host
3c2b29713ce8:8161
Started
2026-11-07T21:35:41Z
Ended
2026-11-07T21:37:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1188/load_day/2023-06-17/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:35:41Z [load_day 2023-06-17] attempt 1 started
2026-11-07T21:35:43Z [load_day 2023-06-17] 2023-06-17: 4 hours in flight, about 2100 MB
2026-11-07T21:35:57Z [load_day 2023-06-17] 2023-06-17 hour 0: 126552 events in 3 files, snapshot 4476954127635681276 (task 11524 ms: download 2723 ms overlapping gunzip 680 ms, parse 2954 ms, sort 103 ms, write 6536 ms, index 433 ms: 7 candidates, 66197 repo-hours, 826 releases; waiting 513 ms; commit 1933 ms)
2026-11-07T21:36:03Z [load_day 2023-06-17] 2023-06-17 hour 1: 131158 events in 3 files, snapshot 2748707643182361905 (task 11348 ms: download 4984 ms overlapping gunzip 703 ms, parse 3065 ms, sort 81 ms, write 6254 ms, index 429 ms: 3 candidates, 71176 repo-hours, 772 releases; waiting 487 ms; commit 5693 ms)
2026-11-07T21:36:05Z [load_day 2023-06-17] 2023-06-17 hour 2: 108624 events in 3 files, snapshot 74263122811451144 (task 9845 ms: download 2340 ms overlapping gunzip 616 ms, parse 2834 ms, sort 116 ms, write 5208 ms, index 317 ms: 5 candidates, 52717 repo-hours, 559 releases; waiting 480 ms; commit 1631 ms)
2026-11-07T21:36:07Z [load_day 2023-06-17] 2023-06-17 hour 3: 101619 events in 3 files, snapshot 732636282164009905 (task 9310 ms: download 2479 ms overlapping gunzip 517 ms, parse 2524 ms, sort 83 ms, write 5071 ms, index 309 ms: 3 candidates, 43022 repo-hours, 800 releases; waiting 486 ms; commit 2113 ms)
2026-11-07T21:36:09Z [load_day 2023-06-17] 2023-06-17 hour 4: 98506 events in 2 files, snapshot 4898334345136481632 (task 8423 ms: download 2363 ms overlapping gunzip 368 ms, parse 1641 ms, sort 76 ms, write 4629 ms, index 296 ms: 6 candidates, 42138 repo-hours, 519 releases; waiting 750 ms; commit 1804 ms)
2026-11-07T21:36:11Z [load_day 2023-06-17] 2023-06-17 hour 5: 100613 events in 3 files, snapshot 3097390580709719517 (task 7785 ms: download 2093 ms overlapping gunzip 364 ms, parse 1666 ms, sort 79 ms, write 4567 ms, index 284 ms: 4 candidates, 44507 repo-hours, 609 releases; waiting 605 ms; commit 2431 ms)
2026-11-07T21:36:15Z [load_day 2023-06-17] 2023-06-17 hour 6: 111866 events in 3 files, snapshot 7641133879257119010 (task 8697 ms: download 2524 ms overlapping gunzip 404 ms, parse 1857 ms, sort 58 ms, write 5119 ms, index 319 ms: 7 candidates, 52065 repo-hours, 641 releases; waiting 590 ms; commit 2106 ms)
2026-11-07T21:36:17Z [load_day 2023-06-17] 2023-06-17 hour 7: 110384 events in 3 files, snapshot 550797570561212529 (task 9352 ms: download 2308 ms overlapping gunzip 473 ms, parse 2243 ms, sort 50 ms, write 5381 ms, index 415 ms: 3 candidates, 48938 repo-hours, 540 releases; waiting 473 ms; commit 1963 ms)
2026-11-07T21:36:19Z [load_day 2023-06-17] 2023-06-17 hour 8: 117377 events in 3 files, snapshot 1642624356721380867 (task 9705 ms: download 2009 ms overlapping gunzip 485 ms, parse 2114 ms, sort 70 ms, write 5801 ms, index 467 ms: 4 candidates, 52768 repo-hours, 616 releases; waiting 508 ms; commit 2098 ms)
2026-11-07T21:36:21Z [load_day 2023-06-17] 2023-06-17 hour 9: 120846 events in 3 files, snapshot 8017977181493585923 (task 9136 ms: download 1029 ms overlapping gunzip 522 ms, parse 2299 ms, sort 64 ms, write 5651 ms, index 384 ms: 2 candidates, 53342 repo-hours, 777 releases; waiting 13 ms; commit 1689 ms)
2026-11-07T21:36:25Z [load_day 2023-06-17] 2023-06-17 hour 10: 121441 events in 3 files, snapshot 8192435622150886705 (task 9902 ms: download 2077 ms overlapping gunzip 496 ms, parse 2146 ms, sort 61 ms, write 5980 ms, index 368 ms: 3 candidates, 54137 repo-hours, 633 releases; waiting 512 ms; commit 1804 ms)
2026-11-07T21:36:28Z [load_day 2023-06-17] 2023-06-17 hour 11: 118862 events in 3 files, snapshot 897683256622500416 (task 10089 ms: download 2123 ms overlapping gunzip 445 ms, parse 2043 ms, sort 76 ms, write 6211 ms, index 477 ms: 5 candidates, 51133 repo-hours, 618 releases; waiting 513 ms; commit 2291 ms)
2026-11-07T21:36:34Z [load_day 2023-06-17] 2023-06-17 hour 12: 190500 events in 4 files, snapshot 3396846270202090234 (task 13192 ms: download 4427 ms overlapping gunzip 634 ms, parse 2935 ms, sort 106 ms, write 7912 ms, index 500 ms: 9 candidates, 84669 repo-hours, 768 releases; waiting 561 ms; commit 1925 ms)
2026-11-07T21:36:36Z [load_day 2023-06-17] 2023-06-17 hour 13: 155712 events in 4 files, snapshot 5771861983322824353 (task 12075 ms: download 4209 ms overlapping gunzip 589 ms, parse 2865 ms, sort 107 ms, write 7063 ms, index 690 ms: 5 candidates, 80372 repo-hours, 728 releases; waiting 493 ms; commit 2364 ms)
2026-11-07T21:36:38Z [load_day 2023-06-17] 2023-06-17 hour 14: 142230 events in 3 files, snapshot 4425580326345763001 (task 10906 ms: download 4051 ms overlapping gunzip 516 ms, parse 2431 ms, sort 75 ms, write 6573 ms, index 480 ms: 1 candidates, 67118 repo-hours, 701 releases; waiting 509 ms; commit 2075 ms)
2026-11-07T21:36:40Z [load_day 2023-06-17] 2023-06-17 hour 15: 143422 events in 3 files, snapshot 7535724120309111609 (task 10753 ms: download 4086 ms overlapping gunzip 521 ms, parse 2382 ms, sort 146 ms, write 6643 ms, index 415 ms: 5 candidates, 65515 repo-hours, 837 releases; waiting 300 ms; commit 1905 ms)
2026-11-07T21:36:47Z [load_day 2023-06-17] 2023-06-17 hour 16: 135002 events in 3 files, snapshot 4704753597645042698 (task 11262 ms: download 2069 ms overlapping gunzip 599 ms, parse 2675 ms, sort 70 ms, write 6519 ms, index 602 ms: 1 candidates, 60321 repo-hours, 630 releases; waiting 486 ms; commit 2973 ms)
2026-11-07T21:36:49Z [load_day 2023-06-17] 2023-06-17 hour 17: 130624 events in 3 files, snapshot 1857642327770991951 (task 10409 ms: download 2105 ms overlapping gunzip 483 ms, parse 2283 ms, sort 119 ms, write 6259 ms, index 384 ms: 2 candidates, 55743 repo-hours, 639 releases; waiting 511 ms; commit 1843 ms)
2026-11-07T21:36:50Z [load_day 2023-06-17] 2023-06-17 hour 18: 133682 events in 3 files, snapshot 6270969870491980190 (task 10925 ms: download 3284 ms overlapping gunzip 463 ms, parse 2103 ms, sort 71 ms, write 6622 ms, index 409 ms: 5 candidates, 62618 repo-hours, 796 releases; waiting 911 ms; commit 1796 ms)
2026-11-07T21:36:53Z [load_day 2023-06-17] 2023-06-17 hour 19: 114193 events in 3 files, snapshot 8092437489656168265 (task 9356 ms: download 1988 ms overlapping gunzip 493 ms, parse 2197 ms, sort 69 ms, write 5550 ms, index 328 ms: 13 candidates, 48522 repo-hours, 665 releases; waiting 473 ms; commit 2327 ms)
2026-11-07T21:36:56Z [load_day 2023-06-17] 2023-06-17 hour 20: 109196 events in 3 files, snapshot 4924000058519141101 (task 8856 ms: download 1656 ms overlapping gunzip 418 ms, parse 2015 ms, sort 65 ms, write 5351 ms, index 318 ms: 4 candidates, 47292 repo-hours, 575 releases; waiting 364 ms; commit 1828 ms)
2026-11-07T21:36:58Z [load_day 2023-06-17] 2023-06-17 hour 21: 105525 events in 3 files, snapshot 4633197167703493997 (task 7913 ms: download 1690 ms overlapping gunzip 368 ms, parse 1776 ms, sort 65 ms, write 4683 ms, index 292 ms: 2 candidates, 43875 repo-hours, 751 releases; waiting 486 ms; commit 2017 ms)
2026-11-07T21:37:00Z [load_day 2023-06-17] 2023-06-17 hour 22: 92263 events in 2 files, snapshot 2385672075185995739 (task 7345 ms: download 2547 ms overlapping gunzip 339 ms, parse 1564 ms, sort 58 ms, write 4268 ms, index 272 ms: 3 candidates, 39738 repo-hours, 650 releases; waiting 552 ms; commit 1836 ms)
2026-11-07T21:37:01Z [load_day 2023-06-17] 2023-06-17 hour 23: 88286 events in 2 files, snapshot 8700557221065386134 (task 6794 ms: download 1672 ms overlapping gunzip 324 ms, parse 1620 ms, sort 46 ms, write 3774 ms, index 262 ms: 3 candidates, 38509 repo-hours, 552 releases; waiting 504 ms; commit 1773 ms)
2026-11-07T21:37:07Z [load_day 2023-06-17] 2023-06-17: repo_hour merged from 24 files to 1 (1326432 rows, 5640 ms)
2026-11-07T21:37:09Z [load_day 2023-06-17] 2023-06-17: index committed in 7490 ms (24 + 1 + 24 files)
2026-11-07T21:37:09Z [load_day 2023-06-17] 2023-06-17: 2908483 events in 24 hours
2026-11-07T21:37:09Z [load_day 2023-06-17] attempt 1 succeeded