orcaLog in

Runs · run 1460

load_day 2023-09-03, attempt 1 succeeded

Host
3c2b29713ce8:292425
Started
2026-11-08T00:29:26Z
Ended
2026-11-08T00:31:58Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1460/load_day/2023-09-03/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:29:26Z [load_day 2023-09-03] attempt 1 started
2026-11-08T00:29:27Z [load_day 2023-09-03] 2023-09-03: 2 hours in flight, about 1200 MB
2026-11-08T00:29:42Z [load_day 2023-09-03] 2023-09-03 hour 0: 123103 events in 3 files, snapshot 2097979626587135661 (task 9377 ms: download 1921 ms overlapping gunzip 541 ms, parse 2730 ms, sort 69 ms, write 4898 ms, index 507 ms: 5 candidates, 68405 repo-hours, 859 releases; waiting 348 ms; commit 3816 ms)
2026-11-08T00:29:45Z [load_day 2023-09-03] 2023-09-03 hour 1: 120511 events in 3 files, snapshot 7539008546607443190 (task 9060 ms: download 1731 ms overlapping gunzip 420 ms, parse 2103 ms, sort 95 ms, write 5307 ms, index 590 ms: 3 candidates, 70323 repo-hours, 665 releases; waiting 286 ms; commit 2630 ms)
2026-11-08T00:29:48Z [load_day 2023-09-03] 2023-09-03 hour 2: 91494 events in 2 files, snapshot 6213348364771396244 (task 7186 ms: download 1517 ms overlapping gunzip 330 ms, parse 1566 ms, sort 76 ms, write 4003 ms, index 448 ms: 0 candidates, 37413 repo-hours, 581 releases; waiting 506 ms; commit 2093 ms)
2026-11-08T00:29:51Z [load_day 2023-09-03] 2023-09-03 hour 3: 87571 events in 2 files, snapshot 6208431739274516472 (task 6099 ms: download 1585 ms overlapping gunzip 406 ms, parse 1867 ms, sort 55 ms, write 2787 ms, index 252 ms: 2 candidates, 35932 repo-hours, 675 releases; waiting 512 ms; commit 1939 ms)
2026-11-08T00:29:56Z [load_day 2023-09-03] 2023-09-03 hour 4: 90832 events in 2 files, snapshot 479580724307216863 (task 6356 ms: download 1565 ms overlapping gunzip 368 ms, parse 1601 ms, sort 61 ms, write 3306 ms, index 263 ms: 4 candidates, 37338 repo-hours, 486 releases; waiting 466 ms; commit 2687 ms)
2026-11-08T00:29:59Z [load_day 2023-09-03] 2023-09-03 hour 5: 99040 events in 2 files, snapshot 7545383720175245438 (task 6571 ms: download 2117 ms overlapping gunzip 353 ms, parse 1559 ms, sort 66 ms, write 3492 ms, index 306 ms: 4 candidates, 40882 repo-hours, 569 releases; waiting 525 ms; commit 2085 ms)
2026-11-08T00:30:05Z [load_day 2023-09-03] 2023-09-03 hour 6: 113737 events in 3 files, snapshot 766776171961932909 (task 7320 ms: download 1895 ms overlapping gunzip 391 ms, parse 1781 ms, sort 63 ms, write 3899 ms, index 391 ms: 1 candidates, 50073 repo-hours, 661 releases; waiting 519 ms; commit 3056 ms)
2026-11-08T00:30:10Z [load_day 2023-09-03] 2023-09-03 hour 7: 111908 events in 3 files, snapshot 6963394850044318404 (task 9178 ms: download 1789 ms overlapping gunzip 404 ms, parse 1921 ms, sort 75 ms, write 5688 ms, index 390 ms: 4 candidates, 46263 repo-hours, 610 releases; waiting 491 ms; commit 2658 ms)
2026-11-08T00:30:17Z [load_day 2023-09-03] 2023-09-03 hour 8: 119530 events in 3 files, snapshot 2696449213007067435 (task 10849 ms: download 2278 ms overlapping gunzip 668 ms, parse 3008 ms, sort 86 ms, write 5906 ms, index 381 ms: 4 candidates, 50125 repo-hours, 656 releases; waiting 489 ms; commit 2852 ms)
2026-11-08T00:30:35Z [load_day 2023-09-03] 2023-09-03 hour 9: 121146 events in 3 files, snapshot 2469642751072645992 (task 10148 ms: download 1888 ms overlapping gunzip 584 ms, parse 2627 ms, sort 139 ms, write 5997 ms, index 364 ms: 4 candidates, 49838 repo-hours, 698 releases; waiting 207 ms; commit 16324 ms)
2026-11-08T00:30:37Z [load_day 2023-09-03] 2023-09-03 hour 10: 121702 events in 3 files, snapshot 8865278748957152825 (task 10634 ms: download 1733 ms overlapping gunzip 493 ms, parse 2233 ms, sort 71 ms, write 6394 ms, index 674 ms: 1 candidates, 51342 repo-hours, 613 releases; waiting 528 ms; commit 2046 ms)
2026-11-08T00:30:40Z [load_day 2023-09-03] 2023-09-03 hour 11: 125464 events in 3 files, snapshot 4726280504301793577 (task 11578 ms: download 2652 ms overlapping gunzip 725 ms, parse 3113 ms, sort 86 ms, write 6409 ms, index 432 ms: 6 candidates, 50332 repo-hours, 647 releases; waiting 472 ms; commit 2284 ms)
2026-11-08T00:30:50Z [load_day 2023-09-03] 2023-09-03 hour 12: 206306 events in 5 files, snapshot 7068248222430019226 (task 11874 ms: download 3628 ms overlapping gunzip 621 ms, parse 3239 ms, sort 135 ms, write 6263 ms, index 624 ms: 6 candidates, 84563 repo-hours, 756 releases; waiting 701 ms; commit 2249 ms)
2026-11-08T00:30:53Z [load_day 2023-09-03] 2023-09-03 hour 13: 156277 events in 4 files, snapshot 7790419749682657300 (task 10409 ms: download 3083 ms overlapping gunzip 535 ms, parse 2475 ms, sort 92 ms, write 5921 ms, index 572 ms: 5 candidates, 76240 repo-hours, 700 releases; waiting 487 ms; commit 2525 ms)
2026-11-08T00:31:04Z [load_day 2023-09-03] 2023-09-03 hour 14: 141767 events in 3 files, snapshot 1977020245787068884 (task 10488 ms: download 3870 ms overlapping gunzip 719 ms, parse 3103 ms, sort 97 ms, write 5674 ms, index 431 ms: 3 candidates, 60505 repo-hours, 741 releases; waiting 200 ms; commit 4112 ms)
2026-11-08T00:31:07Z [load_day 2023-09-03] 2023-09-03 hour 15: 142962 events in 3 files, snapshot 5764549454767193556 (task 11695 ms: download 4139 ms overlapping gunzip 628 ms, parse 2986 ms, sort 129 ms, write 6544 ms, index 640 ms: 19 candidates, 61782 repo-hours, 934 releases; waiting 466 ms; commit 2980 ms)
2026-11-08T00:31:15Z [load_day 2023-09-03] 2023-09-03 hour 16: 141131 events in 3 files, snapshot 814631468861516817 (task 11483 ms: download 4594 ms overlapping gunzip 664 ms, parse 2927 ms, sort 137 ms, write 6706 ms, index 535 ms: 3 candidates, 59622 repo-hours, 862 releases; waiting 211 ms; commit 2419 ms)
2026-11-08T00:31:20Z [load_day 2023-09-03] 2023-09-03 hour 17: 135117 events in 3 files, snapshot 5185551896195749727 (task 10420 ms: download 2530 ms overlapping gunzip 544 ms, parse 2421 ms, sort 120 ms, write 5963 ms, index 511 ms: 5 candidates, 56351 repo-hours, 695 releases; waiting 526 ms; commit 4011 ms)
2026-11-08T00:31:27Z [load_day 2023-09-03] 2023-09-03 hour 18: 141420 events in 3 files, snapshot 1157412453206175296 (task 10851 ms: download 2042 ms overlapping gunzip 633 ms, parse 3012 ms, sort 150 ms, write 5945 ms, index 499 ms: 3 candidates, 62601 repo-hours, 807 releases; waiting 339 ms; commit 2645 ms)
2026-11-08T00:31:30Z [load_day 2023-09-03] 2023-09-03 hour 19: 124034 events in 3 files, snapshot 473874700671563452 (task 10292 ms: download 2239 ms overlapping gunzip 556 ms, parse 2520 ms, sort 124 ms, write 5555 ms, index 743 ms: 4 candidates, 50672 repo-hours, 705 releases; waiting 495 ms; commit 2995 ms)
2026-11-08T00:31:37Z [load_day 2023-09-03] 2023-09-03 hour 20: 118764 events in 3 files, snapshot 8936333589875665731 (task 9338 ms: download 1928 ms overlapping gunzip 489 ms, parse 2171 ms, sort 67 ms, write 5372 ms, index 410 ms: 4 candidates, 49264 repo-hours, 647 releases; waiting 507 ms; commit 2282 ms)
2026-11-08T00:31:42Z [load_day 2023-09-03] 2023-09-03 hour 21: 109391 events in 3 files, snapshot 6182774527616808096 (task 8684 ms: download 1611 ms overlapping gunzip 448 ms, parse 2140 ms, sort 56 ms, write 4936 ms, index 570 ms: 7 candidates, 43106 repo-hours, 697 releases; waiting 244 ms; commit 4960 ms)
2026-11-08T00:31:48Z [load_day 2023-09-03] 2023-09-03 hour 22: 98474 events in 2 files, snapshot 1531754954177009560 (task 8346 ms: download 1634 ms overlapping gunzip 520 ms, parse 2408 ms, sort 74 ms, write 4345 ms, index 272 ms: 4 candidates, 38670 repo-hours, 584 releases; waiting 491 ms; commit 3299 ms)
2026-11-08T00:31:50Z [load_day 2023-09-03] 2023-09-03 hour 23: 96938 events in 2 files, snapshot 2178279033613593630 (task 8241 ms: download 1770 ms overlapping gunzip 483 ms, parse 2306 ms, sort 86 ms, write 4237 ms, index 374 ms: 1 candidates, 38625 repo-hours, 539 releases; waiting 460 ms; commit 2096 ms)
2026-11-08T00:31:56Z [load_day 2023-09-03] 2023-09-03: repo_hour merged from 24 files to 1 (1270267 rows, 5808 ms)
2026-11-08T00:31:58Z [load_day 2023-09-03] 2023-09-03: index committed in 8093 ms (23 + 1 + 24 files)
2026-11-08T00:31:58Z [load_day 2023-09-03] 2023-09-03: 2938619 events in 24 hours
2026-11-08T00:31:58Z [load_day 2023-09-03] attempt 1 succeeded