orcaLog in

Runs · run 1301

load_day 2023-07-16, attempt 1 succeeded

Host
3c2b29713ce8:132069
Started
2026-11-07T23:01:39Z
Ended
2026-11-07T23:04:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1301/load_day/2023-07-16/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T23:01:39Z [load_day 2023-07-16] attempt 1 started
2026-11-07T23:01:41Z [load_day 2023-07-16] 2023-07-16: 2 hours in flight, about 1200 MB
2026-11-07T23:01:51Z [load_day 2023-07-16] 2023-07-16 hour 0: 93837 events in 2 files, snapshot 1721867986365613924 (task 6717 ms: download 1770 ms overlapping gunzip 390 ms, parse 1902 ms, sort 56 ms, write 3253 ms, index 301 ms: 4 candidates, 46042 repo-hours, 734 releases; waiting 527 ms; commit 2004 ms)
2026-11-07T23:01:54Z [load_day 2023-07-16] 2023-07-16 hour 1: 109772 events in 3 files, snapshot 3073349927701141719 (task 6692 ms: download 1867 ms overlapping gunzip 339 ms, parse 1648 ms, sort 60 ms, write 3475 ms, index 372 ms: 4 candidates, 62675 repo-hours, 691 releases; waiting 507 ms; commit 2913 ms)
2026-11-07T23:02:01Z [load_day 2023-07-16] 2023-07-16 hour 2: 98296 events in 2 files, snapshot 4267546792354622898 (task 8591 ms: download 1975 ms overlapping gunzip 487 ms, parse 2202 ms, sort 118 ms, write 4346 ms, index 641 ms: 4 candidates, 49401 repo-hours, 624 releases; waiting 500 ms; commit 2555 ms)
2026-11-07T23:02:03Z [load_day 2023-07-16] 2023-07-16 hour 3: 89208 events in 2 files, snapshot 1169403275951199476 (task 7290 ms: download 1697 ms overlapping gunzip 383 ms, parse 1861 ms, sort 50 ms, write 3879 ms, index 393 ms: 0 candidates, 39434 repo-hours, 768 releases; waiting 433 ms; commit 2282 ms)
2026-11-07T23:02:10Z [load_day 2023-07-16] 2023-07-16 hour 4: 91403 events in 2 files, snapshot 1431442224980608438 (task 7280 ms: download 1362 ms overlapping gunzip 442 ms, parse 1940 ms, sort 79 ms, write 3625 ms, index 354 ms: 4 candidates, 37821 repo-hours, 495 releases; waiting 202 ms; commit 2996 ms)
2026-11-07T23:02:12Z [load_day 2023-07-16] 2023-07-16 hour 5: 93687 events in 2 files, snapshot 4464021238832175732 (task 6740 ms: download 1890 ms overlapping gunzip 359 ms, parse 1570 ms, sort 58 ms, write 3628 ms, index 294 ms: 2 candidates, 40814 repo-hours, 618 releases; waiting 527 ms; commit 1976 ms)
2026-11-07T23:02:19Z [load_day 2023-07-16] 2023-07-16 hour 6: 110130 events in 3 files, snapshot 4957362782889811154 (task 8516 ms: download 1834 ms overlapping gunzip 468 ms, parse 2173 ms, sort 76 ms, write 4625 ms, index 334 ms: 3 candidates, 49146 repo-hours, 730 releases; waiting 508 ms; commit 2131 ms)
2026-11-07T23:02:23Z [load_day 2023-07-16] 2023-07-16 hour 7: 109085 events in 3 files, snapshot 3282378172131387156 (task 8514 ms: download 1972 ms overlapping gunzip 394 ms, parse 1800 ms, sort 83 ms, write 4782 ms, index 577 ms: 2 candidates, 45434 repo-hours, 583 releases; waiting 525 ms; commit 2961 ms)
2026-11-07T23:02:29Z [load_day 2023-07-16] 2023-07-16 hour 8: 113931 events in 3 files, snapshot 4885259134793600652 (task 9109 ms: download 2149 ms overlapping gunzip 493 ms, parse 2061 ms, sort 66 ms, write 5218 ms, index 423 ms: 3 candidates, 48561 repo-hours, 692 releases; waiting 510 ms; commit 2318 ms)
2026-11-07T23:02:34Z [load_day 2023-07-16] 2023-07-16 hour 9: 117119 events in 3 files, snapshot 2868362803363358435 (task 9967 ms: download 5203 ms overlapping gunzip 573 ms, parse 2434 ms, sort 59 ms, write 5111 ms, index 359 ms: 4 candidates, 49667 repo-hours, 792 releases; waiting 964 ms; commit 2728 ms)
2026-11-07T23:02:39Z [load_day 2023-07-16] 2023-07-16 hour 10: 116428 events in 3 files, snapshot 504361575964507245 (task 9487 ms: download 1964 ms overlapping gunzip 464 ms, parse 2239 ms, sort 106 ms, write 5548 ms, index 356 ms: 3 candidates, 50624 repo-hours, 612 releases; waiting 498 ms; commit 2186 ms)
2026-11-07T23:02:45Z [load_day 2023-07-16] 2023-07-16 hour 11: 118360 events in 3 files, snapshot 3660691456096970726 (task 10788 ms: download 2780 ms overlapping gunzip 585 ms, parse 2710 ms, sort 117 ms, write 6143 ms, index 414 ms: 3 candidates, 49093 repo-hours, 631 releases; waiting 530 ms; commit 2770 ms)
2026-11-07T23:02:54Z [load_day 2023-07-16] 2023-07-16 hour 12: 178021 events in 4 files, snapshot 5572380967539740529 (task 12175 ms: download 4401 ms overlapping gunzip 641 ms, parse 3214 ms, sort 91 ms, write 6891 ms, index 618 ms: 5 candidates, 83995 repo-hours, 790 releases; waiting 411 ms; commit 3516 ms)
2026-11-07T23:02:58Z [load_day 2023-07-16] 2023-07-16 hour 13: 155104 events in 4 files, snapshot 3801370609060296379 (task 12175 ms: download 4377 ms overlapping gunzip 650 ms, parse 3074 ms, sort 90 ms, write 7082 ms, index 619 ms: 5 candidates, 78197 repo-hours, 704 releases; waiting 380 ms; commit 2597 ms)
2026-11-07T23:03:05Z [load_day 2023-07-16] 2023-07-16 hour 14: 143806 events in 3 files, snapshot 8308596985376754612 (task 11992 ms: download 4691 ms overlapping gunzip 700 ms, parse 3112 ms, sort 113 ms, write 7008 ms, index 463 ms: 3 candidates, 62009 repo-hours, 822 releases; waiting 300 ms; commit 2104 ms)
2026-11-07T23:03:11Z [load_day 2023-07-16] 2023-07-16 hour 15: 146601 events in 3 files, snapshot 7477787457525729890 (task 11888 ms: download 4519 ms overlapping gunzip 678 ms, parse 3180 ms, sort 132 ms, write 6622 ms, index 501 ms: 5 candidates, 64101 repo-hours, 929 releases; waiting 461 ms; commit 1932 ms)
2026-11-07T23:03:19Z [load_day 2023-07-16] 2023-07-16 hour 16: 140643 events in 3 files, snapshot 7635180699166282300 (task 11598 ms: download 4477 ms overlapping gunzip 582 ms, parse 2536 ms, sort 128 ms, write 6764 ms, index 581 ms: 2 candidates, 62167 repo-hours, 724 releases; waiting 658 ms; commit 2585 ms)
2026-11-07T23:03:23Z [load_day 2023-07-16] 2023-07-16 hour 17: 135930 events in 3 files, snapshot 3900066509448842338 (task 10834 ms: download 2260 ms overlapping gunzip 683 ms, parse 2913 ms, sort 136 ms, write 5952 ms, index 391 ms: 3 candidates, 57309 repo-hours, 720 releases; waiting 477 ms; commit 2187 ms)
2026-11-07T23:03:31Z [load_day 2023-07-16] 2023-07-16 hour 18: 136779 events in 3 files, snapshot 5747211561510294750 (task 11719 ms: download 4246 ms overlapping gunzip 683 ms, parse 2943 ms, sort 103 ms, write 6562 ms, index 588 ms: 7 candidates, 60164 repo-hours, 822 releases; waiting 484 ms; commit 2488 ms)
2026-11-07T23:03:35Z [load_day 2023-07-16] 2023-07-16 hour 19: 122175 events in 3 files, snapshot 3685066726331508703 (task 11010 ms: download 2610 ms overlapping gunzip 681 ms, parse 3045 ms, sort 170 ms, write 5890 ms, index 462 ms: 4 candidates, 49195 repo-hours, 836 releases; waiting 460 ms; commit 2240 ms)
2026-11-07T23:03:42Z [load_day 2023-07-16] 2023-07-16 hour 20: 121076 events in 3 files, snapshot 4938818167739893321 (task 9452 ms: download 1756 ms overlapping gunzip 500 ms, parse 2399 ms, sort 72 ms, write 5490 ms, index 402 ms: 5 candidates, 49787 repo-hours, 722 releases; waiting 275 ms; commit 2385 ms)
2026-11-07T23:03:47Z [load_day 2023-07-16] 2023-07-16 hour 21: 108705 events in 3 files, snapshot 2198250637125029768 (task 9461 ms: download 2213 ms overlapping gunzip 531 ms, parse 2275 ms, sort 90 ms, write 5361 ms, index 394 ms: 1 candidates, 44743 repo-hours, 831 releases; waiting 496 ms; commit 4321 ms)
2026-11-07T23:03:51Z [load_day 2023-07-16] 2023-07-16 hour 22: 97948 events in 2 files, snapshot 4382623102768407547 (task 8610 ms: download 1795 ms overlapping gunzip 433 ms, parse 2063 ms, sort 114 ms, write 4928 ms, index 278 ms: 2 candidates, 39230 repo-hours, 683 releases; waiting 494 ms; commit 2168 ms)
2026-11-07T23:03:54Z [load_day 2023-07-16] 2023-07-16 hour 23: 95282 events in 2 files, snapshot 6410382737374987375 (task 7738 ms: download 1876 ms overlapping gunzip 451 ms, parse 2000 ms, sort 72 ms, write 4178 ms, index 276 ms: 6 candidates, 38835 repo-hours, 547 releases; waiting 475 ms; commit 2274 ms)
2026-11-07T23:04:00Z [load_day 2023-07-16] 2023-07-16: repo_hour merged from 24 files to 1 (1258444 rows, 5825 ms)
2026-11-07T23:04:02Z [load_day 2023-07-16] 2023-07-16: index committed in 7873 ms (23 + 1 + 24 files)
2026-11-07T23:04:02Z [load_day 2023-07-16] 2023-07-16: 2843326 events in 24 hours
2026-11-07T23:04:02Z [load_day 2023-07-16] attempt 1 succeeded