orcaLog in

Runs · run 936

load_day 2023-03-25, attempt 1 succeeded

Host
caf251265124:200058
Started
2026-11-07T17:39:00Z
Ended
2026-11-07T17:41:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/936/load_day/2023-03-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:39:00Z [load_day 2023-03-25] attempt 1 started
2026-11-07T17:39:02Z [load_day 2023-03-25] 2023-03-25: 2 hours in flight, about 1200 MB
2026-11-07T17:39:22Z [load_day 2023-03-25] 2023-03-25 hour 0: 174217 events in 4 files, snapshot 1409293441755197875 (task 17870 ms: download 12535 ms overlapping gunzip 1229 ms, parse 4770 ms, sort 102 ms, write 9692 ms, index 491 ms: 7 candidates, 81086 repo-hours, 834 releases; waiting 1313 ms; commit 1459 ms)
2026-11-07T17:39:24Z [load_day 2023-03-25] 2023-03-25 hour 1: 156527 events in 4 files, snapshot 3781834959206716604 (task 12650 ms: download 5676 ms overlapping gunzip 847 ms, parse 3437 ms, sort 83 ms, write 6895 ms, index 514 ms: 5 candidates, 78919 repo-hours, 796 releases; waiting 548 ms; commit 1431 ms)
2026-11-07T17:39:33Z [load_day 2023-03-25] 2023-03-25 hour 2: 122745 events in 3 files, snapshot 7737348743853881016 (task 9818 ms: download 4480 ms overlapping gunzip 622 ms, parse 2508 ms, sort 77 ms, write 5316 ms, index 343 ms: 5 candidates, 51985 repo-hours, 588 releases; waiting 632 ms; commit 1634 ms)
2026-11-07T17:39:34Z [load_day 2023-03-25] 2023-03-25 hour 3: 115083 events in 3 files, snapshot 2894984653035234881 (task 8609 ms: download 2249 ms overlapping gunzip 541 ms, parse 2292 ms, sort 72 ms, write 4637 ms, index 301 ms: 3 candidates, 44890 repo-hours, 728 releases; waiting 445 ms; commit 1450 ms)
2026-11-07T17:39:42Z [load_day 2023-03-25] 2023-03-25 hour 4: 105775 events in 3 files, snapshot 7400214675004377601 (task 8193 ms: download 3196 ms overlapping gunzip 467 ms, parse 1968 ms, sort 69 ms, write 4043 ms, index 343 ms: 6 candidates, 42822 repo-hours, 528 releases; waiting 916 ms; commit 1458 ms)
2026-11-07T17:39:43Z [load_day 2023-03-25] 2023-03-25 hour 5: 109815 events in 3 files, snapshot 4556244892304746918 (task 7491 ms: download 1652 ms overlapping gunzip 454 ms, parse 2027 ms, sort 69 ms, write 4091 ms, index 310 ms: 4 candidates, 44767 repo-hours, 548 releases; waiting 255 ms; commit 1416 ms)
2026-11-07T17:39:52Z [load_day 2023-03-25] 2023-03-25 hour 6: 119667 events in 3 files, snapshot 2869064301410153448 (task 9541 ms: download 2890 ms overlapping gunzip 513 ms, parse 2258 ms, sort 74 ms, write 4334 ms, index 366 ms: 7 candidates, 52156 repo-hours, 690 releases; waiting 1689 ms; commit 1524 ms)
2026-11-07T17:39:54Z [load_day 2023-03-25] 2023-03-25 hour 7: 121755 events in 3 files, snapshot 5827483555385552946 (task 8520 ms: download 1947 ms overlapping gunzip 499 ms, parse 2191 ms, sort 82 ms, write 4574 ms, index 332 ms: 3 candidates, 50331 repo-hours, 567 releases; waiting 529 ms; commit 1589 ms)
2026-11-07T17:40:01Z [load_day 2023-03-25] 2023-03-25 hour 8: 127026 events in 3 files, snapshot 700534884156213943 (task 8334 ms: download 2173 ms overlapping gunzip 489 ms, parse 2156 ms, sort 80 ms, write 4260 ms, index 384 ms: 4 candidates, 53698 repo-hours, 562 releases; waiting 672 ms; commit 1476 ms)
2026-11-07T17:40:04Z [load_day 2023-03-25] 2023-03-25 hour 9: 130417 events in 3 files, snapshot 3954539473805561737 (task 8946 ms: download 2440 ms overlapping gunzip 486 ms, parse 2180 ms, sort 71 ms, write 4552 ms, index 391 ms: 3 candidates, 54726 repo-hours, 737 releases; waiting 539 ms; commit 1786 ms)
2026-11-07T17:40:11Z [load_day 2023-03-25] 2023-03-25 hour 10: 139651 events in 3 files, snapshot 6961949789768142772 (task 9157 ms: download 2447 ms overlapping gunzip 503 ms, parse 2289 ms, sort 89 ms, write 5031 ms, index 410 ms: 4 candidates, 63147 repo-hours, 679 releases; waiting 536 ms; commit 1468 ms)
2026-11-07T17:40:13Z [load_day 2023-03-25] 2023-03-25 hour 11: 141799 events in 3 files, snapshot 3637784109861818586 (task 9402 ms: download 3459 ms overlapping gunzip 530 ms, parse 2413 ms, sort 92 ms, write 4996 ms, index 497 ms: 5 candidates, 65672 repo-hours, 700 releases; waiting 521 ms; commit 1492 ms)
2026-11-07T17:40:22Z [load_day 2023-03-25] 2023-03-25 hour 12: 190355 events in 4 files, snapshot 8566446120187248249 (task 10410 ms: download 3633 ms overlapping gunzip 566 ms, parse 2726 ms, sort 94 ms, write 5681 ms, index 514 ms: 6 candidates, 85809 repo-hours, 747 releases; waiting 513 ms; commit 1562 ms)
2026-11-07T17:40:24Z [load_day 2023-03-25] 2023-03-25 hour 13: 164455 events in 4 files, snapshot 3552181146421245784 (task 9945 ms: download 3449 ms overlapping gunzip 558 ms, parse 2621 ms, sort 95 ms, write 5264 ms, index 572 ms: 7 candidates, 81493 repo-hours, 735 releases; waiting 508 ms; commit 1594 ms)
2026-11-07T17:40:35Z [load_day 2023-03-25] 2023-03-25 hour 14: 162019 events in 4 files, snapshot 3873892305093304830 (task 12041 ms: download 5658 ms overlapping gunzip 620 ms, parse 2780 ms, sort 100 ms, write 5755 ms, index 463 ms: 4 candidates, 68103 repo-hours, 854 releases; waiting 2010 ms; commit 1554 ms)
2026-11-07T17:40:37Z [load_day 2023-03-25] 2023-03-25 hour 15: 160318 events in 4 files, snapshot 2374914117167252226 (task 10228 ms: download 3882 ms overlapping gunzip 593 ms, parse 2715 ms, sort 101 ms, write 5627 ms, index 454 ms: 5 candidates, 69078 repo-hours, 1059 releases; waiting 457 ms; commit 1474 ms)
2026-11-07T17:40:46Z [load_day 2023-03-25] 2023-03-25 hour 16: 153845 events in 4 files, snapshot 8840503349312844118 (task 10386 ms: download 4242 ms overlapping gunzip 596 ms, parse 2683 ms, sort 88 ms, write 5539 ms, index 473 ms: 4 candidates, 67574 repo-hours, 789 releases; waiting 692 ms; commit 1636 ms)
2026-11-07T17:40:48Z [load_day 2023-03-25] 2023-03-25 hour 17: 149678 events in 3 files, snapshot 6135419583599100680 (task 9952 ms: download 3844 ms overlapping gunzip 532 ms, parse 2469 ms, sort 93 ms, write 5318 ms, index 408 ms: 2 candidates, 62400 repo-hours, 731 releases; waiting 567 ms; commit 1409 ms)
2026-11-07T17:40:59Z [load_day 2023-03-25] 2023-03-25 hour 18: 149539 events in 3 files, snapshot 3729625884591561632 (task 12011 ms: download 6298 ms overlapping gunzip 555 ms, parse 2584 ms, sort 134 ms, write 4829 ms, index 429 ms: 4 candidates, 65446 repo-hours, 886 releases; waiting 3133 ms; commit 1562 ms)
2026-11-07T17:41:01Z [load_day 2023-03-25] 2023-03-25 hour 19: 132692 events in 3 files, snapshot 3897377151889010344 (task 8826 ms: download 2694 ms overlapping gunzip 486 ms, parse 2252 ms, sort 92 ms, write 4806 ms, index 353 ms: 3 candidates, 54615 repo-hours, 669 releases; waiting 515 ms; commit 1381 ms)
2026-11-07T17:41:08Z [load_day 2023-03-25] 2023-03-25 hour 20: 129477 events in 3 files, snapshot 7604588917427659829 (task 8517 ms: download 2351 ms overlapping gunzip 479 ms, parse 2290 ms, sort 83 ms, write 4434 ms, index 402 ms: 3 candidates, 54431 repo-hours, 677 releases; waiting 505 ms; commit 1478 ms)
2026-11-07T17:41:10Z [load_day 2023-03-25] 2023-03-25 hour 21: 121251 events in 3 files, snapshot 7032740557937730046 (task 8452 ms: download 2347 ms overlapping gunzip 469 ms, parse 2259 ms, sort 83 ms, write 4194 ms, index 351 ms: 2 candidates, 48968 repo-hours, 768 releases; waiting 727 ms; commit 1410 ms)
2026-11-07T17:41:17Z [load_day 2023-03-25] 2023-03-25 hour 22: 110044 events in 3 files, snapshot 6153057013150210200 (task 7347 ms: download 1757 ms overlapping gunzip 414 ms, parse 1979 ms, sort 66 ms, write 3779 ms, index 309 ms: 4 candidates, 44393 repo-hours, 631 releases; waiting 513 ms; commit 1581 ms)
2026-11-07T17:41:18Z [load_day 2023-03-25] 2023-03-25 hour 23: 104315 events in 3 files, snapshot 3018612154955192879 (task 7281 ms: download 3346 ms overlapping gunzip 405 ms, parse 1905 ms, sort 69 ms, write 3469 ms, index 296 ms: 5 candidates, 44008 repo-hours, 582 releases; waiting 855 ms; commit 1520 ms)
2026-11-07T17:41:24Z [load_day 2023-03-25] 2023-03-25: repo_hour merged from 24 files to 1 (1430517 rows, 6003 ms)
2026-11-07T17:41:26Z [load_day 2023-03-25] 2023-03-25: index committed in 7698 ms (24 + 1 + 24 files)
2026-11-07T17:41:26Z [load_day 2023-03-25] 2023-03-25: 3292465 events in 24 hours
2026-11-07T17:41:26Z [load_day 2023-03-25] attempt 1 succeeded