orcaLog in

Runs · run 810

load_day 2023-02-11, attempt 1 succeeded

Host
caf251265124:44076
Started
2026-11-07T15:24:25Z
Ended
2026-11-07T15:26:38Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/810/load_day/2023-02-11/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:24:25Z [load_day 2023-02-11] attempt 1 started
2026-11-07T15:24:27Z [load_day 2023-02-11] 2023-02-11: 2 hours in flight, about 1200 MB
2026-11-07T15:24:42Z [load_day 2023-02-11] 2023-02-11 hour 0: 152632 events in 4 files, snapshot 7288415582869079009 (task 11936 ms: download 5086 ms overlapping gunzip 769 ms, parse 3293 ms, sort 96 ms, write 6697 ms, index 497 ms: 4 candidates, 79198 repo-hours, 880 releases; waiting 242 ms; commit 1570 ms)
2026-11-07T15:24:43Z [load_day 2023-02-11] 2023-02-11 hour 1: 130026 events in 3 files, snapshot 1021816131025845320 (task 9609 ms: download 4102 ms overlapping gunzip 557 ms, parse 2484 ms, sort 73 ms, write 5244 ms, index 436 ms: 7 candidates, 66274 repo-hours, 744 releases; waiting 510 ms; commit 1385 ms)
2026-11-07T15:24:51Z [load_day 2023-02-11] 2023-02-11 hour 2: 114102 events in 3 files, snapshot 7405049203078174399 (task 8474 ms: download 2820 ms overlapping gunzip 485 ms, parse 2108 ms, sort 64 ms, write 4404 ms, index 343 ms: 3 candidates, 53581 repo-hours, 575 releases; waiting 728 ms; commit 1589 ms)
2026-11-07T15:24:52Z [load_day 2023-02-11] 2023-02-11 hour 3: 105118 events in 3 files, snapshot 6015947514378128458 (task 7934 ms: download 2513 ms overlapping gunzip 438 ms, parse 1933 ms, sort 70 ms, write 4024 ms, index 323 ms: 1 candidates, 42692 repo-hours, 674 releases; waiting 697 ms; commit 1545 ms)
2026-11-07T15:24:58Z [load_day 2023-02-11] 2023-02-11 hour 4: 103676 events in 3 files, snapshot 7221757452380712096 (task 6989 ms: download 1860 ms overlapping gunzip 419 ms, parse 1802 ms, sort 84 ms, write 3576 ms, index 278 ms: 3 candidates, 42721 repo-hours, 508 releases; waiting 525 ms; commit 1386 ms)
2026-11-07T15:25:02Z [load_day 2023-02-11] 2023-02-11 hour 5: 103167 events in 3 files, snapshot 8046175266121582733 (task 8532 ms: download 2843 ms overlapping gunzip 438 ms, parse 1872 ms, sort 50 ms, write 3786 ms, index 310 ms: 3 candidates, 44141 repo-hours, 625 releases; waiting 1735 ms; commit 1485 ms)
2026-11-07T15:25:07Z [load_day 2023-02-11] 2023-02-11 hour 6: 114947 events in 3 files, snapshot 472117788457196291 (task 7600 ms: download 2031 ms overlapping gunzip 405 ms, parse 1812 ms, sort 70 ms, write 4128 ms, index 377 ms: 1 candidates, 52385 repo-hours, 672 releases; waiting 511 ms; commit 1432 ms)
2026-11-07T15:25:10Z [load_day 2023-02-11] 2023-02-11 hour 7: 109972 events in 3 files, snapshot 6871108419190663372 (task 7692 ms: download 1965 ms overlapping gunzip 407 ms, parse 1791 ms, sort 62 ms, write 4104 ms, index 426 ms: 5 candidates, 47228 repo-hours, 522 releases; waiting 539 ms; commit 1568 ms)
2026-11-07T15:25:16Z [load_day 2023-02-11] 2023-02-11 hour 8: 120534 events in 3 files, snapshot 5403051022008075738 (task 8620 ms: download 2673 ms overlapping gunzip 474 ms, parse 2085 ms, sort 78 ms, write 4594 ms, index 333 ms: 2 candidates, 50841 repo-hours, 562 releases; waiting 676 ms; commit 1327 ms)
2026-11-07T15:25:20Z [load_day 2023-02-11] 2023-02-11 hour 9: 121779 events in 3 files, snapshot 3361955379257738304 (task 8510 ms: download 2044 ms overlapping gunzip 477 ms, parse 2127 ms, sort 85 ms, write 4590 ms, index 350 ms: 6 candidates, 52057 repo-hours, 685 releases; waiting 503 ms; commit 1459 ms)
2026-11-07T15:25:25Z [load_day 2023-02-11] 2023-02-11 hour 10: 127938 events in 3 files, snapshot 7304204111241874864 (task 8526 ms: download 2512 ms overlapping gunzip 465 ms, parse 2066 ms, sort 82 ms, write 4463 ms, index 342 ms: 5 candidates, 54419 repo-hours, 661 releases; waiting 652 ms; commit 1538 ms)
2026-11-07T15:25:30Z [load_day 2023-02-11] 2023-02-11 hour 11: 126749 events in 3 files, snapshot 4198016688879222597 (task 9052 ms: download 2593 ms overlapping gunzip 505 ms, parse 2240 ms, sort 63 ms, write 4935 ms, index 359 ms: 5 candidates, 53848 repo-hours, 754 releases; waiting 617 ms; commit 1535 ms)
2026-11-07T15:25:38Z [load_day 2023-02-11] 2023-02-11 hour 12: 179185 events in 4 files, snapshot 7598344548486995627 (task 11654 ms: download 4893 ms overlapping gunzip 598 ms, parse 2772 ms, sort 104 ms, write 5762 ms, index 555 ms: 4 candidates, 84919 repo-hours, 789 releases; waiting 1578 ms; commit 1697 ms)
2026-11-07T15:25:40Z [load_day 2023-02-11] 2023-02-11 hour 13: 154848 events in 4 files, snapshot 603411345318791304 (task 9886 ms: download 3470 ms overlapping gunzip 550 ms, parse 2480 ms, sort 105 ms, write 5420 ms, index 503 ms: 2 candidates, 77874 repo-hours, 722 releases; waiting 468 ms; commit 1378 ms)
2026-11-07T15:25:48Z [load_day 2023-02-11] 2023-02-11 hour 14: 145965 events in 3 files, snapshot 3359775749218872067 (task 10144 ms: download 4169 ms overlapping gunzip 567 ms, parse 2460 ms, sort 83 ms, write 5396 ms, index 439 ms: 3 candidates, 64945 repo-hours, 784 releases; waiting 904 ms; commit 1669 ms)
2026-11-07T15:25:52Z [load_day 2023-02-11] 2023-02-11 hour 15: 152338 events in 4 files, snapshot 1592813965148597293 (task 10555 ms: download 4129 ms overlapping gunzip 621 ms, parse 2690 ms, sort 99 ms, write 5647 ms, index 457 ms: 1 candidates, 66553 repo-hours, 1042 releases; waiting 517 ms; commit 1499 ms)
2026-11-07T15:25:59Z [load_day 2023-02-11] 2023-02-11 hour 16: 149918 events in 3 files, snapshot 6478950846815592395 (task 10176 ms: download 3963 ms overlapping gunzip 583 ms, parse 2574 ms, sort 101 ms, write 5585 ms, index 462 ms: 1 candidates, 65381 repo-hours, 936 releases; waiting 530 ms; commit 1440 ms)
2026-11-07T15:26:03Z [load_day 2023-02-11] 2023-02-11 hour 17: 144102 events in 3 files, snapshot 375285142458536288 (task 10746 ms: download 4628 ms overlapping gunzip 578 ms, parse 2512 ms, sort 108 ms, write 5541 ms, index 412 ms: 0 candidates, 61426 repo-hours, 750 releases; waiting 1307 ms; commit 1422 ms)
2026-11-07T15:26:10Z [load_day 2023-02-11] 2023-02-11 hour 18: 151298 events in 4 files, snapshot 7241894479956699401 (task 9956 ms: download 3680 ms overlapping gunzip 548 ms, parse 2359 ms, sort 103 ms, write 5348 ms, index 564 ms: 2 candidates, 73166 repo-hours, 859 releases; waiting 553 ms; commit 1441 ms)
2026-11-07T15:26:13Z [load_day 2023-02-11] 2023-02-11 hour 19: 129606 events in 3 files, snapshot 3935313561647397786 (task 8818 ms: download 3490 ms overlapping gunzip 510 ms, parse 2206 ms, sort 70 ms, write 4783 ms, index 389 ms: 3 candidates, 54789 repo-hours, 910 releases; waiting 547 ms; commit 1628 ms)
2026-11-07T15:26:19Z [load_day 2023-02-11] 2023-02-11 hour 20: 129970 events in 3 files, snapshot 2549098737450721872 (task 8446 ms: download 1821 ms overlapping gunzip 498 ms, parse 2187 ms, sort 71 ms, write 4754 ms, index 404 ms: 6 candidates, 57120 repo-hours, 778 releases; waiting 190 ms; commit 1563 ms)
2026-11-07T15:26:22Z [load_day 2023-02-11] 2023-02-11 hour 21: 125356 events in 3 files, snapshot 7948699132915568646 (task 8406 ms: download 2189 ms overlapping gunzip 457 ms, parse 2024 ms, sort 80 ms, write 4591 ms, index 416 ms: 3 candidates, 57576 repo-hours, 791 releases; waiting 507 ms; commit 1473 ms)
2026-11-07T15:26:28Z [load_day 2023-02-11] 2023-02-11 hour 22: 110148 events in 3 files, snapshot 2078805784179563602 (task 7603 ms: download 1867 ms overlapping gunzip 416 ms, parse 1842 ms, sort 63 ms, write 4119 ms, index 324 ms: 5 candidates, 46086 repo-hours, 727 releases; waiting 525 ms; commit 1674 ms)
2026-11-07T15:26:30Z [load_day 2023-02-11] 2023-02-11 hour 23: 108335 events in 3 files, snapshot 8236900776647748444 (task 7431 ms: download 1979 ms overlapping gunzip 417 ms, parse 1854 ms, sort 53 ms, write 3933 ms, index 318 ms: 4 candidates, 47624 repo-hours, 620 releases; waiting 523 ms; commit 1282 ms)
2026-11-07T15:26:36Z [load_day 2023-02-11] 2023-02-11: repo_hour merged from 24 files to 1 (1396844 rows, 5968 ms)
2026-11-07T15:26:38Z [load_day 2023-02-11] 2023-02-11: index committed in 8209 ms (23 + 1 + 24 files)
2026-11-07T15:26:38Z [load_day 2023-02-11] 2023-02-11: 3111709 events in 24 hours
2026-11-07T15:26:38Z [load_day 2023-02-11] attempt 1 succeeded