orcaLog in

Runs · run 1023

load_day 2023-04-23, attempt 1 succeeded

Host
caf251265124:297950
Started
2026-11-07T19:05:18Z
Ended
2026-11-07T19:07:31Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1023/load_day/2023-04-23/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T19:05:18Z [load_day 2023-04-23] attempt 1 started
2026-11-07T19:05:20Z [load_day 2023-04-23] 2023-04-23: 2 hours in flight, about 1200 MB
2026-11-07T19:05:31Z [load_day 2023-04-23] 2023-04-23 hour 0: 113902 events in 3 files, snapshot 3692658019207885674 (task 8082 ms: download 2365 ms overlapping gunzip 451 ms, parse 2028 ms, sort 76 ms, write 4332 ms, index 394 ms: 4 candidates, 61500 repo-hours, 973 releases; waiting 534 ms; commit 1634 ms)
2026-11-07T19:05:33Z [load_day 2023-04-23] 2023-04-23 hour 1: 120152 events in 3 files, snapshot 2119942832849836495 (task 7747 ms: download 2688 ms overlapping gunzip 416 ms, parse 1884 ms, sort 70 ms, write 4144 ms, index 471 ms: 5 candidates, 70304 repo-hours, 866 releases; waiting 499 ms; commit 1828 ms)
2026-11-07T19:05:39Z [load_day 2023-04-23] 2023-04-23 hour 2: 108435 events in 3 files, snapshot 6031559831614918630 (task 7638 ms: download 2311 ms overlapping gunzip 425 ms, parse 1826 ms, sort 71 ms, write 4011 ms, index 354 ms: 2 candidates, 56295 repo-hours, 739 releases; waiting 601 ms; commit 1426 ms)
2026-11-07T19:05:41Z [load_day 2023-04-23] 2023-04-23 hour 3: 104692 events in 3 files, snapshot 6641851512596695072 (task 7373 ms: download 2402 ms overlapping gunzip 405 ms, parse 1776 ms, sort 67 ms, write 3727 ms, index 328 ms: 2 candidates, 48609 repo-hours, 855 releases; waiting 765 ms; commit 1615 ms)
2026-11-07T19:05:47Z [load_day 2023-04-23] 2023-04-23 hour 4: 92895 events in 2 files, snapshot 3937408875138811206 (task 6854 ms: download 2503 ms overlapping gunzip 361 ms, parse 1587 ms, sort 60 ms, write 3306 ms, index 291 ms: 5 candidates, 40329 repo-hours, 614 releases; waiting 933 ms; commit 1567 ms)
2026-11-07T19:05:49Z [load_day 2023-04-23] 2023-04-23 hour 5: 106294 events in 3 files, snapshot 5013126653200601 (task 7243 ms: download 1613 ms overlapping gunzip 405 ms, parse 1735 ms, sort 69 ms, write 3963 ms, index 339 ms: 2 candidates, 46385 repo-hours, 773 releases; waiting 450 ms; commit 1498 ms)
2026-11-07T19:05:58Z [load_day 2023-04-23] 2023-04-23 hour 6: 121452 events in 3 files, snapshot 8821010614869436010 (task 9271 ms: download 2974 ms overlapping gunzip 466 ms, parse 2067 ms, sort 82 ms, write 4574 ms, index 568 ms: 2 candidates, 57836 repo-hours, 868 releases; waiting 1110 ms; commit 1886 ms)
2026-11-07T19:05:59Z [load_day 2023-04-23] 2023-04-23 hour 7: 120168 events in 3 files, snapshot 5261319525353709126 (task 8292 ms: download 2192 ms overlapping gunzip 436 ms, parse 1940 ms, sort 64 ms, write 4603 ms, index 352 ms: 3 candidates, 54008 repo-hours, 795 releases; waiting 512 ms; commit 1504 ms)
2026-11-07T19:06:07Z [load_day 2023-04-23] 2023-04-23 hour 8: 132262 events in 3 files, snapshot 8651252593424428407 (task 8853 ms: download 3446 ms overlapping gunzip 522 ms, parse 2298 ms, sort 98 ms, write 4966 ms, index 395 ms: 3 candidates, 59082 repo-hours, 831 releases; waiting 356 ms; commit 1730 ms)
2026-11-07T19:06:10Z [load_day 2023-04-23] 2023-04-23 hour 9: 132421 events in 3 files, snapshot 696778011648725109 (task 10156 ms: download 4765 ms overlapping gunzip 552 ms, parse 2430 ms, sort 99 ms, write 4853 ms, index 395 ms: 2 candidates, 58961 repo-hours, 926 releases; waiting 1547 ms; commit 1680 ms)
2026-11-07T19:06:17Z [load_day 2023-04-23] 2023-04-23 hour 10: 134587 events in 3 files, snapshot 4536535641092313689 (task 9115 ms: download 3507 ms overlapping gunzip 506 ms, parse 2197 ms, sort 78 ms, write 5063 ms, index 425 ms: 1 candidates, 61331 repo-hours, 849 releases; waiting 566 ms; commit 1755 ms)
2026-11-07T19:06:21Z [load_day 2023-04-23] 2023-04-23 hour 11: 127172 events in 3 files, snapshot 4573338643251948571 (task 9511 ms: download 2637 ms overlapping gunzip 513 ms, parse 2236 ms, sort 74 ms, write 4832 ms, index 407 ms: 3 candidates, 54865 repo-hours, 736 releases; waiting 1181 ms; commit 1830 ms)
2026-11-07T19:06:29Z [load_day 2023-04-23] 2023-04-23 hour 12: 191864 events in 4 files, snapshot 2737169890305753496 (task 10677 ms: download 3792 ms overlapping gunzip 588 ms, parse 2746 ms, sort 99 ms, write 5938 ms, index 519 ms: 5 candidates, 86743 repo-hours, 749 releases; waiting 488 ms; commit 1723 ms)
2026-11-07T19:06:32Z [load_day 2023-04-23] 2023-04-23 hour 13: 162415 events in 4 files, snapshot 3645442829925486445 (task 10514 ms: download 3932 ms overlapping gunzip 566 ms, parse 2565 ms, sort 93 ms, write 5617 ms, index 542 ms: 5 candidates, 81550 repo-hours, 780 releases; waiting 812 ms; commit 1828 ms)
2026-11-07T19:06:41Z [load_day 2023-04-23] 2023-04-23 hour 14: 151819 events in 4 files, snapshot 3762028296371936574 (task 11347 ms: download 5219 ms overlapping gunzip 595 ms, parse 2658 ms, sort 92 ms, write 5358 ms, index 485 ms: 4 candidates, 67637 repo-hours, 814 releases; waiting 1858 ms; commit 1667 ms)
2026-11-07T19:06:43Z [load_day 2023-04-23] 2023-04-23 hour 15: 152783 events in 4 files, snapshot 2169443668792459694 (task 9771 ms: download 3586 ms overlapping gunzip 552 ms, parse 2422 ms, sort 84 ms, write 5333 ms, index 480 ms: 9 candidates, 68512 repo-hours, 1202 releases; waiting 517 ms; commit 1745 ms)
2026-11-07T19:06:51Z [load_day 2023-04-23] 2023-04-23 hour 16: 149741 events in 3 files, snapshot 2663789106510683671 (task 9468 ms: download 3552 ms overlapping gunzip 558 ms, parse 2526 ms, sort 83 ms, write 5219 ms, index 440 ms: 3 candidates, 66041 repo-hours, 1085 releases; waiting 371 ms; commit 1558 ms)
2026-11-07T19:06:53Z [load_day 2023-04-23] 2023-04-23 hour 17: 149719 events in 3 files, snapshot 4422929281740870899 (task 9625 ms: download 3585 ms overlapping gunzip 542 ms, parse 2353 ms, sort 84 ms, write 5300 ms, index 453 ms: 1 candidates, 66429 repo-hours, 812 releases; waiting 545 ms; commit 1394 ms)
2026-11-07T19:07:02Z [load_day 2023-04-23] 2023-04-23 hour 18: 148538 events in 3 files, snapshot 4602848217036109266 (task 10514 ms: download 4263 ms overlapping gunzip 560 ms, parse 2530 ms, sort 88 ms, write 5539 ms, index 481 ms: 3 candidates, 66762 repo-hours, 898 releases; waiting 1031 ms; commit 1791 ms)
2026-11-07T19:07:04Z [load_day 2023-04-23] 2023-04-23 hour 19: 137034 events in 3 files, snapshot 6856361800485708843 (task 9683 ms: download 4024 ms overlapping gunzip 542 ms, parse 2422 ms, sort 99 ms, write 5252 ms, index 373 ms: 1 candidates, 57320 repo-hours, 764 releases; waiting 653 ms; commit 1559 ms)
2026-11-07T19:07:13Z [load_day 2023-04-23] 2023-04-23 hour 20: 134623 events in 3 files, snapshot 2851014991926479118 (task 9920 ms: download 4563 ms overlapping gunzip 523 ms, parse 2412 ms, sort 85 ms, write 4991 ms, index 378 ms: 3 candidates, 57339 repo-hours, 783 releases; waiting 1261 ms; commit 1591 ms)
2026-11-07T19:07:15Z [load_day 2023-04-23] 2023-04-23 hour 21: 129471 events in 3 files, snapshot 1457775919048441565 (task 9016 ms: download 4262 ms overlapping gunzip 503 ms, parse 2188 ms, sort 81 ms, write 4498 ms, index 354 ms: 3 candidates, 57566 repo-hours, 759 releases; waiting 1091 ms; commit 1480 ms)
2026-11-07T19:07:21Z [load_day 2023-04-23] 2023-04-23 hour 22: 112447 events in 3 files, snapshot 5628020155507809363 (task 7649 ms: download 1926 ms overlapping gunzip 423 ms, parse 1881 ms, sort 66 ms, write 4131 ms, index 313 ms: 2 candidates, 48371 repo-hours, 613 releases; waiting 540 ms; commit 1473 ms)
2026-11-07T19:07:23Z [load_day 2023-04-23] 2023-04-23 hour 23: 106124 events in 3 files, snapshot 5801176772341039407 (task 7452 ms: download 1927 ms overlapping gunzip 409 ms, parse 1815 ms, sort 67 ms, write 3934 ms, index 373 ms: 6 candidates, 45296 repo-hours, 560 releases; waiting 491 ms; commit 1612 ms)
2026-11-07T19:07:29Z [load_day 2023-04-23] 2023-04-23: repo_hour merged from 24 files to 1 (1439071 rows, 6333 ms)
2026-11-07T19:07:31Z [load_day 2023-04-23] 2023-04-23: index committed in 8306 ms (24 + 1 + 24 files)
2026-11-07T19:07:31Z [load_day 2023-04-23] 2023-04-23: 3141010 events in 24 hours
2026-11-07T19:07:31Z [load_day 2023-04-23] attempt 1 succeeded