orcaLog in

Runs · run 999

load_day 2023-04-15, attempt 1 succeeded

Host
caf251265124:271786
Started
2026-11-07T18:41:58Z
Ended
2026-11-07T18:44:04Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/999/load_day/2023-04-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T18:41:58Z [load_day 2023-04-15] attempt 1 started
2026-11-07T18:42:00Z [load_day 2023-04-15] 2023-04-15: 2 hours in flight, about 1200 MB
2026-11-07T18:42:11Z [load_day 2023-04-15] 2023-04-15 hour 0: 132073 events in 3 files, snapshot 5460567313592326516 (task 9133 ms: download 2022 ms overlapping gunzip 555 ms, parse 2472 ms, sort 83 ms, write 4945 ms, index 472 ms: 4 candidates, 66562 repo-hours, 862 releases; waiting 296 ms; commit 1456 ms)
2026-11-07T18:42:13Z [load_day 2023-04-15] 2023-04-15 hour 1: 135362 events in 3 files, snapshot 494829012576644134 (task 9263 ms: download 2915 ms overlapping gunzip 491 ms, parse 2293 ms, sort 77 ms, write 4737 ms, index 494 ms: 6 candidates, 74175 repo-hours, 775 releases; waiting 700 ms; commit 1468 ms)
2026-11-07T18:42:20Z [load_day 2023-04-15] 2023-04-15 hour 2: 110631 events in 3 files, snapshot 2659770277501394703 (task 7721 ms: download 1898 ms overlapping gunzip 457 ms, parse 1941 ms, sort 72 ms, write 4359 ms, index 302 ms: 2 candidates, 47164 repo-hours, 647 releases; waiting 298 ms; commit 1553 ms)
2026-11-07T18:42:22Z [load_day 2023-04-15] 2023-04-15 hour 3: 107353 events in 3 files, snapshot 6541381531132887376 (task 8315 ms: download 2197 ms overlapping gunzip 499 ms, parse 1923 ms, sort 82 ms, write 4746 ms, index 307 ms: 1 candidates, 43306 repo-hours, 757 releases; waiting 457 ms; commit 1608 ms)
2026-11-07T18:42:28Z [load_day 2023-04-15] 2023-04-15 hour 4: 102910 events in 3 files, snapshot 4498654665184089416 (task 7869 ms: download 2713 ms overlapping gunzip 413 ms, parse 1786 ms, sort 75 ms, write 3888 ms, index 317 ms: 0 candidates, 41845 repo-hours, 512 releases; waiting 1020 ms; commit 1474 ms)
2026-11-07T18:42:30Z [load_day 2023-04-15] 2023-04-15 hour 5: 104983 events in 3 files, snapshot 8445120429540529114 (task 7065 ms: download 1993 ms overlapping gunzip 393 ms, parse 1729 ms, sort 71 ms, write 3646 ms, index 301 ms: 1 candidates, 44990 repo-hours, 643 releases; waiting 548 ms; commit 1519 ms)
2026-11-07T18:42:37Z [load_day 2023-04-15] 2023-04-15 hour 6: 124289 events in 3 files, snapshot 7271603752250785871 (task 7854 ms: download 2188 ms overlapping gunzip 423 ms, parse 1878 ms, sort 79 ms, write 4159 ms, index 400 ms: 1 candidates, 58943 repo-hours, 742 releases; waiting 581 ms; commit 1686 ms)
2026-11-07T18:42:40Z [load_day 2023-04-15] 2023-04-15 hour 7: 121562 events in 3 files, snapshot 7014036196314680860 (task 8666 ms: download 2274 ms overlapping gunzip 489 ms, parse 1993 ms, sort 70 ms, write 4956 ms, index 348 ms: 2 candidates, 52139 repo-hours, 603 releases; waiting 552 ms; commit 1851 ms)
2026-11-07T18:42:46Z [load_day 2023-04-15] 2023-04-15 hour 8: 125916 events in 3 files, snapshot 121845676414225245 (task 7921 ms: download 2549 ms overlapping gunzip 432 ms, parse 1937 ms, sort 84 ms, write 4230 ms, index 364 ms: 1 candidates, 53913 repo-hours, 704 releases; waiting 534 ms; commit 1854 ms)
2026-11-07T18:42:49Z [load_day 2023-04-15] 2023-04-15 hour 9: 125195 events in 3 files, snapshot 4543503858594672634 (task 8263 ms: download 2247 ms overlapping gunzip 446 ms, parse 2006 ms, sort 76 ms, write 4407 ms, index 359 ms: 2 candidates, 53731 repo-hours, 832 releases; waiting 679 ms; commit 1785 ms)
2026-11-07T18:42:54Z [load_day 2023-04-15] 2023-04-15 hour 10: 128018 events in 3 files, snapshot 5465446613083412296 (task 7581 ms: download 972 ms overlapping gunzip 473 ms, parse 2092 ms, sort 73 ms, write 4363 ms, index 366 ms: 0 candidates, 55833 repo-hours, 703 releases; waiting 17 ms; commit 1503 ms)
2026-11-07T18:42:57Z [load_day 2023-04-15] 2023-04-15 hour 11: 126947 events in 3 files, snapshot 6716580788724826456 (task 7497 ms: download 819 ms overlapping gunzip 447 ms, parse 2022 ms, sort 82 ms, write 4362 ms, index 358 ms: 1 candidates, 53711 repo-hours, 627 releases; waiting 18 ms; commit 1625 ms)
2026-11-07T18:43:05Z [load_day 2023-04-15] 2023-04-15 hour 12: 193529 events in 4 files, snapshot 1573465484389654760 (task 10646 ms: download 3778 ms overlapping gunzip 583 ms, parse 2827 ms, sort 121 ms, write 5767 ms, index 536 ms: 6 candidates, 85359 repo-hours, 754 releases; waiting 508 ms; commit 1492 ms)
2026-11-07T18:43:08Z [load_day 2023-04-15] 2023-04-15 hour 13: 160597 events in 4 files, snapshot 523001886502765374 (task 9692 ms: download 3249 ms overlapping gunzip 587 ms, parse 2635 ms, sort 107 ms, write 5598 ms, index 543 ms: 3 candidates, 81296 repo-hours, 699 releases; waiting 14 ms; commit 1680 ms)
2026-11-07T18:43:18Z [load_day 2023-04-15] 2023-04-15 hour 14: 152257 events in 4 files, snapshot 7970744636108524628 (task 11699 ms: download 4757 ms overlapping gunzip 642 ms, parse 2593 ms, sort 78 ms, write 6982 ms, index 478 ms: 2 candidates, 67410 repo-hours, 762 releases; waiting 626 ms; commit 1566 ms)
2026-11-07T18:43:20Z [load_day 2023-04-15] 2023-04-15 hour 15: 153690 events in 4 files, snapshot 573468781081155671 (task 9709 ms: download 3533 ms overlapping gunzip 601 ms, parse 2599 ms, sort 106 ms, write 5704 ms, index 442 ms: 3 candidates, 68613 repo-hours, 911 releases; waiting 22 ms; commit 1723 ms)
2026-11-07T18:43:29Z [load_day 2023-04-15] 2023-04-15 hour 16: 147640 events in 3 files, snapshot 2367469416647181146 (task 10015 ms: download 4093 ms overlapping gunzip 601 ms, parse 2455 ms, sort 91 ms, write 6179 ms, index 465 ms: 3 candidates, 66887 repo-hours, 742 releases; waiting 21 ms; commit 1454 ms)
2026-11-07T18:43:30Z [load_day 2023-04-15] 2023-04-15 hour 17: 144393 events in 3 files, snapshot 7844159104750025734 (task 10233 ms: download 3946 ms overlapping gunzip 594 ms, parse 2473 ms, sort 88 ms, write 6254 ms, index 597 ms: 2 candidates, 62401 repo-hours, 767 releases; waiting 17 ms; commit 1620 ms)
2026-11-07T18:43:39Z [load_day 2023-04-15] 2023-04-15 hour 18: 143786 events in 3 files, snapshot 978297326104025296 (task 8890 ms: download 3018 ms overlapping gunzip 517 ms, parse 2368 ms, sort 102 ms, write 5202 ms, index 476 ms: 1 candidates, 65135 repo-hours, 873 releases; waiting 17 ms; commit 1742 ms)
2026-11-07T18:43:40Z [load_day 2023-04-15] 2023-04-15 hour 19: 129755 events in 3 files, snapshot 5213519883745961540 (task 8047 ms: download 1039 ms overlapping gunzip 480 ms, parse 2172 ms, sort 80 ms, write 4731 ms, index 353 ms: 3 candidates, 54076 repo-hours, 840 releases; waiting 19 ms; commit 1587 ms)
2026-11-07T18:43:47Z [load_day 2023-04-15] 2023-04-15 hour 20: 126061 events in 3 files, snapshot 4714549226656591369 (task 7434 ms: download 874 ms overlapping gunzip 443 ms, parse 1996 ms, sort 66 ms, write 4340 ms, index 347 ms: 2 candidates, 53972 repo-hours, 767 releases; waiting 17 ms; commit 1432 ms)
2026-11-07T18:43:48Z [load_day 2023-04-15] 2023-04-15 hour 21: 120366 events in 3 files, snapshot 2762655637659618990 (task 7131 ms: download 809 ms overlapping gunzip 448 ms, parse 1999 ms, sort 66 ms, write 4034 ms, index 359 ms: 3 candidates, 51673 repo-hours, 813 releases; waiting 17 ms; commit 1619 ms)
2026-11-07T18:43:54Z [load_day 2023-04-15] 2023-04-15 hour 22: 105349 events in 3 files, snapshot 7636584797788092911 (task 6482 ms: download 693 ms overlapping gunzip 389 ms, parse 1749 ms, sort 65 ms, write 3749 ms, index 294 ms: 4 candidates, 42920 repo-hours, 702 releases; waiting 18 ms; commit 1732 ms)
2026-11-07T18:43:56Z [load_day 2023-04-15] 2023-04-15 hour 23: 99471 events in 2 files, snapshot 855342502109257407 (task 5816 ms: download 644 ms overlapping gunzip 375 ms, parse 1672 ms, sort 60 ms, write 3204 ms, index 291 ms: 6 candidates, 41728 repo-hours, 581 releases; waiting 19 ms; commit 1680 ms)
2026-11-07T18:44:02Z [load_day 2023-04-15] 2023-04-15: repo_hour merged from 24 files to 1 (1387782 rows, 6036 ms)
2026-11-07T18:44:04Z [load_day 2023-04-15] 2023-04-15: index committed in 8336 ms (22 + 1 + 24 files)
2026-11-07T18:44:04Z [load_day 2023-04-15] 2023-04-15: 3122133 events in 24 hours
2026-11-07T18:44:04Z [load_day 2023-04-15] attempt 1 succeeded