orcaLog in

Runs · run 1176

load_day 2023-06-13, attempt 1 succeeded

Host
3c2b29713ce8:7643
Started
2026-11-07T21:27:01Z
Ended
2026-11-07T21:29:16Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1176/load_day/2023-06-13/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:27:01Z [load_day 2023-06-13] attempt 1 started
2026-11-07T21:27:03Z [load_day 2023-06-13] 2023-06-13: 4 hours in flight, about 2100 MB
2026-11-07T21:27:22Z [load_day 2023-06-13] 2023-06-13 hour 0: 159099 events in 4 files, snapshot 4092941332919948649 (task 15981 ms: download 7958 ms overlapping gunzip 931 ms, parse 4496 ms, sort 128 ms, write 9133 ms, index 496 ms: 8 candidates, 79485 repo-hours, 774 releases; waiting 468 ms; commit 1679 ms)
2026-11-07T21:27:23Z [load_day 2023-06-13] 2023-06-13 hour 1: 164843 events in 4 files, snapshot 1282775648737500712 (task 15412 ms: download 6710 ms overlapping gunzip 851 ms, parse 4036 ms, sort 99 ms, write 8986 ms, index 585 ms: 7 candidates, 88329 repo-hours, 810 releases; waiting 511 ms; commit 1603 ms)
2026-11-07T21:27:26Z [load_day 2023-06-13] 2023-06-13 hour 2: 149576 events in 3 files, snapshot 8603831794132128800 (task 14099 ms: download 6275 ms overlapping gunzip 780 ms, parse 3630 ms, sort 103 ms, write 8307 ms, index 469 ms: 8 candidates, 72681 repo-hours, 718 releases; waiting 515 ms; commit 2193 ms)
2026-11-07T21:27:28Z [load_day 2023-06-13] 2023-06-13 hour 3: 136126 events in 3 files, snapshot 7856187340017493465 (task 13097 ms: download 5848 ms overlapping gunzip 804 ms, parse 3613 ms, sort 97 ms, write 7353 ms, index 433 ms: 10 candidates, 61283 repo-hours, 934 releases; waiting 516 ms; commit 1860 ms)
2026-11-07T21:27:35Z [load_day 2023-06-13] 2023-06-13 hour 4: 130509 events in 3 files, snapshot 7040815308545478481 (task 12198 ms: download 5268 ms overlapping gunzip 607 ms, parse 2709 ms, sort 68 ms, write 7363 ms, index 424 ms: 4 candidates, 57265 repo-hours, 656 releases; waiting 687 ms; commit 1975 ms)
2026-11-07T21:27:39Z [load_day 2023-06-13] 2023-06-13 hour 5: 142647 events in 3 files, snapshot 3045947575571372232 (task 14265 ms: download 5950 ms overlapping gunzip 755 ms, parse 3476 ms, sort 93 ms, write 8432 ms, index 533 ms: 9 candidates, 64064 repo-hours, 767 releases; waiting 631 ms; commit 1961 ms)
2026-11-07T21:27:44Z [load_day 2023-06-13] 2023-06-13 hour 6: 174790 events in 4 files, snapshot 8408365687715625775 (task 17581 ms: download 9667 ms overlapping gunzip 877 ms, parse 3947 ms, sort 110 ms, write 11157 ms, index 610 ms: 8 candidates, 84298 repo-hours, 918 releases; waiting 575 ms; commit 2242 ms)
2026-11-07T21:27:47Z [load_day 2023-06-13] 2023-06-13 hour 7: 154631 events in 4 files, snapshot 6945067176241798923 (task 17064 ms: download 6648 ms overlapping gunzip 876 ms, parse 4001 ms, sort 101 ms, write 10777 ms, index 498 ms: 8 candidates, 73242 repo-hours, 880 releases; waiting 500 ms; commit 2439 ms)
2026-11-07T21:27:56Z [load_day 2023-06-13] 2023-06-13 hour 8: 170565 events in 4 files, snapshot 5131300249304541821 (task 19486 ms: download 10740 ms overlapping gunzip 1065 ms, parse 4659 ms, sort 172 ms, write 12260 ms, index 574 ms: 8 candidates, 85067 repo-hours, 1166 releases; waiting 469 ms; commit 2127 ms)
2026-11-07T21:28:00Z [load_day 2023-06-13] 2023-06-13 hour 9: 183394 events in 4 files, snapshot 8596041816121288482 (task 20119 ms: download 12015 ms overlapping gunzip 1007 ms, parse 4777 ms, sort 147 ms, write 12146 ms, index 574 ms: 9 candidates, 92322 repo-hours, 1041 releases; waiting 1139 ms; commit 2103 ms)
2026-11-07T21:28:04Z [load_day 2023-06-13] 2023-06-13 hour 10: 184427 events in 4 files, snapshot 1654235606426613005 (task 19230 ms: download 10750 ms overlapping gunzip 863 ms, parse 3955 ms, sort 142 ms, write 12573 ms, index 683 ms: 6 candidates, 91127 repo-hours, 1047 releases; waiting 690 ms; commit 1801 ms)
2026-11-07T21:28:06Z [load_day 2023-06-13] 2023-06-13 hour 11: 173266 events in 4 files, snapshot 4396149167514820659 (task 18762 ms: download 10585 ms overlapping gunzip 1044 ms, parse 4862 ms, sort 117 ms, write 11383 ms, index 561 ms: 5 candidates, 82211 repo-hours, 933 releases; waiting 499 ms; commit 2309 ms)
2026-11-07T21:28:17Z [load_day 2023-06-13] 2023-06-13 hour 12: 207518 events in 5 files, snapshot 6475671710986571419 (task 19794 ms: download 9956 ms overlapping gunzip 1038 ms, parse 4516 ms, sort 196 ms, write 12873 ms, index 669 ms: 6 candidates, 107449 repo-hours, 986 releases; waiting 219 ms; commit 2446 ms)
2026-11-07T21:28:23Z [load_day 2023-06-13] 2023-06-13 hour 13: 204255 events in 5 files, snapshot 4709264960834170629 (task 21714 ms: download 11872 ms overlapping gunzip 1072 ms, parse 5153 ms, sort 158 ms, write 13841 ms, index 659 ms: 13 candidates, 106527 repo-hours, 979 releases; waiting 530 ms; commit 2065 ms)
2026-11-07T21:28:27Z [load_day 2023-06-13] 2023-06-13 hour 14: 201882 events in 5 files, snapshot 8476694498639576967 (task 22534 ms: download 12533 ms overlapping gunzip 1079 ms, parse 4691 ms, sort 113 ms, write 15233 ms, index 644 ms: 5 candidates, 96528 repo-hours, 1087 releases; waiting 518 ms; commit 1903 ms)
2026-11-07T21:28:30Z [load_day 2023-06-13] 2023-06-13 hour 15: 180061 events in 4 files, snapshot 7833769817581892605 (task 20062 ms: download 11374 ms overlapping gunzip 1061 ms, parse 4666 ms, sort 108 ms, write 12977 ms, index 759 ms: 6 candidates, 89093 repo-hours, 1001 releases; waiting 253 ms; commit 2672 ms)
2026-11-07T21:28:38Z [load_day 2023-06-13] 2023-06-13 hour 16: 185755 events in 4 files, snapshot 7239872578031028457 (task 20439 ms: download 10857 ms overlapping gunzip 1049 ms, parse 4734 ms, sort 188 ms, write 12825 ms, index 712 ms: 7 candidates, 91885 repo-hours, 1060 releases; waiting 494 ms; commit 1894 ms)
2026-11-07T21:28:43Z [load_day 2023-06-13] 2023-06-13 hour 17: 179943 events in 4 files, snapshot 5948685956295782472 (task 19420 ms: download 11069 ms overlapping gunzip 1046 ms, parse 4846 ms, sort 140 ms, write 11963 ms, index 572 ms: 7 candidates, 83245 repo-hours, 916 releases; waiting 519 ms; commit 2005 ms)
2026-11-07T21:28:48Z [load_day 2023-06-13] 2023-06-13 hour 18: 187677 events in 4 files, snapshot 6962960031478074245 (task 19918 ms: download 11296 ms overlapping gunzip 990 ms, parse 4528 ms, sort 119 ms, write 12930 ms, index 579 ms: 10 candidates, 86610 repo-hours, 1080 releases; waiting 514 ms; commit 2032 ms)
2026-11-07T21:28:51Z [load_day 2023-06-13] 2023-06-13 hour 19: 179752 events in 4 files, snapshot 2754383739546058529 (task 18880 ms: download 10919 ms overlapping gunzip 1064 ms, parse 4821 ms, sort 165 ms, write 11691 ms, index 651 ms: 8 candidates, 76193 repo-hours, 967 releases; waiting 202 ms; commit 2835 ms)
2026-11-07T21:28:58Z [load_day 2023-06-13] 2023-06-13 hour 20: 176659 events in 4 files, snapshot 3007736078695266344 (task 18994 ms: download 11040 ms overlapping gunzip 980 ms, parse 4464 ms, sort 151 ms, write 12096 ms, index 480 ms: 10 candidates, 76110 repo-hours, 927 releases; waiting 505 ms; commit 1634 ms)
2026-11-07T21:29:01Z [load_day 2023-06-13] 2023-06-13 hour 21: 159166 events in 4 files, snapshot 7247108221124372922 (task 16832 ms: download 6972 ms overlapping gunzip 918 ms, parse 4158 ms, sort 119 ms, write 10420 ms, index 432 ms: 15 candidates, 66225 repo-hours, 977 releases; waiting 474 ms; commit 2232 ms)
2026-11-07T21:29:05Z [load_day 2023-06-13] 2023-06-13 hour 22: 150718 events in 4 files, snapshot 2899000776511651506 (task 15595 ms: download 7249 ms overlapping gunzip 869 ms, parse 3856 ms, sort 105 ms, write 9574 ms, index 383 ms: 10 candidates, 61652 repo-hours, 814 releases; waiting 482 ms; commit 1944 ms)
2026-11-07T21:29:06Z [load_day 2023-06-13] 2023-06-13 hour 23: 133780 events in 3 files, snapshot 7228003800484228867 (task 12695 ms: download 5960 ms overlapping gunzip 746 ms, parse 3279 ms, sort 81 ms, write 7389 ms, index 383 ms: 6 candidates, 55813 repo-hours, 662 releases; waiting 501 ms; commit 1834 ms)
2026-11-07T21:29:14Z [load_day 2023-06-13] 2023-06-13: repo_hour merged from 24 files to 1 (1928704 rows, 7577 ms)
2026-11-07T21:29:16Z [load_day 2023-06-13] 2023-06-13: index committed in 9493 ms (24 + 1 + 24 files)
2026-11-07T21:29:16Z [load_day 2023-06-13] 2023-06-13: 4071039 events in 24 hours
2026-11-07T21:29:16Z [load_day 2023-06-13] attempt 1 succeeded