orcaLog in

Runs · run 822

load_day 2023-02-15, attempt 1 succeeded

Host
caf251265124:57878
Started
2026-11-07T15:36:15Z
Ended
2026-11-07T15:39:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/822/load_day/2023-02-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:36:15Z [load_day 2023-02-15] attempt 1 started
2026-11-07T15:36:16Z [load_day 2023-02-15] 2023-02-15: 2 hours in flight, about 1200 MB
2026-11-07T15:36:30Z [load_day 2023-02-15] 2023-02-15 hour 0: 161104 events in 4 files, snapshot 8310267934801670072 (task 12251 ms: download 5361 ms overlapping gunzip 733 ms, parse 3304 ms, sort 103 ms, write 6795 ms, index 466 ms: 4 candidates, 73047 repo-hours, 960 releases; waiting 525 ms; commit 1361 ms)
2026-11-07T15:36:32Z [load_day 2023-02-15] 2023-02-15 hour 1: 162898 events in 4 files, snapshot 716944771994351104 (task 12350 ms: download 5314 ms overlapping gunzip 776 ms, parse 3400 ms, sort 105 ms, write 6745 ms, index 548 ms: 3 candidates, 79350 repo-hours, 870 releases; waiting 495 ms; commit 1395 ms)
2026-11-07T15:36:42Z [load_day 2023-02-15] 2023-02-15 hour 2: 135621 events in 3 files, snapshot 991354426812689667 (task 11233 ms: download 4943 ms overlapping gunzip 707 ms, parse 2948 ms, sort 101 ms, write 6141 ms, index 420 ms: 5 candidates, 65373 repo-hours, 636 releases; waiting 532 ms; commit 1313 ms)
2026-11-07T15:36:44Z [load_day 2023-02-15] 2023-02-15 hour 3: 138391 events in 3 files, snapshot 6208886973288450539 (task 11546 ms: download 5259 ms overlapping gunzip 756 ms, parse 3103 ms, sort 89 ms, write 6174 ms, index 387 ms: 3 candidates, 58241 repo-hours, 853 releases; waiting 637 ms; commit 1205 ms)
2026-11-07T15:36:53Z [load_day 2023-02-15] 2023-02-15 hour 4: 127519 events in 3 files, snapshot 8150439011961684542 (task 9795 ms: download 4269 ms overlapping gunzip 587 ms, parse 2540 ms, sort 78 ms, write 5377 ms, index 369 ms: 1 candidates, 52552 repo-hours, 607 releases; waiting 543 ms; commit 1252 ms)
2026-11-07T15:36:56Z [load_day 2023-02-15] 2023-02-15 hour 5: 137242 events in 3 files, snapshot 5839192596315763991 (task 11146 ms: download 5363 ms overlapping gunzip 668 ms, parse 2825 ms, sort 102 ms, write 5617 ms, index 404 ms: 4 candidates, 59520 repo-hours, 817 releases; waiting 1223 ms; commit 1397 ms)
2026-11-07T15:37:05Z [load_day 2023-02-15] 2023-02-15 hour 6: 155800 events in 4 files, snapshot 3049022622227725834 (task 11413 ms: download 4585 ms overlapping gunzip 661 ms, parse 2909 ms, sort 101 ms, write 6450 ms, index 464 ms: 5 candidates, 70764 repo-hours, 827 releases; waiting 527 ms; commit 1272 ms)
2026-11-07T15:37:09Z [load_day 2023-02-15] 2023-02-15 hour 7: 161702 events in 4 files, snapshot 3409176650549463032 (task 12531 ms: download 4935 ms overlapping gunzip 769 ms, parse 3335 ms, sort 104 ms, write 7160 ms, index 476 ms: 6 candidates, 70817 repo-hours, 892 releases; waiting 306 ms; commit 1197 ms)
2026-11-07T15:37:21Z [load_day 2023-02-15] 2023-02-15 hour 8: 179911 events in 4 files, snapshot 2758832407871695602 (task 14801 ms: download 8390 ms overlapping gunzip 917 ms, parse 3976 ms, sort 107 ms, write 8484 ms, index 557 ms: 5 candidates, 80229 repo-hours, 989 releases; waiting 477 ms; commit 1472 ms)
2026-11-07T15:37:26Z [load_day 2023-02-15] 2023-02-15 hour 9: 190063 events in 4 files, snapshot 9122675629235907913 (task 15933 ms: download 9259 ms overlapping gunzip 982 ms, parse 4222 ms, sort 108 ms, write 8865 ms, index 584 ms: 2 candidates, 84154 repo-hours, 1165 releases; waiting 804 ms; commit 1474 ms)
2026-11-07T15:37:37Z [load_day 2023-02-15] 2023-02-15 hour 10: 193239 events in 4 files, snapshot 7431160637875807347 (task 15147 ms: download 8395 ms overlapping gunzip 989 ms, parse 4311 ms, sort 127 ms, write 8927 ms, index 565 ms: 2 candidates, 84450 repo-hours, 1117 releases; waiting 21 ms; commit 1381 ms)
2026-11-07T15:37:43Z [load_day 2023-02-15] 2023-02-15 hour 11: 189936 events in 4 files, snapshot 8685498276954855319 (task 15590 ms: download 8734 ms overlapping gunzip 948 ms, parse 4086 ms, sort 117 ms, write 9066 ms, index 537 ms: 4 candidates, 81280 repo-hours, 998 releases; waiting 498 ms; commit 1272 ms)
2026-11-07T15:37:53Z [load_day 2023-02-15] 2023-02-15 hour 12: 225052 events in 5 files, snapshot 739727570432880517 (task 16081 ms: download 10205 ms overlapping gunzip 989 ms, parse 4323 ms, sort 126 ms, write 9738 ms, index 693 ms: 10 candidates, 109316 repo-hours, 1168 releases; waiting 19 ms; commit 1435 ms)
2026-11-07T15:38:01Z [load_day 2023-02-15] 2023-02-15 hour 13: 224089 events in 5 files, snapshot 6095600129870129406 (task 17448 ms: download 11507 ms overlapping gunzip 1073 ms, parse 4668 ms, sort 128 ms, write 10004 ms, index 678 ms: 5 candidates, 108251 repo-hours, 1283 releases; waiting 600 ms; commit 1350 ms)
2026-11-07T15:38:11Z [load_day 2023-02-15] 2023-02-15 hour 14: 216153 events in 5 files, snapshot 9115430659076921044 (task 17376 ms: download 11581 ms overlapping gunzip 1102 ms, parse 4830 ms, sort 137 ms, write 10428 ms, index 640 ms: 3 candidates, 97245 repo-hours, 1257 releases; waiting 24 ms; commit 1273 ms)
2026-11-07T15:38:20Z [load_day 2023-02-15] 2023-02-15 hour 15: 217345 events in 5 files, snapshot 291707219346968780 (task 17659 ms: download 11573 ms overlapping gunzip 1103 ms, parse 4727 ms, sort 135 ms, write 10842 ms, index 616 ms: 5 candidates, 98956 repo-hours, 1321 releases; waiting 18 ms; commit 1477 ms)
2026-11-07T15:38:31Z [load_day 2023-02-15] 2023-02-15 hour 16: 211248 events in 5 files, snapshot 3623502260388971667 (task 19002 ms: download 13346 ms overlapping gunzip 1114 ms, parse 5046 ms, sort 139 ms, write 10921 ms, index 629 ms: 5 candidates, 94398 repo-hours, 1249 releases; waiting 804 ms; commit 1303 ms)
2026-11-07T15:38:37Z [load_day 2023-02-15] 2023-02-15 hour 17: 215248 events in 5 files, snapshot 6592046637450614746 (task 16946 ms: download 9371 ms overlapping gunzip 1019 ms, parse 4427 ms, sort 129 ms, write 10513 ms, index 638 ms: 5 candidates, 101771 repo-hours, 973 releases; waiting 16 ms; commit 1304 ms)
2026-11-07T15:38:49Z [load_day 2023-02-15] 2023-02-15 hour 18: 206166 events in 5 files, snapshot 347987911397306302 (task 16607 ms: download 9003 ms overlapping gunzip 1095 ms, parse 4668 ms, sort 134 ms, write 9903 ms, index 586 ms: 10 candidates, 88717 repo-hours, 1057 releases; waiting 17 ms; commit 1324 ms)
2026-11-07T15:38:55Z [load_day 2023-02-15] 2023-02-15 hour 19: 196445 events in 4 files, snapshot 3641496122961066520 (task 16642 ms: download 9596 ms overlapping gunzip 1042 ms, parse 4507 ms, sort 122 ms, write 9545 ms, index 564 ms: 4 candidates, 79775 repo-hours, 1003 releases; waiting 574 ms; commit 1420 ms)
2026-11-07T15:39:05Z [load_day 2023-02-15] 2023-02-15 hour 20: 193983 events in 4 files, snapshot 5744832582223730891 (task 15891 ms: download 8908 ms overlapping gunzip 1033 ms, parse 4503 ms, sort 128 ms, write 9459 ms, index 554 ms: 7 candidates, 77909 repo-hours, 957 releases; waiting 18 ms; commit 1318 ms)
2026-11-07T15:39:11Z [load_day 2023-02-15] 2023-02-15 hour 21: 186565 events in 4 files, snapshot 7951684874745365523 (task 15970 ms: download 9177 ms overlapping gunzip 1097 ms, parse 4617 ms, sort 127 ms, write 9417 ms, index 481 ms: 4 candidates, 73497 repo-hours, 1028 releases; waiting 17 ms; commit 1433 ms)
2026-11-07T15:39:22Z [load_day 2023-02-15] 2023-02-15 hour 22: 177628 events in 4 files, snapshot 9086334170255501899 (task 15402 ms: download 8977 ms overlapping gunzip 1061 ms, parse 4353 ms, sort 108 ms, write 9175 ms, index 475 ms: 2 candidates, 69106 repo-hours, 896 releases; waiting 19 ms; commit 1450 ms)
2026-11-07T15:39:27Z [load_day 2023-02-15] 2023-02-15 hour 23: 153930 events in 4 files, snapshot 2816426444083469968 (task 15179 ms: download 8096 ms overlapping gunzip 882 ms, parse 3729 ms, sort 96 ms, write 7440 ms, index 409 ms: 9 candidates, 63497 repo-hours, 762 releases; waiting 2339 ms; commit 1321 ms)
2026-11-07T15:39:35Z [load_day 2023-02-15] 2023-02-15: repo_hour merged from 24 files to 1 (1922215 rows, 8077 ms)
2026-11-07T15:39:37Z [load_day 2023-02-15] 2023-02-15: index committed in 9972 ms (24 + 1 + 24 files)
2026-11-07T15:39:37Z [load_day 2023-02-15] 2023-02-15: 4357278 events in 24 hours
2026-11-07T15:39:37Z [load_day 2023-02-15] attempt 1 succeeded