orcaLog in

Runs · run 768

load_day 2023-01-28, attempt 1 succeeded

Host
d3d1748bf284:55254
Started
2026-11-07T14:28:45Z
Ended
2026-11-07T14:30:59Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/768/load_day/2023-01-28/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T14:28:45Z [load_day 2023-01-28] attempt 1 started
2026-11-07T14:28:46Z [load_day 2023-01-28] 2023-01-28: 2 hours in flight, about 1200 MB
2026-11-07T14:29:00Z [load_day 2023-01-28] 2023-01-28 hour 0: 126441 events in 3 files, snapshot 8955479796728596369 (task 11100 ms: download 3716 ms overlapping gunzip 572 ms, parse 2603 ms, sort 81 ms, write 4916 ms, index 368 ms: 5 candidates, 61988 repo-hours, 915 releases; waiting 2168 ms; commit 1359 ms)
2026-11-07T14:29:01Z [load_day 2023-01-28] 2023-01-28 hour 1: 125935 events in 3 files, snapshot 8022144149587130840 (task 8622 ms: download 2571 ms overlapping gunzip 508 ms, parse 2314 ms, sort 69 ms, write 4616 ms, index 392 ms: 4 candidates, 63679 repo-hours, 709 releases; waiting 508 ms; commit 1336 ms)
2026-11-07T14:29:09Z [load_day 2023-01-28] 2023-01-28 hour 2: 107039 events in 3 files, snapshot 70963851396531329 (task 7810 ms: download 2402 ms overlapping gunzip 452 ms, parse 1965 ms, sort 54 ms, write 3982 ms, index 325 ms: 3 candidates, 50629 repo-hours, 601 releases; waiting 773 ms; commit 2835 ms)
2026-11-07T14:29:10Z [load_day 2023-01-28] 2023-01-28 hour 3: 101159 events in 3 files, snapshot 788836160193969182 (task 8867 ms: download 3051 ms overlapping gunzip 433 ms, parse 1915 ms, sort 51 ms, write 4808 ms, index 300 ms: 7 candidates, 41720 repo-hours, 712 releases; waiting 996 ms; commit 1123 ms)
2026-11-07T14:29:17Z [load_day 2023-01-28] 2023-01-28 hour 4: 97355 events in 2 files, snapshot 2452694196590474732 (task 6523 ms: download 1768 ms overlapping gunzip 374 ms, parse 1647 ms, sort 72 ms, write 3329 ms, index 259 ms: 5 candidates, 39066 repo-hours, 548 releases; waiting 523 ms; commit 1165 ms)
2026-11-07T14:29:33Z [load_day 2023-01-28] 2023-01-28 hour 5: 101248 events in 3 files, snapshot 4843703703230433113 (task 6619 ms: download 1678 ms overlapping gunzip 390 ms, parse 1669 ms, sort 70 ms, write 3413 ms, index 274 ms: 4 candidates, 41629 repo-hours, 653 releases; waiting 514 ms; commit 16786 ms)
2026-11-07T14:29:35Z [load_day 2023-01-28] 2023-01-28 hour 6: 108382 events in 3 files, snapshot 238912710970460362 (task 9437 ms: download 1691 ms overlapping gunzip 374 ms, parse 1637 ms, sort 62 ms, write 6465 ms, index 301 ms: 4 candidates, 48084 repo-hours, 651 releases; waiting 298 ms; commit 1323 ms)
2026-11-07T14:29:41Z [load_day 2023-01-28] 2023-01-28 hour 7: 106270 events in 3 files, snapshot 3356081384379551014 (task 6876 ms: download 1890 ms overlapping gunzip 404 ms, parse 1779 ms, sort 71 ms, write 3479 ms, index 319 ms: 1 candidates, 45487 repo-hours, 556 releases; waiting 500 ms; commit 1145 ms)
2026-11-07T14:29:42Z [load_day 2023-01-28] 2023-01-28 hour 8: 115244 events in 3 files, snapshot 3513201837201418540 (task 7095 ms: download 1786 ms overlapping gunzip 434 ms, parse 1884 ms, sort 46 ms, write 3888 ms, index 312 ms: 3 candidates, 48309 repo-hours, 590 releases; waiting 188 ms; commit 1165 ms)
2026-11-07T14:29:49Z [load_day 2023-01-28] 2023-01-28 hour 9: 120037 events in 3 files, snapshot 6228924470566420984 (task 7376 ms: download 1733 ms overlapping gunzip 431 ms, parse 1954 ms, sort 67 ms, write 3891 ms, index 313 ms: 6 candidates, 51194 repo-hours, 763 releases; waiting 427 ms; commit 1217 ms)
2026-11-07T14:29:51Z [load_day 2023-01-28] 2023-01-28 hour 10: 118906 events in 3 files, snapshot 1659303019768159680 (task 7541 ms: download 2504 ms overlapping gunzip 414 ms, parse 1871 ms, sort 46 ms, write 3897 ms, index 354 ms: 3 candidates, 51963 repo-hours, 672 releases; waiting 641 ms; commit 1229 ms)
2026-11-07T14:29:59Z [load_day 2023-01-28] 2023-01-28 hour 11: 120899 events in 3 files, snapshot 7147473544419362530 (task 8379 ms: download 1751 ms overlapping gunzip 445 ms, parse 1965 ms, sort 67 ms, write 4821 ms, index 339 ms: 3 candidates, 50900 repo-hours, 637 releases; waiting 512 ms; commit 1824 ms)
2026-11-07T14:30:01Z [load_day 2023-01-28] 2023-01-28 hour 12: 176612 events in 4 files, snapshot 8837297047598334281 (task 9591 ms: download 3456 ms overlapping gunzip 520 ms, parse 2407 ms, sort 106 ms, write 4982 ms, index 589 ms: 6 candidates, 80690 repo-hours, 718 releases; waiting 605 ms; commit 1204 ms)
2026-11-07T14:30:08Z [load_day 2023-01-28] 2023-01-28 hour 13: 152807 events in 4 files, snapshot 8079206368133386522 (task 8705 ms: download 2945 ms overlapping gunzip 487 ms, parse 2231 ms, sort 94 ms, write 4549 ms, index 480 ms: 2 candidates, 77480 repo-hours, 781 releases; waiting 504 ms; commit 1294 ms)
2026-11-07T14:30:12Z [load_day 2023-01-28] 2023-01-28 hour 14: 142734 events in 3 files, snapshot 7814973941826677474 (task 9437 ms: download 3815 ms overlapping gunzip 508 ms, parse 2223 ms, sort 79 ms, write 4795 ms, index 436 ms: 4 candidates, 64137 repo-hours, 861 releases; waiting 985 ms; commit 1396 ms)
2026-11-07T14:30:18Z [load_day 2023-01-28] 2023-01-28 hour 15: 146342 events in 3 files, snapshot 8064826223456402899 (task 9295 ms: download 3519 ms overlapping gunzip 552 ms, parse 2372 ms, sort 96 ms, write 4971 ms, index 402 ms: 5 candidates, 63989 repo-hours, 976 releases; waiting 623 ms; commit 1348 ms)
2026-11-07T14:30:22Z [load_day 2023-01-28] 2023-01-28 hour 16: 138662 events in 3 files, snapshot 7923339615325044447 (task 9302 ms: download 3860 ms overlapping gunzip 513 ms, parse 2320 ms, sort 85 ms, write 4822 ms, index 395 ms: 5 candidates, 61479 repo-hours, 865 releases; waiting 865 ms; commit 1374 ms)
2026-11-07T14:30:27Z [load_day 2023-01-28] 2023-01-28 hour 17: 140702 events in 3 files, snapshot 2620311247055167346 (task 8410 ms: download 3003 ms overlapping gunzip 489 ms, parse 2170 ms, sort 62 ms, write 4765 ms, index 369 ms: 8 candidates, 59250 repo-hours, 759 releases; waiting 201 ms; commit 1384 ms)
2026-11-07T14:30:32Z [load_day 2023-01-28] 2023-01-28 hour 18: 139220 events in 3 files, snapshot 3969215803205398534 (task 9097 ms: download 2983 ms overlapping gunzip 474 ms, parse 2175 ms, sort 60 ms, write 4864 ms, index 472 ms: 4 candidates, 62657 repo-hours, 861 releases; waiting 709 ms; commit 1375 ms)
2026-11-07T14:30:36Z [load_day 2023-01-28] 2023-01-28 hour 19: 127208 events in 3 files, snapshot 3658666202443775384 (task 8083 ms: download 2431 ms overlapping gunzip 452 ms, parse 2016 ms, sort 59 ms, write 4204 ms, index 369 ms: 2 candidates, 53941 repo-hours, 831 releases; waiting 629 ms; commit 1250 ms)
2026-11-07T14:30:41Z [load_day 2023-01-28] 2023-01-28 hour 20: 122933 events in 3 files, snapshot 2805878168457302030 (task 8484 ms: download 2912 ms overlapping gunzip 448 ms, parse 1991 ms, sort 75 ms, write 4372 ms, index 332 ms: 3 candidates, 51979 repo-hours, 778 releases; waiting 950 ms; commit 1167 ms)
2026-11-07T14:30:44Z [load_day 2023-01-28] 2023-01-28 hour 21: 115654 events in 3 files, snapshot 6945126327593110934 (task 7381 ms: download 1754 ms overlapping gunzip 412 ms, parse 1856 ms, sort 70 ms, write 3840 ms, index 347 ms: 4 candidates, 47855 repo-hours, 821 releases; waiting 544 ms; commit 1352 ms)
2026-11-07T14:30:50Z [load_day 2023-01-28] 2023-01-28 hour 22: 109235 events in 3 files, snapshot 6350063461817921747 (task 7620 ms: download 2501 ms overlapping gunzip 440 ms, parse 1929 ms, sort 48 ms, write 3768 ms, index 304 ms: 2 candidates, 43628 repo-hours, 664 releases; waiting 796 ms; commit 1254 ms)
2026-11-07T14:30:51Z [load_day 2023-01-28] 2023-01-28 hour 23: 102687 events in 3 files, snapshot 6029495663818072822 (task 6472 ms: download 1522 ms overlapping gunzip 363 ms, parse 1666 ms, sort 66 ms, write 3462 ms, index 297 ms: 2 candidates, 42441 repo-hours, 648 releases; waiting 336 ms; commit 1300 ms)
2026-11-07T14:30:57Z [load_day 2023-01-28] 2023-01-28: repo_hour merged from 24 files to 1 (1304174 rows, 5484 ms)
2026-11-07T14:30:59Z [load_day 2023-01-28] 2023-01-28: index committed in 7354 ms (24 + 1 + 24 files)
2026-11-07T14:30:59Z [load_day 2023-01-28] 2023-01-28: 2963711 events in 24 hours
2026-11-07T14:30:59Z [load_day 2023-01-28] attempt 1 succeeded