orcaLog in

Runs · run 1080

load_day 2023-05-12, attempt 1 succeeded

Host
caf251265124:361524
Started
2026-11-07T20:01:23Z
Ended
2026-11-07T20:04:21Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1080/load_day/2023-05-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T20:01:23Z [load_day 2023-05-12] attempt 1 started
2026-11-07T20:01:25Z [load_day 2023-05-12] 2023-05-12: 2 hours in flight, about 1200 MB
2026-11-07T20:01:39Z [load_day 2023-05-12] 2023-05-12 hour 0: 146337 events in 3 files, snapshot 8188388686672837635 (task 11098 ms: download 4770 ms overlapping gunzip 615 ms, parse 2870 ms, sort 96 ms, write 6048 ms, index 476 ms: 14 candidates, 77331 repo-hours, 975 releases; waiting 513 ms; commit 1818 ms)
2026-11-07T20:01:40Z [load_day 2023-05-12] 2023-05-12 hour 1: 158346 events in 4 files, snapshot 4910479864749333222 (task 11468 ms: download 4677 ms overlapping gunzip 673 ms, parse 3101 ms, sort 91 ms, write 6215 ms, index 564 ms: 17 candidates, 89497 repo-hours, 856 releases; waiting 358 ms; commit 1682 ms)
2026-11-07T20:01:51Z [load_day 2023-05-12] 2023-05-12 hour 2: 131934 events in 3 files, snapshot 1537607447737988822 (task 11445 ms: download 5867 ms overlapping gunzip 627 ms, parse 2698 ms, sort 89 ms, write 5442 ms, index 377 ms: 15 candidates, 61887 repo-hours, 805 releases; waiting 1898 ms; commit 1618 ms)
2026-11-07T20:01:53Z [load_day 2023-05-12] 2023-05-12 hour 3: 124262 events in 3 files, snapshot 2839881387894396884 (task 9231 ms: download 4027 ms overlapping gunzip 547 ms, parse 2450 ms, sort 87 ms, write 4978 ms, index 371 ms: 12 candidates, 56581 repo-hours, 931 releases; waiting 569 ms; commit 1798 ms)
2026-11-07T20:02:01Z [load_day 2023-05-12] 2023-05-12 hour 4: 123818 events in 3 files, snapshot 7819785305006720315 (task 9814 ms: download 4603 ms overlapping gunzip 550 ms, parse 2403 ms, sort 76 ms, write 4796 ms, index 372 ms: 16 candidates, 53060 repo-hours, 638 releases; waiting 1333 ms; commit 1706 ms)
2026-11-07T20:02:05Z [load_day 2023-05-12] 2023-05-12 hour 5: 131782 events in 3 files, snapshot 3584774547619147581 (task 11487 ms: download 5489 ms overlapping gunzip 658 ms, parse 2853 ms, sort 76 ms, write 5809 ms, index 386 ms: 18 candidates, 59019 repo-hours, 782 releases; waiting 1409 ms; commit 1704 ms)
2026-11-07T20:02:14Z [load_day 2023-05-12] 2023-05-12 hour 6: 158992 events in 4 files, snapshot 8643818052524945589 (task 11976 ms: download 4743 ms overlapping gunzip 699 ms, parse 3075 ms, sort 94 ms, write 6907 ms, index 483 ms: 27 candidates, 76168 repo-hours, 975 releases; waiting 412 ms; commit 1762 ms)
2026-11-07T20:02:18Z [load_day 2023-05-12] 2023-05-12 hour 7: 150710 events in 4 files, snapshot 8359343532288679584 (task 12317 ms: download 5257 ms overlapping gunzip 731 ms, parse 3212 ms, sort 90 ms, write 7006 ms, index 457 ms: 13 candidates, 71916 repo-hours, 912 releases; waiting 507 ms; commit 1962 ms)
2026-11-07T20:02:29Z [load_day 2023-05-12] 2023-05-12 hour 8: 159492 events in 4 files, snapshot 1793543799731066274 (task 13387 ms: download 5695 ms overlapping gunzip 801 ms, parse 3550 ms, sort 117 ms, write 7530 ms, index 507 ms: 15 candidates, 76555 repo-hours, 1014 releases; waiting 535 ms; commit 1687 ms)
2026-11-07T20:02:33Z [load_day 2023-05-12] 2023-05-12 hour 9: 170968 events in 4 files, snapshot 7804425830849096172 (task 14380 ms: download 8382 ms overlapping gunzip 832 ms, parse 3703 ms, sort 99 ms, write 8370 ms, index 528 ms: 15 candidates, 79339 repo-hours, 1121 releases; waiting 522 ms; commit 1703 ms)
2026-11-07T20:02:44Z [load_day 2023-05-12] 2023-05-12 hour 10: 168404 events in 4 files, snapshot 8940432045921474922 (task 13880 ms: download 8171 ms overlapping gunzip 826 ms, parse 3713 ms, sort 97 ms, write 7920 ms, index 502 ms: 15 candidates, 76869 repo-hours, 1048 releases; waiting 561 ms; commit 1817 ms)
2026-11-07T20:02:48Z [load_day 2023-05-12] 2023-05-12 hour 11: 167272 events in 4 files, snapshot 8892278244802652233 (task 13829 ms: download 8220 ms overlapping gunzip 801 ms, parse 3590 ms, sort 109 ms, write 7808 ms, index 502 ms: 10 candidates, 73983 repo-hours, 938 releases; waiting 663 ms; commit 1575 ms)
2026-11-07T20:03:00Z [load_day 2023-05-12] 2023-05-12 hour 12: 216792 events in 5 files, snapshot 2046523691927289989 (task 15912 ms: download 8381 ms overlapping gunzip 876 ms, parse 4074 ms, sort 136 ms, write 8759 ms, index 777 ms: 11 candidates, 105837 repo-hours, 1062 releases; waiting 954 ms; commit 1812 ms)
2026-11-07T20:03:04Z [load_day 2023-05-12] 2023-05-12 hour 13: 192956 events in 4 files, snapshot 5863779081748424700 (task 15037 ms: download 7883 ms overlapping gunzip 893 ms, parse 3970 ms, sort 131 ms, write 8822 ms, index 642 ms: 29 candidates, 99364 repo-hours, 986 releases; waiting 330 ms; commit 1599 ms)
2026-11-07T20:03:17Z [load_day 2023-05-12] 2023-05-12 hour 14: 186702 events in 4 files, snapshot 9116323873673811526 (task 15730 ms: download 9194 ms overlapping gunzip 973 ms, parse 4221 ms, sort 122 ms, write 9038 ms, index 574 ms: 20 candidates, 89864 repo-hours, 1133 releases; waiting 522 ms; commit 1861 ms)
2026-11-07T20:03:20Z [load_day 2023-05-12] 2023-05-12 hour 15: 169827 events in 4 files, snapshot 7109825067348773764 (task 15909 ms: download 10003 ms overlapping gunzip 878 ms, parse 3921 ms, sort 98 ms, write 8025 ms, index 544 ms: 8 candidates, 81200 repo-hours, 1082 releases; waiting 2128 ms; commit 1774 ms)
2026-11-07T20:03:32Z [load_day 2023-05-12] 2023-05-12 hour 16: 164831 events in 4 files, snapshot 8156655022625192619 (task 14465 ms: download 8895 ms overlapping gunzip 831 ms, parse 3667 ms, sort 119 ms, write 7697 ms, index 527 ms: 11 candidates, 79207 repo-hours, 973 releases; waiting 1290 ms; commit 1696 ms)
2026-11-07T20:03:35Z [load_day 2023-05-12] 2023-05-12 hour 17: 165249 events in 4 files, snapshot 2128849265286146576 (task 13552 ms: download 7993 ms overlapping gunzip 781 ms, parse 3450 ms, sort 105 ms, write 7846 ms, index 524 ms: 10 candidates, 73957 repo-hours, 905 releases; waiting 543 ms; commit 1707 ms)
2026-11-07T20:03:46Z [load_day 2023-05-12] 2023-05-12 hour 18: 164063 events in 4 files, snapshot 5410212010529667637 (task 13266 ms: download 5462 ms overlapping gunzip 760 ms, parse 3402 ms, sort 104 ms, write 7705 ms, index 515 ms: 17 candidates, 74476 repo-hours, 992 releases; waiting 533 ms; commit 1753 ms)
2026-11-07T20:03:48Z [load_day 2023-05-12] 2023-05-12 hour 19: 154980 events in 4 files, snapshot 8917932059210249464 (task 12894 ms: download 5456 ms overlapping gunzip 776 ms, parse 3451 ms, sort 100 ms, write 6988 ms, index 467 ms: 23 candidates, 66834 repo-hours, 909 releases; waiting 495 ms; commit 1540 ms)
2026-11-07T20:03:59Z [load_day 2023-05-12] 2023-05-12 hour 20: 154146 events in 4 files, snapshot 2135931826860095681 (task 12177 ms: download 5049 ms overlapping gunzip 746 ms, parse 3314 ms, sort 102 ms, write 6753 ms, index 512 ms: 18 candidates, 68916 repo-hours, 884 releases; waiting 494 ms; commit 1586 ms)
2026-11-07T20:04:01Z [load_day 2023-05-12] 2023-05-12 hour 21: 136884 events in 3 files, snapshot 5981049218642233962 (task 10725 ms: download 4605 ms overlapping gunzip 629 ms, parse 2816 ms, sort 83 ms, write 6046 ms, index 364 ms: 11 candidates, 58190 repo-hours, 896 releases; waiting 534 ms; commit 1819 ms)
2026-11-07T20:04:11Z [load_day 2023-05-12] 2023-05-12 hour 22: 123529 events in 3 files, snapshot 8286354196750752472 (task 10499 ms: download 5242 ms overlapping gunzip 560 ms, parse 2535 ms, sort 78 ms, write 5239 ms, index 347 ms: 7 candidates, 52314 repo-hours, 879 releases; waiting 1499 ms; commit 1588 ms)
2026-11-07T20:04:12Z [load_day 2023-05-12] 2023-05-12 hour 23: 106359 events in 3 files, snapshot 8420278034342188565 (task 8111 ms: download 2325 ms overlapping gunzip 466 ms, parse 2117 ms, sort 64 ms, write 4270 ms, index 311 ms: 5 candidates, 45706 repo-hours, 649 releases; waiting 543 ms; commit 1458 ms)
2026-11-07T20:04:19Z [load_day 2023-05-12] 2023-05-12: repo_hour merged from 24 files to 1 (1748070 rows, 7277 ms)
2026-11-07T20:04:21Z [load_day 2023-05-12] 2023-05-12: index committed in 9166 ms (24 + 1 + 24 files)
2026-11-07T20:04:21Z [load_day 2023-05-12] 2023-05-12: 3728635 events in 24 hours
2026-11-07T20:04:21Z [load_day 2023-05-12] attempt 1 succeeded