orcaLog in

Runs · run 746

load_day 2023-01-20, attempt 1 succeeded

Host
d3d1748bf284:26217
Started
2026-11-07T13:59:19Z
Ended
2026-11-07T14:02:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/746/load_day/2023-01-20/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:59:19Z [load_day 2023-01-20] attempt 1 started
2026-11-07T13:59:20Z [load_day 2023-01-20] 2023-01-20: 2 hours in flight, about 1200 MB
2026-11-07T13:59:34Z [load_day 2023-01-20] 2023-01-20 hour 0: 149747 events in 3 files, snapshot 1273337287401064485 (task 11979 ms: download 5299 ms overlapping gunzip 699 ms, parse 3140 ms, sort 107 ms, write 6780 ms, index 477 ms: 3 candidates, 70817 repo-hours, 1042 releases; waiting 499 ms; commit 1330 ms)
2026-11-07T13:59:36Z [load_day 2023-01-20] 2023-01-20 hour 1: 141152 events in 3 files, snapshot 2319200502131434399 (task 11177 ms: download 5028 ms overlapping gunzip 683 ms, parse 2962 ms, sort 107 ms, write 6080 ms, index 493 ms: 4 candidates, 70488 repo-hours, 815 releases; waiting 575 ms; commit 1488 ms)
2026-11-07T13:59:44Z [load_day 2023-01-20] 2023-01-20 hour 2: 122617 events in 3 files, snapshot 5028146426973970985 (task 9317 ms: download 4244 ms overlapping gunzip 591 ms, parse 2496 ms, sort 63 ms, write 4959 ms, index 357 ms: 2 candidates, 56267 repo-hours, 605 releases; waiting 517 ms; commit 1444 ms)
2026-11-07T13:59:46Z [load_day 2023-01-20] 2023-01-20 hour 3: 129170 events in 3 files, snapshot 6840833097377327954 (task 8932 ms: download 3962 ms overlapping gunzip 556 ms, parse 2396 ms, sort 61 ms, write 4849 ms, index 313 ms: 3 candidates, 47468 repo-hours, 740 releases; waiting 440 ms; commit 1404 ms)
2026-11-07T13:59:55Z [load_day 2023-01-20] 2023-01-20 hour 4: 130856 events in 3 files, snapshot 1735208282459974727 (task 9756 ms: download 4636 ms overlapping gunzip 619 ms, parse 2549 ms, sort 71 ms, write 5335 ms, index 310 ms: 4 candidates, 48101 repo-hours, 509 releases; waiting 566 ms; commit 1215 ms)
2026-11-07T13:59:56Z [load_day 2023-01-20] 2023-01-20 hour 5: 135762 events in 3 files, snapshot 154067277618437713 (task 9592 ms: download 4254 ms overlapping gunzip 617 ms, parse 2551 ms, sort 71 ms, write 5074 ms, index 340 ms: 2 candidates, 49731 repo-hours, 685 releases; waiting 598 ms; commit 1181 ms)
2026-11-07T14:00:06Z [load_day 2023-01-20] 2023-01-20 hour 6: 149027 events in 3 files, snapshot 7503034791383381519 (task 10543 ms: download 4502 ms overlapping gunzip 681 ms, parse 2882 ms, sort 93 ms, write 5695 ms, index 354 ms: 4 candidates, 56597 repo-hours, 660 releases; waiting 523 ms; commit 1425 ms)
2026-11-07T14:00:08Z [load_day 2023-01-20] 2023-01-20 hour 7: 152929 events in 4 files, snapshot 369537754009632552 (task 11631 ms: download 5258 ms overlapping gunzip 723 ms, parse 3026 ms, sort 101 ms, write 6161 ms, index 345 ms: 3 candidates, 56216 repo-hours, 604 releases; waiting 991 ms; commit 1224 ms)
2026-11-07T14:00:20Z [load_day 2023-01-20] 2023-01-20 hour 8: 163747 events in 4 files, snapshot 170355087619689103 (task 13604 ms: download 6197 ms overlapping gunzip 779 ms, parse 3385 ms, sort 80 ms, write 7180 ms, index 411 ms: 7 candidates, 63950 repo-hours, 729 releases; waiting 1367 ms; commit 1409 ms)
2026-11-07T14:00:23Z [load_day 2023-01-20] 2023-01-20 hour 9: 180152 events in 4 files, snapshot 1449581334963494310 (task 14176 ms: download 8223 ms overlapping gunzip 878 ms, parse 3874 ms, sort 93 ms, write 8042 ms, index 460 ms: 5 candidates, 69808 repo-hours, 1012 releases; waiting 525 ms; commit 1396 ms)
2026-11-07T14:00:36Z [load_day 2023-01-20] 2023-01-20 hour 10: 184581 events in 4 files, snapshot 1230190670160887362 (task 15182 ms: download 8848 ms overlapping gunzip 923 ms, parse 4003 ms, sort 108 ms, write 8464 ms, index 500 ms: 5 candidates, 72540 repo-hours, 961 releases; waiting 752 ms; commit 1563 ms)
2026-11-07T14:00:38Z [load_day 2023-01-20] 2023-01-20 hour 11: 175083 events in 4 files, snapshot 6315725778656527558 (task 13437 ms: download 7706 ms overlapping gunzip 821 ms, parse 3608 ms, sort 92 ms, write 7796 ms, index 475 ms: 4 candidates, 68869 repo-hours, 927 releases; waiting 228 ms; commit 1479 ms)
2026-11-07T14:00:53Z [load_day 2023-01-20] 2023-01-20 hour 12: 206214 events in 5 files, snapshot 1834235687698334439 (task 15471 ms: download 8651 ms overlapping gunzip 948 ms, parse 4103 ms, sort 117 ms, write 8615 ms, index 593 ms: 2 candidates, 95920 repo-hours, 1075 releases; waiting 735 ms; commit 1501 ms)
2026-11-07T14:00:54Z [load_day 2023-01-20] 2023-01-20 hour 13: 207723 events in 5 files, snapshot 4254057457891962708 (task 15624 ms: download 8211 ms overlapping gunzip 934 ms, parse 4062 ms, sort 123 ms, write 9070 ms, index 598 ms: 3 candidates, 95221 repo-hours, 1079 releases; waiting 542 ms; commit 1441 ms)
2026-11-07T14:01:09Z [load_day 2023-01-20] 2023-01-20 hour 14: 200753 events in 5 files, snapshot 5539147491559586317 (task 16000 ms: download 8967 ms overlapping gunzip 1006 ms, parse 4297 ms, sort 110 ms, write 9169 ms, index 546 ms: 7 candidates, 84192 repo-hours, 1104 releases; waiting 562 ms; commit 1347 ms)
2026-11-07T14:01:11Z [load_day 2023-01-20] 2023-01-20 hour 15: 202282 events in 5 files, snapshot 5675879354722705342 (task 16319 ms: download 9274 ms overlapping gunzip 994 ms, parse 4343 ms, sort 111 ms, write 9281 ms, index 556 ms: 8 candidates, 85948 repo-hours, 1275 releases; waiting 719 ms; commit 1472 ms)
2026-11-07T14:01:26Z [load_day 2023-01-20] 2023-01-20 hour 16: 191260 events in 4 files, snapshot 5369892617657960776 (task 15904 ms: download 8946 ms overlapping gunzip 964 ms, parse 4214 ms, sort 111 ms, write 8942 ms, index 519 ms: 7 candidates, 81460 repo-hours, 1023 releases; waiting 576 ms; commit 1521 ms)
2026-11-07T14:01:27Z [load_day 2023-01-20] 2023-01-20 hour 17: 188961 events in 4 files, snapshot 1133022304765239420 (task 14739 ms: download 8574 ms overlapping gunzip 943 ms, parse 4031 ms, sort 126 ms, write 8356 ms, index 503 ms: 3 candidates, 76482 repo-hours, 923 releases; waiting 549 ms; commit 1313 ms)
2026-11-07T14:01:41Z [load_day 2023-01-20] 2023-01-20 hour 18: 183956 events in 4 files, snapshot 2835621631421529664 (task 14291 ms: download 8210 ms overlapping gunzip 850 ms, parse 3714 ms, sort 94 ms, write 8082 ms, index 523 ms: 2 candidates, 76925 repo-hours, 1057 releases; waiting 643 ms; commit 1406 ms)
2026-11-07T14:01:42Z [load_day 2023-01-20] 2023-01-20 hour 19: 174937 events in 4 files, snapshot 1577738904102276716 (task 13223 ms: download 7676 ms overlapping gunzip 811 ms, parse 3501 ms, sort 97 ms, write 7492 ms, index 474 ms: 3 candidates, 68098 repo-hours, 939 releases; waiting 531 ms; commit 1499 ms)
2026-11-07T14:01:55Z [load_day 2023-01-20] 2023-01-20 hour 20: 174525 events in 4 files, snapshot 7591059858948926709 (task 13126 ms: download 7644 ms overlapping gunzip 824 ms, parse 3507 ms, sort 120 ms, write 7610 ms, index 447 ms: 8 candidates, 66616 repo-hours, 933 releases; waiting 244 ms; commit 1416 ms)
2026-11-07T14:01:57Z [load_day 2023-01-20] 2023-01-20 hour 21: 173853 events in 4 files, snapshot 5188481842547300866 (task 13889 ms: download 7982 ms overlapping gunzip 895 ms, parse 3842 ms, sort 99 ms, write 7846 ms, index 395 ms: 6 candidates, 63301 repo-hours, 898 releases; waiting 540 ms; commit 1469 ms)
2026-11-07T14:02:09Z [load_day 2023-01-20] 2023-01-20 hour 22: 159352 events in 4 files, snapshot 358399721303828668 (task 13296 ms: download 6088 ms overlapping gunzip 855 ms, parse 3597 ms, sort 86 ms, write 7299 ms, index 372 ms: 3 candidates, 59949 repo-hours, 921 releases; waiting 601 ms; commit 1297 ms)
2026-11-07T14:02:10Z [load_day 2023-01-20] 2023-01-20 hour 23: 137349 events in 3 files, snapshot 1532164010181661631 (task 11246 ms: download 5292 ms overlapping gunzip 677 ms, parse 2857 ms, sort 74 ms, write 6383 ms, index 341 ms: 5 candidates, 53468 repo-hours, 745 releases; waiting 581 ms; commit 1231 ms)
2026-11-07T14:02:17Z [load_day 2023-01-20] 2023-01-20: repo_hour merged from 24 files to 1 (1638432 rows, 7090 ms)
2026-11-07T14:02:19Z [load_day 2023-01-20] 2023-01-20: index committed in 9292 ms (24 + 1 + 24 files)
2026-11-07T14:02:19Z [load_day 2023-01-20] 2023-01-20: 4015988 events in 24 hours
2026-11-07T14:02:19Z [load_day 2023-01-20] attempt 1 succeeded