orcaLog in

Runs · run 918

load_day 2023-03-19, attempt 1 succeeded

Host
caf251265124:178410
Started
2026-11-07T17:20:18Z
Ended
2026-11-07T17:22:24Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/918/load_day/2023-03-19/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T17:20:18Z [load_day 2023-03-19] attempt 1 started
2026-11-07T17:20:20Z [load_day 2023-03-19] 2023-03-19: 2 hours in flight, about 1200 MB
2026-11-07T17:20:30Z [load_day 2023-03-19] 2023-03-19 hour 0: 113307 events in 3 files, snapshot 7384542745228552976 (task 7355 ms: download 1919 ms overlapping gunzip 396 ms, parse 1870 ms, sort 71 ms, write 4093 ms, index 353 ms: 7 candidates, 55877 repo-hours, 819 releases; waiting 239 ms; commit 1561 ms)
2026-11-07T17:20:31Z [load_day 2023-03-19] 2023-03-19 hour 1: 119751 events in 3 files, snapshot 3694974036127562966 (task 7653 ms: download 1966 ms overlapping gunzip 389 ms, parse 1853 ms, sort 107 ms, write 3980 ms, index 410 ms: 3 candidates, 64222 repo-hours, 797 releases; waiting 506 ms; commit 1491 ms)
2026-11-07T17:20:38Z [load_day 2023-03-19] 2023-03-19 hour 2: 103425 events in 3 files, snapshot 323984546568731186 (task 7302 ms: download 2794 ms overlapping gunzip 407 ms, parse 1768 ms, sort 74 ms, write 3610 ms, index 320 ms: 3 candidates, 49547 repo-hours, 543 releases; waiting 761 ms; commit 1617 ms)
2026-11-07T17:20:40Z [load_day 2023-03-19] 2023-03-19 hour 3: 98807 events in 2 files, snapshot 5554499656320641793 (task 6581 ms: download 2888 ms overlapping gunzip 345 ms, parse 1555 ms, sort 65 ms, write 3195 ms, index 277 ms: 3 candidates, 40155 repo-hours, 682 releases; waiting 830 ms; commit 1488 ms)
2026-11-07T17:20:45Z [load_day 2023-03-19] 2023-03-19 hour 4: 102699 events in 3 files, snapshot 3069342423972571083 (task 6151 ms: download 1776 ms overlapping gunzip 338 ms, parse 1507 ms, sort 73 ms, write 3058 ms, index 343 ms: 1 candidates, 45807 repo-hours, 567 releases; waiting 525 ms; commit 1404 ms)
2026-11-07T17:20:47Z [load_day 2023-03-19] 2023-03-19 hour 5: 100153 events in 3 files, snapshot 4729639841835878823 (task 6469 ms: download 1729 ms overlapping gunzip 330 ms, parse 1520 ms, sort 81 ms, write 3205 ms, index 308 ms: 1 candidates, 41125 repo-hours, 627 releases; waiting 610 ms; commit 1449 ms)
2026-11-07T17:20:52Z [load_day 2023-03-19] 2023-03-19 hour 6: 107909 events in 3 files, snapshot 3733165002300384479 (task 6465 ms: download 2092 ms overlapping gunzip 356 ms, parse 1600 ms, sort 66 ms, write 3257 ms, index 321 ms: 4 candidates, 47283 repo-hours, 603 releases; waiting 527 ms; commit 1640 ms)
2026-11-07T17:20:55Z [load_day 2023-03-19] 2023-03-19 hour 7: 112002 events in 3 files, snapshot 5264607704069648685 (task 7089 ms: download 2378 ms overlapping gunzip 382 ms, parse 1724 ms, sort 65 ms, write 3476 ms, index 341 ms: 4 candidates, 45672 repo-hours, 561 releases; waiting 722 ms; commit 1563 ms)
2026-11-07T17:21:00Z [load_day 2023-03-19] 2023-03-19 hour 8: 119010 events in 3 files, snapshot 2212019968394451948 (task 7223 ms: download 1881 ms overlapping gunzip 393 ms, parse 1801 ms, sort 66 ms, write 3711 ms, index 366 ms: 3 candidates, 49938 repo-hours, 609 releases; waiting 522 ms; commit 1475 ms)
2026-11-07T17:21:04Z [load_day 2023-03-19] 2023-03-19 hour 9: 150525 events in 4 files, snapshot 1503479198300179250 (task 8168 ms: download 1797 ms overlapping gunzip 445 ms, parse 2029 ms, sort 119 ms, write 4247 ms, index 463 ms: 3 candidates, 80963 repo-hours, 719 releases; waiting 548 ms; commit 1512 ms)
2026-11-07T17:21:09Z [load_day 2023-03-19] 2023-03-19 hour 10: 129045 events in 3 files, snapshot 6444490529997248924 (task 8205 ms: download 2625 ms overlapping gunzip 454 ms, parse 2027 ms, sort 79 ms, write 4300 ms, index 389 ms: 1 candidates, 55311 repo-hours, 723 releases; waiting 602 ms; commit 1402 ms)
2026-11-07T17:21:13Z [load_day 2023-03-19] 2023-03-19 hour 11: 132115 events in 3 files, snapshot 2014462433447295072 (task 8394 ms: download 2046 ms overlapping gunzip 468 ms, parse 2109 ms, sort 94 ms, write 4363 ms, index 369 ms: 3 candidates, 56042 repo-hours, 730 releases; waiting 721 ms; commit 1718 ms)
2026-11-07T17:21:20Z [load_day 2023-03-19] 2023-03-19 hour 12: 185880 events in 4 files, snapshot 571290228167543393 (task 10446 ms: download 3553 ms overlapping gunzip 580 ms, parse 2709 ms, sort 113 ms, write 5660 ms, index 559 ms: 4 candidates, 87957 repo-hours, 784 releases; waiting 515 ms; commit 1467 ms)
2026-11-07T17:21:24Z [load_day 2023-03-19] 2023-03-19 hour 13: 177679 events in 4 files, snapshot 8094642392538431626 (task 10188 ms: download 3446 ms overlapping gunzip 553 ms, parse 2511 ms, sort 103 ms, write 5564 ms, index 564 ms: 3 candidates, 93750 repo-hours, 798 releases; waiting 539 ms; commit 1411 ms)
2026-11-07T17:21:31Z [load_day 2023-03-19] 2023-03-19 hour 14: 166242 events in 4 files, snapshot 9157621318821767915 (task 10467 ms: download 3666 ms overlapping gunzip 609 ms, parse 2666 ms, sort 113 ms, write 6004 ms, index 460 ms: 0 candidates, 76478 repo-hours, 791 releases; waiting 313 ms; commit 1723 ms)
2026-11-07T17:21:35Z [load_day 2023-03-19] 2023-03-19 hour 15: 160864 events in 4 files, snapshot 7505411312594271844 (task 10249 ms: download 3744 ms overlapping gunzip 564 ms, parse 2557 ms, sort 94 ms, write 5692 ms, index 454 ms: 1 candidates, 71503 repo-hours, 908 releases; waiting 521 ms; commit 1561 ms)
2026-11-07T17:21:42Z [load_day 2023-03-19] 2023-03-19 hour 16: 154895 events in 4 files, snapshot 3638647076861591492 (task 9982 ms: download 3696 ms overlapping gunzip 558 ms, parse 2549 ms, sort 105 ms, write 5422 ms, index 458 ms: 3 candidates, 67384 repo-hours, 801 releases; waiting 562 ms; commit 1493 ms)
2026-11-07T17:21:46Z [load_day 2023-03-19] 2023-03-19 hour 17: 149086 events in 3 files, snapshot 7328579465826590502 (task 9724 ms: download 3860 ms overlapping gunzip 540 ms, parse 2470 ms, sort 107 ms, write 5162 ms, index 416 ms: 3 candidates, 62870 repo-hours, 782 releases; waiting 745 ms; commit 1516 ms)
2026-11-07T17:21:52Z [load_day 2023-03-19] 2023-03-19 hour 18: 152559 events in 4 files, snapshot 3168057895750184707 (task 9718 ms: download 3558 ms overlapping gunzip 543 ms, parse 2465 ms, sort 101 ms, write 5320 ms, index 441 ms: 2 candidates, 67629 repo-hours, 862 releases; waiting 495 ms; commit 1438 ms)
2026-11-07T17:21:56Z [load_day 2023-03-19] 2023-03-19 hour 19: 143856 events in 3 files, snapshot 967844941983431501 (task 9877 ms: download 4413 ms overlapping gunzip 520 ms, parse 2334 ms, sort 98 ms, write 4926 ms, index 398 ms: 2 candidates, 60212 repo-hours, 770 releases; waiting 1234 ms; commit 1295 ms)
2026-11-07T17:22:02Z [load_day 2023-03-19] 2023-03-19 hour 20: 138136 events in 3 files, snapshot 3245787940435331775 (task 8942 ms: download 3809 ms overlapping gunzip 495 ms, parse 2222 ms, sort 89 ms, write 4648 ms, index 395 ms: 3 candidates, 59149 repo-hours, 782 releases; waiting 767 ms; commit 1881 ms)
2026-11-07T17:22:06Z [load_day 2023-03-19] 2023-03-19 hour 21: 129574 events in 3 files, snapshot 2012818188285798503 (task 8345 ms: download 2085 ms overlapping gunzip 471 ms, parse 2100 ms, sort 72 ms, write 4480 ms, index 363 ms: 4 candidates, 53304 repo-hours, 828 releases; waiting 519 ms; commit 1672 ms)
2026-11-07T17:22:11Z [load_day 2023-03-19] 2023-03-19 hour 22: 141533 events in 3 files, snapshot 7963088946042081752 (task 8069 ms: download 2156 ms overlapping gunzip 454 ms, parse 2109 ms, sort 98 ms, write 4090 ms, index 461 ms: 2 candidates, 74647 repo-hours, 697 releases; waiting 525 ms; commit 1534 ms)
2026-11-07T17:22:14Z [load_day 2023-03-19] 2023-03-19 hour 23: 115643 events in 3 files, snapshot 2743763028247660314 (task 7869 ms: download 2249 ms overlapping gunzip 416 ms, parse 1892 ms, sort 69 ms, write 3931 ms, index 298 ms: 3 candidates, 47192 repo-hours, 760 releases; waiting 994 ms; commit 1578 ms)
2026-11-07T17:22:20Z [load_day 2023-03-19] 2023-03-19: repo_hour merged from 24 files to 1 (1454017 rows, 5955 ms)
2026-11-07T17:22:24Z [load_day 2023-03-19] 2023-03-19: index committed in 9433 ms (23 + 1 + 24 files)
2026-11-07T17:22:24Z [load_day 2023-03-19] 2023-03-19: 3204695 events in 24 hours
2026-11-07T17:22:24Z [load_day 2023-03-19] attempt 1 succeeded