orcaLog in

Runs · run 792

load_day 2023-02-05, attempt 1 succeeded

Host
caf251265124:20700
Started
2026-11-07T15:05:03Z
Ended
2026-11-07T15:07:05Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/792/load_day/2023-02-05/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:05:03Z [load_day 2023-02-05] attempt 1 started
2026-11-07T15:05:04Z [load_day 2023-02-05] 2023-02-05: 2 hours in flight, about 1200 MB
2026-11-07T15:05:14Z [load_day 2023-02-05] 2023-02-05 hour 0: 115793 events in 3 files, snapshot 7734966120257943101 (task 7643 ms: download 2030 ms overlapping gunzip 421 ms, parse 1955 ms, sort 58 ms, write 4033 ms, index 372 ms: 4 candidates, 58134 repo-hours, 849 releases; waiting 508 ms; commit 1282 ms)
2026-11-07T15:05:18Z [load_day 2023-02-05] 2023-02-05 hour 1: 119097 events in 3 files, snapshot 2221809340212783470 (task 8959 ms: download 3982 ms overlapping gunzip 434 ms, parse 2045 ms, sort 61 ms, write 4205 ms, index 390 ms: 1 candidates, 64430 repo-hours, 844 releases; waiting 1518 ms; commit 4119 ms)
2026-11-07T15:05:23Z [load_day 2023-02-05] 2023-02-05 hour 2: 100943 events in 3 files, snapshot 2589261765142813221 (task 7794 ms: download 2065 ms overlapping gunzip 434 ms, parse 1915 ms, sort 65 ms, write 3942 ms, index 376 ms: 4 candidates, 49264 repo-hours, 601 releases; waiting 515 ms; commit 1448 ms)
2026-11-07T15:05:24Z [load_day 2023-02-05] 2023-02-05 hour 3: 100937 events in 3 files, snapshot 574650652007037160 (task 6703 ms: download 2125 ms overlapping gunzip 383 ms, parse 1671 ms, sort 69 ms, write 3445 ms, index 301 ms: 2 candidates, 44973 repo-hours, 716 releases; waiting 518 ms; commit 1340 ms)
2026-11-07T15:05:31Z [load_day 2023-02-05] 2023-02-05 hour 4: 95384 events in 2 files, snapshot 2953143223527050470 (task 6751 ms: download 2139 ms overlapping gunzip 364 ms, parse 1595 ms, sort 54 ms, write 3024 ms, index 272 ms: 2 candidates, 40370 repo-hours, 541 releases; waiting 1143 ms; commit 1361 ms)
2026-11-07T15:05:32Z [load_day 2023-02-05] 2023-02-05 hour 5: 100207 events in 3 files, snapshot 8094151299870964114 (task 6323 ms: download 1886 ms overlapping gunzip 341 ms, parse 1544 ms, sort 56 ms, write 3229 ms, index 319 ms: 2 candidates, 43822 repo-hours, 674 releases; waiting 489 ms; commit 1356 ms)
2026-11-07T15:05:38Z [load_day 2023-02-05] 2023-02-05 hour 6: 106797 events in 3 files, snapshot 830699716461384355 (task 6461 ms: download 1873 ms overlapping gunzip 376 ms, parse 1663 ms, sort 67 ms, write 3244 ms, index 315 ms: 2 candidates, 46630 repo-hours, 659 releases; waiting 516 ms; commit 1582 ms)
2026-11-07T15:05:39Z [load_day 2023-02-05] 2023-02-05 hour 7: 102274 events in 3 files, snapshot 5791192470113240758 (task 6237 ms: download 1699 ms overlapping gunzip 359 ms, parse 1603 ms, sort 67 ms, write 3344 ms, index 323 ms: 2 candidates, 43106 repo-hours, 494 releases; waiting 249 ms; commit 1498 ms)
2026-11-07T15:05:46Z [load_day 2023-02-05] 2023-02-05 hour 8: 110203 events in 3 files, snapshot 8076649552683220835 (task 7362 ms: download 2934 ms overlapping gunzip 423 ms, parse 1849 ms, sort 74 ms, write 3919 ms, index 299 ms: 3 candidates, 47309 repo-hours, 623 releases; waiting 504 ms; commit 1473 ms)
2026-11-07T15:05:47Z [load_day 2023-02-05] 2023-02-05 hour 9: 112661 events in 3 files, snapshot 264786797897507849 (task 7512 ms: download 2594 ms overlapping gunzip 422 ms, parse 1852 ms, sort 71 ms, write 3986 ms, index 331 ms: 2 candidates, 48203 repo-hours, 697 releases; waiting 518 ms; commit 1376 ms)
2026-11-07T15:05:54Z [load_day 2023-02-05] 2023-02-05 hour 10: 129363 events in 3 files, snapshot 8842815228974822405 (task 8165 ms: download 2606 ms overlapping gunzip 428 ms, parse 1932 ms, sort 72 ms, write 4272 ms, index 403 ms: 1 candidates, 61123 repo-hours, 607 releases; waiting 563 ms; commit 1285 ms)
2026-11-07T15:05:56Z [load_day 2023-02-05] 2023-02-05 hour 11: 126248 events in 3 files, snapshot 1163740560127240356 (task 8123 ms: download 2421 ms overlapping gunzip 442 ms, parse 2008 ms, sort 74 ms, write 4289 ms, index 409 ms: 1 candidates, 55463 repo-hours, 712 releases; waiting 522 ms; commit 1402 ms)
2026-11-07T15:06:05Z [load_day 2023-02-05] 2023-02-05 hour 12: 178390 events in 4 files, snapshot 5073489020143797157 (task 10265 ms: download 3645 ms overlapping gunzip 560 ms, parse 2591 ms, sort 94 ms, write 5716 ms, index 571 ms: 9 candidates, 82106 repo-hours, 758 releases; waiting 476 ms; commit 1299 ms)
2026-11-07T15:06:07Z [load_day 2023-02-05] 2023-02-05 hour 13: 157098 events in 4 files, snapshot 2047347429526737684 (task 9412 ms: download 3036 ms overlapping gunzip 529 ms, parse 2415 ms, sort 92 ms, write 5247 ms, index 495 ms: 5 candidates, 78876 repo-hours, 785 releases; waiting 186 ms; commit 1465 ms)
2026-11-07T15:06:17Z [load_day 2023-02-05] 2023-02-05 hour 14: 146504 events in 3 files, snapshot 6306719445672383753 (task 11279 ms: download 5741 ms overlapping gunzip 542 ms, parse 2371 ms, sort 88 ms, write 4748 ms, index 424 ms: 2 candidates, 67083 repo-hours, 828 releases; waiting 2775 ms; commit 1481 ms)
2026-11-07T15:06:19Z [load_day 2023-02-05] 2023-02-05 hour 15: 150272 events in 4 files, snapshot 6773830192200231924 (task 9186 ms: download 3314 ms overlapping gunzip 541 ms, parse 2445 ms, sort 93 ms, write 5007 ms, index 445 ms: 2 candidates, 66488 repo-hours, 999 releases; waiting 230 ms; commit 1281 ms)
2026-11-07T15:06:27Z [load_day 2023-02-05] 2023-02-05 hour 16: 149567 events in 3 files, snapshot 7480964818880762004 (task 9392 ms: download 3295 ms overlapping gunzip 517 ms, parse 2324 ms, sort 96 ms, write 5348 ms, index 432 ms: 0 candidates, 66177 repo-hours, 822 releases; waiting 290 ms; commit 1488 ms)
2026-11-07T15:06:29Z [load_day 2023-02-05] 2023-02-05 hour 17: 150561 events in 4 files, snapshot 2714537881803804421 (task 9334 ms: download 3408 ms overlapping gunzip 527 ms, parse 2403 ms, sort 88 ms, write 5063 ms, index 421 ms: 3 candidates, 67345 repo-hours, 771 releases; waiting 523 ms; commit 1271 ms)
2026-11-07T15:06:37Z [load_day 2023-02-05] 2023-02-05 hour 18: 150635 events in 4 files, snapshot 1244695553745445941 (task 9196 ms: download 3422 ms overlapping gunzip 514 ms, parse 2335 ms, sort 86 ms, write 4932 ms, index 442 ms: 4 candidates, 69667 repo-hours, 862 releases; waiting 567 ms; commit 1448 ms)
2026-11-07T15:06:39Z [load_day 2023-02-05] 2023-02-05 hour 19: 138351 events in 3 files, snapshot 5863822426604493879 (task 8909 ms: download 3438 ms overlapping gunzip 516 ms, parse 2262 ms, sort 64 ms, write 4842 ms, index 381 ms: 5 candidates, 59393 repo-hours, 830 releases; waiting 524 ms; commit 1290 ms)
2026-11-07T15:06:47Z [load_day 2023-02-05] 2023-02-05 hour 20: 133914 events in 3 files, snapshot 5153560829297249230 (task 9282 ms: download 3842 ms overlapping gunzip 519 ms, parse 2288 ms, sort 92 ms, write 4763 ms, index 437 ms: 2 candidates, 57424 repo-hours, 780 releases; waiting 789 ms; commit 1475 ms)
2026-11-07T15:06:49Z [load_day 2023-02-05] 2023-02-05 hour 21: 129454 events in 3 files, snapshot 7838351713681264566 (task 9021 ms: download 3280 ms overlapping gunzip 507 ms, parse 2193 ms, sort 80 ms, write 4586 ms, index 347 ms: 2 candidates, 54975 repo-hours, 909 releases; waiting 1009 ms; commit 1433 ms)
2026-11-07T15:06:56Z [load_day 2023-02-05] 2023-02-05 hour 22: 118629 events in 3 files, snapshot 5168218340955029368 (task 8056 ms: download 2240 ms overlapping gunzip 450 ms, parse 2030 ms, sort 63 ms, write 4359 ms, index 323 ms: 0 candidates, 48662 repo-hours, 723 releases; waiting 526 ms; commit 1227 ms)
2026-11-07T15:06:57Z [load_day 2023-02-05] 2023-02-05 hour 23: 110486 events in 3 files, snapshot 2323543713236697713 (task 7247 ms: download 1673 ms overlapping gunzip 448 ms, parse 1917 ms, sort 59 ms, write 4060 ms, index 295 ms: 0 candidates, 46670 repo-hours, 655 releases; waiting 211 ms; commit 1576 ms)
2026-11-07T15:07:03Z [load_day 2023-02-05] 2023-02-05: repo_hour merged from 24 files to 1 (1367693 rows, 5803 ms)
2026-11-07T15:07:05Z [load_day 2023-02-05] 2023-02-05: index committed in 7404 ms (21 + 1 + 24 files)
2026-11-07T15:07:05Z [load_day 2023-02-05] 2023-02-05: 3033768 events in 24 hours
2026-11-07T15:07:05Z [load_day 2023-02-05] attempt 1 succeeded