orcaLog in

Runs · run 897

load_day 2023-03-12, attempt 1 succeeded

Host
caf251265124:153428
Started
2026-11-07T16:58:31Z
Ended
2026-11-07T17:00:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/897/load_day/2023-03-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T16:58:31Z [load_day 2023-03-12] attempt 1 started
2026-11-07T16:58:33Z [load_day 2023-03-12] 2023-03-12: 2 hours in flight, about 1200 MB
2026-11-07T16:58:43Z [load_day 2023-03-12] 2023-03-12 hour 0: 121197 events in 3 files, snapshot 7485019003602157299 (task 7719 ms: download 2359 ms overlapping gunzip 406 ms, parse 1959 ms, sort 73 ms, write 4030 ms, index 410 ms: 3 candidates, 57939 repo-hours, 871 releases; waiting 518 ms; commit 1258 ms)
2026-11-07T16:58:44Z [load_day 2023-03-12] 2023-03-12 hour 1: 116517 events in 3 files, snapshot 2508264780180661670 (task 7402 ms: download 2111 ms overlapping gunzip 363 ms, parse 1770 ms, sort 68 ms, write 3969 ms, index 411 ms: 4 candidates, 63316 repo-hours, 871 releases; waiting 505 ms; commit 1398 ms)
2026-11-07T16:58:50Z [load_day 2023-03-12] 2023-03-12 hour 2: 104246 events in 3 files, snapshot 744608836358210162 (task 6827 ms: download 2129 ms overlapping gunzip 369 ms, parse 1645 ms, sort 65 ms, write 3396 ms, index 311 ms: 1 candidates, 50275 repo-hours, 562 releases; waiting 722 ms; commit 1416 ms)
2026-11-07T16:58:52Z [load_day 2023-03-12] 2023-03-12 hour 3: 96871 events in 2 files, snapshot 3581925207081132317 (task 5899 ms: download 2051 ms overlapping gunzip 337 ms, parse 1461 ms, sort 55 ms, write 2925 ms, index 274 ms: 1 candidates, 40209 repo-hours, 791 releases; waiting 531 ms; commit 1285 ms)
2026-11-07T16:58:58Z [load_day 2023-03-12] 2023-03-12 hour 4: 95808 events in 2 files, snapshot 5106283056322883348 (task 6216 ms: download 1931 ms overlapping gunzip 329 ms, parse 1505 ms, sort 71 ms, write 3051 ms, index 279 ms: 5 candidates, 40328 repo-hours, 529 releases; waiting 607 ms; commit 1578 ms)
2026-11-07T16:58:59Z [load_day 2023-03-12] 2023-03-12 hour 5: 100209 events in 3 files, snapshot 8140842313157978084 (task 6194 ms: download 1860 ms overlapping gunzip 336 ms, parse 1477 ms, sort 64 ms, write 3169 ms, index 285 ms: 2 candidates, 42535 repo-hours, 705 releases; waiting 506 ms; commit 1546 ms)
2026-11-07T16:59:05Z [load_day 2023-03-12] 2023-03-12 hour 6: 108376 events in 3 files, snapshot 1885801868632861972 (task 6780 ms: download 2026 ms overlapping gunzip 351 ms, parse 1596 ms, sort 69 ms, write 3476 ms, index 358 ms: 2 candidates, 48584 repo-hours, 633 releases; waiting 550 ms; commit 1590 ms)
2026-11-07T16:59:06Z [load_day 2023-03-12] 2023-03-12 hour 7: 107016 events in 3 files, snapshot 3607570200276879695 (task 6657 ms: download 1973 ms overlapping gunzip 357 ms, parse 1609 ms, sort 72 ms, write 3491 ms, index 306 ms: 2 candidates, 45762 repo-hours, 529 releases; waiting 513 ms; commit 1362 ms)
2026-11-07T16:59:13Z [load_day 2023-03-12] 2023-03-12 hour 8: 119469 events in 3 files, snapshot 6293239711173525193 (task 7375 ms: download 2042 ms overlapping gunzip 404 ms, parse 1820 ms, sort 65 ms, write 3887 ms, index 326 ms: 5 candidates, 51554 repo-hours, 604 releases; waiting 525 ms; commit 1487 ms)
2026-11-07T16:59:15Z [load_day 2023-03-12] 2023-03-12 hour 9: 116469 events in 3 files, snapshot 6755198659718564489 (task 7537 ms: download 2045 ms overlapping gunzip 415 ms, parse 1855 ms, sort 55 ms, write 4021 ms, index 373 ms: 4 candidates, 49570 repo-hours, 730 releases; waiting 517 ms; commit 1442 ms)
2026-11-07T16:59:22Z [load_day 2023-03-12] 2023-03-12 hour 10: 130964 events in 3 files, snapshot 8477690571760493395 (task 8231 ms: download 2217 ms overlapping gunzip 476 ms, parse 2074 ms, sort 66 ms, write 4366 ms, index 378 ms: 3 candidates, 55124 repo-hours, 663 releases; waiting 510 ms; commit 1484 ms)
2026-11-07T16:59:24Z [load_day 2023-03-12] 2023-03-12 hour 11: 148784 events in 3 files, snapshot 5128759690844858111 (task 8541 ms: download 2931 ms overlapping gunzip 462 ms, parse 2051 ms, sort 99 ms, write 4565 ms, index 452 ms: 1 candidates, 72511 repo-hours, 667 releases; waiting 502 ms; commit 1587 ms)
2026-11-07T16:59:33Z [load_day 2023-03-12] 2023-03-12 hour 12: 185653 events in 4 files, snapshot 4747141652341632395 (task 10000 ms: download 3430 ms overlapping gunzip 561 ms, parse 2619 ms, sort 111 ms, write 5323 ms, index 532 ms: 5 candidates, 87150 repo-hours, 811 releases; waiting 522 ms; commit 1521 ms)
2026-11-07T16:59:35Z [load_day 2023-03-12] 2023-03-12 hour 13: 167325 events in 4 files, snapshot 656987658380916232 (task 9928 ms: download 3606 ms overlapping gunzip 543 ms, parse 2474 ms, sort 85 ms, write 5468 ms, index 513 ms: 5 candidates, 83704 repo-hours, 824 releases; waiting 556 ms; commit 1454 ms)
2026-11-07T16:59:43Z [load_day 2023-03-12] 2023-03-12 hour 14: 155231 events in 4 files, snapshot 719746153317650863 (task 9892 ms: download 3584 ms overlapping gunzip 556 ms, parse 2512 ms, sort 87 ms, write 5387 ms, index 489 ms: 9 candidates, 70216 repo-hours, 794 releases; waiting 511 ms; commit 1403 ms)
2026-11-07T16:59:46Z [load_day 2023-03-12] 2023-03-12 hour 15: 160315 events in 4 files, snapshot 7654952350597197821 (task 10541 ms: download 4074 ms overlapping gunzip 592 ms, parse 2606 ms, sort 88 ms, write 5769 ms, index 482 ms: 7 candidates, 73279 repo-hours, 980 releases; waiting 655 ms; commit 1361 ms)
2026-11-07T16:59:54Z [load_day 2023-03-12] 2023-03-12 hour 16: 155518 events in 4 files, snapshot 6278914735550396908 (task 10074 ms: download 3935 ms overlapping gunzip 568 ms, parse 2557 ms, sort 100 ms, write 5440 ms, index 467 ms: 6 candidates, 69871 repo-hours, 774 releases; waiting 634 ms; commit 1432 ms)
2026-11-07T16:59:58Z [load_day 2023-03-12] 2023-03-12 hour 17: 154152 events in 4 files, snapshot 4928839826815487635 (task 10597 ms: download 4975 ms overlapping gunzip 556 ms, parse 2479 ms, sort 78 ms, write 5127 ms, index 459 ms: 7 candidates, 67286 repo-hours, 780 releases; waiting 1301 ms; commit 1490 ms)
2026-11-07T17:00:06Z [load_day 2023-03-12] 2023-03-12 hour 18: 159090 events in 4 files, snapshot 2968884179050208049 (task 10455 ms: download 3850 ms overlapping gunzip 565 ms, parse 2544 ms, sort 105 ms, write 5727 ms, index 501 ms: 7 candidates, 71959 repo-hours, 879 releases; waiting 719 ms; commit 1472 ms)
2026-11-07T17:00:08Z [load_day 2023-03-12] 2023-03-12 hour 19: 143311 events in 3 files, snapshot 1490196943549547522 (task 9717 ms: download 3762 ms overlapping gunzip 547 ms, parse 2405 ms, sort 88 ms, write 5337 ms, index 440 ms: 10 candidates, 60467 repo-hours, 825 releases; waiting 553 ms; commit 1531 ms)
2026-11-07T17:00:16Z [load_day 2023-03-12] 2023-03-12 hour 20: 142842 events in 3 files, snapshot 426089676995474414 (task 9705 ms: download 3963 ms overlapping gunzip 546 ms, parse 2401 ms, sort 85 ms, write 5080 ms, index 392 ms: 1 candidates, 61174 repo-hours, 885 releases; waiting 858 ms; commit 1371 ms)
2026-11-07T17:00:18Z [load_day 2023-03-12] 2023-03-12 hour 21: 131214 events in 3 files, snapshot 5819812844741259639 (task 8945 ms: download 2816 ms overlapping gunzip 497 ms, parse 2210 ms, sort 70 ms, write 4661 ms, index 375 ms: 6 candidates, 55426 repo-hours, 888 releases; waiting 786 ms; commit 1430 ms)
2026-11-07T17:00:25Z [load_day 2023-03-12] 2023-03-12 hour 22: 137008 events in 3 files, snapshot 3648395325250354215 (task 8487 ms: download 2619 ms overlapping gunzip 450 ms, parse 2011 ms, sort 80 ms, write 4403 ms, index 452 ms: 3 candidates, 68847 repo-hours, 816 releases; waiting 734 ms; commit 1397 ms)
2026-11-07T17:00:27Z [load_day 2023-03-12] 2023-03-12 hour 23: 115247 events in 3 files, snapshot 12209134636454050 (task 7709 ms: download 2405 ms overlapping gunzip 435 ms, parse 1929 ms, sort 62 ms, write 4110 ms, index 356 ms: 4 candidates, 49147 repo-hours, 614 releases; waiting 483 ms; commit 1458 ms)
2026-11-07T17:00:33Z [load_day 2023-03-12] 2023-03-12: repo_hour merged from 24 files to 1 (1436233 rows, 6163 ms)
2026-11-07T17:00:35Z [load_day 2023-03-12] 2023-03-12: index committed in 8040 ms (24 + 1 + 24 files)
2026-11-07T17:00:35Z [load_day 2023-03-12] 2023-03-12: 3172832 events in 24 hours
2026-11-07T17:00:35Z [load_day 2023-03-12] attempt 1 succeeded