orcaLog in

Runs · run 813

load_day 2023-02-12, attempt 1 succeeded

Host
caf251265124:46310
Started
2026-11-07T15:26:40Z
Ended
2026-11-07T15:28:44Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/813/load_day/2023-02-12/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:26:40Z [load_day 2023-02-12] attempt 1 started
2026-11-07T15:26:41Z [load_day 2023-02-12] 2023-02-12: 2 hours in flight, about 1200 MB
2026-11-07T15:26:51Z [load_day 2023-02-12] 2023-02-12 hour 0: 119713 events in 3 files, snapshot 5421704994048126902 (task 8186 ms: download 2337 ms overlapping gunzip 465 ms, parse 2109 ms, sort 78 ms, write 4378 ms, index 371 ms: 4 candidates, 56892 repo-hours, 848 releases; waiting 438 ms; commit 1226 ms)
2026-11-07T15:26:53Z [load_day 2023-02-12] 2023-02-12 hour 1: 115133 events in 3 files, snapshot 3892275840094958672 (task 7558 ms: download 1827 ms overlapping gunzip 409 ms, parse 1934 ms, sort 58 ms, write 3988 ms, index 383 ms: 4 candidates, 62812 repo-hours, 835 releases; waiting 492 ms; commit 1305 ms)
2026-11-07T15:27:00Z [load_day 2023-02-12] 2023-02-12 hour 2: 99687 events in 2 files, snapshot 2825536960490376958 (task 7337 ms: download 2100 ms overlapping gunzip 393 ms, parse 1730 ms, sort 65 ms, write 3931 ms, index 338 ms: 1 candidates, 48241 repo-hours, 606 releases; waiting 577 ms; commit 1446 ms)
2026-11-07T15:27:01Z [load_day 2023-02-12] 2023-02-12 hour 3: 98954 events in 2 files, snapshot 7291365183547228133 (task 6774 ms: download 1838 ms overlapping gunzip 390 ms, parse 1727 ms, sort 71 ms, write 3556 ms, index 261 ms: 0 candidates, 40518 repo-hours, 652 releases; waiting 534 ms; commit 1344 ms)
2026-11-07T15:27:07Z [load_day 2023-02-12] 2023-02-12 hour 4: 94147 events in 2 files, snapshot 3272859548397154899 (task 6524 ms: download 2106 ms overlapping gunzip 374 ms, parse 1615 ms, sort 70 ms, write 3388 ms, index 270 ms: 4 candidates, 39473 repo-hours, 523 releases; waiting 528 ms; commit 1515 ms)
2026-11-07T15:27:09Z [load_day 2023-02-12] 2023-02-12 hour 5: 98944 events in 2 files, snapshot 9043162711179513235 (task 7247 ms: download 2854 ms overlapping gunzip 393 ms, parse 1675 ms, sort 60 ms, write 3544 ms, index 297 ms: 2 candidates, 41657 repo-hours, 611 releases; waiting 971 ms; commit 1274 ms)
2026-11-07T15:27:14Z [load_day 2023-02-12] 2023-02-12 hour 6: 106704 events in 3 files, snapshot 9109383006029217567 (task 7003 ms: download 1922 ms overlapping gunzip 407 ms, parse 1772 ms, sort 67 ms, write 3618 ms, index 300 ms: 3 candidates, 47689 repo-hours, 650 releases; waiting 501 ms; commit 1317 ms)
2026-11-07T15:27:16Z [load_day 2023-02-12] 2023-02-12 hour 7: 105231 events in 3 files, snapshot 1002722991826136645 (task 6541 ms: download 1467 ms overlapping gunzip 378 ms, parse 1722 ms, sort 62 ms, write 3496 ms, index 329 ms: 2 candidates, 44323 repo-hours, 554 releases; waiting 227 ms; commit 1432 ms)
2026-11-07T15:27:23Z [load_day 2023-02-12] 2023-02-12 hour 8: 115400 events in 3 files, snapshot 6518000071300312381 (task 7634 ms: download 2303 ms overlapping gunzip 430 ms, parse 1903 ms, sort 75 ms, write 3946 ms, index 333 ms: 3 candidates, 49626 repo-hours, 893 releases; waiting 575 ms; commit 1356 ms)
2026-11-07T15:27:25Z [load_day 2023-02-12] 2023-02-12 hour 9: 118480 events in 3 files, snapshot 4165280411051828517 (task 7974 ms: download 2010 ms overlapping gunzip 452 ms, parse 2030 ms, sort 77 ms, write 4080 ms, index 375 ms: 1 candidates, 50079 repo-hours, 774 releases; waiting 527 ms; commit 1357 ms)
2026-11-07T15:27:32Z [load_day 2023-02-12] 2023-02-12 hour 10: 123877 events in 3 files, snapshot 2473797037555766568 (task 7899 ms: download 1696 ms overlapping gunzip 463 ms, parse 2033 ms, sort 87 ms, write 4242 ms, index 342 ms: 0 candidates, 52373 repo-hours, 699 releases; waiting 287 ms; commit 1399 ms)
2026-11-07T15:27:34Z [load_day 2023-02-12] 2023-02-12 hour 11: 123391 events in 3 files, snapshot 1320634739688427158 (task 8264 ms: download 2552 ms overlapping gunzip 480 ms, parse 2093 ms, sort 86 ms, write 4431 ms, index 334 ms: 2 candidates, 51121 repo-hours, 899 releases; waiting 548 ms; commit 1459 ms)
2026-11-07T15:27:42Z [load_day 2023-02-12] 2023-02-12 hour 12: 172941 events in 4 files, snapshot 2788576311317155177 (task 9677 ms: download 3196 ms overlapping gunzip 547 ms, parse 2535 ms, sort 85 ms, write 5441 ms, index 501 ms: 4 candidates, 81637 repo-hours, 815 releases; waiting 268 ms; commit 1628 ms)
2026-11-07T15:27:44Z [load_day 2023-02-12] 2023-02-12 hour 13: 156441 events in 4 files, snapshot 32476898959208054 (task 9653 ms: download 3479 ms overlapping gunzip 545 ms, parse 2463 ms, sort 92 ms, write 5217 ms, index 501 ms: 5 candidates, 79319 repo-hours, 836 releases; waiting 501 ms; commit 1414 ms)
2026-11-07T15:27:53Z [load_day 2023-02-12] 2023-02-12 hour 14: 146496 events in 3 files, snapshot 3199689199860288549 (task 10067 ms: download 3971 ms overlapping gunzip 593 ms, parse 2547 ms, sort 99 ms, write 5520 ms, index 462 ms: 2 candidates, 65646 repo-hours, 833 releases; waiting 569 ms; commit 1456 ms)
2026-11-07T15:27:56Z [load_day 2023-02-12] 2023-02-12 hour 15: 152003 events in 4 files, snapshot 8859248758944773382 (task 10969 ms: download 4926 ms overlapping gunzip 587 ms, parse 2632 ms, sort 111 ms, write 5418 ms, index 495 ms: 3 candidates, 67658 repo-hours, 986 releases; waiting 1427 ms; commit 1477 ms)
2026-11-07T15:28:03Z [load_day 2023-02-12] 2023-02-12 hour 16: 150558 events in 4 files, snapshot 7639003382765703434 (task 9810 ms: download 3898 ms overlapping gunzip 556 ms, parse 2496 ms, sort 94 ms, write 5327 ms, index 481 ms: 3 candidates, 66384 repo-hours, 767 releases; waiting 619 ms; commit 1171 ms)
2026-11-07T15:28:06Z [load_day 2023-02-12] 2023-02-12 hour 17: 150698 events in 4 files, snapshot 5015623883555695778 (task 9623 ms: download 3547 ms overlapping gunzip 575 ms, parse 2563 ms, sort 101 ms, write 5307 ms, index 412 ms: 0 candidates, 63788 repo-hours, 784 releases; waiting 264 ms; commit 1256 ms)
2026-11-07T15:28:14Z [load_day 2023-02-12] 2023-02-12 hour 18: 149743 events in 3 files, snapshot 1911642359824922911 (task 10063 ms: download 3818 ms overlapping gunzip 563 ms, parse 2515 ms, sort 94 ms, write 5584 ms, index 469 ms: 3 candidates, 67279 repo-hours, 852 releases; waiting 511 ms; commit 1412 ms)
2026-11-07T15:28:16Z [load_day 2023-02-12] 2023-02-12 hour 19: 137865 events in 3 files, snapshot 1769649237270217390 (task 9507 ms: download 3817 ms overlapping gunzip 526 ms, parse 2383 ms, sort 88 ms, write 5196 ms, index 443 ms: 3 candidates, 57671 repo-hours, 819 releases; waiting 529 ms; commit 1364 ms)
2026-11-07T15:28:25Z [load_day 2023-02-12] 2023-02-12 hour 20: 141090 events in 3 files, snapshot 8741765703109474638 (task 9778 ms: download 4017 ms overlapping gunzip 602 ms, parse 2672 ms, sort 104 ms, write 5227 ms, index 397 ms: 5 candidates, 59590 repo-hours, 826 releases; waiting 504 ms; commit 1346 ms)
2026-11-07T15:28:26Z [load_day 2023-02-12] 2023-02-12 hour 21: 137680 events in 3 files, snapshot 4973049297959005017 (task 8645 ms: download 3342 ms overlapping gunzip 505 ms, parse 2288 ms, sort 74 ms, write 4775 ms, index 350 ms: 5 candidates, 54969 repo-hours, 836 releases; waiting 375 ms; commit 1371 ms)
2026-11-07T15:28:34Z [load_day 2023-02-12] 2023-02-12 hour 22: 121701 events in 3 files, snapshot 3842519026944854763 (task 8881 ms: download 4049 ms overlapping gunzip 467 ms, parse 2068 ms, sort 78 ms, write 4490 ms, index 320 ms: 7 candidates, 48217 repo-hours, 794 releases; waiting 1091 ms; commit 1409 ms)
2026-11-07T15:28:36Z [load_day 2023-02-12] 2023-02-12 hour 23: 109841 events in 3 files, snapshot 1912449775005770649 (task 7913 ms: download 1870 ms overlapping gunzip 439 ms, parse 1959 ms, sort 80 ms, write 4306 ms, index 340 ms: 5 candidates, 45573 repo-hours, 556 releases; waiting 515 ms; commit 1639 ms)
2026-11-07T15:28:42Z [load_day 2023-02-12] 2023-02-12: repo_hour merged from 24 files to 1 (1342535 rows, 5733 ms)
2026-11-07T15:28:43Z [load_day 2023-02-12] 2023-02-12: index committed in 7427 ms (21 + 1 + 24 files)
2026-11-07T15:28:43Z [load_day 2023-02-12] 2023-02-12: 3046718 events in 24 hours
2026-11-07T15:28:43Z [load_day 2023-02-12] attempt 1 succeeded