orcaLog in

Runs · run 1146

load_day 2023-06-03, attempt 1 succeeded

Host
caf251265124:430714
Started
2026-11-07T21:02:52Z
Ended
2026-11-07T21:04:55Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1146/load_day/2023-06-03/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T21:02:52Z [load_day 2023-06-03] attempt 1 started
2026-11-07T21:02:54Z [load_day 2023-06-03] 2023-06-03: 2 hours in flight, about 1200 MB
2026-11-07T21:03:09Z [load_day 2023-06-03] 2023-06-03 hour 0: 124834 events in 3 files, snapshot 7938607034163306025 (task 11971 ms: download 4469 ms overlapping gunzip 623 ms, parse 2819 ms, sort 72 ms, write 5016 ms, index 423 ms: 4 candidates, 66811 repo-hours, 905 releases; waiting 2740 ms; commit 1713 ms)
2026-11-07T21:03:10Z [load_day 2023-06-03] 2023-06-03 hour 1: 124427 events in 3 files, snapshot 6394891200896228972 (task 8843 ms: download 2321 ms overlapping gunzip 526 ms, parse 2361 ms, sort 77 ms, write 4630 ms, index 447 ms: 3 candidates, 70761 repo-hours, 753 releases; waiting 490 ms; commit 1733 ms)
2026-11-07T21:03:17Z [load_day 2023-06-03] 2023-06-03 hour 2: 105319 events in 3 files, snapshot 529635429870938631 (task 7346 ms: download 1787 ms overlapping gunzip 411 ms, parse 1821 ms, sort 66 ms, write 3916 ms, index 359 ms: 4 candidates, 54483 repo-hours, 549 releases; waiting 501 ms; commit 1794 ms)
2026-11-07T21:03:18Z [load_day 2023-06-03] 2023-06-03 hour 3: 96715 events in 2 files, snapshot 5635569882081658732 (task 6717 ms: download 1776 ms overlapping gunzip 379 ms, parse 1778 ms, sort 59 ms, write 3417 ms, index 268 ms: 3 candidates, 41970 repo-hours, 755 releases; waiting 535 ms; commit 1679 ms)
2026-11-07T21:03:24Z [load_day 2023-06-03] 2023-06-03 hour 4: 98750 events in 2 files, snapshot 1882336895261818710 (task 6375 ms: download 1461 ms overlapping gunzip 372 ms, parse 1678 ms, sort 69 ms, write 3437 ms, index 290 ms: 2 candidates, 43259 repo-hours, 519 releases; waiting 288 ms; commit 2076 ms)
2026-11-07T21:03:26Z [load_day 2023-06-03] 2023-06-03 hour 5: 103005 events in 3 files, snapshot 8956343743939045296 (task 6480 ms: download 2123 ms overlapping gunzip 341 ms, parse 1596 ms, sort 59 ms, write 3312 ms, index 343 ms: 7 candidates, 48194 repo-hours, 633 releases; waiting 502 ms; commit 1788 ms)
2026-11-07T21:03:33Z [load_day 2023-06-03] 2023-06-03 hour 6: 111043 events in 3 files, snapshot 6154350754715455110 (task 7904 ms: download 2720 ms overlapping gunzip 410 ms, parse 1888 ms, sort 64 ms, write 3978 ms, index 378 ms: 8 candidates, 51429 repo-hours, 723 releases; waiting 868 ms; commit 1715 ms)
2026-11-07T21:03:35Z [load_day 2023-06-03] 2023-06-03 hour 7: 109368 events in 3 files, snapshot 2590339957459777748 (task 8040 ms: download 2441 ms overlapping gunzip 422 ms, parse 1937 ms, sort 74 ms, write 3962 ms, index 324 ms: 4 candidates, 48380 repo-hours, 642 releases; waiting 1039 ms; commit 1815 ms)
2026-11-07T21:03:41Z [load_day 2023-06-03] 2023-06-03 hour 8: 114363 events in 3 files, snapshot 4660524835904838205 (task 7558 ms: download 2193 ms overlapping gunzip 410 ms, parse 1869 ms, sort 65 ms, write 4012 ms, index 364 ms: 7 candidates, 51048 repo-hours, 603 releases; waiting 533 ms; commit 1685 ms)
2026-11-07T21:03:44Z [load_day 2023-06-03] 2023-06-03 hour 9: 116210 events in 3 files, snapshot 4058039793739630734 (task 7777 ms: download 2592 ms overlapping gunzip 440 ms, parse 1990 ms, sort 73 ms, write 4000 ms, index 343 ms: 9 candidates, 51488 repo-hours, 755 releases; waiting 615 ms; commit 1920 ms)
2026-11-07T21:03:52Z [load_day 2023-06-03] 2023-06-03 hour 10: 130449 events in 3 files, snapshot 600722476141470508 (task 8310 ms: download 2026 ms overlapping gunzip 479 ms, parse 2107 ms, sort 81 ms, write 4373 ms, index 421 ms: 9 candidates, 64207 repo-hours, 646 releases; waiting 501 ms; commit 2990 ms)
2026-11-07T21:03:54Z [load_day 2023-06-03] 2023-06-03 hour 11: 121867 events in 3 files, snapshot 3203112677628448977 (task 8154 ms: download 2020 ms overlapping gunzip 432 ms, parse 1912 ms, sort 68 ms, write 4589 ms, index 353 ms: 5 candidates, 55805 repo-hours, 675 releases; waiting 524 ms; commit 1974 ms)
2026-11-07T21:04:02Z [load_day 2023-06-03] 2023-06-03 hour 12: 190578 events in 4 files, snapshot 7632914985545682632 (task 9814 ms: download 3318 ms overlapping gunzip 527 ms, parse 2575 ms, sort 113 ms, write 5358 ms, index 611 ms: 7 candidates, 90763 repo-hours, 755 releases; waiting 363 ms; commit 1725 ms)
2026-11-07T21:04:04Z [load_day 2023-06-03] 2023-06-03 hour 13: 153250 events in 4 files, snapshot 4908136753432821002 (task 9270 ms: download 3185 ms overlapping gunzip 473 ms, parse 2208 ms, sort 91 ms, write 5102 ms, index 537 ms: 3 candidates, 82956 repo-hours, 777 releases; waiting 515 ms; commit 1830 ms)
2026-11-07T21:04:12Z [load_day 2023-06-03] 2023-06-03 hour 14: 146455 events in 3 files, snapshot 6179425547892137610 (task 9144 ms: download 2637 ms overlapping gunzip 492 ms, parse 2193 ms, sort 87 ms, write 4941 ms, index 456 ms: 6 candidates, 73873 repo-hours, 733 releases; waiting 623 ms; commit 1624 ms)
2026-11-07T21:04:14Z [load_day 2023-06-03] 2023-06-03 hour 15: 139259 events in 3 files, snapshot 4863137209863646100 (task 8350 ms: download 1726 ms overlapping gunzip 493 ms, parse 2289 ms, sort 77 ms, write 4562 ms, index 393 ms: 7 candidates, 65134 repo-hours, 885 releases; waiting 235 ms; commit 1840 ms)
2026-11-07T21:04:22Z [load_day 2023-06-03] 2023-06-03 hour 16: 131972 events in 3 files, snapshot 6228354364987447416 (task 8401 ms: download 2314 ms overlapping gunzip 461 ms, parse 2118 ms, sort 70 ms, write 4586 ms, index 392 ms: 5 candidates, 60731 repo-hours, 688 releases; waiting 489 ms; commit 1675 ms)
2026-11-07T21:04:23Z [load_day 2023-06-03] 2023-06-03 hour 17: 128913 events in 3 files, snapshot 7285599728486884137 (task 8196 ms: download 2010 ms overlapping gunzip 449 ms, parse 2058 ms, sort 73 ms, write 4473 ms, index 368 ms: 8 candidates, 55308 repo-hours, 670 releases; waiting 498 ms; commit 1906 ms)
2026-11-07T21:04:30Z [load_day 2023-06-03] 2023-06-03 hour 18: 128367 events in 3 files, snapshot 3996849838681241777 (task 8032 ms: download 1935 ms overlapping gunzip 440 ms, parse 2045 ms, sort 76 ms, write 4352 ms, index 376 ms: 9 candidates, 59810 repo-hours, 746 releases; waiting 520 ms; commit 1689 ms)
2026-11-07T21:04:32Z [load_day 2023-06-03] 2023-06-03 hour 19: 114362 events in 3 files, snapshot 2994843389892099983 (task 7470 ms: download 1789 ms overlapping gunzip 418 ms, parse 1903 ms, sort 59 ms, write 4015 ms, index 324 ms: 7 candidates, 51658 repo-hours, 663 releases; waiting 499 ms; commit 1633 ms)
2026-11-07T21:04:38Z [load_day 2023-06-03] 2023-06-03 hour 20: 108551 events in 3 files, snapshot 532229620315690267 (task 6909 ms: download 1348 ms overlapping gunzip 379 ms, parse 1803 ms, sort 67 ms, write 3803 ms, index 327 ms: 9 candidates, 48676 repo-hours, 695 releases; waiting 252 ms; commit 1701 ms)
2026-11-07T21:04:40Z [load_day 2023-06-03] 2023-06-03 hour 21: 100778 events in 3 files, snapshot 4020776634897695775 (task 7189 ms: download 1853 ms overlapping gunzip 387 ms, parse 1789 ms, sort 78 ms, write 3830 ms, index 300 ms: 8 candidates, 43264 repo-hours, 710 releases; waiting 494 ms; commit 1776 ms)
2026-11-07T21:04:45Z [load_day 2023-06-03] 2023-06-03 hour 22: 92315 events in 2 files, snapshot 1580333896626902207 (task 5709 ms: download 1405 ms overlapping gunzip 317 ms, parse 1467 ms, sort 58 ms, write 3073 ms, index 271 ms: 4 candidates, 40051 repo-hours, 661 releases; waiting 178 ms; commit 1646 ms)
2026-11-07T21:04:47Z [load_day 2023-06-03] 2023-06-03 hour 23: 84560 events in 2 files, snapshot 5034946365534373950 (task 5621 ms: download 1946 ms overlapping gunzip 289 ms, parse 1383 ms, sort 51 ms, write 2858 ms, index 260 ms: 3 candidates, 37822 repo-hours, 545 releases; waiting 543 ms; commit 1853 ms)
2026-11-07T21:04:53Z [load_day 2023-06-03] 2023-06-03: repo_hour merged from 24 files to 1 (1357881 rows, 5618 ms)
2026-11-07T21:04:55Z [load_day 2023-06-03] 2023-06-03: index committed in 7763 ms (24 + 1 + 24 files)
2026-11-07T21:04:55Z [load_day 2023-06-03] 2023-06-03: 2875710 events in 24 hours
2026-11-07T21:04:55Z [load_day 2023-06-03] attempt 1 succeeded