orcaLog in

Runs · run 789

load_day 2023-02-04, attempt 1 succeeded

Host
caf251265124:18334
Started
2026-11-07T15:02:51Z
Ended
2026-11-07T15:05:02Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/789/load_day/2023-02-04/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T15:02:51Z [load_day 2023-02-04] attempt 1 started
2026-11-07T15:02:53Z [load_day 2023-02-04] 2023-02-04: 2 hours in flight, about 1200 MB
2026-11-07T15:03:07Z [load_day 2023-02-04] 2023-02-04 hour 0: 141485 events in 3 files, snapshot 1599309138701780712 (task 11450 ms: download 5045 ms overlapping gunzip 715 ms, parse 3058 ms, sort 80 ms, write 6309 ms, index 462 ms: 8 candidates, 69208 repo-hours, 899 releases; waiting 510 ms; commit 1344 ms)
2026-11-07T15:03:08Z [load_day 2023-02-04] 2023-02-04 hour 1: 130760 events in 3 files, snapshot 7694373687336096952 (task 9506 ms: download 3831 ms overlapping gunzip 596 ms, parse 2673 ms, sort 96 ms, write 5193 ms, index 465 ms: 4 candidates, 68806 repo-hours, 804 releases; waiting 206 ms; commit 1345 ms)
2026-11-07T15:03:16Z [load_day 2023-02-04] 2023-02-04 hour 2: 113483 events in 3 files, snapshot 2792182714177971658 (task 8775 ms: download 2248 ms overlapping gunzip 536 ms, parse 2217 ms, sort 75 ms, write 4712 ms, index 379 ms: 1 candidates, 53245 repo-hours, 595 releases; waiting 546 ms; commit 1536 ms)
2026-11-07T15:03:18Z [load_day 2023-02-04] 2023-02-04 hour 3: 104349 events in 3 files, snapshot 7241235795200999759 (task 8025 ms: download 3142 ms overlapping gunzip 423 ms, parse 1894 ms, sort 66 ms, write 4026 ms, index 314 ms: 4 candidates, 44095 repo-hours, 659 releases; waiting 995 ms; commit 1623 ms)
2026-11-07T15:03:24Z [load_day 2023-02-04] 2023-02-04 hour 4: 102844 events in 3 files, snapshot 7006285043532151785 (task 7311 ms: download 2177 ms overlapping gunzip 428 ms, parse 1845 ms, sort 66 ms, write 3824 ms, index 291 ms: 2 candidates, 43681 repo-hours, 467 releases; waiting 523 ms; commit 1398 ms)
2026-11-07T15:03:26Z [load_day 2023-02-04] 2023-02-04 hour 5: 105662 events in 3 files, snapshot 5406495789176005484 (task 7662 ms: download 2329 ms overlapping gunzip 412 ms, parse 1879 ms, sort 63 ms, write 3939 ms, index 314 ms: 2 candidates, 45210 repo-hours, 619 releases; waiting 722 ms; commit 1453 ms)
2026-11-07T15:03:33Z [load_day 2023-02-04] 2023-02-04 hour 6: 114494 events in 3 files, snapshot 8468705614115376511 (task 7671 ms: download 2510 ms overlapping gunzip 435 ms, parse 1935 ms, sort 74 ms, write 3966 ms, index 328 ms: 3 candidates, 51448 repo-hours, 614 releases; waiting 628 ms; commit 1371 ms)
2026-11-07T15:03:35Z [load_day 2023-02-04] 2023-02-04 hour 7: 110626 events in 3 files, snapshot 7868620687073544152 (task 7816 ms: download 1987 ms overlapping gunzip 466 ms, parse 2053 ms, sort 84 ms, write 4039 ms, index 352 ms: 5 candidates, 47289 repo-hours, 548 releases; waiting 508 ms; commit 1654 ms)
2026-11-07T15:03:42Z [load_day 2023-02-04] 2023-02-04 hour 8: 116833 events in 3 files, snapshot 3886134539990407413 (task 9079 ms: download 3787 ms overlapping gunzip 453 ms, parse 2000 ms, sort 73 ms, write 4410 ms, index 343 ms: 5 candidates, 51481 repo-hours, 555 releases; waiting 1237 ms; commit 1453 ms)
2026-11-07T15:03:44Z [load_day 2023-02-04] 2023-02-04 hour 9: 117682 events in 3 files, snapshot 7931111061669747937 (task 7985 ms: download 1903 ms overlapping gunzip 449 ms, parse 2010 ms, sort 73 ms, write 4304 ms, index 344 ms: 6 candidates, 51939 repo-hours, 639 releases; waiting 483 ms; commit 1471 ms)
2026-11-07T15:03:51Z [load_day 2023-02-04] 2023-02-04 hour 10: 123514 events in 3 files, snapshot 8585002464677845867 (task 8394 ms: download 2026 ms overlapping gunzip 496 ms, parse 2121 ms, sort 56 ms, write 4524 ms, index 371 ms: 1 candidates, 55758 repo-hours, 611 releases; waiting 534 ms; commit 1412 ms)
2026-11-07T15:03:54Z [load_day 2023-02-04] 2023-02-04 hour 11: 127576 events in 3 files, snapshot 212408267331294943 (task 8485 ms: download 2101 ms overlapping gunzip 487 ms, parse 2204 ms, sort 72 ms, write 4477 ms, index 382 ms: 4 candidates, 56954 repo-hours, 745 releases; waiting 522 ms; commit 2335 ms)
2026-11-07T15:04:03Z [load_day 2023-02-04] 2023-02-04 hour 12: 181378 events in 4 files, snapshot 2857185285978001400 (task 10860 ms: download 4061 ms overlapping gunzip 602 ms, parse 2756 ms, sort 94 ms, write 5865 ms, index 551 ms: 6 candidates, 84902 repo-hours, 1125 releases; waiting 628 ms; commit 1277 ms)
2026-11-07T15:04:04Z [load_day 2023-02-04] 2023-02-04 hour 13: 156095 events in 4 files, snapshot 3170782915239710258 (task 10215 ms: download 3968 ms overlapping gunzip 597 ms, parse 2726 ms, sort 89 ms, write 5383 ms, index 512 ms: 3 candidates, 78966 repo-hours, 675 releases; waiting 575 ms; commit 1264 ms)
2026-11-07T15:04:13Z [load_day 2023-02-04] 2023-02-04 hour 14: 146783 events in 3 files, snapshot 3165229030745807582 (task 9296 ms: download 3598 ms overlapping gunzip 542 ms, parse 2425 ms, sort 75 ms, write 5194 ms, index 413 ms: 1 candidates, 64587 repo-hours, 751 releases; waiting 360 ms; commit 1406 ms)
2026-11-07T15:04:15Z [load_day 2023-02-04] 2023-02-04 hour 15: 147935 events in 3 files, snapshot 8785919176107416648 (task 10470 ms: download 4608 ms overlapping gunzip 582 ms, parse 2533 ms, sort 90 ms, write 5128 ms, index 457 ms: 5 candidates, 68090 repo-hours, 958 releases; waiting 1343 ms; commit 1238 ms)
2026-11-07T15:04:24Z [load_day 2023-02-04] 2023-02-04 hour 16: 146679 events in 3 files, snapshot 8390140292604921032 (task 9814 ms: download 3838 ms overlapping gunzip 578 ms, parse 2559 ms, sort 96 ms, write 5314 ms, index 441 ms: 6 candidates, 66211 repo-hours, 728 releases; waiting 509 ms; commit 1369 ms)
2026-11-07T15:04:26Z [load_day 2023-02-04] 2023-02-04 hour 17: 146615 events in 3 files, snapshot 8713506578297202716 (task 9972 ms: download 4094 ms overlapping gunzip 565 ms, parse 2499 ms, sort 94 ms, write 5443 ms, index 413 ms: 13 candidates, 63722 repo-hours, 709 releases; waiting 648 ms; commit 1376 ms)
2026-11-07T15:04:35Z [load_day 2023-02-04] 2023-02-04 hour 18: 146499 events in 3 files, snapshot 4368246793946116320 (task 10207 ms: download 3790 ms overlapping gunzip 569 ms, parse 2520 ms, sort 86 ms, write 5559 ms, index 473 ms: 3 candidates, 67109 repo-hours, 780 releases; waiting 502 ms; commit 1713 ms)
2026-11-07T15:04:36Z [load_day 2023-02-04] 2023-02-04 hour 19: 133555 events in 3 files, snapshot 2449265227920880742 (task 8669 ms: download 3463 ms overlapping gunzip 499 ms, parse 2274 ms, sort 76 ms, write 4608 ms, index 378 ms: 1 candidates, 57186 repo-hours, 778 releases; waiting 538 ms; commit 1410 ms)
2026-11-07T15:04:44Z [load_day 2023-02-04] 2023-02-04 hour 20: 131196 events in 3 files, snapshot 2359606823988929133 (task 8545 ms: download 3209 ms overlapping gunzip 508 ms, parse 2221 ms, sort 76 ms, write 4893 ms, index 370 ms: 3 candidates, 56237 repo-hours, 730 releases; waiting 211 ms; commit 1282 ms)
2026-11-07T15:04:45Z [load_day 2023-02-04] 2023-02-04 hour 21: 125898 events in 3 files, snapshot 5169893969659523748 (task 8502 ms: download 2320 ms overlapping gunzip 493 ms, parse 2192 ms, sort 78 ms, write 4477 ms, index 375 ms: 5 candidates, 52927 repo-hours, 822 releases; waiting 608 ms; commit 1502 ms)
2026-11-07T15:04:52Z [load_day 2023-02-04] 2023-02-04 hour 22: 114293 events in 3 files, snapshot 1476953927200513905 (task 7880 ms: download 2460 ms overlapping gunzip 444 ms, parse 1992 ms, sort 72 ms, write 4241 ms, index 305 ms: 4 candidates, 47538 repo-hours, 707 releases; waiting 510 ms; commit 1340 ms)
2026-11-07T15:04:55Z [load_day 2023-02-04] 2023-02-04 hour 23: 107012 events in 3 files, snapshot 6812820920527709704 (task 8498 ms: download 3661 ms overlapping gunzip 427 ms, parse 1919 ms, sort 63 ms, write 3836 ms, index 307 ms: 0 candidates, 47038 repo-hours, 653 releases; waiting 1635 ms; commit 1479 ms)
2026-11-07T15:05:00Z [load_day 2023-02-04] 2023-02-04: repo_hour merged from 24 files to 1 (1393627 rows, 5825 ms)
2026-11-07T15:05:02Z [load_day 2023-02-04] 2023-02-04: index committed in 7658 ms (23 + 1 + 24 files)
2026-11-07T15:05:02Z [load_day 2023-02-04] 2023-02-04: 3093246 events in 24 hours
2026-11-07T15:05:02Z [load_day 2023-02-04] attempt 1 succeeded