orcaLog in

Runs · run 729

load_day 2023-01-15, attempt 1 succeeded

Host
d3d1748bf284:6315
Started
2026-11-07T13:42:50Z
Ended
2026-11-07T13:45:40Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/729/load_day/2023-01-15/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T13:42:50Z [load_day 2023-01-15] attempt 1 started
2026-11-07T13:42:51Z [load_day 2023-01-15] 2023-01-15: 2 hours in flight, about 1200 MB
2026-11-07T13:43:01Z [load_day 2023-01-15] 2023-01-15 hour 0: 115945 events in 3 files, snapshot 6882641688320342015 (task 7570 ms: download 2118 ms overlapping gunzip 435 ms, parse 2026 ms, sort 77 ms, write 3776 ms, index 391 ms: 3 candidates, 55607 repo-hours, 929 releases; waiting 508 ms; commit 1228 ms)
2026-11-07T13:43:02Z [load_day 2023-01-15] 2023-01-15 hour 1: 115273 events in 3 files, snapshot 3637808360476976124 (task 7202 ms: download 1974 ms overlapping gunzip 395 ms, parse 1811 ms, sort 45 ms, write 3532 ms, index 425 ms: 4 candidates, 59785 repo-hours, 714 releases; waiting 524 ms; commit 1223 ms)
2026-11-07T13:43:08Z [load_day 2023-01-15] 2023-01-15 hour 2: 101452 events in 3 files, snapshot 4541327959537574336 (task 6064 ms: download 1501 ms overlapping gunzip 351 ms, parse 1542 ms, sort 51 ms, write 3314 ms, index 307 ms: 2 candidates, 45179 repo-hours, 578 releases; waiting 211 ms; commit 1279 ms)
2026-11-07T13:43:09Z [load_day 2023-01-15] 2023-01-15 hour 3: 106725 events in 3 files, snapshot 138182757962475765 (task 6058 ms: download 2110 ms overlapping gunzip 338 ms, parse 1576 ms, sort 48 ms, write 2848 ms, index 246 ms: 3 candidates, 37236 repo-hours, 736 releases; waiting 693 ms; commit 1373 ms)
2026-11-07T13:43:15Z [load_day 2023-01-15] 2023-01-15 hour 4: 103550 events in 3 files, snapshot 7580785136978667749 (task 6322 ms: download 1986 ms overlapping gunzip 373 ms, parse 1644 ms, sort 74 ms, write 3090 ms, index 315 ms: 3 candidates, 37237 repo-hours, 542 releases; waiting 510 ms; commit 1397 ms)
2026-11-07T13:43:16Z [load_day 2023-01-15] 2023-01-15 hour 5: 105946 events in 3 files, snapshot 8395669173739065576 (task 6261 ms: download 2173 ms overlapping gunzip 374 ms, parse 1611 ms, sort 85 ms, write 3038 ms, index 267 ms: 3 candidates, 39113 repo-hours, 657 releases; waiting 596 ms; commit 1280 ms)
2026-11-07T13:43:22Z [load_day 2023-01-15] 2023-01-15 hour 6: 113078 events in 3 files, snapshot 6123317671874114548 (task 6356 ms: download 1956 ms overlapping gunzip 359 ms, parse 1582 ms, sort 80 ms, write 3150 ms, index 380 ms: 3 candidates, 45633 repo-hours, 639 releases; waiting 515 ms; commit 1139 ms)
2026-11-07T13:43:23Z [load_day 2023-01-15] 2023-01-15 hour 7: 115218 events in 3 files, snapshot 3525495126640666792 (task 6077 ms: download 1486 ms overlapping gunzip 375 ms, parse 1638 ms, sort 51 ms, write 3080 ms, index 318 ms: 0 candidates, 41499 repo-hours, 516 releases; waiting 354 ms; commit 1160 ms)
2026-11-07T13:43:30Z [load_day 2023-01-15] 2023-01-15 hour 8: 123074 events in 3 files, snapshot 8607220329880683360 (task 6981 ms: download 1928 ms overlapping gunzip 440 ms, parse 1907 ms, sort 62 ms, write 3478 ms, index 300 ms: 6 candidates, 45983 repo-hours, 573 releases; waiting 499 ms; commit 1282 ms)
2026-11-07T13:43:31Z [load_day 2023-01-15] 2023-01-15 hour 9: 126952 events in 3 files, snapshot 7653583592061055982 (task 7437 ms: download 1881 ms overlapping gunzip 448 ms, parse 1928 ms, sort 78 ms, write 3848 ms, index 345 ms: 3 candidates, 47402 repo-hours, 706 releases; waiting 497 ms; commit 1229 ms)
2026-11-07T13:43:39Z [load_day 2023-01-15] 2023-01-15 hour 10: 127917 events in 3 files, snapshot 7638834432932288000 (task 6699 ms: download 1076 ms overlapping gunzip 436 ms, parse 1905 ms, sort 51 ms, write 3902 ms, index 324 ms: 1 candidates, 50685 repo-hours, 647 releases; waiting 16 ms; commit 3599 ms)
2026-11-07T13:44:39Z [load_day 2023-01-15] 2023-01-15 hour 11: 126384 events in 3 files, snapshot 6794949525632683377 (task 67156 ms: download 65885 ms overlapping gunzip 891 ms, parse 4017 ms, sort 63 ms, write 3967 ms, index 342 ms: 1 candidates, 50603 repo-hours, 609 releases; waiting 57800 ms; commit 1301 ms)
2026-11-07T13:44:41Z [load_day 2023-01-15] 2023-01-15 hour 12: 178015 events in 4 files, snapshot 3507373694627894147 (task 8513 ms: download 2813 ms overlapping gunzip 549 ms, parse 2553 ms, sort 72 ms, write 4771 ms, index 474 ms: 2 candidates, 80062 repo-hours, 716 releases; waiting 21 ms; commit 1386 ms)
2026-11-07T13:44:49Z [load_day 2023-01-15] 2023-01-15 hour 13: 164540 events in 4 files, snapshot 8068557964358598970 (task 9471 ms: download 3351 ms overlapping gunzip 533 ms, parse 2413 ms, sort 74 ms, write 4997 ms, index 465 ms: 1 candidates, 76322 repo-hours, 724 releases; waiting 493 ms; commit 1253 ms)
2026-11-07T13:44:50Z [load_day 2023-01-15] 2023-01-15 hour 14: 155582 events in 4 files, snapshot 1493692039828156401 (task 8517 ms: download 3040 ms overlapping gunzip 536 ms, parse 2452 ms, sort 80 ms, write 4954 ms, index 396 ms: 3 candidates, 63509 repo-hours, 741 releases; waiting 17 ms; commit 1102 ms)
2026-11-07T13:44:59Z [load_day 2023-01-15] 2023-01-15 hour 15: 159705 events in 4 files, snapshot 538298939907380534 (task 8910 ms: download 3229 ms overlapping gunzip 545 ms, parse 2435 ms, sort 70 ms, write 5321 ms, index 458 ms: 3 candidates, 65865 repo-hours, 941 releases; waiting 18 ms; commit 1069 ms)
2026-11-07T13:45:00Z [load_day 2023-01-15] 2023-01-15 hour 16: 155551 events in 4 files, snapshot 2694598713291456339 (task 8261 ms: download 2871 ms overlapping gunzip 513 ms, parse 2312 ms, sort 80 ms, write 4884 ms, index 396 ms: 4 candidates, 63726 repo-hours, 840 releases; waiting 16 ms; commit 1211 ms)
2026-11-07T13:45:08Z [load_day 2023-01-15] 2023-01-15 hour 17: 150929 events in 4 files, snapshot 4298050925163404477 (task 8802 ms: download 3447 ms overlapping gunzip 573 ms, parse 2576 ms, sort 96 ms, write 5080 ms, index 409 ms: 2 candidates, 60818 repo-hours, 663 releases; waiting 15 ms; commit 1179 ms)
2026-11-07T13:45:10Z [load_day 2023-01-15] 2023-01-15 hour 18: 153387 events in 4 files, snapshot 2208927597947935138 (task 8222 ms: download 2901 ms overlapping gunzip 515 ms, parse 2276 ms, sort 81 ms, write 4862 ms, index 405 ms: 2 candidates, 64433 repo-hours, 869 releases; waiting 19 ms; commit 1170 ms)
2026-11-07T13:45:17Z [load_day 2023-01-15] 2023-01-15 hour 19: 143205 events in 3 files, snapshot 8398394301788350539 (task 7776 ms: download 2784 ms overlapping gunzip 489 ms, parse 2200 ms, sort 61 ms, write 4557 ms, index 371 ms: 4 candidates, 54799 repo-hours, 785 releases; waiting 15 ms; commit 1291 ms)
2026-11-07T13:45:18Z [load_day 2023-01-15] 2023-01-15 hour 20: 141093 events in 3 files, snapshot 8513208408845671199 (task 7333 ms: download 2547 ms overlapping gunzip 475 ms, parse 2134 ms, sort 79 ms, write 4175 ms, index 395 ms: 5 candidates, 54236 repo-hours, 777 releases; waiting 15 ms; commit 1375 ms)
2026-11-07T13:45:26Z [load_day 2023-01-15] 2023-01-15 hour 21: 137013 events in 3 files, snapshot 7465627748705417738 (task 7646 ms: download 2695 ms overlapping gunzip 525 ms, parse 2310 ms, sort 63 ms, write 4338 ms, index 339 ms: 4 candidates, 50317 repo-hours, 910 releases; waiting 18 ms; commit 1472 ms)
2026-11-07T13:45:28Z [load_day 2023-01-15] 2023-01-15 hour 22: 121706 events in 3 files, snapshot 6179250609884569597 (task 8262 ms: download 2105 ms overlapping gunzip 454 ms, parse 1992 ms, sort 58 ms, write 4136 ms, index 319 ms: 3 candidates, 47085 repo-hours, 752 releases; waiting 1029 ms; commit 1552 ms)
2026-11-07T13:45:33Z [load_day 2023-01-15] 2023-01-15 hour 23: 113469 events in 3 files, snapshot 1650047939655855459 (task 6470 ms: download 828 ms overlapping gunzip 424 ms, parse 1847 ms, sort 62 ms, write 3761 ms, index 283 ms: 4 candidates, 44399 repo-hours, 581 releases; waiting 18 ms; commit 1353 ms)
2026-11-07T13:45:38Z [load_day 2023-01-15] 2023-01-15: repo_hour merged from 24 files to 1 (1281533 rows, 5443 ms)
2026-11-07T13:45:40Z [load_day 2023-01-15] 2023-01-15: index committed in 7331 ms (23 + 1 + 24 files)
2026-11-07T13:45:40Z [load_day 2023-01-15] 2023-01-15: 3155709 events in 24 hours
2026-11-07T13:45:40Z [load_day 2023-01-15] attempt 1 succeeded