orcaLog in

Runs · run 1480

load_day 2023-09-09, attempt 1 succeeded

Host
3c2b29713ce8:312093
Started
2026-11-08T00:40:07Z
Ended
2026-11-08T00:42:37Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1480/load_day/2023-09-09/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-08T00:40:07Z [load_day 2023-09-09] attempt 1 started
2026-11-08T00:40:09Z [load_day 2023-09-09] 2023-09-09: 2 hours in flight, about 1200 MB
2026-11-08T00:40:25Z [load_day 2023-09-09] 2023-09-09 hour 0: 144385 events in 3 files, snapshot 1323874320005756168 (task 12861 ms: download 3142 ms overlapping gunzip 764 ms, parse 3465 ms, sort 127 ms, write 6756 ms, index 533 ms: 8 candidates, 77311 repo-hours, 941 releases; waiting 573 ms; commit 2162 ms)
2026-11-08T00:40:28Z [load_day 2023-09-09] 2023-09-09 hour 1: 131350 events in 3 files, snapshot 5533382326046559505 (task 11012 ms: download 3242 ms overlapping gunzip 554 ms, parse 2588 ms, sort 84 ms, write 6403 ms, index 511 ms: 9 candidates, 71612 repo-hours, 679 releases; waiting 612 ms; commit 2551 ms)
2026-11-08T00:40:37Z [load_day 2023-09-09] 2023-09-09 hour 2: 110340 events in 3 files, snapshot 8771453177955005822 (task 9661 ms: download 4148 ms overlapping gunzip 574 ms, parse 2333 ms, sort 85 ms, write 5002 ms, index 308 ms: 6 candidates, 42814 repo-hours, 529 releases; waiting 969 ms; commit 2414 ms)
2026-11-08T00:40:42Z [load_day 2023-09-09] 2023-09-09 hour 3: 104581 events in 3 files, snapshot 7802206675704484757 (task 9898 ms: download 3290 ms overlapping gunzip 479 ms, parse 2277 ms, sort 108 ms, write 4876 ms, index 474 ms: 3 candidates, 41719 repo-hours, 803 releases; waiting 898 ms; commit 5291 ms)
2026-11-08T00:40:47Z [load_day 2023-09-09] 2023-09-09 hour 4: 105714 events in 3 files, snapshot 7127275482713658480 (task 9055 ms: download 1794 ms overlapping gunzip 609 ms, parse 2528 ms, sort 74 ms, write 4687 ms, index 359 ms: 11 candidates, 42074 repo-hours, 601 releases; waiting 483 ms; commit 2521 ms)
2026-11-08T00:40:51Z [load_day 2023-09-09] 2023-09-09 hour 5: 113641 events in 3 files, snapshot 8680332167203413035 (task 10710 ms: download 2316 ms overlapping gunzip 721 ms, parse 3117 ms, sort 170 ms, write 5575 ms, index 331 ms: 6 candidates, 45577 repo-hours, 759 releases; waiting 477 ms; commit 2800 ms)
2026-11-08T00:40:57Z [load_day 2023-09-09] 2023-09-09 hour 6: 119115 events in 3 files, snapshot 5882934736605455089 (task 9120 ms: download 1838 ms overlapping gunzip 505 ms, parse 2208 ms, sort 69 ms, write 5094 ms, index 444 ms: 8 candidates, 52647 repo-hours, 605 releases; waiting 516 ms; commit 2229 ms)
2026-11-08T00:41:02Z [load_day 2023-09-09] 2023-09-09 hour 7: 119168 events in 3 files, snapshot 3197323556573935928 (task 9287 ms: download 1965 ms overlapping gunzip 547 ms, parse 2525 ms, sort 119 ms, write 4935 ms, index 399 ms: 9 candidates, 48660 repo-hours, 587 releases; waiting 486 ms; commit 3403 ms)
2026-11-08T00:41:08Z [load_day 2023-09-09] 2023-09-09 hour 8: 121995 events in 3 files, snapshot 1961545559138908779 (task 10121 ms: download 2381 ms overlapping gunzip 508 ms, parse 2254 ms, sort 127 ms, write 6038 ms, index 359 ms: 10 candidates, 52817 repo-hours, 650 releases; waiting 527 ms; commit 2293 ms)
2026-11-08T00:41:13Z [load_day 2023-09-09] 2023-09-09 hour 9: 124194 events in 3 files, snapshot 6359282852459430791 (task 10255 ms: download 2588 ms overlapping gunzip 612 ms, parse 2691 ms, sort 114 ms, write 5506 ms, index 430 ms: 12 candidates, 52204 repo-hours, 759 releases; waiting 476 ms; commit 2352 ms)
2026-11-08T00:41:22Z [load_day 2023-09-09] 2023-09-09 hour 10: 126742 events in 3 files, snapshot 7271576075598852660 (task 10339 ms: download 3220 ms overlapping gunzip 573 ms, parse 2427 ms, sort 86 ms, write 5900 ms, index 430 ms: 11 candidates, 53148 repo-hours, 638 releases; waiting 619 ms; commit 4460 ms)
2026-11-08T00:41:24Z [load_day 2023-09-09] 2023-09-09 hour 11: 121801 events in 3 files, snapshot 3658241176480032562 (task 10239 ms: download 2122 ms overlapping gunzip 527 ms, parse 2251 ms, sort 94 ms, write 5928 ms, index 684 ms: 6 candidates, 51092 repo-hours, 637 releases; waiting 481 ms; commit 2420 ms)
2026-11-08T00:41:34Z [load_day 2023-09-09] 2023-09-09 hour 12: 200952 events in 5 files, snapshot 5337707929152942136 (task 12861 ms: download 4411 ms overlapping gunzip 666 ms, parse 3344 ms, sort 136 ms, write 7273 ms, index 652 ms: 14 candidates, 85022 repo-hours, 828 releases; waiting 483 ms; commit 2756 ms)
2026-11-08T00:41:41Z [load_day 2023-09-09] 2023-09-09 hour 13: 158275 events in 4 files, snapshot 7608136579971609178 (task 11948 ms: download 4182 ms overlapping gunzip 576 ms, parse 2756 ms, sort 121 ms, write 6586 ms, index 1163 ms: 14 candidates, 77116 repo-hours, 745 releases; waiting 460 ms; commit 5910 ms)
2026-11-08T00:41:48Z [load_day 2023-09-09] 2023-09-09 hour 14: 145651 events in 3 files, snapshot 2058275646421508769 (task 12689 ms: download 4436 ms overlapping gunzip 695 ms, parse 3222 ms, sort 152 ms, write 7262 ms, index 537 ms: 16 candidates, 61688 repo-hours, 746 releases; waiting 511 ms; commit 2660 ms)
2026-11-08T00:41:51Z [load_day 2023-09-09] 2023-09-09 hour 15: 147467 events in 3 files, snapshot 8941590248019613179 (task 12194 ms: download 5034 ms overlapping gunzip 613 ms, parse 2897 ms, sort 157 ms, write 7007 ms, index 495 ms: 14 candidates, 62714 repo-hours, 869 releases; waiting 737 ms; commit 2400 ms)
2026-11-08T00:42:00Z [load_day 2023-09-09] 2023-09-09 hour 16: 141636 events in 3 files, snapshot 7092808596920532469 (task 10629 ms: download 3685 ms overlapping gunzip 663 ms, parse 2729 ms, sort 89 ms, write 6276 ms, index 426 ms: 9 candidates, 60326 repo-hours, 763 releases; waiting 224 ms; commit 2585 ms)
2026-11-08T00:42:02Z [load_day 2023-09-09] 2023-09-09 hour 17: 132785 events in 3 files, snapshot 5758914142201200889 (task 10439 ms: download 1847 ms overlapping gunzip 598 ms, parse 2680 ms, sort 120 ms, write 5853 ms, index 451 ms: 7 candidates, 55119 repo-hours, 746 releases; waiting 172 ms; commit 2760 ms)
2026-11-08T00:42:10Z [load_day 2023-09-09] 2023-09-09 hour 18: 136477 events in 3 files, snapshot 2776398364777596501 (task 9326 ms: download 2215 ms overlapping gunzip 479 ms, parse 2205 ms, sort 120 ms, write 5340 ms, index 446 ms: 9 candidates, 60802 repo-hours, 825 releases; waiting 501 ms; commit 2186 ms)
2026-11-08T00:42:12Z [load_day 2023-09-09] 2023-09-09 hour 19: 119061 events in 3 files, snapshot 4977742586195487539 (task 8055 ms: download 1758 ms overlapping gunzip 486 ms, parse 2221 ms, sort 72 ms, write 4282 ms, index 337 ms: 12 candidates, 49025 repo-hours, 693 releases; waiting 334 ms; commit 2224 ms)
2026-11-08T00:42:18Z [load_day 2023-09-09] 2023-09-09 hour 20: 118928 events in 3 files, snapshot 7596306566213436430 (task 7347 ms: download 1601 ms overlapping gunzip 421 ms, parse 1853 ms, sort 82 ms, write 4157 ms, index 354 ms: 9 candidates, 47780 repo-hours, 769 releases; waiting 221 ms; commit 2114 ms)
2026-11-08T00:42:20Z [load_day 2023-09-09] 2023-09-09 hour 21: 108011 events in 3 files, snapshot 4987114318474254214 (task 6781 ms: download 1684 ms overlapping gunzip 379 ms, parse 1737 ms, sort 97 ms, write 3503 ms, index 299 ms: 4 candidates, 42213 repo-hours, 811 releases; waiting 490 ms; commit 2200 ms)
2026-11-08T00:42:26Z [load_day 2023-09-09] 2023-09-09 hour 22: 99563 events in 2 files, snapshot 1147505422184838244 (task 6649 ms: download 1707 ms overlapping gunzip 365 ms, parse 1565 ms, sort 56 ms, write 3485 ms, index 356 ms: 5 candidates, 38464 repo-hours, 716 releases; waiting 457 ms; commit 2743 ms)
2026-11-08T00:42:29Z [load_day 2023-09-09] 2023-09-09 hour 23: 95625 events in 2 files, snapshot 8546699249014015685 (task 8017 ms: download 4138 ms overlapping gunzip 438 ms, parse 1935 ms, sort 116 ms, write 3099 ms, index 284 ms: 8 candidates, 37153 repo-hours, 559 releases; waiting 1309 ms; commit 2203 ms)
2026-11-08T00:42:35Z [load_day 2023-09-09] 2023-09-09: repo_hour merged from 24 files to 1 (1309097 rows, 5732 ms)
2026-11-08T00:42:37Z [load_day 2023-09-09] 2023-09-09: index committed in 7444 ms (24 + 1 + 24 files)
2026-11-08T00:42:37Z [load_day 2023-09-09] 2023-09-09: 3047457 events in 24 hours
2026-11-08T00:42:37Z [load_day 2023-09-09] attempt 1 succeeded