orcaLog in

Runs · run 1212

load_day 2023-06-25, attempt 1 succeeded

Host
3c2b29713ce8:36398
Started
2026-11-07T22:01:53Z
Ended
2026-11-07T22:05:13Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
not measured
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
not measured
Log file
s3://census-mlake-dev/logs/gharchive/1212/load_day/2023-06-25/1.log
Code
pipelines/gharchive.mojo:116

Log

2026-11-07T22:01:53Z [load_day 2023-06-25] attempt 1 started
2026-11-07T22:01:55Z [load_day 2023-06-25] 2023-06-25: 1 hours in flight, about 750 MB
2026-11-07T22:02:04Z [load_day 2023-06-25] 2023-06-25 hour 0: 96324 events in 2 files, snapshot 2598044355079144055 (task 5734 ms: download 1707 ms overlapping gunzip 335 ms, parse 1621 ms, sort 56 ms, write 2682 ms, index 315 ms: 5 candidates, 49446 repo-hours, 675 releases; waiting 507 ms; commit 1827 ms)
2026-11-07T22:02:11Z [load_day 2023-06-25] 2023-06-25 hour 1: 115207 events in 3 files, snapshot 5475083312763546970 (task 6569 ms: download 2101 ms overlapping gunzip 396 ms, parse 1881 ms, sort 57 ms, write 2985 ms, index 451 ms: 2 candidates, 67003 repo-hours, 735 releases; waiting 496 ms; commit 1697 ms)
2026-11-07T22:02:19Z [load_day 2023-06-25] 2023-06-25 hour 2: 107172 events in 3 files, snapshot 4877533618793957150 (task 6422 ms: download 2018 ms overlapping gunzip 393 ms, parse 1783 ms, sort 62 ms, write 3018 ms, index 349 ms: 6 candidates, 58391 repo-hours, 610 releases; waiting 493 ms; commit 1875 ms)
2026-11-07T22:02:25Z [load_day 2023-06-25] 2023-06-25 hour 3: 97428 events in 2 files, snapshot 573464162096388240 (task 5659 ms: download 1585 ms overlapping gunzip 346 ms, parse 1575 ms, sort 57 ms, write 2693 ms, index 296 ms: 6 candidates, 45042 repo-hours, 762 releases; waiting 385 ms; commit 1800 ms)
2026-11-07T22:02:32Z [load_day 2023-06-25] 2023-06-25 hour 4: 91029 events in 2 files, snapshot 2532062436272174205 (task 5484 ms: download 1570 ms overlapping gunzip 336 ms, parse 1463 ms, sort 46 ms, write 2536 ms, index 298 ms: 3 candidates, 39648 repo-hours, 498 releases; waiting 501 ms; commit 1972 ms)
2026-11-07T22:02:38Z [load_day 2023-06-25] 2023-06-25 hour 5: 99132 events in 2 files, snapshot 219543699383128553 (task 5713 ms: download 1940 ms overlapping gunzip 366 ms, parse 1641 ms, sort 75 ms, write 2578 ms, index 273 ms: 0 candidates, 44392 repo-hours, 579 releases; waiting 493 ms; commit 1832 ms)
2026-11-07T22:02:45Z [load_day 2023-06-25] 2023-06-25 hour 6: 113330 events in 3 files, snapshot 5022258607397478736 (task 6367 ms: download 1950 ms overlapping gunzip 377 ms, parse 1704 ms, sort 61 ms, write 3120 ms, index 333 ms: 2 candidates, 55530 repo-hours, 604 releases; waiting 463 ms; commit 1903 ms)
2026-11-07T22:02:57Z [load_day 2023-06-25] 2023-06-25 hour 7: 116929 events in 3 files, snapshot 127294789725448402 (task 6853 ms: download 2099 ms overlapping gunzip 413 ms, parse 1855 ms, sort 63 ms, write 3405 ms, index 328 ms: 1 candidates, 53997 repo-hours, 677 releases; waiting 493 ms; commit 5562 ms)
2026-11-07T22:03:03Z [load_day 2023-06-25] 2023-06-25 hour 8: 128302 events in 3 files, snapshot 8030756654815786928 (task 7691 ms: download 2090 ms overlapping gunzip 460 ms, parse 2069 ms, sort 63 ms, write 3825 ms, index 373 ms: 4 candidates, 60178 repo-hours, 620 releases; waiting 586 ms; commit 2884 ms)
2026-11-07T22:03:10Z [load_day 2023-06-25] 2023-06-25 hour 9: 130237 events in 3 files, snapshot 797123705857308328 (task 7490 ms: download 1674 ms overlapping gunzip 485 ms, parse 2201 ms, sort 82 ms, write 3843 ms, index 406 ms: 2 candidates, 60221 repo-hours, 895 releases; waiting 242 ms; commit 1811 ms)
2026-11-07T22:03:18Z [load_day 2023-06-25] 2023-06-25 hour 10: 128451 events in 3 files, snapshot 7292576942233453315 (task 7426 ms: download 2357 ms overlapping gunzip 472 ms, parse 2123 ms, sort 68 ms, write 3592 ms, index 385 ms: 2 candidates, 58613 repo-hours, 742 releases; waiting 498 ms; commit 1807 ms)
2026-11-07T22:03:26Z [load_day 2023-06-25] 2023-06-25 hour 11: 126466 events in 3 files, snapshot 6627311643615216828 (task 7221 ms: download 2030 ms overlapping gunzip 444 ms, parse 2013 ms, sort 76 ms, write 3523 ms, index 341 ms: 9 candidates, 55339 repo-hours, 735 releases; waiting 511 ms; commit 1847 ms)
2026-11-07T22:03:37Z [load_day 2023-06-25] 2023-06-25 hour 12: 171099 events in 4 files, snapshot 5390610692096934606 (task 10003 ms: download 4314 ms overlapping gunzip 539 ms, parse 2531 ms, sort 97 ms, write 4305 ms, index 548 ms: 5 candidates, 87572 repo-hours, 706 releases; waiting 1682 ms; commit 1707 ms)
2026-11-07T22:03:46Z [load_day 2023-06-25] 2023-06-25 hour 13: 155300 events in 4 files, snapshot 5451320267603642447 (task 8723 ms: download 3362 ms overlapping gunzip 559 ms, parse 2527 ms, sort 89 ms, write 4275 ms, index 513 ms: 6 candidates, 81676 repo-hours, 633 releases; waiting 507 ms; commit 1964 ms)
2026-11-07T22:03:55Z [load_day 2023-06-25] 2023-06-25 hour 14: 145416 events in 3 files, snapshot 5499739648156211492 (task 8472 ms: download 3027 ms overlapping gunzip 541 ms, parse 2405 ms, sort 86 ms, write 4152 ms, index 451 ms: 3 candidates, 66085 repo-hours, 693 releases; waiting 194 ms; commit 1670 ms)
2026-11-07T22:04:05Z [load_day 2023-06-25] 2023-06-25 hour 15: 150416 events in 4 files, snapshot 3190459510145309510 (task 8360 ms: download 2995 ms overlapping gunzip 502 ms, parse 2285 ms, sort 99 ms, write 4366 ms, index 506 ms: 4 candidates, 71082 repo-hours, 873 releases; waiting 295 ms; commit 2028 ms)
2026-11-07T22:04:13Z [load_day 2023-06-25] 2023-06-25 hour 16: 142561 events in 3 files, snapshot 2447955151072101247 (task 7513 ms: download 2700 ms overlapping gunzip 482 ms, parse 2162 ms, sort 80 ms, write 3821 ms, index 406 ms: 2 candidates, 65409 repo-hours, 735 releases; waiting 267 ms; commit 1645 ms)
2026-11-07T22:04:21Z [load_day 2023-06-25] 2023-06-25 hour 17: 127522 events in 3 files, snapshot 3408383613785999998 (task 7350 ms: download 2133 ms overlapping gunzip 464 ms, parse 2116 ms, sort 102 ms, write 3478 ms, index 373 ms: 4 candidates, 56439 repo-hours, 750 releases; waiting 511 ms; commit 1640 ms)
2026-11-07T22:04:29Z [load_day 2023-06-25] 2023-06-25 hour 18: 135179 events in 3 files, snapshot 1410830233409139176 (task 7508 ms: download 2070 ms overlapping gunzip 457 ms, parse 2126 ms, sort 94 ms, write 3615 ms, index 451 ms: 3 candidates, 62718 repo-hours, 808 releases; waiting 470 ms; commit 1758 ms)
2026-11-07T22:04:38Z [load_day 2023-06-25] 2023-06-25 hour 19: 120342 events in 3 files, snapshot 4555591463098879708 (task 6801 ms: download 1736 ms overlapping gunzip 413 ms, parse 1891 ms, sort 68 ms, write 3484 ms, index 356 ms: 6 candidates, 51984 repo-hours, 665 releases; waiting 265 ms; commit 3128 ms)
2026-11-07T22:04:45Z [load_day 2023-06-25] 2023-06-25 hour 20: 118219 events in 3 files, snapshot 6618301513893262930 (task 7131 ms: download 2376 ms overlapping gunzip 423 ms, parse 1937 ms, sort 82 ms, write 3487 ms, index 355 ms: 8 candidates, 52424 repo-hours, 657 releases; waiting 543 ms; commit 1541 ms)
2026-11-07T22:04:52Z [load_day 2023-06-25] 2023-06-25 hour 21: 113408 events in 3 files, snapshot 4090113294307675436 (task 6260 ms: download 1587 ms overlapping gunzip 379 ms, parse 1747 ms, sort 68 ms, write 3022 ms, index 319 ms: 4 candidates, 49333 repo-hours, 763 releases; waiting 491 ms; commit 1687 ms)
2026-11-07T22:04:59Z [load_day 2023-06-25] 2023-06-25 hour 22: 100533 events in 3 files, snapshot 8017539790632961739 (task 5930 ms: download 1805 ms overlapping gunzip 363 ms, parse 1663 ms, sort 67 ms, write 2723 ms, index 302 ms: 2 candidates, 43052 repo-hours, 649 releases; waiting 504 ms; commit 1696 ms)
2026-11-07T22:05:06Z [load_day 2023-06-25] 2023-06-25 hour 23: 95123 events in 2 files, snapshot 983613875896150153 (task 6079 ms: download 2151 ms overlapping gunzip 353 ms, parse 1635 ms, sort 64 ms, write 2797 ms, index 281 ms: 3 candidates, 41762 repo-hours, 615 releases; waiting 605 ms; commit 1751 ms)
2026-11-07T22:05:12Z [load_day 2023-06-25] 2023-06-25: repo_hour merged from 24 files to 1 (1377336 rows, 6045 ms)
2026-11-07T22:05:13Z [load_day 2023-06-25] 2023-06-25: index committed in 7853 ms (23 + 1 + 24 files)
2026-11-07T22:05:13Z [load_day 2023-06-25] 2023-06-25: 2925125 events in 24 hours
2026-11-07T22:05:13Z [load_day 2023-06-25] attempt 1 succeeded