orcaLog in

Runs · run 1831

load_day 2023-12-08, attempt 1 succeeded

Host
73ccef5e07c2:63
Started
2026-11-08T03:37:07Z
Ended
2026-11-08T03:41:32Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
1077 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
449.6 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1831/load_day/2023-12-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T03:37:07Z [load_day 2023-12-08] attempt 1 started
2026-11-08T03:37:08Z [load_day 2023-12-08] 2023-12-08: 2 hours in flight, about 1200 MB
2026-11-08T03:37:32Z [load_day 2023-12-08] 2023-12-08 hour 0: 267713 events in 6 files, snapshot 1880911539035711758 (task 19486 ms: download 11993 ms overlapping gunzip 949 ms, parse 4833 ms, sort 419 ms, write 12183 ms, index 637 ms: 10 candidates, 74892 repo-hours, 869 releases; waiting 199 ms; commit 2604 ms)
2026-11-08T03:37:38Z [load_day 2023-12-08] 2023-12-08 hour 1: 284656 events in 6 files, snapshot 5366650507391523997 (task 19830 ms: download 12351 ms overlapping gunzip 1108 ms, parse 6012 ms, sort 400 ms, write 11024 ms, index 531 ms: 7 candidates, 76816 repo-hours, 727 releases; waiting 489 ms; commit 5669 ms)
2026-11-08T03:37:50Z [load_day 2023-12-08] 2023-12-08 hour 2: 308439 events in 7 files, snapshot 1775882886356958312 (task 16659 ms: download 9109 ms overlapping gunzip 968 ms, parse 4389 ms, sort 414 ms, write 9534 ms, index 491 ms: 4 candidates, 50334 repo-hours, 504 releases; waiting 513 ms; commit 3043 ms)
2026-11-08T03:37:56Z [load_day 2023-12-08] 2023-12-08 hour 3: 302405 events in 7 files, snapshot 5529576577477571263 (task 17227 ms: download 9908 ms overlapping gunzip 1002 ms, parse 5437 ms, sort 335 ms, write 9109 ms, index 614 ms: 5 candidates, 48637 repo-hours, 610 releases; waiting 480 ms; commit 5622 ms)
2026-11-08T03:38:09Z [load_day 2023-12-08] 2023-12-08 hour 4: 306358 events in 7 files, snapshot 6438354317851941799 (task 17070 ms: download 9004 ms overlapping gunzip 979 ms, parse 4921 ms, sort 418 ms, write 9519 ms, index 397 ms: 3 candidates, 45799 repo-hours, 495 releases; waiting 530 ms; commit 3506 ms)
2026-11-08T03:38:14Z [load_day 2023-12-08] 2023-12-08 hour 5: 312491 events in 7 files, snapshot 350159003608845174 (task 18182 ms: download 9683 ms overlapping gunzip 1132 ms, parse 5329 ms, sort 287 ms, write 10248 ms, index 437 ms: 4 candidates, 48449 repo-hours, 493 releases; waiting 448 ms; commit 3467 ms)
2026-11-08T03:38:28Z [load_day 2023-12-08] 2023-12-08 hour 6: 310517 events in 7 files, snapshot 2064020208487090315 (task 17824 ms: download 9111 ms overlapping gunzip 1023 ms, parse 5150 ms, sort 404 ms, write 10018 ms, index 439 ms: 7 candidates, 57334 repo-hours, 585 releases; waiting 476 ms; commit 3555 ms)
2026-11-08T03:38:34Z [load_day 2023-12-08] 2023-12-08 hour 7: 301333 events in 7 files, snapshot 3397900739732065434 (task 18099 ms: download 9612 ms overlapping gunzip 931 ms, parse 4584 ms, sort 342 ms, write 11029 ms, index 524 ms: 6 candidates, 57065 repo-hours, 565 releases; waiting 380 ms; commit 4128 ms)
2026-11-08T03:38:49Z [load_day 2023-12-08] 2023-12-08 hour 8: 281811 events in 6 files, snapshot 3866665823251958249 (task 20095 ms: download 11796 ms overlapping gunzip 1124 ms, parse 5266 ms, sort 420 ms, write 11996 ms, index 508 ms: 11 candidates, 66555 repo-hours, 703 releases; waiting 527 ms; commit 3191 ms)
2026-11-08T03:38:57Z [load_day 2023-12-08] 2023-12-08 hour 9: 309458 events in 7 files, snapshot 2257607234517258262 (task 20392 ms: download 12736 ms overlapping gunzip 1295 ms, parse 6269 ms, sort 395 ms, write 11165 ms, index 510 ms: 8 candidates, 63424 repo-hours, 964 releases; waiting 431 ms; commit 5490 ms)
2026-11-08T03:39:11Z [load_day 2023-12-08] 2023-12-08 hour 10: 253596 events in 6 files, snapshot 877332013000575181 (task 21381 ms: download 12618 ms overlapping gunzip 1162 ms, parse 5257 ms, sort 273 ms, write 13296 ms, index 625 ms: 7 candidates, 74762 repo-hours, 1091 releases; waiting 493 ms; commit 3015 ms)
2026-11-08T03:39:16Z [load_day 2023-12-08] 2023-12-08 hour 11: 265858 events in 6 files, snapshot 8249245093592486444 (task 20687 ms: download 12256 ms overlapping gunzip 1378 ms, parse 6509 ms, sort 273 ms, write 10806 ms, index 894 ms: 10 candidates, 67313 repo-hours, 877 releases; waiting 540 ms; commit 3005 ms)
2026-11-08T03:39:35Z [load_day 2023-12-08] 2023-12-08 hour 12: 285292 events in 6 files, snapshot 1454760627304070421 (task 22113 ms: download 11662 ms overlapping gunzip 1288 ms, parse 6064 ms, sort 420 ms, write 12735 ms, index 700 ms: 12 candidates, 97785 repo-hours, 892 releases; waiting 563 ms; commit 2829 ms)
2026-11-08T03:39:42Z [load_day 2023-12-08] 2023-12-08 hour 13: 260991 events in 6 files, snapshot 1320312031176408358 (task 22120 ms: download 13694 ms overlapping gunzip 1169 ms, parse 5519 ms, sort 236 ms, write 13350 ms, index 843 ms: 7 candidates, 93301 repo-hours, 998 releases; waiting 697 ms; commit 5960 ms)
2026-11-08T03:39:58Z [load_day 2023-12-08] 2023-12-08 hour 14: 305795 events in 7 files, snapshot 5719463912555903065 (task 21798 ms: download 14164 ms overlapping gunzip 1093 ms, parse 5505 ms, sort 356 ms, write 13303 ms, index 730 ms: 4 candidates, 67890 repo-hours, 768 releases; waiting 526 ms; commit 2820 ms)
2026-11-08T03:40:03Z [load_day 2023-12-08] 2023-12-08 hour 15: 305860 events in 7 files, snapshot 3783559282740147100 (task 22187 ms: download 14768 ms overlapping gunzip 1453 ms, parse 6379 ms, sort 371 ms, write 12686 ms, index 567 ms: 7 candidates, 68720 repo-hours, 851 releases; waiting 491 ms; commit 3232 ms)
2026-11-08T03:40:21Z [load_day 2023-12-08] 2023-12-08 hour 16: 310488 events in 7 files, snapshot 5766107208596021237 (task 21725 ms: download 14216 ms overlapping gunzip 1263 ms, parse 5608 ms, sort 350 ms, write 13213 ms, index 500 ms: 5 candidates, 67451 repo-hours, 900 releases; waiting 548 ms; commit 3164 ms)
2026-11-08T03:40:24Z [load_day 2023-12-08] 2023-12-08 hour 17: 310617 events in 7 files, snapshot 1073636146753092573 (task 20671 ms: download 11029 ms overlapping gunzip 1296 ms, parse 6009 ms, sort 319 ms, write 11306 ms, index 800 ms: 4 candidates, 61863 repo-hours, 758 releases; waiting 559 ms; commit 2681 ms)
2026-11-08T03:40:42Z [load_day 2023-12-08] 2023-12-08 hour 18: 303994 events in 7 files, snapshot 4229060024430557059 (task 18803 ms: download 10297 ms overlapping gunzip 1074 ms, parse 5170 ms, sort 308 ms, write 11062 ms, index 468 ms: 8 candidates, 62316 repo-hours, 671 releases; waiting 487 ms; commit 4026 ms)
2026-11-08T03:40:45Z [load_day 2023-12-08] 2023-12-08 hour 19: 304635 events in 7 files, snapshot 8997989491200149484 (task 18818 ms: download 10405 ms overlapping gunzip 1048 ms, parse 5039 ms, sort 289 ms, write 11074 ms, index 806 ms: 7 candidates, 56603 repo-hours, 630 releases; waiting 299 ms; commit 2925 ms)
2026-11-08T03:40:59Z [load_day 2023-12-08] 2023-12-08 hour 20: 295064 events in 6 files, snapshot 7876319860035307531 (task 17622 ms: download 9675 ms overlapping gunzip 1050 ms, parse 5142 ms, sort 344 ms, write 9955 ms, index 518 ms: 11 candidates, 56565 repo-hours, 721 releases; waiting 338 ms; commit 2727 ms)
2026-11-08T03:41:05Z [load_day 2023-12-08] 2023-12-08 hour 21: 253761 events in 6 files, snapshot 1374451333731781235 (task 18968 ms: download 11301 ms overlapping gunzip 1079 ms, parse 4815 ms, sort 263 ms, write 11547 ms, index 459 ms: 9 candidates, 59536 repo-hours, 904 releases; waiting 498 ms; commit 3220 ms)
2026-11-08T03:41:18Z [load_day 2023-12-08] 2023-12-08 hour 22: 225288 events in 5 files, snapshot 6984713317297375193 (task 17769 ms: download 9232 ms overlapping gunzip 1086 ms, parse 5125 ms, sort 209 ms, write 9864 ms, index 673 ms: 11 candidates, 57506 repo-hours, 1000 releases; waiting 496 ms; commit 2841 ms)
2026-11-08T03:41:22Z [load_day 2023-12-08] 2023-12-08 hour 23: 200516 events in 5 files, snapshot 5210319030333305769 (task 15351 ms: download 8671 ms overlapping gunzip 928 ms, parse 4076 ms, sort 218 ms, write 9017 ms, index 376 ms: 3 candidates, 52157 repo-hours, 704 releases; waiting 472 ms; commit 2459 ms)
2026-11-08T03:41:29Z [load_day 2023-12-08] 2023-12-08: repo_hour merged from 24 files to 1 (1533073 rows, 7417 ms)
2026-11-08T03:41:32Z [load_day 2023-12-08] 2023-12-08: index committed in 10387 ms (24 + 1 + 24 files)
2026-11-08T03:41:32Z [load_day 2023-12-08] 2023-12-08: 6866936 events in 24 hours
2026-11-08T03:41:32Z [load_day 2023-12-08] attempt 1 succeeded