orcaLog in

Runs · run 2323

load_day 2024-04-14, attempt 1 succeeded

Host
73ccef5e07c2:109555
Started
2026-11-08T05:36:17Z
Ended
2026-11-08T05:37:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
587 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
105.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2323/load_day/2024-04-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:36:17Z [load_day 2024-04-14] attempt 1 started
2026-11-08T05:36:18Z [load_day 2024-04-14] 2024-04-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:36:23Z [load_day 2024-04-14] 2024-04-14 hour 0: 144960 events in 0 files, snapshot none (task 4075 ms: download 1540 ms overlapping gunzip 528 ms, parse 2480 ms, sort 0 ms, write 0 ms, index 499 ms: 4 candidates, 63320 repo-hours, 926 releases; waiting 356 ms; commit 0 ms)
2026-11-08T05:36:23Z [load_day 2024-04-14] 2024-04-14 hour 1: 159405 events in 0 files, snapshot none (task 4522 ms: download 1726 ms overlapping gunzip 507 ms, parse 2312 ms, sort 0 ms, write 0 ms, index 1027 ms: 4 candidates, 76819 repo-hours, 673 releases; waiting 468 ms; commit 0 ms)
2026-11-08T05:36:27Z [load_day 2024-04-14] 2024-04-14 hour 2: 125914 events in 0 files, snapshot none (task 3484 ms: download 1827 ms overlapping gunzip 433 ms, parse 1933 ms, sort 0 ms, write 0 ms, index 352 ms: 6 candidates, 48067 repo-hours, 523 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:36:27Z [load_day 2024-04-14] 2024-04-14 hour 3: 129861 events in 0 files, snapshot none (task 3344 ms: download 2015 ms overlapping gunzip 416 ms, parse 1802 ms, sort 0 ms, write 0 ms, index 361 ms: 3 candidates, 47249 repo-hours, 805 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:36:31Z [load_day 2024-04-14] 2024-04-14 hour 4: 126271 events in 0 files, snapshot none (task 4059 ms: download 2033 ms overlapping gunzip 546 ms, parse 2298 ms, sort 0 ms, write 0 ms, index 342 ms: 2 candidates, 45588 repo-hours, 589 releases; waiting 458 ms; commit 0 ms)
2026-11-08T05:36:31Z [load_day 2024-04-14] 2024-04-14 hour 5: 127008 events in 0 files, snapshot none (task 3780 ms: download 2088 ms overlapping gunzip 471 ms, parse 2092 ms, sort 0 ms, write 0 ms, index 350 ms: 3 candidates, 45710 repo-hours, 538 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:36:36Z [load_day 2024-04-14] 2024-04-14 hour 6: 134115 events in 0 files, snapshot none (task 4547 ms: download 2008 ms overlapping gunzip 662 ms, parse 2757 ms, sort 0 ms, write 0 ms, index 362 ms: 3 candidates, 47688 repo-hours, 683 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:36:36Z [load_day 2024-04-14] 2024-04-14 hour 7: 145806 events in 0 files, snapshot none (task 4895 ms: download 2421 ms overlapping gunzip 673 ms, parse 2964 ms, sort 0 ms, write 0 ms, index 409 ms: 9 candidates, 57673 repo-hours, 660 releases; waiting 517 ms; commit 0 ms)
2026-11-08T05:36:42Z [load_day 2024-04-14] 2024-04-14 hour 8: 153022 events in 0 files, snapshot none (task 5265 ms: download 2304 ms overlapping gunzip 767 ms, parse 3290 ms, sort 0 ms, write 0 ms, index 396 ms: 6 candidates, 52546 repo-hours, 652 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:36:42Z [load_day 2024-04-14] 2024-04-14 hour 9: 146690 events in 0 files, snapshot none (task 5009 ms: download 2911 ms overlapping gunzip 742 ms, parse 2998 ms, sort 0 ms, write 0 ms, index 350 ms: 3 candidates, 48310 repo-hours, 552 releases; waiting 528 ms; commit 0 ms)
2026-11-08T05:36:48Z [load_day 2024-04-14] 2024-04-14 hour 10: 156869 events in 0 files, snapshot none (task 6090 ms: download 2776 ms overlapping gunzip 741 ms, parse 3221 ms, sort 0 ms, write 0 ms, index 1292 ms: 3 candidates, 57663 repo-hours, 745 releases; waiting 505 ms; commit 0 ms)
2026-11-08T05:36:48Z [load_day 2024-04-14] 2024-04-14 hour 11: 154831 events in 0 files, snapshot none (task 5775 ms: download 3032 ms overlapping gunzip 783 ms, parse 3526 ms, sort 0 ms, write 0 ms, index 503 ms: 9 candidates, 57823 repo-hours, 698 releases; waiting 612 ms; commit 0 ms)
2026-11-08T05:36:54Z [load_day 2024-04-14] 2024-04-14 hour 12: 153143 events in 0 files, snapshot none (task 5315 ms: download 3302 ms overlapping gunzip 851 ms, parse 3341 ms, sort 0 ms, write 0 ms, index 398 ms: 14 candidates, 55100 repo-hours, 705 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:36:54Z [load_day 2024-04-14] 2024-04-14 hour 13: 161056 events in 0 files, snapshot none (task 5296 ms: download 3099 ms overlapping gunzip 760 ms, parse 3259 ms, sort 0 ms, write 0 ms, index 436 ms: 13 candidates, 58652 repo-hours, 729 releases; waiting 541 ms; commit 0 ms)
2026-11-08T05:37:00Z [load_day 2024-04-14] 2024-04-14 hour 14: 212707 events in 0 files, snapshot none (task 5663 ms: download 3032 ms overlapping gunzip 781 ms, parse 3355 ms, sort 0 ms, write 0 ms, index 693 ms: 11 candidates, 102800 repo-hours, 984 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:37:00Z [load_day 2024-04-14] 2024-04-14 hour 15: 181041 events in 0 files, snapshot none (task 5239 ms: download 3267 ms overlapping gunzip 719 ms, parse 3052 ms, sort 0 ms, write 0 ms, index 521 ms: 10 candidates, 69318 repo-hours, 970 releases; waiting 599 ms; commit 0 ms)
2026-11-08T05:37:06Z [load_day 2024-04-14] 2024-04-14 hour 16: 174453 events in 0 files, snapshot none (task 5081 ms: download 3364 ms overlapping gunzip 686 ms, parse 2919 ms, sort 0 ms, write 0 ms, index 430 ms: 7 candidates, 62541 repo-hours, 893 releases; waiting 608 ms; commit 0 ms)
2026-11-08T05:37:06Z [load_day 2024-04-14] 2024-04-14 hour 17: 167005 events in 0 files, snapshot none (task 4882 ms: download 3754 ms overlapping gunzip 639 ms, parse 2647 ms, sort 0 ms, write 0 ms, index 452 ms: 5 candidates, 60286 repo-hours, 799 releases; waiting 832 ms; commit 0 ms)
2026-11-08T05:37:13Z [load_day 2024-04-14] 2024-04-14 hour 18: 170813 events in 0 files, snapshot none (task 6780 ms: download 3959 ms overlapping gunzip 992 ms, parse 4432 ms, sort 0 ms, write 0 ms, index 569 ms: 6 candidates, 60509 repo-hours, 687 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:37:13Z [load_day 2024-04-14] 2024-04-14 hour 19: 164049 events in 0 files, snapshot none (task 6871 ms: download 3905 ms overlapping gunzip 1050 ms, parse 4342 ms, sort 0 ms, write 0 ms, index 513 ms: 11 candidates, 57218 repo-hours, 706 releases; waiting 692 ms; commit 0 ms)
2026-11-08T05:37:20Z [load_day 2024-04-14] 2024-04-14 hour 20: 153569 events in 0 files, snapshot none (task 5981 ms: download 3265 ms overlapping gunzip 929 ms, parse 3790 ms, sort 0 ms, write 0 ms, index 420 ms: 8 candidates, 53696 repo-hours, 733 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:37:20Z [load_day 2024-04-14] 2024-04-14 hour 21: 144691 events in 0 files, snapshot none (task 5934 ms: download 3364 ms overlapping gunzip 900 ms, parse 3875 ms, sort 0 ms, write 0 ms, index 380 ms: 9 candidates, 50640 repo-hours, 675 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:37:26Z [load_day 2024-04-14] 2024-04-14 hour 22: 160415 events in 0 files, snapshot none (task 6395 ms: download 3427 ms overlapping gunzip 924 ms, parse 3932 ms, sort 0 ms, write 0 ms, index 480 ms: 10 candidates, 65814 repo-hours, 844 releases; waiting 785 ms; commit 0 ms)
2026-11-08T05:37:26Z [load_day 2024-04-14] 2024-04-14 hour 23: 137635 events in 0 files, snapshot none (task 5182 ms: download 2561 ms overlapping gunzip 734 ms, parse 3042 ms, sort 0 ms, write 0 ms, index 575 ms: 6 candidates, 50891 repo-hours, 776 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:37:33Z [load_day 2024-04-14] 2024-04-14: repo_hour merged from 24 files to 1 (1395921 rows, 6748 ms)
2026-11-08T05:37:36Z [load_day 2024-04-14] 2024-04-14: index committed in 9663 ms (24 + 1 + 24 files)
2026-11-08T05:37:36Z [load_day 2024-04-14] 2024-04-14: 3685329 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:37:36Z [load_day 2024-04-14] attempt 1 succeeded