orcaLog in

Runs · run 2562

load_day 2024-06-08, attempt 1 succeeded

Host
73ccef5e07c2:133315
Started
2026-11-08T06:27:08Z
Ended
2026-11-08T06:28:19Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
638 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
106.7 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2562/load_day/2024-06-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:27:08Z [load_day 2024-06-08] attempt 1 started
2026-11-08T06:27:09Z [load_day 2024-06-08] 2024-06-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:27:14Z [load_day 2024-06-08] 2024-06-08 hour 0: 175439 events in 0 files, snapshot none (task 5175 ms: download 2491 ms overlapping gunzip 817 ms, parse 3521 ms, sort 0 ms, write 0 ms, index 622 ms: 6 candidates, 87892 repo-hours, 953 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:27:14Z [load_day 2024-06-08] 2024-06-08 hour 1: 175654 events in 0 files, snapshot none (task 5094 ms: download 2356 ms overlapping gunzip 736 ms, parse 3312 ms, sort 0 ms, write 0 ms, index 844 ms: 8 candidates, 93467 repo-hours, 750 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:27:19Z [load_day 2024-06-08] 2024-06-08 hour 2: 125362 events in 0 files, snapshot none (task 4212 ms: download 1505 ms overlapping gunzip 651 ms, parse 2892 ms, sort 0 ms, write 0 ms, index 457 ms: 11 candidates, 48368 repo-hours, 674 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:27:20Z [load_day 2024-06-08] 2024-06-08 hour 3: 149103 events in 0 files, snapshot none (task 4430 ms: download 1715 ms overlapping gunzip 707 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 502 ms: 9 candidates, 60171 repo-hours, 3868 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:27:24Z [load_day 2024-06-08] 2024-06-08 hour 4: 132480 events in 0 files, snapshot none (task 3982 ms: download 1118 ms overlapping gunzip 582 ms, parse 2561 ms, sort 0 ms, write 0 ms, index 632 ms: 7 candidates, 51501 repo-hours, 550 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:27:24Z [load_day 2024-06-08] 2024-06-08 hour 5: 134440 events in 0 files, snapshot none (task 4089 ms: download 1322 ms overlapping gunzip 636 ms, parse 2773 ms, sort 0 ms, write 0 ms, index 451 ms: 10 candidates, 53216 repo-hours, 611 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:27:29Z [load_day 2024-06-08] 2024-06-08 hour 6: 162205 events in 0 files, snapshot none (task 4437 ms: download 1750 ms overlapping gunzip 673 ms, parse 2995 ms, sort 0 ms, write 0 ms, index 570 ms: 14 candidates, 68906 repo-hours, 953 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:27:29Z [load_day 2024-06-08] 2024-06-08 hour 7: 170632 events in 0 files, snapshot none (task 3937 ms: download 1469 ms overlapping gunzip 610 ms, parse 2707 ms, sort 0 ms, write 0 ms, index 404 ms: 10 candidates, 59824 repo-hours, 875 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:27:34Z [load_day 2024-06-08] 2024-06-08 hour 8: 163913 events in 0 files, snapshot none (task 4916 ms: download 2433 ms overlapping gunzip 832 ms, parse 3477 ms, sort 0 ms, write 0 ms, index 409 ms: 12 candidates, 61304 repo-hours, 1023 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:27:34Z [load_day 2024-06-08] 2024-06-08 hour 9: 172158 events in 0 files, snapshot none (task 4705 ms: download 2385 ms overlapping gunzip 751 ms, parse 3247 ms, sort 0 ms, write 0 ms, index 493 ms: 13 candidates, 67941 repo-hours, 1102 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:27:38Z [load_day 2024-06-08] 2024-06-08 hour 10: 170537 events in 0 files, snapshot none (task 3453 ms: download 1199 ms overlapping gunzip 526 ms, parse 2291 ms, sort 0 ms, write 0 ms, index 441 ms: 6 candidates, 62157 repo-hours, 888 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:27:38Z [load_day 2024-06-08] 2024-06-08 hour 11: 156247 events in 0 files, snapshot none (task 3399 ms: download 1122 ms overlapping gunzip 507 ms, parse 2260 ms, sort 0 ms, write 0 ms, index 448 ms: 8 candidates, 59075 repo-hours, 716 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:27:43Z [load_day 2024-06-08] 2024-06-08 hour 12: 235919 events in 0 files, snapshot none (task 4631 ms: download 1880 ms overlapping gunzip 635 ms, parse 3065 ms, sort 0 ms, write 0 ms, index 715 ms: 11 candidates, 105078 repo-hours, 881 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:27:43Z [load_day 2024-06-08] 2024-06-08 hour 13: 194052 events in 0 files, snapshot none (task 4245 ms: download 1801 ms overlapping gunzip 627 ms, parse 2742 ms, sort 0 ms, write 0 ms, index 629 ms: 8 candidates, 90459 repo-hours, 751 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:27:47Z [load_day 2024-06-08] 2024-06-08 hour 14: 176735 events in 0 files, snapshot none (task 3903 ms: download 1504 ms overlapping gunzip 574 ms, parse 2559 ms, sort 0 ms, write 0 ms, index 561 ms: 10 candidates, 77581 repo-hours, 823 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:27:48Z [load_day 2024-06-08] 2024-06-08 hour 15: 189831 events in 0 files, snapshot none (task 4200 ms: download 1848 ms overlapping gunzip 663 ms, parse 2740 ms, sort 0 ms, write 0 ms, index 589 ms: 11 candidates, 79441 repo-hours, 967 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:27:53Z [load_day 2024-06-08] 2024-06-08 hour 16: 180786 events in 0 files, snapshot none (task 5874 ms: download 3481 ms overlapping gunzip 941 ms, parse 4108 ms, sort 0 ms, write 0 ms, index 617 ms: 19 candidates, 70079 repo-hours, 764 releases; waiting 29 ms; commit 0 ms)
2026-11-08T06:27:53Z [load_day 2024-06-08] 2024-06-08 hour 17: 165503 events in 0 files, snapshot none (task 4571 ms: download 2170 ms overlapping gunzip 694 ms, parse 3166 ms, sort 0 ms, write 0 ms, index 480 ms: 11 candidates, 63508 repo-hours, 734 releases; waiting 5 ms; commit 0 ms)
2026-11-08T06:28:00Z [load_day 2024-06-08] 2024-06-08 hour 18: 180265 events in 0 files, snapshot none (task 5879 ms: download 2558 ms overlapping gunzip 900 ms, parse 4046 ms, sort 0 ms, write 0 ms, index 705 ms: 9 candidates, 78421 repo-hours, 941 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:28:00Z [load_day 2024-06-08] 2024-06-08 hour 19: 164859 events in 0 files, snapshot none (task 4854 ms: download 1772 ms overlapping gunzip 680 ms, parse 3012 ms, sort 0 ms, write 0 ms, index 919 ms: 5 candidates, 75209 repo-hours, 748 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:28:05Z [load_day 2024-06-08] 2024-06-08 hour 20: 153899 events in 0 files, snapshot none (task 4529 ms: download 1308 ms overlapping gunzip 658 ms, parse 3155 ms, sort 0 ms, write 0 ms, index 499 ms: 5 candidates, 57197 repo-hours, 688 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:28:05Z [load_day 2024-06-08] 2024-06-08 hour 21: 163145 events in 0 files, snapshot none (task 4180 ms: download 1236 ms overlapping gunzip 627 ms, parse 2783 ms, sort 0 ms, write 0 ms, index 546 ms: 15 candidates, 82926 repo-hours, 790 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:28:09Z [load_day 2024-06-08] 2024-06-08 hour 22: 125229 events in 0 files, snapshot none (task 3573 ms: download 904 ms overlapping gunzip 542 ms, parse 2305 ms, sort 0 ms, write 0 ms, index 518 ms: 4 candidates, 44540 repo-hours, 651 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:28:09Z [load_day 2024-06-08] 2024-06-08 hour 23: 149802 events in 0 files, snapshot none (task 3464 ms: download 823 ms overlapping gunzip 469 ms, parse 2249 ms, sort 0 ms, write 0 ms, index 512 ms: 5 candidates, 44880 repo-hours, 455 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:28:16Z [load_day 2024-06-08] 2024-06-08: repo_hour merged from 24 files to 1 (1643141 rows, 7148 ms)
2026-11-08T06:28:19Z [load_day 2024-06-08] 2024-06-08: index committed in 9655 ms (24 + 1 + 24 files)
2026-11-08T06:28:19Z [load_day 2024-06-08] 2024-06-08: 3968195 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:28:19Z [load_day 2024-06-08] attempt 1 succeeded