orcaLog in

Runs · run 2626

load_day 2024-06-22, attempt 1 succeeded

Host
73ccef5e07c2:140032
Started
2026-11-08T06:39:30Z
Ended
2026-11-08T06:40:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
623 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.8 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2626/load_day/2024-06-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:39:30Z [load_day 2024-06-22] attempt 1 started
2026-11-08T06:39:31Z [load_day 2024-06-22] 2024-06-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:39:36Z [load_day 2024-06-22] 2024-06-22 hour 0: 163176 events in 0 files, snapshot none (task 5406 ms: download 2672 ms overlapping gunzip 734 ms, parse 3192 ms, sort 0 ms, write 0 ms, index 593 ms: 14 candidates, 83763 repo-hours, 1503 releases; waiting 500 ms; commit 0 ms)
2026-11-08T06:39:37Z [load_day 2024-06-22] 2024-06-22 hour 1: 164980 events in 0 files, snapshot none (task 5719 ms: download 2925 ms overlapping gunzip 789 ms, parse 3493 ms, sort 0 ms, write 0 ms, index 714 ms: 7 candidates, 90470 repo-hours, 1154 releases; waiting 467 ms; commit 0 ms)
2026-11-08T06:39:42Z [load_day 2024-06-22] 2024-06-22 hour 2: 128831 events in 0 files, snapshot none (task 5495 ms: download 3594 ms overlapping gunzip 761 ms, parse 3042 ms, sort 0 ms, write 0 ms, index 446 ms: 12 candidates, 48235 repo-hours, 1238 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:39:43Z [load_day 2024-06-22] 2024-06-22 hour 3: 148167 events in 0 files, snapshot none (task 5195 ms: download 2579 ms overlapping gunzip 721 ms, parse 3143 ms, sort 0 ms, write 0 ms, index 479 ms: 6 candidates, 61300 repo-hours, 5860 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:39:48Z [load_day 2024-06-22] 2024-06-22 hour 4: 128153 events in 0 files, snapshot none (task 4641 ms: download 2172 ms overlapping gunzip 654 ms, parse 2690 ms, sort 0 ms, write 0 ms, index 495 ms: 10 candidates, 48394 repo-hours, 933 releases; waiting 534 ms; commit 0 ms)
2026-11-08T06:39:48Z [load_day 2024-06-22] 2024-06-22 hour 5: 132832 events in 0 files, snapshot none (task 4325 ms: download 1821 ms overlapping gunzip 565 ms, parse 2350 ms, sort 0 ms, write 0 ms, index 641 ms: 8 candidates, 52555 repo-hours, 945 releases; waiting 533 ms; commit 0 ms)
2026-11-08T06:39:53Z [load_day 2024-06-22] 2024-06-22 hour 6: 154787 events in 0 files, snapshot none (task 5094 ms: download 2590 ms overlapping gunzip 727 ms, parse 2973 ms, sort 0 ms, write 0 ms, index 602 ms: 6 candidates, 69355 repo-hours, 1287 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:39:53Z [load_day 2024-06-22] 2024-06-22 hour 7: 146659 events in 0 files, snapshot none (task 4550 ms: download 2240 ms overlapping gunzip 698 ms, parse 2906 ms, sort 0 ms, write 0 ms, index 407 ms: 5 candidates, 55965 repo-hours, 1195 releases; waiting 341 ms; commit 0 ms)
2026-11-08T06:39:59Z [load_day 2024-06-22] 2024-06-22 hour 8: 159305 events in 0 files, snapshot none (task 5331 ms: download 2842 ms overlapping gunzip 763 ms, parse 3297 ms, sort 0 ms, write 0 ms, index 504 ms: 2 candidates, 61797 repo-hours, 1222 releases; waiting 430 ms; commit 0 ms)
2026-11-08T06:39:59Z [load_day 2024-06-22] 2024-06-22 hour 9: 164643 events in 0 files, snapshot none (task 5198 ms: download 2968 ms overlapping gunzip 756 ms, parse 3230 ms, sort 0 ms, write 0 ms, index 502 ms: 6 candidates, 69103 repo-hours, 1409 releases; waiting 435 ms; commit 0 ms)
2026-11-08T06:40:05Z [load_day 2024-06-22] 2024-06-22 hour 10: 154163 events in 0 files, snapshot none (task 5201 ms: download 3551 ms overlapping gunzip 574 ms, parse 2393 ms, sort 0 ms, write 0 ms, index 451 ms: 6 candidates, 62138 repo-hours, 1245 releases; waiting 1429 ms; commit 0 ms)
2026-11-08T06:40:05Z [load_day 2024-06-22] 2024-06-22 hour 11: 151496 events in 0 files, snapshot none (task 4276 ms: download 2040 ms overlapping gunzip 563 ms, parse 2520 ms, sort 0 ms, write 0 ms, index 431 ms: 12 candidates, 59086 repo-hours, 1231 releases; waiting 488 ms; commit 0 ms)
2026-11-08T06:40:10Z [load_day 2024-06-22] 2024-06-22 hour 12: 220610 events in 0 files, snapshot none (task 5443 ms: download 2534 ms overlapping gunzip 681 ms, parse 3165 ms, sort 0 ms, write 0 ms, index 737 ms: 9 candidates, 105436 repo-hours, 1412 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:40:10Z [load_day 2024-06-22] 2024-06-22 hour 13: 182622 events in 0 files, snapshot none (task 4996 ms: download 2440 ms overlapping gunzip 643 ms, parse 2927 ms, sort 0 ms, write 0 ms, index 648 ms: 10 candidates, 86073 repo-hours, 1281 releases; waiting 484 ms; commit 0 ms)
2026-11-08T06:40:18Z [load_day 2024-06-22] 2024-06-22 hour 14: 169064 events in 0 files, snapshot none (task 6662 ms: download 3259 ms overlapping gunzip 963 ms, parse 4146 ms, sort 0 ms, write 0 ms, index 732 ms: 16 candidates, 68032 repo-hours, 1319 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:40:19Z [load_day 2024-06-22] 2024-06-22 hour 15: 186978 events in 0 files, snapshot none (task 7617 ms: download 4904 ms overlapping gunzip 989 ms, parse 4190 ms, sort 0 ms, write 0 ms, index 598 ms: 9 candidates, 77709 repo-hours, 1490 releases; waiting 1455 ms; commit 0 ms)
2026-11-08T06:40:24Z [load_day 2024-06-22] 2024-06-22 hour 16: 170852 events in 0 files, snapshot none (task 5900 ms: download 2905 ms overlapping gunzip 826 ms, parse 3745 ms, sort 0 ms, write 0 ms, index 500 ms: 5 candidates, 66990 repo-hours, 1378 releases; waiting 235 ms; commit 0 ms)
2026-11-08T06:40:24Z [load_day 2024-06-22] 2024-06-22 hour 17: 164199 events in 0 files, snapshot none (task 5228 ms: download 2833 ms overlapping gunzip 761 ms, parse 3204 ms, sort 0 ms, write 0 ms, index 463 ms: 10 candidates, 61541 repo-hours, 1195 releases; waiting 493 ms; commit 0 ms)
2026-11-08T06:40:30Z [load_day 2024-06-22] 2024-06-22 hour 18: 179382 events in 0 files, snapshot none (task 5690 ms: download 3168 ms overlapping gunzip 773 ms, parse 3506 ms, sort 0 ms, write 0 ms, index 565 ms: 8 candidates, 78924 repo-hours, 890 releases; waiting 509 ms; commit 0 ms)
2026-11-08T06:40:30Z [load_day 2024-06-22] 2024-06-22 hour 19: 150475 events in 0 files, snapshot none (task 5037 ms: download 2590 ms overlapping gunzip 715 ms, parse 3200 ms, sort 0 ms, write 0 ms, index 391 ms: 8 candidates, 55692 repo-hours, 2603 releases; waiting 458 ms; commit 0 ms)
2026-11-08T06:40:35Z [load_day 2024-06-22] 2024-06-22 hour 20: 156765 events in 0 files, snapshot none (task 4809 ms: download 2517 ms overlapping gunzip 661 ms, parse 2950 ms, sort 0 ms, write 0 ms, index 434 ms: 2 candidates, 64422 repo-hours, 3090 releases; waiting 473 ms; commit 0 ms)
2026-11-08T06:40:35Z [load_day 2024-06-22] 2024-06-22 hour 21: 146329 events in 0 files, snapshot none (task 4433 ms: download 2619 ms overlapping gunzip 585 ms, parse 2559 ms, sort 0 ms, write 0 ms, index 436 ms: 8 candidates, 57578 repo-hours, 3120 releases; waiting 182 ms; commit 0 ms)
2026-11-08T06:40:41Z [load_day 2024-06-22] 2024-06-22 hour 22: 136632 events in 0 files, snapshot none (task 4702 ms: download 2482 ms overlapping gunzip 659 ms, parse 2857 ms, sort 0 ms, write 0 ms, index 332 ms: 3 candidates, 45297 repo-hours, 2901 releases; waiting 553 ms; commit 0 ms)
2026-11-08T06:40:41Z [load_day 2024-06-22] 2024-06-22 hour 23: 131757 events in 0 files, snapshot none (task 4099 ms: download 2273 ms overlapping gunzip 604 ms, parse 2570 ms, sort 0 ms, write 0 ms, index 392 ms: 2 candidates, 53077 repo-hours, 2274 releases; waiting 238 ms; commit 0 ms)
2026-11-08T06:40:47Z [load_day 2024-06-22] 2024-06-22: repo_hour merged from 24 files to 1 (1582932 rows, 6660 ms)
2026-11-08T06:40:49Z [load_day 2024-06-22] 2024-06-22: index committed in 8837 ms (24 + 1 + 24 files)
2026-11-08T06:40:49Z [load_day 2024-06-22] 2024-06-22: 3792857 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:40:49Z [load_day 2024-06-22] attempt 1 succeeded