orcaLog in

Runs · run 2320

load_day 2024-04-13, attempt 1 succeeded

Host
73ccef5e07c2:109280
Started
2026-11-08T05:35:45Z
Ended
2026-11-08T05:37:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
616 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
110.0 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2320/load_day/2024-04-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:35:46Z [load_day 2024-04-13] attempt 1 started
2026-11-08T05:35:46Z [load_day 2024-04-13] 2024-04-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:35:53Z [load_day 2024-04-13] 2024-04-13 hour 0: 206827 events in 0 files, snapshot none (task 6319 ms: download 4693 ms overlapping gunzip 844 ms, parse 3660 ms, sort 0 ms, write 0 ms, index 798 ms: 10 candidates, 102859 repo-hours, 1134 releases; waiting 666 ms; commit 0 ms)
2026-11-08T05:35:53Z [load_day 2024-04-13] 2024-04-13 hour 1: 173071 events in 0 files, snapshot none (task 5269 ms: download 3286 ms overlapping gunzip 721 ms, parse 3142 ms, sort 0 ms, write 0 ms, index 568 ms: 10 candidates, 77979 repo-hours, 648 releases; waiting 538 ms; commit 0 ms)
2026-11-08T05:35:59Z [load_day 2024-04-13] 2024-04-13 hour 2: 151137 events in 0 files, snapshot none (task 4938 ms: download 2487 ms overlapping gunzip 703 ms, parse 3019 ms, sort 0 ms, write 0 ms, index 330 ms: 6 candidates, 47667 repo-hours, 524 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:35:59Z [load_day 2024-04-13] 2024-04-13 hour 3: 145220 events in 0 files, snapshot none (task 4928 ms: download 2388 ms overlapping gunzip 714 ms, parse 3001 ms, sort 0 ms, write 0 ms, index 454 ms: 9 candidates, 48592 repo-hours, 721 releases; waiting 463 ms; commit 0 ms)
2026-11-08T05:36:05Z [load_day 2024-04-13] 2024-04-13 hour 4: 143635 events in 0 files, snapshot none (task 5275 ms: download 2150 ms overlapping gunzip 797 ms, parse 3311 ms, sort 0 ms, write 0 ms, index 419 ms: 8 candidates, 48442 repo-hours, 525 releases; waiting 453 ms; commit 0 ms)
2026-11-08T05:36:05Z [load_day 2024-04-13] 2024-04-13 hour 5: 147859 events in 0 files, snapshot none (task 4926 ms: download 3123 ms overlapping gunzip 732 ms, parse 2974 ms, sort 0 ms, write 0 ms, index 405 ms: 8 candidates, 51290 repo-hours, 622 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:36:10Z [load_day 2024-04-13] 2024-04-13 hour 6: 166755 events in 0 files, snapshot none (task 4637 ms: download 3150 ms overlapping gunzip 551 ms, parse 2467 ms, sort 0 ms, write 0 ms, index 479 ms: 6 candidates, 60469 repo-hours, 932 releases; waiting 842 ms; commit 0 ms)
2026-11-08T05:36:10Z [load_day 2024-04-13] 2024-04-13 hour 7: 161512 events in 0 files, snapshot none (task 4170 ms: download 2663 ms overlapping gunzip 552 ms, parse 2337 ms, sort 0 ms, write 0 ms, index 415 ms: 8 candidates, 54221 repo-hours, 836 releases; waiting 576 ms; commit 0 ms)
2026-11-08T05:36:15Z [load_day 2024-04-13] 2024-04-13 hour 8: 173049 events in 0 files, snapshot none (task 4488 ms: download 2594 ms overlapping gunzip 596 ms, parse 2651 ms, sort 0 ms, write 0 ms, index 472 ms: 11 candidates, 58660 repo-hours, 878 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:36:15Z [load_day 2024-04-13] 2024-04-13 hour 9: 171454 events in 0 files, snapshot none (task 4155 ms: download 3033 ms overlapping gunzip 538 ms, parse 2355 ms, sort 0 ms, write 0 ms, index 405 ms: 10 candidates, 59228 repo-hours, 962 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:36:19Z [load_day 2024-04-13] 2024-04-13 hour 10: 170287 events in 0 files, snapshot none (task 4075 ms: download 2111 ms overlapping gunzip 549 ms, parse 2396 ms, sort 0 ms, write 0 ms, index 404 ms: 15 candidates, 59590 repo-hours, 710 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:36:19Z [load_day 2024-04-13] 2024-04-13 hour 11: 168783 events in 0 files, snapshot none (task 4234 ms: download 2250 ms overlapping gunzip 556 ms, parse 2475 ms, sort 0 ms, write 0 ms, index 460 ms: 11 candidates, 57429 repo-hours, 604 releases; waiting 529 ms; commit 0 ms)
2026-11-08T05:36:25Z [load_day 2024-04-13] 2024-04-13 hour 12: 256724 events in 0 files, snapshot none (task 5805 ms: download 2700 ms overlapping gunzip 690 ms, parse 3519 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 91563 repo-hours, 857 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:36:26Z [load_day 2024-04-13] 2024-04-13 hour 13: 197103 events in 0 files, snapshot none (task 5683 ms: download 2713 ms overlapping gunzip 717 ms, parse 3338 ms, sort 0 ms, write 0 ms, index 998 ms: 10 candidates, 82401 repo-hours, 795 releases; waiting 339 ms; commit 0 ms)
2026-11-08T05:36:31Z [load_day 2024-04-13] 2024-04-13 hour 14: 188894 events in 0 files, snapshot none (task 5327 ms: download 2585 ms overlapping gunzip 744 ms, parse 3243 ms, sort 0 ms, write 0 ms, index 519 ms: 17 candidates, 68185 repo-hours, 816 releases; waiting 559 ms; commit 0 ms)
2026-11-08T05:36:31Z [load_day 2024-04-13] 2024-04-13 hour 15: 193562 events in 0 files, snapshot none (task 5284 ms: download 2751 ms overlapping gunzip 710 ms, parse 3164 ms, sort 0 ms, write 0 ms, index 521 ms: 12 candidates, 74017 repo-hours, 1007 releases; waiting 625 ms; commit 0 ms)
2026-11-08T05:36:37Z [load_day 2024-04-13] 2024-04-13 hour 16: 191222 events in 0 files, snapshot none (task 5839 ms: download 3408 ms overlapping gunzip 849 ms, parse 3759 ms, sort 0 ms, write 0 ms, index 487 ms: 7 candidates, 69651 repo-hours, 829 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:36:37Z [load_day 2024-04-13] 2024-04-13 hour 17: 180482 events in 0 files, snapshot none (task 5300 ms: download 2765 ms overlapping gunzip 747 ms, parse 3268 ms, sort 0 ms, write 0 ms, index 438 ms: 8 candidates, 63328 repo-hours, 840 releases; waiting 533 ms; commit 0 ms)
2026-11-08T05:36:43Z [load_day 2024-04-13] 2024-04-13 hour 18: 190751 events in 0 files, snapshot none (task 5410 ms: download 2967 ms overlapping gunzip 760 ms, parse 3414 ms, sort 0 ms, write 0 ms, index 552 ms: 5 candidates, 70465 repo-hours, 836 releases; waiting 398 ms; commit 0 ms)
2026-11-08T05:36:43Z [load_day 2024-04-13] 2024-04-13 hour 19: 167525 events in 0 files, snapshot none (task 5088 ms: download 2858 ms overlapping gunzip 740 ms, parse 3243 ms, sort 0 ms, write 0 ms, index 380 ms: 4 candidates, 56430 repo-hours, 799 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:36:49Z [load_day 2024-04-13] 2024-04-13 hour 20: 166729 events in 0 files, snapshot none (task 5076 ms: download 2366 ms overlapping gunzip 727 ms, parse 3393 ms, sort 0 ms, write 0 ms, index 469 ms: 9 candidates, 56991 repo-hours, 646 releases; waiting 204 ms; commit 0 ms)
2026-11-08T05:36:49Z [load_day 2024-04-13] 2024-04-13 hour 21: 148836 events in 0 files, snapshot none (task 5011 ms: download 2328 ms overlapping gunzip 715 ms, parse 3094 ms, sort 0 ms, write 0 ms, index 342 ms: 7 candidates, 49551 repo-hours, 746 releases; waiting 560 ms; commit 0 ms)
2026-11-08T05:36:54Z [load_day 2024-04-13] 2024-04-13 hour 22: 134475 events in 0 files, snapshot none (task 4395 ms: download 1924 ms overlapping gunzip 620 ms, parse 2693 ms, sort 0 ms, write 0 ms, index 338 ms: 8 candidates, 44100 repo-hours, 707 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:36:54Z [load_day 2024-04-13] 2024-04-13 hour 23: 129793 events in 0 files, snapshot none (task 4687 ms: download 2238 ms overlapping gunzip 626 ms, parse 2873 ms, sort 0 ms, write 0 ms, index 397 ms: 5 candidates, 42794 repo-hours, 538 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:37:01Z [load_day 2024-04-13] 2024-04-13: repo_hour merged from 24 files to 1 (1495902 rows, 6895 ms)
2026-11-08T05:37:03Z [load_day 2024-04-13] 2024-04-13: index committed in 9362 ms (24 + 1 + 24 files)
2026-11-08T05:37:03Z [load_day 2024-04-13] 2024-04-13: 4125685 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:37:03Z [load_day 2024-04-13] attempt 1 succeeded