orcaLog in

Runs · run 3421

load_day 2025-01-11, attempt 1 succeeded

Host
73ccef5e07c2:235901
Started
2026-11-08T09:45:57Z
Ended
2026-11-08T09:47:35Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
670 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
137.7 s, up to 3.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3421/load_day/2025-01-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:45:57Z [load_day 2025-01-11] attempt 1 started
2026-11-08T09:45:58Z [load_day 2025-01-11] 2025-01-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:46:07Z [load_day 2025-01-11] 2025-01-11 hour 0: 200015 events in 0 files, snapshot none (task 7705 ms: download 4449 ms overlapping gunzip 1184 ms, parse 5140 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 80344 repo-hours, 1160 releases; waiting 476 ms; commit 0 ms)
2026-11-08T09:46:07Z [load_day 2025-01-11] 2025-01-11 hour 1: 180367 events in 0 files, snapshot none (task 6971 ms: download 3808 ms overlapping gunzip 1021 ms, parse 4319 ms, sort 0 ms, write 0 ms, index 904 ms: 11 candidates, 99438 repo-hours, 886 releases; waiting 481 ms; commit 0 ms)
2026-11-08T09:46:14Z [load_day 2025-01-11] 2025-01-11 hour 2: 147871 events in 0 files, snapshot none (task 7254 ms: download 3444 ms overlapping gunzip 1138 ms, parse 4599 ms, sort 0 ms, write 0 ms, index 693 ms: 1 candidates, 64545 repo-hours, 846 releases; waiting 512 ms; commit 0 ms)
2026-11-08T09:46:14Z [load_day 2025-01-11] 2025-01-11 hour 3: 171388 events in 0 files, snapshot none (task 7180 ms: download 3215 ms overlapping gunzip 1027 ms, parse 4712 ms, sort 0 ms, write 0 ms, index 674 ms: 6 candidates, 62299 repo-hours, 3955 releases; waiting 523 ms; commit 0 ms)
2026-11-08T09:46:21Z [load_day 2025-01-11] 2025-01-11 hour 4: 198319 events in 0 files, snapshot none (task 6017 ms: download 3277 ms overlapping gunzip 891 ms, parse 3991 ms, sort 0 ms, write 0 ms, index 375 ms: 2 candidates, 51988 repo-hours, 596 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:46:21Z [load_day 2025-01-11] 2025-01-11 hour 5: 205694 events in 0 files, snapshot none (task 6064 ms: download 3390 ms overlapping gunzip 913 ms, parse 4192 ms, sort 0 ms, write 0 ms, index 414 ms: 1 candidates, 55025 repo-hours, 747 releases; waiting 269 ms; commit 0 ms)
2026-11-08T09:46:29Z [load_day 2025-01-11] 2025-01-11 hour 6: 253295 events in 0 files, snapshot none (task 7261 ms: download 3898 ms overlapping gunzip 1024 ms, parse 4851 ms, sort 0 ms, write 0 ms, index 631 ms: 4 candidates, 71577 repo-hours, 996 releases; waiting 465 ms; commit 0 ms)
2026-11-08T09:46:29Z [load_day 2025-01-11] 2025-01-11 hour 7: 247675 events in 0 files, snapshot none (task 7184 ms: download 3854 ms overlapping gunzip 1052 ms, parse 4925 ms, sort 0 ms, write 0 ms, index 447 ms: 2 candidates, 55783 repo-hours, 865 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:46:36Z [load_day 2025-01-11] 2025-01-11 hour 8: 250427 events in 0 files, snapshot none (task 7138 ms: download 2814 ms overlapping gunzip 1034 ms, parse 4734 ms, sort 0 ms, write 0 ms, index 576 ms: 3 candidates, 61618 repo-hours, 782 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:46:36Z [load_day 2025-01-11] 2025-01-11 hour 9: 260549 events in 0 files, snapshot none (task 6686 ms: download 3315 ms overlapping gunzip 944 ms, parse 4078 ms, sort 0 ms, write 0 ms, index 864 ms: 0 candidates, 68295 repo-hours, 1080 releases; waiting 513 ms; commit 0 ms)
2026-11-08T09:46:43Z [load_day 2025-01-11] 2025-01-11 hour 10: 265076 events in 0 files, snapshot none (task 6574 ms: download 3609 ms overlapping gunzip 856 ms, parse 3938 ms, sort 0 ms, write 0 ms, index 1057 ms: 4 candidates, 66214 repo-hours, 851 releases; waiting 504 ms; commit 0 ms)
2026-11-08T09:46:43Z [load_day 2025-01-11] 2025-01-11 hour 11: 267770 events in 0 files, snapshot none (task 6508 ms: download 3452 ms overlapping gunzip 881 ms, parse 4041 ms, sort 0 ms, write 0 ms, index 597 ms: 4 candidates, 62013 repo-hours, 705 releases; waiting 473 ms; commit 0 ms)
2026-11-08T09:46:51Z [load_day 2025-01-11] 2025-01-11 hour 12: 298754 events in 0 files, snapshot none (task 7174 ms: download 4409 ms overlapping gunzip 952 ms, parse 4773 ms, sort 0 ms, write 0 ms, index 698 ms: 8 candidates, 108159 repo-hours, 864 releases; waiting 528 ms; commit 0 ms)
2026-11-08T09:46:51Z [load_day 2025-01-11] 2025-01-11 hour 13: 287545 events in 0 files, snapshot none (task 6816 ms: download 4226 ms overlapping gunzip 903 ms, parse 4551 ms, sort 0 ms, write 0 ms, index 623 ms: 6 candidates, 88478 repo-hours, 788 releases; waiting 468 ms; commit 0 ms)
2026-11-08T09:46:59Z [load_day 2025-01-11] 2025-01-11 hour 14: 277575 events in 0 files, snapshot none (task 7247 ms: download 4580 ms overlapping gunzip 1035 ms, parse 4785 ms, sort 0 ms, write 0 ms, index 613 ms: 6 candidates, 72742 repo-hours, 913 releases; waiting 486 ms; commit 0 ms)
2026-11-08T09:46:59Z [load_day 2025-01-11] 2025-01-11 hour 15: 287287 events in 0 files, snapshot none (task 7366 ms: download 4760 ms overlapping gunzip 1048 ms, parse 4972 ms, sort 0 ms, write 0 ms, index 578 ms: 7 candidates, 81149 repo-hours, 981 releases; waiting 498 ms; commit 0 ms)
2026-11-08T09:47:05Z [load_day 2025-01-11] 2025-01-11 hour 16: 282206 events in 0 files, snapshot none (task 5666 ms: download 3142 ms overlapping gunzip 822 ms, parse 3761 ms, sort 0 ms, write 0 ms, index 540 ms: 7 candidates, 75149 repo-hours, 840 releases; waiting 270 ms; commit 0 ms)
2026-11-08T09:47:05Z [load_day 2025-01-11] 2025-01-11 hour 17: 278297 events in 0 files, snapshot none (task 5794 ms: download 3266 ms overlapping gunzip 797 ms, parse 3702 ms, sort 0 ms, write 0 ms, index 530 ms: 2 candidates, 70810 repo-hours, 853 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:47:11Z [load_day 2025-01-11] 2025-01-11 hour 18: 289319 events in 0 files, snapshot none (task 5594 ms: download 3063 ms overlapping gunzip 749 ms, parse 3463 ms, sort 0 ms, write 0 ms, index 597 ms: 7 candidates, 83798 repo-hours, 961 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:47:11Z [load_day 2025-01-11] 2025-01-11 hour 19: 263179 events in 0 files, snapshot none (task 4993 ms: download 2560 ms overlapping gunzip 686 ms, parse 3127 ms, sort 0 ms, write 0 ms, index 483 ms: 4 candidates, 60485 repo-hours, 824 releases; waiting 484 ms; commit 0 ms)
2026-11-08T09:47:18Z [load_day 2025-01-11] 2025-01-11 hour 20: 264213 events in 0 files, snapshot none (task 6776 ms: download 4191 ms overlapping gunzip 1039 ms, parse 4522 ms, sort 0 ms, write 0 ms, index 511 ms: 3 candidates, 61618 repo-hours, 680 releases; waiting 479 ms; commit 0 ms)
2026-11-08T09:47:18Z [load_day 2025-01-11] 2025-01-11 hour 21: 259473 events in 0 files, snapshot none (task 6970 ms: download 4203 ms overlapping gunzip 1008 ms, parse 4742 ms, sort 0 ms, write 0 ms, index 491 ms: 4 candidates, 63444 repo-hours, 923 releases; waiting 310 ms; commit 0 ms)
2026-11-08T09:47:24Z [load_day 2025-01-11] 2025-01-11 hour 22: 160891 events in 0 files, snapshot none (task 5608 ms: download 2895 ms overlapping gunzip 851 ms, parse 3494 ms, sort 0 ms, write 0 ms, index 447 ms: 4 candidates, 54558 repo-hours, 1040 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:47:24Z [load_day 2025-01-11] 2025-01-11 hour 23: 165712 events in 0 files, snapshot none (task 5262 ms: download 2652 ms overlapping gunzip 729 ms, parse 3307 ms, sort 0 ms, write 0 ms, index 370 ms: 7 candidates, 51708 repo-hours, 870 releases; waiting 527 ms; commit 0 ms)
2026-11-08T09:47:32Z [load_day 2025-01-11] 2025-01-11: repo_hour merged from 24 files to 1 (1671237 rows, 7682 ms)
2026-11-08T09:47:35Z [load_day 2025-01-11] 2025-01-11: index committed in 10535 ms (23 + 1 + 24 files)
2026-11-08T09:47:35Z [load_day 2025-01-11] 2025-01-11: 5762897 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:47:35Z [load_day 2025-01-11] attempt 1 succeeded