orcaLog in

Runs · run 2002

load_day 2024-01-24, attempt 1 succeeded

Host
73ccef5e07c2:67611
Started
2026-11-08T04:18:34Z
Ended
2026-11-08T04:20:39Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
697 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
176.5 s, up to 2.7 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2002/load_day/2024-01-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:18:34Z [load_day 2024-01-24] attempt 1 started
2026-11-08T04:18:35Z [load_day 2024-01-24] 2024-01-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:18:45Z [load_day 2024-01-24] 2024-01-24 hour 0: 218400 events in 0 files, snapshot none (task 8620 ms: download 5331 ms overlapping gunzip 1272 ms, parse 5586 ms, sort 0 ms, write 0 ms, index 882 ms: 10 candidates, 84014 repo-hours, 926 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:18:45Z [load_day 2024-01-24] 2024-01-24 hour 1: 221437 events in 0 files, snapshot none (task 7974 ms: download 4675 ms overlapping gunzip 1222 ms, parse 5122 ms, sort 0 ms, write 0 ms, index 842 ms: 13 candidates, 94576 repo-hours, 861 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:18:52Z [load_day 2024-01-24] 2024-01-24 hour 2: 194002 events in 0 files, snapshot none (task 6658 ms: download 3859 ms overlapping gunzip 1022 ms, parse 4307 ms, sort 0 ms, write 0 ms, index 465 ms: 7 candidates, 63598 repo-hours, 759 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:18:52Z [load_day 2024-01-24] 2024-01-24 hour 3: 191121 events in 0 files, snapshot none (task 6349 ms: download 3577 ms overlapping gunzip 1050 ms, parse 4290 ms, sort 0 ms, write 0 ms, index 440 ms: 10 candidates, 61585 repo-hours, 823 releases; waiting 176 ms; commit 0 ms)
2026-11-08T04:18:58Z [load_day 2024-01-24] 2024-01-24 hour 4: 187763 events in 0 files, snapshot none (task 5334 ms: download 2752 ms overlapping gunzip 759 ms, parse 3380 ms, sort 0 ms, write 0 ms, index 408 ms: 12 candidates, 56548 repo-hours, 635 releases; waiting 520 ms; commit 0 ms)
2026-11-08T04:18:58Z [load_day 2024-01-24] 2024-01-24 hour 5: 197061 events in 0 files, snapshot none (task 5801 ms: download 3413 ms overlapping gunzip 904 ms, parse 3595 ms, sort 0 ms, write 0 ms, index 449 ms: 8 candidates, 61445 repo-hours, 631 releases; waiting 561 ms; commit 0 ms)
2026-11-08T04:19:04Z [load_day 2024-01-24] 2024-01-24 hour 6: 217637 events in 0 files, snapshot none (task 5951 ms: download 3386 ms overlapping gunzip 838 ms, parse 3694 ms, sort 0 ms, write 0 ms, index 604 ms: 6 candidates, 76415 repo-hours, 761 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:19:05Z [load_day 2024-01-24] 2024-01-24 hour 7: 219075 events in 0 files, snapshot none (task 6407 ms: download 3722 ms overlapping gunzip 945 ms, parse 4042 ms, sort 0 ms, write 0 ms, index 614 ms: 9 candidates, 74954 repo-hours, 869 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:19:15Z [load_day 2024-01-24] 2024-01-24 hour 8: 225351 events in 0 files, snapshot none (task 10296 ms: download 6653 ms overlapping gunzip 1624 ms, parse 6838 ms, sort 0 ms, write 0 ms, index 893 ms: 6 candidates, 82661 repo-hours, 1057 releases; waiting 568 ms; commit 0 ms)
2026-11-08T04:19:17Z [load_day 2024-01-24] 2024-01-24 hour 9: 236360 events in 0 files, snapshot none (task 10743 ms: download 7549 ms overlapping gunzip 1636 ms, parse 7084 ms, sort 0 ms, write 0 ms, index 1207 ms: 9 candidates, 87714 repo-hours, 1209 releases; waiting 532 ms; commit 0 ms)
2026-11-08T04:19:26Z [load_day 2024-01-24] 2024-01-24 hour 10: 239757 events in 0 files, snapshot none (task 10241 ms: download 6543 ms overlapping gunzip 1726 ms, parse 7041 ms, sort 0 ms, write 0 ms, index 745 ms: 6 candidates, 86057 repo-hours, 1268 releases; waiting 443 ms; commit 0 ms)
2026-11-08T04:19:26Z [load_day 2024-01-24] 2024-01-24 hour 11: 209914 events in 0 files, snapshot none (task 8912 ms: download 5668 ms overlapping gunzip 1447 ms, parse 5903 ms, sort 0 ms, write 0 ms, index 771 ms: 9 candidates, 83634 repo-hours, 962 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:19:37Z [load_day 2024-01-24] 2024-01-24 hour 12: 277005 events in 0 files, snapshot none (task 9803 ms: download 6649 ms overlapping gunzip 1456 ms, parse 6661 ms, sort 0 ms, write 0 ms, index 841 ms: 12 candidates, 114947 repo-hours, 1152 releases; waiting 549 ms; commit 0 ms)
2026-11-08T04:19:37Z [load_day 2024-01-24] 2024-01-24 hour 13: 264652 events in 0 files, snapshot none (task 10392 ms: download 7428 ms overlapping gunzip 1599 ms, parse 7191 ms, sort 0 ms, write 0 ms, index 796 ms: 10 candidates, 109273 repo-hours, 1092 releases; waiting 538 ms; commit 0 ms)
2026-11-08T04:19:47Z [load_day 2024-01-24] 2024-01-24 hour 14: 238715 events in 0 files, snapshot none (task 9936 ms: download 6908 ms overlapping gunzip 1548 ms, parse 6490 ms, sort 0 ms, write 0 ms, index 1042 ms: 10 candidates, 99375 repo-hours, 1223 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:19:48Z [load_day 2024-01-24] 2024-01-24 hour 15: 224539 events in 0 files, snapshot none (task 10328 ms: download 7283 ms overlapping gunzip 1659 ms, parse 7008 ms, sort 0 ms, write 0 ms, index 829 ms: 7 candidates, 101438 repo-hours, 1437 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:19:58Z [load_day 2024-01-24] 2024-01-24 hour 16: 220954 events in 0 files, snapshot none (task 10237 ms: download 7189 ms overlapping gunzip 1617 ms, parse 6892 ms, sort 0 ms, write 0 ms, index 901 ms: 10 candidates, 98863 repo-hours, 1274 releases; waiting 536 ms; commit 0 ms)
2026-11-08T04:19:58Z [load_day 2024-01-24] 2024-01-24 hour 17: 226788 events in 0 files, snapshot none (task 9171 ms: download 6348 ms overlapping gunzip 1443 ms, parse 6419 ms, sort 0 ms, write 0 ms, index 782 ms: 12 candidates, 90967 repo-hours, 1191 releases; waiting 323 ms; commit 0 ms)
2026-11-08T04:20:07Z [load_day 2024-01-24] 2024-01-24 hour 18: 229520 events in 0 files, snapshot none (task 8598 ms: download 5854 ms overlapping gunzip 1409 ms, parse 5898 ms, sort 0 ms, write 0 ms, index 760 ms: 6 candidates, 92875 repo-hours, 1145 releases; waiting 220 ms; commit 0 ms)
2026-11-08T04:20:08Z [load_day 2024-01-24] 2024-01-24 hour 19: 219636 events in 0 files, snapshot none (task 9285 ms: download 6261 ms overlapping gunzip 1504 ms, parse 5980 ms, sort 0 ms, write 0 ms, index 954 ms: 8 candidates, 80687 repo-hours, 973 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:20:17Z [load_day 2024-01-24] 2024-01-24 hour 20: 206826 events in 0 files, snapshot none (task 9133 ms: download 6149 ms overlapping gunzip 1512 ms, parse 6195 ms, sort 0 ms, write 0 ms, index 630 ms: 8 candidates, 77274 repo-hours, 877 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:20:18Z [load_day 2024-01-24] 2024-01-24 hour 21: 201115 events in 0 files, snapshot none (task 9064 ms: download 6331 ms overlapping gunzip 1538 ms, parse 6144 ms, sort 0 ms, write 0 ms, index 584 ms: 12 candidates, 72507 repo-hours, 1078 releases; waiting 443 ms; commit 0 ms)
2026-11-08T04:20:26Z [load_day 2024-01-24] 2024-01-24 hour 22: 190732 events in 0 files, snapshot none (task 8724 ms: download 5433 ms overlapping gunzip 1395 ms, parse 5691 ms, sort 0 ms, write 0 ms, index 721 ms: 6 candidates, 66553 repo-hours, 986 releases; waiting 574 ms; commit 0 ms)
2026-11-08T04:20:26Z [load_day 2024-01-24] 2024-01-24 hour 23: 175110 events in 0 files, snapshot none (task 7237 ms: download 4647 ms overlapping gunzip 1157 ms, parse 4755 ms, sort 0 ms, write 0 ms, index 494 ms: 2 candidates, 58980 repo-hours, 725 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:20:36Z [load_day 2024-01-24] 2024-01-24: repo_hour merged from 24 files to 1 (1976940 rows, 9829 ms)
2026-11-08T04:20:39Z [load_day 2024-01-24] 2024-01-24: index committed in 12663 ms (24 + 1 + 24 files)
2026-11-08T04:20:39Z [load_day 2024-01-24] 2024-01-24: 5233470 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:20:39Z [load_day 2024-01-24] attempt 1 succeeded