orcaLog in

Runs · run 2705

load_day 2024-07-11, attempt 1 succeeded

Host
73ccef5e07c2:148519
Started
2026-11-08T06:56:30Z
Ended
2026-11-08T06:58:22Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
761 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
180.2 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2705/load_day/2024-07-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:56:30Z [load_day 2024-07-11] attempt 1 started
2026-11-08T06:56:31Z [load_day 2024-07-11] 2024-07-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:56:38Z [load_day 2024-07-11] 2024-07-11 hour 0: 181253 events in 0 files, snapshot none (task 6691 ms: download 3778 ms overlapping gunzip 1035 ms, parse 4542 ms, sort 0 ms, write 0 ms, index 626 ms: 4 candidates, 93366 repo-hours, 1084 releases; waiting 243 ms; commit 0 ms)
2026-11-08T06:56:39Z [load_day 2024-07-11] 2024-07-11 hour 1: 196919 events in 0 files, snapshot none (task 6965 ms: download 4224 ms overlapping gunzip 1038 ms, parse 4388 ms, sort 0 ms, write 0 ms, index 736 ms: 8 candidates, 107978 repo-hours, 835 releases; waiting 478 ms; commit 0 ms)
2026-11-08T06:56:45Z [load_day 2024-07-11] 2024-07-11 hour 2: 162544 events in 0 files, snapshot none (task 6603 ms: download 3460 ms overlapping gunzip 973 ms, parse 4159 ms, sort 0 ms, write 0 ms, index 649 ms: 9 candidates, 68750 repo-hours, 870 releases; waiting 439 ms; commit 0 ms)
2026-11-08T06:56:46Z [load_day 2024-07-11] 2024-07-11 hour 3: 184461 events in 0 files, snapshot none (task 7291 ms: download 4636 ms overlapping gunzip 1120 ms, parse 4800 ms, sort 0 ms, write 0 ms, index 603 ms: 6 candidates, 78693 repo-hours, 5481 releases; waiting 487 ms; commit 0 ms)
2026-11-08T06:56:52Z [load_day 2024-07-11] 2024-07-11 hour 4: 156370 events in 0 files, snapshot none (task 5652 ms: download 2554 ms overlapping gunzip 722 ms, parse 3179 ms, sort 0 ms, write 0 ms, index 735 ms: 7 candidates, 66471 repo-hours, 592 releases; waiting 317 ms; commit 0 ms)
2026-11-08T06:56:54Z [load_day 2024-07-11] 2024-07-11 hour 5: 176493 events in 0 files, snapshot none (task 7448 ms: download 4095 ms overlapping gunzip 1104 ms, parse 4393 ms, sort 0 ms, write 0 ms, index 1167 ms: 8 candidates, 73576 repo-hours, 756 releases; waiting 497 ms; commit 0 ms)
2026-11-08T06:57:00Z [load_day 2024-07-11] 2024-07-11 hour 6: 203771 events in 0 files, snapshot none (task 7596 ms: download 4542 ms overlapping gunzip 1100 ms, parse 4618 ms, sort 0 ms, write 0 ms, index 991 ms: 16 candidates, 94916 repo-hours, 962 releases; waiting 515 ms; commit 0 ms)
2026-11-08T06:57:04Z [load_day 2024-07-11] 2024-07-11 hour 7: 210052 events in 0 files, snapshot none (task 8869 ms: download 5512 ms overlapping gunzip 1402 ms, parse 5786 ms, sort 0 ms, write 0 ms, index 851 ms: 13 candidates, 91727 repo-hours, 1029 releases; waiting 507 ms; commit 0 ms)
2026-11-08T06:57:11Z [load_day 2024-07-11] 2024-07-11 hour 8: 226712 events in 0 files, snapshot none (task 10413 ms: download 6260 ms overlapping gunzip 1659 ms, parse 6407 ms, sort 0 ms, write 0 ms, index 937 ms: 14 candidates, 97928 repo-hours, 1350 releases; waiting 546 ms; commit 0 ms)
2026-11-08T06:57:13Z [load_day 2024-07-11] 2024-07-11 hour 9: 228431 events in 0 files, snapshot none (task 8603 ms: download 5919 ms overlapping gunzip 1345 ms, parse 5730 ms, sort 0 ms, write 0 ms, index 771 ms: 15 candidates, 100029 repo-hours, 1394 releases; waiting 524 ms; commit 0 ms)
2026-11-08T06:57:18Z [load_day 2024-07-11] 2024-07-11 hour 10: 213309 events in 0 files, snapshot none (task 6998 ms: download 4369 ms overlapping gunzip 1074 ms, parse 4391 ms, sort 0 ms, write 0 ms, index 673 ms: 9 candidates, 88096 repo-hours, 1289 releases; waiting 528 ms; commit 0 ms)
2026-11-08T06:57:20Z [load_day 2024-07-11] 2024-07-11 hour 11: 214450 events in 0 files, snapshot none (task 6911 ms: download 4344 ms overlapping gunzip 1039 ms, parse 4369 ms, sort 0 ms, write 0 ms, index 718 ms: 14 candidates, 87242 repo-hours, 1254 releases; waiting 531 ms; commit 0 ms)
2026-11-08T06:57:26Z [load_day 2024-07-11] 2024-07-11 hour 12: 265612 events in 0 files, snapshot none (task 7402 ms: download 4475 ms overlapping gunzip 1061 ms, parse 4639 ms, sort 0 ms, write 0 ms, index 929 ms: 15 candidates, 135820 repo-hours, 1363 releases; waiting 510 ms; commit 0 ms)
2026-11-08T06:57:28Z [load_day 2024-07-11] 2024-07-11 hour 13: 244453 events in 0 files, snapshot none (task 7748 ms: download 4806 ms overlapping gunzip 1141 ms, parse 4757 ms, sort 0 ms, write 0 ms, index 892 ms: 20 candidates, 113995 repo-hours, 1343 releases; waiting 517 ms; commit 0 ms)
2026-11-08T06:57:36Z [load_day 2024-07-11] 2024-07-11 hour 14: 243645 events in 0 files, snapshot none (task 9463 ms: download 7061 ms overlapping gunzip 1548 ms, parse 6609 ms, sort 0 ms, write 0 ms, index 664 ms: 9 candidates, 101669 repo-hours, 1513 releases; waiting 437 ms; commit 0 ms)
2026-11-08T06:57:38Z [load_day 2024-07-11] 2024-07-11 hour 15: 246777 events in 0 files, snapshot none (task 9468 ms: download 6044 ms overlapping gunzip 1391 ms, parse 5997 ms, sort 0 ms, write 0 ms, index 1364 ms: 13 candidates, 111426 repo-hours, 1308 releases; waiting 464 ms; commit 0 ms)
2026-11-08T06:57:46Z [load_day 2024-07-11] 2024-07-11 hour 16: 227272 events in 0 files, snapshot none (task 9453 ms: download 5772 ms overlapping gunzip 1477 ms, parse 6277 ms, sort 0 ms, write 0 ms, index 953 ms: 8 candidates, 99830 repo-hours, 1093 releases; waiting 485 ms; commit 0 ms)
2026-11-08T06:57:47Z [load_day 2024-07-11] 2024-07-11 hour 17: 221408 events in 0 files, snapshot none (task 8113 ms: download 5406 ms overlapping gunzip 1261 ms, parse 5268 ms, sort 0 ms, write 0 ms, index 707 ms: 18 candidates, 100088 repo-hours, 1152 releases; waiting 609 ms; commit 0 ms)
2026-11-08T06:57:55Z [load_day 2024-07-11] 2024-07-11 hour 18: 222317 events in 0 files, snapshot none (task 8582 ms: download 5390 ms overlapping gunzip 1279 ms, parse 5523 ms, sort 0 ms, write 0 ms, index 916 ms: 12 candidates, 100104 repo-hours, 1192 releases; waiting 530 ms; commit 0 ms)
2026-11-08T06:57:55Z [load_day 2024-07-11] 2024-07-11 hour 19: 197835 events in 0 files, snapshot none (task 8043 ms: download 5139 ms overlapping gunzip 1355 ms, parse 5620 ms, sort 0 ms, write 0 ms, index 547 ms: 14 candidates, 78115 repo-hours, 1003 releases; waiting 263 ms; commit 0 ms)
2026-11-08T06:58:03Z [load_day 2024-07-11] 2024-07-11 hour 20: 194958 events in 0 files, snapshot none (task 7935 ms: download 4972 ms overlapping gunzip 1150 ms, parse 5122 ms, sort 0 ms, write 0 ms, index 821 ms: 20 candidates, 78471 repo-hours, 896 releases; waiting 620 ms; commit 0 ms)
2026-11-08T06:58:03Z [load_day 2024-07-11] 2024-07-11 hour 21: 180558 events in 0 files, snapshot none (task 7560 ms: download 4611 ms overlapping gunzip 1182 ms, parse 4849 ms, sort 0 ms, write 0 ms, index 745 ms: 13 candidates, 75725 repo-hours, 1100 releases; waiting 513 ms; commit 0 ms)
2026-11-08T06:58:10Z [load_day 2024-07-11] 2024-07-11 hour 22: 157369 events in 0 files, snapshot none (task 6466 ms: download 3544 ms overlapping gunzip 999 ms, parse 4104 ms, sort 0 ms, write 0 ms, index 608 ms: 15 candidates, 59774 repo-hours, 1064 releases; waiting 505 ms; commit 0 ms)
2026-11-08T06:58:10Z [load_day 2024-07-11] 2024-07-11 hour 23: 144804 events in 0 files, snapshot none (task 5206 ms: download 2733 ms overlapping gunzip 763 ms, parse 3162 ms, sort 0 ms, write 0 ms, index 526 ms: 6 candidates, 55151 repo-hours, 817 releases; waiting 498 ms; commit 0 ms)
2026-11-08T06:58:20Z [load_day 2024-07-11] 2024-07-11: repo_hour merged from 24 files to 1 (2158940 rows, 9202 ms)
2026-11-08T06:58:22Z [load_day 2024-07-11] 2024-07-11: index committed in 11616 ms (24 + 1 + 24 files)
2026-11-08T06:58:22Z [load_day 2024-07-11] 2024-07-11: 4901773 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:58:22Z [load_day 2024-07-11] attempt 1 succeeded