orcaLog in

Runs · run 2279

load_day 2024-04-04, attempt 1 succeeded

Host
73ccef5e07c2:105399
Started
2026-11-08T05:26:32Z
Ended
2026-11-08T05:28:36Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
693 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2279/load_day/2024-04-04/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:26:32Z [load_day 2024-04-04] attempt 1 started
2026-11-08T05:26:33Z [load_day 2024-04-04] 2024-04-04: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:26:42Z [load_day 2024-04-04] 2024-04-04 hour 0: 255624 events in 0 files, snapshot none (task 8292 ms: download 5507 ms overlapping gunzip 1256 ms, parse 5688 ms, sort 0 ms, write 0 ms, index 778 ms: 11 candidates, 100133 repo-hours, 1091 releases; waiting 299 ms; commit 0 ms)
2026-11-08T05:26:42Z [load_day 2024-04-04] 2024-04-04 hour 1: 251947 events in 0 files, snapshot none (task 8063 ms: download 5448 ms overlapping gunzip 1170 ms, parse 5435 ms, sort 0 ms, write 0 ms, index 738 ms: 11 candidates, 102516 repo-hours, 783 releases; waiting 465 ms; commit 0 ms)
2026-11-08T05:26:50Z [load_day 2024-04-04] 2024-04-04 hour 2: 216115 events in 0 files, snapshot none (task 7284 ms: download 4504 ms overlapping gunzip 1138 ms, parse 4875 ms, sort 0 ms, write 0 ms, index 477 ms: 11 candidates, 64780 repo-hours, 756 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:26:50Z [load_day 2024-04-04] 2024-04-04 hour 3: 213569 events in 0 files, snapshot none (task 6929 ms: download 4259 ms overlapping gunzip 1017 ms, parse 4615 ms, sort 0 ms, write 0 ms, index 565 ms: 14 candidates, 61326 repo-hours, 972 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:26:58Z [load_day 2024-04-04] 2024-04-04 hour 4: 214832 events in 0 files, snapshot none (task 8070 ms: download 3848 ms overlapping gunzip 1228 ms, parse 5468 ms, sort 0 ms, write 0 ms, index 646 ms: 11 candidates, 61825 repo-hours, 749 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:26:59Z [load_day 2024-04-04] 2024-04-04 hour 5: 227624 events in 0 files, snapshot none (task 8720 ms: download 5203 ms overlapping gunzip 1503 ms, parse 5717 ms, sort 0 ms, write 0 ms, index 694 ms: 12 candidates, 67990 repo-hours, 779 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:27:07Z [load_day 2024-04-04] 2024-04-04 hour 6: 247629 events in 0 files, snapshot none (task 8418 ms: download 4927 ms overlapping gunzip 1344 ms, parse 5406 ms, sort 0 ms, write 0 ms, index 779 ms: 10 candidates, 80802 repo-hours, 874 releases; waiting 558 ms; commit 0 ms)
2026-11-08T05:27:09Z [load_day 2024-04-04] 2024-04-04 hour 7: 247513 events in 0 files, snapshot none (task 9052 ms: download 5969 ms overlapping gunzip 1427 ms, parse 5967 ms, sort 0 ms, write 0 ms, index 834 ms: 10 candidates, 78845 repo-hours, 917 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:27:16Z [load_day 2024-04-04] 2024-04-04 hour 8: 238383 events in 0 files, snapshot none (task 7954 ms: download 5037 ms overlapping gunzip 1226 ms, parse 5425 ms, sort 0 ms, write 0 ms, index 819 ms: 6 candidates, 80393 repo-hours, 1078 releases; waiting 202 ms; commit 0 ms)
2026-11-08T05:27:18Z [load_day 2024-04-04] 2024-04-04 hour 9: 268089 events in 0 files, snapshot none (task 8454 ms: download 5478 ms overlapping gunzip 1324 ms, parse 5569 ms, sort 0 ms, write 0 ms, index 692 ms: 11 candidates, 88033 repo-hours, 1262 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:27:26Z [load_day 2024-04-04] 2024-04-04 hour 10: 262810 events in 0 files, snapshot none (task 9556 ms: download 6751 ms overlapping gunzip 1443 ms, parse 6475 ms, sort 0 ms, write 0 ms, index 849 ms: 10 candidates, 87543 repo-hours, 1128 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:27:27Z [load_day 2024-04-04] 2024-04-04 hour 11: 263712 events in 0 files, snapshot none (task 8488 ms: download 5878 ms overlapping gunzip 1330 ms, parse 5686 ms, sort 0 ms, write 0 ms, index 715 ms: 10 candidates, 85068 repo-hours, 1100 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:27:36Z [load_day 2024-04-04] 2024-04-04 hour 12: 301866 events in 0 files, snapshot none (task 9733 ms: download 6763 ms overlapping gunzip 1510 ms, parse 6602 ms, sort 0 ms, write 0 ms, index 787 ms: 14 candidates, 116506 repo-hours, 1176 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:27:37Z [load_day 2024-04-04] 2024-04-04 hour 13: 290164 events in 0 files, snapshot none (task 10192 ms: download 7585 ms overlapping gunzip 1661 ms, parse 7019 ms, sort 0 ms, write 0 ms, index 787 ms: 11 candidates, 112513 repo-hours, 1190 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:27:47Z [load_day 2024-04-04] 2024-04-04 hour 14: 281824 events in 0 files, snapshot none (task 10920 ms: download 8097 ms overlapping gunzip 1821 ms, parse 7178 ms, sort 0 ms, write 0 ms, index 746 ms: 8 candidates, 104335 repo-hours, 1285 releases; waiting 843 ms; commit 0 ms)
2026-11-08T05:27:48Z [load_day 2024-04-04] 2024-04-04 hour 15: 274327 events in 0 files, snapshot none (task 10481 ms: download 7859 ms overlapping gunzip 1804 ms, parse 7163 ms, sort 0 ms, write 0 ms, index 735 ms: 12 candidates, 104788 repo-hours, 1419 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:27:58Z [load_day 2024-04-04] 2024-04-04 hour 16: 251627 events in 0 files, snapshot none (task 10391 ms: download 7768 ms overlapping gunzip 1677 ms, parse 7112 ms, sort 0 ms, write 0 ms, index 730 ms: 11 candidates, 97788 repo-hours, 1245 releases; waiting 550 ms; commit 0 ms)
2026-11-08T05:27:59Z [load_day 2024-04-04] 2024-04-04 hour 17: 256769 events in 0 files, snapshot none (task 10261 ms: download 7607 ms overlapping gunzip 1655 ms, parse 7071 ms, sort 0 ms, write 0 ms, index 721 ms: 11 candidates, 94669 repo-hours, 1117 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:28:08Z [load_day 2024-04-04] 2024-04-04 hour 18: 273938 events in 0 files, snapshot none (task 9568 ms: download 6602 ms overlapping gunzip 1462 ms, parse 6200 ms, sort 0 ms, write 0 ms, index 662 ms: 17 candidates, 96024 repo-hours, 1226 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:28:08Z [load_day 2024-04-04] 2024-04-04 hour 19: 264320 events in 0 files, snapshot none (task 9040 ms: download 6717 ms overlapping gunzip 1560 ms, parse 6392 ms, sort 0 ms, write 0 ms, index 648 ms: 6 candidates, 90708 repo-hours, 1018 releases; waiting 195 ms; commit 0 ms)
2026-11-08T05:28:16Z [load_day 2024-04-04] 2024-04-04 hour 20: 261145 events in 0 files, snapshot none (task 7679 ms: download 5111 ms overlapping gunzip 1182 ms, parse 4898 ms, sort 0 ms, write 0 ms, index 672 ms: 11 candidates, 84650 repo-hours, 956 releases; waiting 638 ms; commit 0 ms)
2026-11-08T05:28:16Z [load_day 2024-04-04] 2024-04-04 hour 21: 240636 events in 0 files, snapshot none (task 7032 ms: download 4622 ms overlapping gunzip 1105 ms, parse 4496 ms, sort 0 ms, write 0 ms, index 598 ms: 9 candidates, 73112 repo-hours, 1120 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:28:24Z [load_day 2024-04-04] 2024-04-04 hour 22: 220792 events in 0 files, snapshot none (task 6597 ms: download 4117 ms overlapping gunzip 1038 ms, parse 4241 ms, sort 0 ms, write 0 ms, index 487 ms: 5 candidates, 64134 repo-hours, 1041 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:28:24Z [load_day 2024-04-04] 2024-04-04 hour 23: 211773 events in 0 files, snapshot none (task 5649 ms: download 3440 ms overlapping gunzip 820 ms, parse 3480 ms, sort 0 ms, write 0 ms, index 437 ms: 4 candidates, 61515 repo-hours, 797 releases; waiting 560 ms; commit 0 ms)
2026-11-08T05:28:33Z [load_day 2024-04-04] 2024-04-04: repo_hour merged from 24 files to 1 (2059996 rows, 9111 ms)
2026-11-08T05:28:36Z [load_day 2024-04-04] 2024-04-04: index committed in 12927 ms (24 + 1 + 24 files)
2026-11-08T05:28:36Z [load_day 2024-04-04] 2024-04-04: 6037028 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:28:36Z [load_day 2024-04-04] attempt 1 succeeded