orcaLog in

Runs · run 2862

load_day 2024-08-19, attempt 1 succeeded

Host
73ccef5e07c2:165991
Started
2026-11-08T07:30:21Z
Ended
2026-11-08T07:32:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
728 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
196.0 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2862/load_day/2024-08-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:30:21Z [load_day 2024-08-19] attempt 1 started
2026-11-08T07:30:22Z [load_day 2024-08-19] 2024-08-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:30:29Z [load_day 2024-08-19] 2024-08-19 hour 0: 173927 events in 0 files, snapshot none (task 6904 ms: download 3899 ms overlapping gunzip 1090 ms, parse 4362 ms, sort 0 ms, write 0 ms, index 563 ms: 9 candidates, 83051 repo-hours, 1031 releases; waiting 506 ms; commit 0 ms)
2026-11-08T07:30:29Z [load_day 2024-08-19] 2024-08-19 hour 1: 192536 events in 0 files, snapshot none (task 6725 ms: download 3728 ms overlapping gunzip 1072 ms, parse 4141 ms, sort 0 ms, write 0 ms, index 937 ms: 8 candidates, 102824 repo-hours, 771 releases; waiting 230 ms; commit 0 ms)
2026-11-08T07:30:37Z [load_day 2024-08-19] 2024-08-19 hour 2: 161870 events in 0 files, snapshot none (task 6793 ms: download 4015 ms overlapping gunzip 1146 ms, parse 4312 ms, sort 0 ms, write 0 ms, index 546 ms: 8 candidates, 66592 repo-hours, 768 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:30:37Z [load_day 2024-08-19] 2024-08-19 hour 3: 186487 events in 0 files, snapshot none (task 7521 ms: download 4997 ms overlapping gunzip 1234 ms, parse 4928 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 74327 repo-hours, 4666 releases; waiting 518 ms; commit 0 ms)
2026-11-08T07:30:44Z [load_day 2024-08-19] 2024-08-19 hour 4: 164339 events in 0 files, snapshot none (task 7063 ms: download 4734 ms overlapping gunzip 1088 ms, parse 4384 ms, sort 0 ms, write 0 ms, index 520 ms: 14 candidates, 60653 repo-hours, 699 releases; waiting 767 ms; commit 0 ms)
2026-11-08T07:30:45Z [load_day 2024-08-19] 2024-08-19 hour 5: 170219 events in 0 files, snapshot none (task 6896 ms: download 4445 ms overlapping gunzip 1114 ms, parse 4371 ms, sort 0 ms, write 0 ms, index 584 ms: 4 candidates, 64796 repo-hours, 786 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:30:52Z [load_day 2024-08-19] 2024-08-19 hour 6: 204120 events in 0 files, snapshot none (task 7774 ms: download 4769 ms overlapping gunzip 1248 ms, parse 5014 ms, sort 0 ms, write 0 ms, index 663 ms: 8 candidates, 89014 repo-hours, 975 releases; waiting 521 ms; commit 0 ms)
2026-11-08T07:30:54Z [load_day 2024-08-19] 2024-08-19 hour 7: 208373 events in 0 files, snapshot none (task 8793 ms: download 6191 ms overlapping gunzip 1416 ms, parse 5861 ms, sort 0 ms, write 0 ms, index 716 ms: 10 candidates, 81332 repo-hours, 1044 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:31:02Z [load_day 2024-08-19] 2024-08-19 hour 8: 224653 events in 0 files, snapshot none (task 9474 ms: download 6714 ms overlapping gunzip 1617 ms, parse 6424 ms, sort 0 ms, write 0 ms, index 621 ms: 21 candidates, 88409 repo-hours, 1230 releases; waiting 528 ms; commit 0 ms)
2026-11-08T07:31:05Z [load_day 2024-08-19] 2024-08-19 hour 9: 236317 events in 0 files, snapshot none (task 10151 ms: download 7380 ms overlapping gunzip 1643 ms, parse 6760 ms, sort 0 ms, write 0 ms, index 953 ms: 14 candidates, 98237 repo-hours, 1322 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:31:15Z [load_day 2024-08-19] 2024-08-19 hour 10: 224574 events in 0 files, snapshot none (task 12172 ms: download 9571 ms overlapping gunzip 1615 ms, parse 6869 ms, sort 0 ms, write 0 ms, index 653 ms: 14 candidates, 90368 repo-hours, 1137 releases; waiting 2772 ms; commit 0 ms)
2026-11-08T07:31:15Z [load_day 2024-08-19] 2024-08-19 hour 11: 226451 events in 0 files, snapshot none (task 8683 ms: download 5886 ms overlapping gunzip 1439 ms, parse 5809 ms, sort 0 ms, write 0 ms, index 674 ms: 18 candidates, 88658 repo-hours, 1208 releases; waiting 455 ms; commit 0 ms)
2026-11-08T07:31:26Z [load_day 2024-08-19] 2024-08-19 hour 12: 276545 events in 0 files, snapshot none (task 10557 ms: download 7030 ms overlapping gunzip 1711 ms, parse 6864 ms, sort 0 ms, write 0 ms, index 1156 ms: 18 candidates, 135403 repo-hours, 1275 releases; waiting 498 ms; commit 0 ms)
2026-11-08T07:31:26Z [load_day 2024-08-19] 2024-08-19 hour 13: 255241 events in 0 files, snapshot none (task 10691 ms: download 7645 ms overlapping gunzip 1794 ms, parse 7608 ms, sort 0 ms, write 0 ms, index 760 ms: 7 candidates, 114213 repo-hours, 1239 releases; waiting 239 ms; commit 0 ms)
2026-11-08T07:31:35Z [load_day 2024-08-19] 2024-08-19 hour 14: 239311 events in 0 files, snapshot none (task 8497 ms: download 5968 ms overlapping gunzip 1401 ms, parse 5513 ms, sort 0 ms, write 0 ms, index 695 ms: 14 candidates, 99449 repo-hours, 1151 releases; waiting 540 ms; commit 0 ms)
2026-11-08T07:31:35Z [load_day 2024-08-19] 2024-08-19 hour 15: 241780 events in 0 files, snapshot none (task 8506 ms: download 6026 ms overlapping gunzip 1361 ms, parse 5611 ms, sort 0 ms, write 0 ms, index 710 ms: 18 candidates, 102825 repo-hours, 1271 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:31:45Z [load_day 2024-08-19] 2024-08-19 hour 16: 225548 events in 0 files, snapshot none (task 10016 ms: download 5224 ms overlapping gunzip 1293 ms, parse 5115 ms, sort 0 ms, write 0 ms, index 2923 ms: 28 candidates, 90696 repo-hours, 1294 releases; waiting 388 ms; commit 0 ms)
2026-11-08T07:31:46Z [load_day 2024-08-19] 2024-08-19 hour 17: 221067 events in 0 files, snapshot none (task 9973 ms: download 5048 ms overlapping gunzip 1207 ms, parse 4818 ms, sort 0 ms, write 0 ms, index 3202 ms: 24 candidates, 86881 repo-hours, 1098 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:32:00Z [load_day 2024-08-19] 2024-08-19 hour 18: 232829 events in 0 files, snapshot none (task 11027 ms: download 8030 ms overlapping gunzip 1871 ms, parse 7321 ms, sort 0 ms, write 0 ms, index 1073 ms: 15 candidates, 100499 repo-hours, 1162 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:32:00Z [load_day 2024-08-19] 2024-08-19 hour 19: 213716 events in 0 files, snapshot none (task 10005 ms: download 7474 ms overlapping gunzip 1635 ms, parse 6857 ms, sort 0 ms, write 0 ms, index 704 ms: 11 candidates, 80392 repo-hours, 1052 releases; waiting 533 ms; commit 0 ms)
2026-11-08T07:32:09Z [load_day 2024-08-19] 2024-08-19 hour 20: 206549 events in 0 files, snapshot none (task 8694 ms: download 5465 ms overlapping gunzip 1443 ms, parse 6024 ms, sort 0 ms, write 0 ms, index 759 ms: 14 candidates, 78819 repo-hours, 1107 releases; waiting 191 ms; commit 0 ms)
2026-11-08T07:32:09Z [load_day 2024-08-19] 2024-08-19 hour 21: 197874 events in 0 files, snapshot none (task 8773 ms: download 6082 ms overlapping gunzip 1427 ms, parse 5918 ms, sort 0 ms, write 0 ms, index 638 ms: 12 candidates, 75256 repo-hours, 1247 releases; waiting 508 ms; commit 0 ms)
2026-11-08T07:32:17Z [load_day 2024-08-19] 2024-08-19 hour 22: 181092 events in 0 files, snapshot none (task 7512 ms: download 4804 ms overlapping gunzip 1118 ms, parse 4917 ms, sort 0 ms, write 0 ms, index 686 ms: 12 candidates, 67481 repo-hours, 1116 releases; waiting 505 ms; commit 0 ms)
2026-11-08T07:32:17Z [load_day 2024-08-19] 2024-08-19 hour 23: 168807 events in 0 files, snapshot none (task 7372 ms: download 4863 ms overlapping gunzip 1223 ms, parse 4814 ms, sort 0 ms, write 0 ms, index 539 ms: 3 candidates, 62165 repo-hours, 832 releases; waiting 558 ms; commit 0 ms)
2026-11-08T07:32:26Z [load_day 2024-08-19] 2024-08-19: repo_hour merged from 24 files to 1 (2082340 rows, 8898 ms)
2026-11-08T07:32:29Z [load_day 2024-08-19] 2024-08-19: index committed in 11679 ms (24 + 1 + 24 files)
2026-11-08T07:32:29Z [load_day 2024-08-19] 2024-08-19: 5034225 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:32:29Z [load_day 2024-08-19] attempt 1 succeeded