orcaLog in

Runs · run 1937

load_day 2024-01-05, attempt 1 succeeded

Host
73ccef5e07c2:16098
Started
2026-11-08T04:01:12Z
Ended
2026-11-08T04:02:49Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
156.4 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1937/load_day/2024-01-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:01:12Z [load_day 2024-01-05] attempt 1 started
2026-11-08T04:01:13Z [load_day 2024-01-05] 2024-01-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:01:20Z [load_day 2024-01-05] 2024-01-05 hour 0: 194442 events in 0 files, snapshot none (task 6217 ms: download 2949 ms overlapping gunzip 846 ms, parse 3632 ms, sort 0 ms, write 0 ms, index 1129 ms: 7 candidates, 81656 repo-hours, 1018 releases; waiting 300 ms; commit 0 ms)
2026-11-08T04:01:21Z [load_day 2024-01-05] 2024-01-05 hour 1: 202637 events in 0 files, snapshot none (task 7206 ms: download 3598 ms overlapping gunzip 1018 ms, parse 4442 ms, sort 0 ms, write 0 ms, index 924 ms: 3 candidates, 91526 repo-hours, 952 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:01:26Z [load_day 2024-01-05] 2024-01-05 hour 2: 172591 events in 0 files, snapshot none (task 5853 ms: download 3037 ms overlapping gunzip 872 ms, parse 3687 ms, sort 0 ms, write 0 ms, index 488 ms: 5 candidates, 59674 repo-hours, 675 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:01:27Z [load_day 2024-01-05] 2024-01-05 hour 3: 167114 events in 0 files, snapshot none (task 5269 ms: download 2853 ms overlapping gunzip 765 ms, parse 3256 ms, sort 0 ms, write 0 ms, index 474 ms: 5 candidates, 55526 repo-hours, 818 releases; waiting 447 ms; commit 0 ms)
2026-11-08T04:01:33Z [load_day 2024-01-05] 2024-01-05 hour 4: 168315 events in 0 files, snapshot none (task 5644 ms: download 3329 ms overlapping gunzip 847 ms, parse 3621 ms, sort 0 ms, write 0 ms, index 415 ms: 3 candidates, 52520 repo-hours, 743 releases; waiting 486 ms; commit 0 ms)
2026-11-08T04:01:34Z [load_day 2024-01-05] 2024-01-05 hour 5: 182546 events in 0 files, snapshot none (task 6483 ms: download 3962 ms overlapping gunzip 1032 ms, parse 4207 ms, sort 0 ms, write 0 ms, index 397 ms: 4 candidates, 58661 repo-hours, 618 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:01:39Z [load_day 2024-01-05] 2024-01-05 hour 6: 195307 events in 0 files, snapshot none (task 5877 ms: download 2552 ms overlapping gunzip 844 ms, parse 3620 ms, sort 0 ms, write 0 ms, index 621 ms: 0 candidates, 70378 repo-hours, 771 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:01:40Z [load_day 2024-01-05] 2024-01-05 hour 7: 197870 events in 0 files, snapshot none (task 6234 ms: download 3652 ms overlapping gunzip 924 ms, parse 3872 ms, sort 0 ms, write 0 ms, index 513 ms: 3 candidates, 68022 repo-hours, 749 releases; waiting 643 ms; commit 0 ms)
2026-11-08T04:01:47Z [load_day 2024-01-05] 2024-01-05 hour 8: 206093 events in 0 files, snapshot none (task 7135 ms: download 3674 ms overlapping gunzip 1087 ms, parse 4343 ms, sort 0 ms, write 0 ms, index 707 ms: 6 candidates, 73320 repo-hours, 900 releases; waiting 612 ms; commit 0 ms)
2026-11-08T04:01:48Z [load_day 2024-01-05] 2024-01-05 hour 9: 226412 events in 0 files, snapshot none (task 7138 ms: download 4577 ms overlapping gunzip 1113 ms, parse 4614 ms, sort 0 ms, write 0 ms, index 603 ms: 7 candidates, 83451 repo-hours, 1239 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:01:54Z [load_day 2024-01-05] 2024-01-05 hour 10: 216400 events in 0 files, snapshot none (task 6944 ms: download 3859 ms overlapping gunzip 1021 ms, parse 4266 ms, sort 0 ms, write 0 ms, index 823 ms: 9 candidates, 77924 repo-hours, 1056 releases; waiting 543 ms; commit 0 ms)
2026-11-08T04:01:55Z [load_day 2024-01-05] 2024-01-05 hour 11: 212491 events in 0 files, snapshot none (task 6200 ms: download 3154 ms overlapping gunzip 976 ms, parse 3953 ms, sort 0 ms, write 0 ms, index 715 ms: 4 candidates, 73325 repo-hours, 971 releases; waiting 206 ms; commit 0 ms)
2026-11-08T04:02:01Z [load_day 2024-01-05] 2024-01-05 hour 12: 255253 events in 0 files, snapshot none (task 5902 ms: download 3210 ms overlapping gunzip 883 ms, parse 3862 ms, sort 0 ms, write 0 ms, index 679 ms: 4 candidates, 103204 repo-hours, 1016 releases; waiting 177 ms; commit 0 ms)
2026-11-08T04:02:02Z [load_day 2024-01-05] 2024-01-05 hour 13: 236736 events in 0 files, snapshot none (task 6492 ms: download 4101 ms overlapping gunzip 953 ms, parse 4162 ms, sort 0 ms, write 0 ms, index 668 ms: 9 candidates, 97128 repo-hours, 1025 releases; waiting 497 ms; commit 0 ms)
2026-11-08T04:02:08Z [load_day 2024-01-05] 2024-01-05 hour 14: 236920 events in 0 files, snapshot none (task 6950 ms: download 4568 ms overlapping gunzip 1110 ms, parse 4327 ms, sort 0 ms, write 0 ms, index 635 ms: 2 candidates, 87538 repo-hours, 1046 releases; waiting 599 ms; commit 0 ms)
2026-11-08T04:02:09Z [load_day 2024-01-05] 2024-01-05 hour 15: 233355 events in 0 files, snapshot none (task 7153 ms: download 4610 ms overlapping gunzip 1095 ms, parse 4500 ms, sort 0 ms, write 0 ms, index 651 ms: 7 candidates, 87494 repo-hours, 1352 releases; waiting 551 ms; commit 0 ms)
2026-11-08T04:02:17Z [load_day 2024-01-05] 2024-01-05 hour 16: 229793 events in 0 files, snapshot none (task 8508 ms: download 6045 ms overlapping gunzip 1347 ms, parse 5797 ms, sort 0 ms, write 0 ms, index 595 ms: 8 candidates, 82763 repo-hours, 1101 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:02:18Z [load_day 2024-01-05] 2024-01-05 hour 17: 223018 events in 0 files, snapshot none (task 8121 ms: download 5579 ms overlapping gunzip 1402 ms, parse 5526 ms, sort 0 ms, write 0 ms, index 628 ms: 9 candidates, 78858 repo-hours, 988 releases; waiting 193 ms; commit 0 ms)
2026-11-08T04:02:25Z [load_day 2024-01-05] 2024-01-05 hour 18: 205533 events in 0 files, snapshot none (task 7948 ms: download 4667 ms overlapping gunzip 1235 ms, parse 5147 ms, sort 0 ms, write 0 ms, index 723 ms: 4 candidates, 81527 repo-hours, 1107 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:02:25Z [load_day 2024-01-05] 2024-01-05 hour 19: 175609 events in 0 files, snapshot none (task 6775 ms: download 3763 ms overlapping gunzip 1034 ms, parse 4239 ms, sort 0 ms, write 0 ms, index 733 ms: 9 candidates, 68170 repo-hours, 1189 releases; waiting 485 ms; commit 0 ms)
2026-11-08T04:02:32Z [load_day 2024-01-05] 2024-01-05 hour 20: 167340 events in 0 files, snapshot none (task 6437 ms: download 4079 ms overlapping gunzip 978 ms, parse 4090 ms, sort 0 ms, write 0 ms, index 554 ms: 9 candidates, 65852 repo-hours, 1066 releases; waiting 537 ms; commit 0 ms)
2026-11-08T04:02:32Z [load_day 2024-01-05] 2024-01-05 hour 21: 156574 events in 0 files, snapshot none (task 6261 ms: download 4027 ms overlapping gunzip 1002 ms, parse 3933 ms, sort 0 ms, write 0 ms, index 504 ms: 8 candidates, 59881 repo-hours, 963 releases; waiting 536 ms; commit 0 ms)
2026-11-08T04:02:38Z [load_day 2024-01-05] 2024-01-05 hour 22: 150097 events in 0 files, snapshot none (task 5620 ms: download 3425 ms overlapping gunzip 869 ms, parse 3489 ms, sort 0 ms, write 0 ms, index 429 ms: 4 candidates, 55887 repo-hours, 956 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:02:38Z [load_day 2024-01-05] 2024-01-05 hour 23: 133092 events in 0 files, snapshot none (task 4573 ms: download 2511 ms overlapping gunzip 758 ms, parse 2929 ms, sort 0 ms, write 0 ms, index 354 ms: 3 candidates, 50217 repo-hours, 811 releases; waiting 272 ms; commit 0 ms)
2026-11-08T04:02:46Z [load_day 2024-01-05] 2024-01-05: repo_hour merged from 24 files to 1 (1764502 rows, 7860 ms)
2026-11-08T04:02:49Z [load_day 2024-01-05] 2024-01-05: index committed in 10546 ms (23 + 1 + 24 files)
2026-11-08T04:02:49Z [load_day 2024-01-05] 2024-01-05: 4745538 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:02:49Z [load_day 2024-01-05] attempt 1 succeeded