orcaLog in

Runs · run 2195

load_day 2024-03-13, attempt 1 succeeded

Host
73ccef5e07c2:97630
Started
2026-11-08T05:05:21Z
Ended
2026-11-08T05:07:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
710 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
190.1 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2195/load_day/2024-03-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:05:21Z [load_day 2024-03-13] attempt 1 started
2026-11-08T05:05:22Z [load_day 2024-03-13] 2024-03-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:05:28Z [load_day 2024-03-13] 2024-03-13 hour 0: 162319 events in 0 files, snapshot none (task 5503 ms: download 2716 ms overlapping gunzip 819 ms, parse 3546 ms, sort 0 ms, write 0 ms, index 723 ms: 10 candidates, 72573 repo-hours, 1187 releases; waiting 169 ms; commit 0 ms)
2026-11-08T05:05:28Z [load_day 2024-03-13] 2024-03-13 hour 1: 179825 events in 0 files, snapshot none (task 5872 ms: download 3256 ms overlapping gunzip 819 ms, parse 3669 ms, sort 0 ms, write 0 ms, index 665 ms: 9 candidates, 90007 repo-hours, 1014 releases; waiting 461 ms; commit 0 ms)
2026-11-08T05:05:35Z [load_day 2024-03-13] 2024-03-13 hour 2: 207653 events in 0 files, snapshot none (task 6928 ms: download 4037 ms overlapping gunzip 1080 ms, parse 4538 ms, sort 0 ms, write 0 ms, index 532 ms: 4 candidates, 68769 repo-hours, 1117 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:05:36Z [load_day 2024-03-13] 2024-03-13 hour 3: 206319 events in 0 files, snapshot none (task 6746 ms: download 3955 ms overlapping gunzip 988 ms, parse 4441 ms, sort 0 ms, write 0 ms, index 552 ms: 5 candidates, 67185 repo-hours, 1162 releases; waiting 471 ms; commit 0 ms)
2026-11-08T05:05:43Z [load_day 2024-03-13] 2024-03-13 hour 4: 192977 events in 0 files, snapshot none (task 6690 ms: download 3651 ms overlapping gunzip 1035 ms, parse 4362 ms, sort 0 ms, write 0 ms, index 525 ms: 2 candidates, 61325 repo-hours, 675 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:05:43Z [load_day 2024-03-13] 2024-03-13 hour 5: 208585 events in 0 files, snapshot none (task 7536 ms: download 4929 ms overlapping gunzip 1276 ms, parse 4903 ms, sort 0 ms, write 0 ms, index 615 ms: 4 candidates, 67747 repo-hours, 703 releases; waiting 476 ms; commit 0 ms)
2026-11-08T05:05:50Z [load_day 2024-03-13] 2024-03-13 hour 6: 227715 events in 0 files, snapshot none (task 6682 ms: download 3818 ms overlapping gunzip 971 ms, parse 4240 ms, sort 0 ms, write 0 ms, index 637 ms: 4 candidates, 81848 repo-hours, 972 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:05:52Z [load_day 2024-03-13] 2024-03-13 hour 7: 243444 events in 0 files, snapshot none (task 7577 ms: download 4247 ms overlapping gunzip 1088 ms, parse 4330 ms, sort 0 ms, write 0 ms, index 1293 ms: 7 candidates, 80983 repo-hours, 843 releases; waiting 498 ms; commit 0 ms)
2026-11-08T05:05:58Z [load_day 2024-03-13] 2024-03-13 hour 8: 251867 events in 0 files, snapshot none (task 8346 ms: download 5733 ms overlapping gunzip 1311 ms, parse 5648 ms, sort 0 ms, write 0 ms, index 651 ms: 12 candidates, 90587 repo-hours, 1032 releases; waiting 446 ms; commit 0 ms)
2026-11-08T05:06:01Z [load_day 2024-03-13] 2024-03-13 hour 9: 265743 events in 0 files, snapshot none (task 8580 ms: download 5723 ms overlapping gunzip 1238 ms, parse 5483 ms, sort 0 ms, write 0 ms, index 984 ms: 4 candidates, 96235 repo-hours, 1422 releases; waiting 548 ms; commit 0 ms)
2026-11-08T05:06:08Z [load_day 2024-03-13] 2024-03-13 hour 10: 262144 events in 0 files, snapshot none (task 9133 ms: download 6439 ms overlapping gunzip 1458 ms, parse 6161 ms, sort 0 ms, write 0 ms, index 741 ms: 7 candidates, 94814 repo-hours, 1203 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:06:11Z [load_day 2024-03-13] 2024-03-13 hour 11: 260339 events in 0 files, snapshot none (task 9166 ms: download 5678 ms overlapping gunzip 1378 ms, parse 5781 ms, sort 0 ms, write 0 ms, index 1182 ms: 16 candidates, 92935 repo-hours, 1119 releases; waiting 485 ms; commit 0 ms)
2026-11-08T05:06:17Z [load_day 2024-03-13] 2024-03-13 hour 12: 304929 events in 0 files, snapshot none (task 8493 ms: download 5476 ms overlapping gunzip 1267 ms, parse 6025 ms, sort 0 ms, write 0 ms, index 984 ms: 8 candidates, 122557 repo-hours, 1247 releases; waiting 19 ms; commit 0 ms)
2026-11-08T05:06:21Z [load_day 2024-03-13] 2024-03-13 hour 13: 289016 events in 0 files, snapshot none (task 9506 ms: download 5990 ms overlapping gunzip 1463 ms, parse 6212 ms, sort 0 ms, write 0 ms, index 1074 ms: 8 candidates, 120710 repo-hours, 1380 releases; waiting 471 ms; commit 0 ms)
2026-11-08T05:06:26Z [load_day 2024-03-13] 2024-03-13 hour 14: 285993 events in 0 files, snapshot none (task 9066 ms: download 6417 ms overlapping gunzip 1439 ms, parse 6115 ms, sort 0 ms, write 0 ms, index 831 ms: 8 candidates, 106779 repo-hours, 1335 releases; waiting 461 ms; commit 0 ms)
2026-11-08T05:06:29Z [load_day 2024-03-13] 2024-03-13 hour 15: 284118 events in 0 files, snapshot none (task 8016 ms: download 5377 ms overlapping gunzip 1263 ms, parse 5136 ms, sort 0 ms, write 0 ms, index 768 ms: 7 candidates, 107230 repo-hours, 1455 releases; waiting 512 ms; commit 0 ms)
2026-11-08T05:06:35Z [load_day 2024-03-13] 2024-03-13 hour 16: 281815 events in 0 files, snapshot none (task 7801 ms: download 5195 ms overlapping gunzip 1215 ms, parse 5002 ms, sort 0 ms, write 0 ms, index 719 ms: 11 candidates, 104382 repo-hours, 1213 releases; waiting 543 ms; commit 0 ms)
2026-11-08T05:06:38Z [load_day 2024-03-13] 2024-03-13 hour 17: 278464 events in 0 files, snapshot none (task 8070 ms: download 5162 ms overlapping gunzip 1188 ms, parse 5128 ms, sort 0 ms, write 0 ms, index 899 ms: 8 candidates, 97403 repo-hours, 1120 releases; waiting 544 ms; commit 0 ms)
2026-11-08T05:06:44Z [load_day 2024-03-13] 2024-03-13 hour 18: 272220 events in 0 files, snapshot none (task 8723 ms: download 5387 ms overlapping gunzip 1350 ms, parse 5699 ms, sort 0 ms, write 0 ms, index 847 ms: 11 candidates, 97034 repo-hours, 1230 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:06:47Z [load_day 2024-03-13] 2024-03-13 hour 19: 251251 events in 0 files, snapshot none (task 8101 ms: download 5596 ms overlapping gunzip 1320 ms, parse 5537 ms, sort 0 ms, write 0 ms, index 721 ms: 7 candidates, 83627 repo-hours, 1208 releases; waiting 208 ms; commit 0 ms)
2026-11-08T05:06:54Z [load_day 2024-03-13] 2024-03-13 hour 20: 247111 events in 0 files, snapshot none (task 9403 ms: download 4787 ms overlapping gunzip 1404 ms, parse 5947 ms, sort 0 ms, write 0 ms, index 968 ms: 8 candidates, 82773 repo-hours, 1049 releases; waiting 812 ms; commit 0 ms)
2026-11-08T05:06:57Z [load_day 2024-03-13] 2024-03-13 hour 21: 242525 events in 0 files, snapshot none (task 8170 ms: download 5214 ms overlapping gunzip 1197 ms, parse 5104 ms, sort 0 ms, write 0 ms, index 1103 ms: 9 candidates, 81847 repo-hours, 1026 releases; waiting 460 ms; commit 0 ms)
2026-11-08T05:07:03Z [load_day 2024-03-13] 2024-03-13 hour 22: 245228 events in 0 files, snapshot none (task 8693 ms: download 5789 ms overlapping gunzip 1282 ms, parse 5524 ms, sort 0 ms, write 0 ms, index 768 ms: 8 candidates, 72082 repo-hours, 850 releases; waiting 735 ms; commit 0 ms)
2026-11-08T05:07:05Z [load_day 2024-03-13] 2024-03-13 hour 23: 257203 events in 0 files, snapshot none (task 7602 ms: download 4719 ms overlapping gunzip 1166 ms, parse 5020 ms, sort 0 ms, write 0 ms, index 598 ms: 11 candidates, 68915 repo-hours, 740 releases; waiting 226 ms; commit 0 ms)
2026-11-08T05:07:15Z [load_day 2024-03-13] 2024-03-13: repo_hour merged from 24 files to 1 (2110347 rows, 9753 ms)
2026-11-08T05:07:17Z [load_day 2024-03-13] 2024-03-13: index committed in 12076 ms (24 + 1 + 24 files)
2026-11-08T05:07:17Z [load_day 2024-03-13] 2024-03-13: 5908803 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:07:17Z [load_day 2024-03-13] attempt 1 succeeded