orcaLog in

Runs · run 3245

load_day 2024-11-26, attempt 1 succeeded

Host
73ccef5e07c2:212830
Started
2026-11-08T09:02:55Z
Ended
2026-11-08T09:05:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
750 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
250.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3245/load_day/2024-11-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T09:02:55Z [load_day 2024-11-26] attempt 1 started
2026-11-08T09:02:56Z [load_day 2024-11-26] 2024-11-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T09:03:05Z [load_day 2024-11-26] 2024-11-26 hour 0: 201545 events in 0 files, snapshot none (task 8463 ms: download 5643 ms overlapping gunzip 1364 ms, parse 5800 ms, sort 0 ms, write 0 ms, index 714 ms: 11 candidates, 93443 repo-hours, 1267 releases; waiting 310 ms; commit 0 ms)
2026-11-08T09:03:05Z [load_day 2024-11-26] 2024-11-26 hour 1: 224794 events in 0 files, snapshot none (task 8635 ms: download 5902 ms overlapping gunzip 1384 ms, parse 5539 ms, sort 0 ms, write 0 ms, index 838 ms: 4 candidates, 117991 repo-hours, 1066 releases; waiting 489 ms; commit 0 ms)
2026-11-08T09:03:15Z [load_day 2024-11-26] 2024-11-26 hour 2: 189921 events in 0 files, snapshot none (task 9028 ms: download 5795 ms overlapping gunzip 1379 ms, parse 5955 ms, sort 0 ms, write 0 ms, index 876 ms: 7 candidates, 84167 repo-hours, 941 releases; waiting 483 ms; commit 0 ms)
2026-11-08T09:03:17Z [load_day 2024-11-26] 2024-11-26 hour 3: 222212 events in 0 files, snapshot none (task 10920 ms: download 8278 ms overlapping gunzip 1974 ms, parse 7464 ms, sort 0 ms, write 0 ms, index 718 ms: 6 candidates, 82560 repo-hours, 3995 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:03:26Z [load_day 2024-11-26] 2024-11-26 hour 4: 206080 events in 0 files, snapshot none (task 10519 ms: download 7084 ms overlapping gunzip 1813 ms, parse 6691 ms, sort 0 ms, write 0 ms, index 906 ms: 4 candidates, 70169 repo-hours, 723 releases; waiting 608 ms; commit 0 ms)
2026-11-08T09:03:28Z [load_day 2024-11-26] 2024-11-26 hour 5: 219618 events in 0 files, snapshot none (task 10577 ms: download 7525 ms overlapping gunzip 1921 ms, parse 7190 ms, sort 0 ms, write 0 ms, index 830 ms: 3 candidates, 74597 repo-hours, 813 releases; waiting 203 ms; commit 0 ms)
2026-11-08T09:03:36Z [load_day 2024-11-26] 2024-11-26 hour 6: 237283 events in 0 files, snapshot none (task 9439 ms: download 6487 ms overlapping gunzip 1586 ms, parse 6166 ms, sort 0 ms, write 0 ms, index 1162 ms: 3 candidates, 96508 repo-hours, 907 releases; waiting 207 ms; commit 0 ms)
2026-11-08T09:03:39Z [load_day 2024-11-26] 2024-11-26 hour 7: 234850 events in 0 files, snapshot none (task 10183 ms: download 7086 ms overlapping gunzip 1754 ms, parse 6878 ms, sort 0 ms, write 0 ms, index 871 ms: 3 candidates, 86818 repo-hours, 1003 releases; waiting 364 ms; commit 0 ms)
2026-11-08T09:03:49Z [load_day 2024-11-26] 2024-11-26 hour 8: 250015 events in 0 files, snapshot none (task 12496 ms: download 9589 ms overlapping gunzip 2138 ms, parse 8453 ms, sort 0 ms, write 0 ms, index 1234 ms: 11 candidates, 96067 repo-hours, 1244 releases; waiting 342 ms; commit 0 ms)
2026-11-08T09:03:52Z [load_day 2024-11-26] 2024-11-26 hour 9: 264108 events in 0 files, snapshot none (task 12524 ms: download 9048 ms overlapping gunzip 2211 ms, parse 8373 ms, sort 0 ms, write 0 ms, index 1126 ms: 8 candidates, 103059 repo-hours, 1419 releases; waiting 475 ms; commit 0 ms)
2026-11-08T09:04:02Z [load_day 2024-11-26] 2024-11-26 hour 10: 256836 events in 0 files, snapshot none (task 12994 ms: download 10544 ms overlapping gunzip 2385 ms, parse 9211 ms, sort 0 ms, write 0 ms, index 705 ms: 10 candidates, 97681 repo-hours, 1115 releases; waiting 368 ms; commit 0 ms)
2026-11-08T09:04:03Z [load_day 2024-11-26] 2024-11-26 hour 11: 252373 events in 0 files, snapshot none (task 11154 ms: download 8692 ms overlapping gunzip 1967 ms, parse 7676 ms, sort 0 ms, write 0 ms, index 737 ms: 9 candidates, 94317 repo-hours, 1164 releases; waiting 469 ms; commit 0 ms)
2026-11-08T09:04:12Z [load_day 2024-11-26] 2024-11-26 hour 12: 280022 events in 0 files, snapshot none (task 8764 ms: download 5933 ms overlapping gunzip 1387 ms, parse 5465 ms, sort 0 ms, write 0 ms, index 1015 ms: 11 candidates, 141049 repo-hours, 1501 releases; waiting 598 ms; commit 0 ms)
2026-11-08T09:04:14Z [load_day 2024-11-26] 2024-11-26 hour 13: 282194 events in 0 files, snapshot none (task 10309 ms: download 7717 ms overlapping gunzip 1807 ms, parse 6749 ms, sort 0 ms, write 0 ms, index 922 ms: 4 candidates, 120281 repo-hours, 1233 releases; waiting 587 ms; commit 0 ms)
2026-11-08T09:04:25Z [load_day 2024-11-26] 2024-11-26 hour 14: 273250 events in 0 files, snapshot none (task 12864 ms: download 9764 ms overlapping gunzip 2296 ms, parse 8865 ms, sort 0 ms, write 0 ms, index 861 ms: 3 candidates, 108642 repo-hours, 1329 releases; waiting 540 ms; commit 0 ms)
2026-11-08T09:04:29Z [load_day 2024-11-26] 2024-11-26 hour 15: 277166 events in 0 files, snapshot none (task 14179 ms: download 10487 ms overlapping gunzip 2432 ms, parse 9779 ms, sort 0 ms, write 0 ms, index 1142 ms: 7 candidates, 113005 repo-hours, 1381 releases; waiting 508 ms; commit 0 ms)
2026-11-08T09:04:37Z [load_day 2024-11-26] 2024-11-26 hour 16: 265138 events in 0 files, snapshot none (task 12124 ms: download 8967 ms overlapping gunzip 2089 ms, parse 8196 ms, sort 0 ms, write 0 ms, index 1132 ms: 8 candidates, 105705 repo-hours, 1231 releases; waiting 342 ms; commit 0 ms)
2026-11-08T09:04:42Z [load_day 2024-11-26] 2024-11-26 hour 17: 260227 events in 0 files, snapshot none (task 12918 ms: download 9008 ms overlapping gunzip 2275 ms, parse 8619 ms, sort 0 ms, write 0 ms, index 1139 ms: 6 candidates, 97951 repo-hours, 1097 releases; waiting 514 ms; commit 0 ms)
2026-11-08T09:04:50Z [load_day 2024-11-26] 2024-11-26 hour 18: 260580 events in 0 files, snapshot none (task 12091 ms: download 8789 ms overlapping gunzip 2137 ms, parse 8167 ms, sort 0 ms, write 0 ms, index 1004 ms: 4 candidates, 107469 repo-hours, 1262 releases; waiting 550 ms; commit 0 ms)
2026-11-08T09:04:54Z [load_day 2024-11-26] 2024-11-26 hour 19: 243872 events in 0 files, snapshot none (task 10994 ms: download 8029 ms overlapping gunzip 1891 ms, parse 7619 ms, sort 0 ms, write 0 ms, index 678 ms: 1 candidates, 86134 repo-hours, 1138 releases; waiting 506 ms; commit 0 ms)
2026-11-08T09:05:02Z [load_day 2024-11-26] 2024-11-26 hour 20: 241548 events in 0 files, snapshot none (task 11756 ms: download 8437 ms overlapping gunzip 2034 ms, parse 7833 ms, sort 0 ms, write 0 ms, index 1119 ms: 4 candidates, 85077 repo-hours, 991 releases; waiting 507 ms; commit 0 ms)
2026-11-08T09:05:05Z [load_day 2024-11-26] 2024-11-26 hour 21: 233355 events in 0 files, snapshot none (task 10740 ms: download 7762 ms overlapping gunzip 1876 ms, parse 7167 ms, sort 0 ms, write 0 ms, index 887 ms: 1 candidates, 83629 repo-hours, 1188 releases; waiting 497 ms; commit 0 ms)
2026-11-08T09:05:12Z [load_day 2024-11-26] 2024-11-26 hour 22: 213813 events in 0 files, snapshot none (task 9212 ms: download 6322 ms overlapping gunzip 1586 ms, parse 6228 ms, sort 0 ms, write 0 ms, index 660 ms: 2 candidates, 72448 repo-hours, 1113 releases; waiting 518 ms; commit 0 ms)
2026-11-08T09:05:14Z [load_day 2024-11-26] 2024-11-26 hour 23: 206525 events in 0 files, snapshot none (task 8754 ms: download 6361 ms overlapping gunzip 1477 ms, parse 5805 ms, sort 0 ms, write 0 ms, index 624 ms: 5 candidates, 69138 repo-hours, 852 releases; waiting 547 ms; commit 0 ms)
2026-11-08T09:05:25Z [load_day 2024-11-26] 2024-11-26: repo_hour merged from 24 files to 1 (2287905 rows, 10135 ms)
2026-11-08T09:05:27Z [load_day 2024-11-26] 2024-11-26: index committed in 12933 ms (24 + 1 + 24 files)
2026-11-08T09:05:27Z [load_day 2024-11-26] 2024-11-26: 5797325 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T09:05:27Z [load_day 2024-11-26] attempt 1 succeeded