orcaLog in

Runs · run 3642

load_day 2025-03-07, attempt 1 succeeded

Host
73ccef5e07c2:266713
Started
2026-11-08T10:42:40Z
Ended
2026-11-08T10:45:25Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
900 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
208.1 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3642/load_day/2025-03-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:42:40Z [load_day 2025-03-07] attempt 1 started
2026-11-08T10:42:41Z [load_day 2025-03-07] 2025-03-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:42:50Z [load_day 2025-03-07] 2025-03-07 hour 0: 220937 events in 0 files, snapshot none (task 8347 ms: download 5292 ms overlapping gunzip 1306 ms, parse 5786 ms, sort 0 ms, write 0 ms, index 735 ms: 6 candidates, 98745 repo-hours, 1232 releases; waiting 255 ms; commit 0 ms)
2026-11-08T10:42:50Z [load_day 2025-03-07] 2025-03-07 hour 1: 240264 events in 0 files, snapshot none (task 8385 ms: download 5372 ms overlapping gunzip 1248 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 866 ms: 8 candidates, 125432 repo-hours, 991 releases; waiting 444 ms; commit 0 ms)
2026-11-08T10:42:59Z [load_day 2025-03-07] 2025-03-07 hour 2: 213215 events in 0 files, snapshot none (task 8467 ms: download 4941 ms overlapping gunzip 1322 ms, parse 5407 ms, sort 0 ms, write 0 ms, index 955 ms: 12 candidates, 91515 repo-hours, 889 releases; waiting 496 ms; commit 0 ms)
2026-11-08T10:43:00Z [load_day 2025-03-07] 2025-03-07 hour 3: 226136 events in 0 files, snapshot none (task 9128 ms: download 6144 ms overlapping gunzip 1403 ms, parse 6215 ms, sort 0 ms, write 0 ms, index 795 ms: 7 candidates, 90871 repo-hours, 3855 releases; waiting 499 ms; commit 0 ms)
2026-11-08T10:43:08Z [load_day 2025-03-07] 2025-03-07 hour 4: 208305 events in 0 files, snapshot none (task 8238 ms: download 4230 ms overlapping gunzip 1253 ms, parse 5430 ms, sort 0 ms, write 0 ms, index 786 ms: 5 candidates, 77399 repo-hours, 910 releases; waiting 492 ms; commit 0 ms)
2026-11-08T10:43:09Z [load_day 2025-03-07] 2025-03-07 hour 5: 217802 events in 0 files, snapshot none (task 9411 ms: download 6365 ms overlapping gunzip 1523 ms, parse 6221 ms, sort 0 ms, write 0 ms, index 772 ms: 6 candidates, 82382 repo-hours, 862 releases; waiting 616 ms; commit 0 ms)
2026-11-08T10:43:15Z [load_day 2025-03-07] 2025-03-07 hour 6: 240924 events in 0 files, snapshot none (task 7084 ms: download 4272 ms overlapping gunzip 1054 ms, parse 4345 ms, sort 0 ms, write 0 ms, index 828 ms: 8 candidates, 103715 repo-hours, 1081 releases; waiting 539 ms; commit 0 ms)
2026-11-08T10:43:36Z [load_day 2025-03-07] 2025-03-07 hour 7: 237577 events in 0 files, snapshot none (task 25893 ms: download 24650 ms overlapping gunzip 1433 ms, parse 5825 ms, sort 0 ms, write 0 ms, index 891 ms: 8 candidates, 93007 repo-hours, 960 releases; waiting 17411 ms; commit 0 ms)
2026-11-08T10:43:36Z [load_day 2025-03-07] 2025-03-07 hour 8: 250786 events in 0 files, snapshot none (task 7587 ms: download 4876 ms overlapping gunzip 1179 ms, parse 4819 ms, sort 0 ms, write 0 ms, index 790 ms: 11 candidates, 101434 repo-hours, 1145 releases; waiting 509 ms; commit 0 ms)
2026-11-08T10:43:47Z [load_day 2025-03-07] 2025-03-07 hour 9: 263266 events in 0 files, snapshot none (task 10522 ms: download 7712 ms overlapping gunzip 1684 ms, parse 7162 ms, sort 0 ms, write 0 ms, index 818 ms: 9 candidates, 109164 repo-hours, 1435 releases; waiting 551 ms; commit 0 ms)
2026-11-08T10:43:47Z [load_day 2025-03-07] 2025-03-07 hour 10: 258362 events in 0 files, snapshot none (task 9684 ms: download 6821 ms overlapping gunzip 1598 ms, parse 6489 ms, sort 0 ms, write 0 ms, index 787 ms: 10 candidates, 103757 repo-hours, 1144 releases; waiting 507 ms; commit 0 ms)
2026-11-08T10:43:57Z [load_day 2025-03-07] 2025-03-07 hour 11: 248370 events in 0 files, snapshot none (task 9956 ms: download 6584 ms overlapping gunzip 1548 ms, parse 6496 ms, sort 0 ms, write 0 ms, index 1162 ms: 8 candidates, 96371 repo-hours, 1198 releases; waiting 480 ms; commit 0 ms)
2026-11-08T10:43:58Z [load_day 2025-03-07] 2025-03-07 hour 12: 283072 events in 0 files, snapshot none (task 10771 ms: download 6629 ms overlapping gunzip 1617 ms, parse 7141 ms, sort 0 ms, write 0 ms, index 1135 ms: 11 candidates, 140069 repo-hours, 1258 releases; waiting 525 ms; commit 0 ms)
2026-11-08T10:44:07Z [load_day 2025-03-07] 2025-03-07 hour 13: 271239 events in 0 files, snapshot none (task 9637 ms: download 6873 ms overlapping gunzip 1450 ms, parse 6593 ms, sort 0 ms, write 0 ms, index 865 ms: 7 candidates, 122989 repo-hours, 1299 releases; waiting 503 ms; commit 0 ms)
2026-11-08T10:44:10Z [load_day 2025-03-07] 2025-03-07 hour 14: 266369 events in 0 files, snapshot none (task 11509 ms: download 8121 ms overlapping gunzip 1435 ms, parse 6225 ms, sort 0 ms, write 0 ms, index 1409 ms: 10 candidates, 109327 repo-hours, 1374 releases; waiting 2214 ms; commit 0 ms)
2026-11-08T10:44:17Z [load_day 2025-03-07] 2025-03-07 hour 15: 272438 events in 0 files, snapshot none (task 8870 ms: download 6023 ms overlapping gunzip 1370 ms, parse 5790 ms, sort 0 ms, write 0 ms, index 828 ms: 14 candidates, 114993 repo-hours, 1405 releases; waiting 560 ms; commit 0 ms)
2026-11-08T10:44:45Z [load_day 2025-03-07] 2025-03-07 hour 16: 259947 events in 0 files, snapshot none (task 34551 ms: download 32526 ms overlapping gunzip 1510 ms, parse 6193 ms, sort 0 ms, write 0 ms, index 771 ms: 12 candidates, 107057 repo-hours, 1403 releases; waiting 25799 ms; commit 0 ms)
2026-11-08T10:44:45Z [load_day 2025-03-07] 2025-03-07 hour 17: 257193 events in 0 files, snapshot none (task 8865 ms: download 6030 ms overlapping gunzip 1514 ms, parse 6038 ms, sort 0 ms, write 0 ms, index 754 ms: 12 candidates, 101058 repo-hours, 1535 releases; waiting 255 ms; commit 0 ms)
2026-11-08T10:44:55Z [load_day 2025-03-07] 2025-03-07 hour 18: 250917 events in 0 files, snapshot none (task 9035 ms: download 6514 ms overlapping gunzip 1389 ms, parse 6077 ms, sort 0 ms, write 0 ms, index 764 ms: 13 candidates, 110747 repo-hours, 1303 releases; waiting 551 ms; commit 0 ms)
2026-11-08T10:44:55Z [load_day 2025-03-07] 2025-03-07 hour 19: 231774 events in 0 files, snapshot none (task 8692 ms: download 6201 ms overlapping gunzip 1332 ms, parse 5937 ms, sort 0 ms, write 0 ms, index 673 ms: 14 candidates, 87581 repo-hours, 1163 releases; waiting 500 ms; commit 0 ms)
2026-11-08T10:45:03Z [load_day 2025-03-07] 2025-03-07 hour 20: 223187 events in 0 files, snapshot none (task 7216 ms: download 4574 ms overlapping gunzip 1112 ms, parse 4510 ms, sort 0 ms, write 0 ms, index 736 ms: 8 candidates, 86140 repo-hours, 1212 releases; waiting 470 ms; commit 0 ms)
2026-11-08T10:45:03Z [load_day 2025-03-07] 2025-03-07 hour 21: 225375 events in 0 files, snapshot none (task 8033 ms: download 5614 ms overlapping gunzip 1182 ms, parse 4657 ms, sort 0 ms, write 0 ms, index 618 ms: 9 candidates, 86861 repo-hours, 1282 releases; waiting 1298 ms; commit 0 ms)
2026-11-08T10:45:11Z [load_day 2025-03-07] 2025-03-07 hour 22: 213289 events in 0 files, snapshot none (task 8023 ms: download 4735 ms overlapping gunzip 1191 ms, parse 5113 ms, sort 0 ms, write 0 ms, index 621 ms: 15 candidates, 78285 repo-hours, 1203 releases; waiting 798 ms; commit 0 ms)
2026-11-08T10:45:12Z [load_day 2025-03-07] 2025-03-07 hour 23: 197032 events in 0 files, snapshot none (task 7692 ms: download 4931 ms overlapping gunzip 1235 ms, parse 4882 ms, sort 0 ms, write 0 ms, index 576 ms: 10 candidates, 71071 repo-hours, 1122 releases; waiting 643 ms; commit 0 ms)
2026-11-08T10:45:22Z [load_day 2025-03-07] 2025-03-07: repo_hour merged from 24 files to 1 (2389970 rows, 10575 ms)
2026-11-08T10:45:25Z [load_day 2025-03-07] 2025-03-07: index committed in 13462 ms (24 + 1 + 24 files)
2026-11-08T10:45:25Z [load_day 2025-03-07] 2025-03-07: 5777776 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:45:25Z [load_day 2025-03-07] attempt 1 succeeded