orcaLog in

Runs · run 3201

load_day 2024-11-14, attempt 1 succeeded

Host
73ccef5e07c2:207144
Started
2026-11-08T08:49:35Z
Ended
2026-11-08T08:51:56Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
733 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
227.5 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3201/load_day/2024-11-14/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:49:35Z [load_day 2024-11-14] attempt 1 started
2026-11-08T08:49:35Z [load_day 2024-11-14] 2024-11-14: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:49:45Z [load_day 2024-11-14] 2024-11-14 hour 0: 203828 events in 0 files, snapshot none (task 9368 ms: download 5462 ms overlapping gunzip 1433 ms, parse 6002 ms, sort 0 ms, write 0 ms, index 1147 ms: 10 candidates, 96209 repo-hours, 1250 releases; waiting 481 ms; commit 0 ms)
2026-11-08T08:49:45Z [load_day 2024-11-14] 2024-11-14 hour 1: 215449 events in 0 files, snapshot none (task 7433 ms: download 3642 ms overlapping gunzip 1096 ms, parse 4682 ms, sort 0 ms, write 0 ms, index 1139 ms: 9 candidates, 113518 repo-hours, 888 releases; waiting 207 ms; commit 0 ms)
2026-11-08T08:49:55Z [load_day 2024-11-14] 2024-11-14 hour 2: 203273 events in 0 files, snapshot none (task 9610 ms: download 6496 ms overlapping gunzip 1576 ms, parse 6491 ms, sort 0 ms, write 0 ms, index 816 ms: 10 candidates, 81762 repo-hours, 867 releases; waiting 509 ms; commit 0 ms)
2026-11-08T08:49:55Z [load_day 2024-11-14] 2024-11-14 hour 3: 213508 events in 0 files, snapshot none (task 9236 ms: download 6329 ms overlapping gunzip 1522 ms, parse 6112 ms, sort 0 ms, write 0 ms, index 806 ms: 9 candidates, 80499 repo-hours, 3805 releases; waiting 515 ms; commit 0 ms)
2026-11-08T08:50:04Z [load_day 2024-11-14] 2024-11-14 hour 4: 193392 events in 0 files, snapshot none (task 8512 ms: download 5478 ms overlapping gunzip 1396 ms, parse 5528 ms, sort 0 ms, write 0 ms, index 741 ms: 8 candidates, 66163 repo-hours, 638 releases; waiting 527 ms; commit 0 ms)
2026-11-08T08:50:05Z [load_day 2024-11-14] 2024-11-14 hour 5: 201385 events in 0 files, snapshot none (task 9092 ms: download 5317 ms overlapping gunzip 1522 ms, parse 6120 ms, sort 0 ms, write 0 ms, index 791 ms: 10 candidates, 69829 repo-hours, 822 releases; waiting 293 ms; commit 0 ms)
2026-11-08T08:50:14Z [load_day 2024-11-14] 2024-11-14 hour 6: 222607 events in 0 files, snapshot none (task 9211 ms: download 6027 ms overlapping gunzip 1486 ms, parse 6125 ms, sort 0 ms, write 0 ms, index 769 ms: 6 candidates, 92201 repo-hours, 953 releases; waiting 486 ms; commit 0 ms)
2026-11-08T08:50:15Z [load_day 2024-11-14] 2024-11-14 hour 7: 217831 events in 0 files, snapshot none (task 9744 ms: download 7045 ms overlapping gunzip 1640 ms, parse 6583 ms, sort 0 ms, write 0 ms, index 670 ms: 11 candidates, 80971 repo-hours, 881 releases; waiting 526 ms; commit 0 ms)
2026-11-08T08:50:23Z [load_day 2024-11-14] 2024-11-14 hour 8: 230535 events in 0 files, snapshot none (task 8732 ms: download 6137 ms overlapping gunzip 1480 ms, parse 5959 ms, sort 0 ms, write 0 ms, index 733 ms: 10 candidates, 89738 repo-hours, 1030 releases; waiting 195 ms; commit 0 ms)
2026-11-08T08:50:25Z [load_day 2024-11-14] 2024-11-14 hour 9: 244665 events in 0 files, snapshot none (task 9326 ms: download 6840 ms overlapping gunzip 1609 ms, parse 6156 ms, sort 0 ms, write 0 ms, index 793 ms: 13 candidates, 98631 repo-hours, 1363 releases; waiting 453 ms; commit 0 ms)
2026-11-08T08:50:33Z [load_day 2024-11-14] 2024-11-14 hour 10: 242415 events in 0 files, snapshot none (task 8593 ms: download 6129 ms overlapping gunzip 1409 ms, parse 5689 ms, sort 0 ms, write 0 ms, index 679 ms: 6 candidates, 93598 repo-hours, 1313 releases; waiting 525 ms; commit 0 ms)
2026-11-08T08:50:34Z [load_day 2024-11-14] 2024-11-14 hour 11: 244835 events in 0 files, snapshot none (task 7828 ms: download 5457 ms overlapping gunzip 1324 ms, parse 5214 ms, sort 0 ms, write 0 ms, index 697 ms: 14 candidates, 87775 repo-hours, 966 releases; waiting 323 ms; commit 0 ms)
2026-11-08T08:50:42Z [load_day 2024-11-14] 2024-11-14 hour 12: 271561 events in 0 files, snapshot none (task 9182 ms: download 5080 ms overlapping gunzip 1374 ms, parse 5953 ms, sort 0 ms, write 0 ms, index 1329 ms: 29 candidates, 134707 repo-hours, 1299 releases; waiting 185 ms; commit 0 ms)
2026-11-08T08:50:45Z [load_day 2024-11-14] 2024-11-14 hour 13: 270159 events in 0 files, snapshot none (task 11221 ms: download 8507 ms overlapping gunzip 1875 ms, parse 7563 ms, sort 0 ms, write 0 ms, index 991 ms: 16 candidates, 115262 repo-hours, 1123 releases; waiting 516 ms; commit 0 ms)
2026-11-08T08:50:54Z [load_day 2024-11-14] 2024-11-14 hour 14: 252837 events in 0 files, snapshot none (task 11243 ms: download 8615 ms overlapping gunzip 1966 ms, parse 7750 ms, sort 0 ms, write 0 ms, index 853 ms: 16 candidates, 101493 repo-hours, 1273 releases; waiting 341 ms; commit 0 ms)
2026-11-08T08:50:59Z [load_day 2024-11-14] 2024-11-14 hour 15: 266153 events in 0 files, snapshot none (task 12623 ms: download 8557 ms overlapping gunzip 2094 ms, parse 8446 ms, sort 0 ms, write 0 ms, index 1279 ms: 12 candidates, 109730 repo-hours, 1367 releases; waiting 442 ms; commit 0 ms)
2026-11-08T08:51:07Z [load_day 2024-11-14] 2024-11-14 hour 16: 255754 events in 0 files, snapshot none (task 12442 ms: download 8607 ms overlapping gunzip 2079 ms, parse 8443 ms, sort 0 ms, write 0 ms, index 1154 ms: 16 candidates, 102891 repo-hours, 1287 releases; waiting 429 ms; commit 0 ms)
2026-11-08T08:51:10Z [load_day 2024-11-14] 2024-11-14 hour 17: 245800 events in 0 files, snapshot none (task 11384 ms: download 8069 ms overlapping gunzip 1827 ms, parse 7602 ms, sort 0 ms, write 0 ms, index 1139 ms: 12 candidates, 94374 repo-hours, 1238 releases; waiting 535 ms; commit 0 ms)
2026-11-08T08:51:20Z [load_day 2024-11-14] 2024-11-14 hour 18: 251096 events in 0 files, snapshot none (task 11816 ms: download 8607 ms overlapping gunzip 1997 ms, parse 8027 ms, sort 0 ms, write 0 ms, index 984 ms: 14 candidates, 105789 repo-hours, 1254 releases; waiting 501 ms; commit 0 ms)
2026-11-08T08:51:22Z [load_day 2024-11-14] 2024-11-14 hour 19: 238357 events in 0 files, snapshot none (task 10706 ms: download 7877 ms overlapping gunzip 1692 ms, parse 7216 ms, sort 0 ms, write 0 ms, index 917 ms: 10 candidates, 85355 repo-hours, 1010 releases; waiting 523 ms; commit 0 ms)
2026-11-08T08:51:30Z [load_day 2024-11-14] 2024-11-14 hour 20: 230374 events in 0 files, snapshot none (task 10090 ms: download 7156 ms overlapping gunzip 1721 ms, parse 7038 ms, sort 0 ms, write 0 ms, index 706 ms: 15 candidates, 82845 repo-hours, 1086 releases; waiting 364 ms; commit 0 ms)
2026-11-08T08:51:33Z [load_day 2024-11-14] 2024-11-14 hour 21: 228733 events in 0 files, snapshot none (task 10329 ms: download 7635 ms overlapping gunzip 1810 ms, parse 7044 ms, sort 0 ms, write 0 ms, index 789 ms: 9 candidates, 84498 repo-hours, 1256 releases; waiting 328 ms; commit 0 ms)
2026-11-08T08:51:40Z [load_day 2024-11-14] 2024-11-14 hour 22: 212221 events in 0 files, snapshot none (task 9603 ms: download 6599 ms overlapping gunzip 1599 ms, parse 6286 ms, sort 0 ms, write 0 ms, index 901 ms: 12 candidates, 71571 repo-hours, 1371 releases; waiting 513 ms; commit 0 ms)
2026-11-08T08:51:43Z [load_day 2024-11-14] 2024-11-14 hour 23: 197718 events in 0 files, snapshot none (task 9627 ms: download 7297 ms overlapping gunzip 1660 ms, parse 6657 ms, sort 0 ms, write 0 ms, index 546 ms: 8 candidates, 67820 repo-hours, 1006 releases; waiting 507 ms; commit 0 ms)
2026-11-08T08:51:53Z [load_day 2024-11-14] 2024-11-14: repo_hour merged from 24 files to 1 (2207229 rows, 10702 ms)
2026-11-08T08:51:56Z [load_day 2024-11-14] 2024-11-14: index committed in 13400 ms (24 + 1 + 24 files)
2026-11-08T08:51:56Z [load_day 2024-11-14] 2024-11-14: 5554486 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:51:56Z [load_day 2024-11-14] attempt 1 succeeded