orcaLog in

Runs · run 2129

load_day 2024-02-26, attempt 1 succeeded

Host
73ccef5e07c2:91383
Started
2026-11-08T04:50:20Z
Ended
2026-11-08T04:52:27Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
698 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
206.9 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2129/load_day/2024-02-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:50:20Z [load_day 2024-02-26] attempt 1 started
2026-11-08T04:50:21Z [load_day 2024-02-26] 2024-02-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:50:29Z [load_day 2024-02-26] 2024-02-26 hour 0: 253290 events in 0 files, snapshot none (task 7857 ms: download 4352 ms overlapping gunzip 1146 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 954 ms: 13 candidates, 86792 repo-hours, 1096 releases; waiting 463 ms; commit 0 ms)
2026-11-08T04:50:29Z [load_day 2024-02-26] 2024-02-26 hour 1: 264304 events in 0 files, snapshot none (task 7865 ms: download 4756 ms overlapping gunzip 1304 ms, parse 5090 ms, sort 0 ms, write 0 ms, index 727 ms: 12 candidates, 90717 repo-hours, 686 releases; waiting 499 ms; commit 0 ms)
2026-11-08T04:50:38Z [load_day 2024-02-26] 2024-02-26 hour 2: 235136 events in 0 files, snapshot none (task 7966 ms: download 5246 ms overlapping gunzip 1305 ms, parse 5384 ms, sort 0 ms, write 0 ms, index 529 ms: 3 candidates, 61938 repo-hours, 797 releases; waiting 478 ms; commit 0 ms)
2026-11-08T04:50:38Z [load_day 2024-02-26] 2024-02-26 hour 3: 246210 events in 0 files, snapshot none (task 8553 ms: download 6162 ms overlapping gunzip 1432 ms, parse 5956 ms, sort 0 ms, write 0 ms, index 504 ms: 9 candidates, 62368 repo-hours, 808 releases; waiting 405 ms; commit 0 ms)
2026-11-08T04:50:46Z [load_day 2024-02-26] 2024-02-26 hour 4: 239579 events in 0 files, snapshot none (task 7902 ms: download 5244 ms overlapping gunzip 1264 ms, parse 5182 ms, sort 0 ms, write 0 ms, index 609 ms: 6 candidates, 58965 repo-hours, 602 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:50:46Z [load_day 2024-02-26] 2024-02-26 hour 5: 242747 events in 0 files, snapshot none (task 7647 ms: download 5004 ms overlapping gunzip 1201 ms, parse 5027 ms, sort 0 ms, write 0 ms, index 538 ms: 5 candidates, 63532 repo-hours, 623 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:50:54Z [load_day 2024-02-26] 2024-02-26 hour 6: 259152 events in 0 files, snapshot none (task 7848 ms: download 5112 ms overlapping gunzip 1258 ms, parse 5058 ms, sort 0 ms, write 0 ms, index 758 ms: 16 candidates, 77953 repo-hours, 789 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:50:55Z [load_day 2024-02-26] 2024-02-26 hour 7: 270674 events in 0 files, snapshot none (task 8261 ms: download 5740 ms overlapping gunzip 1416 ms, parse 5746 ms, sort 0 ms, write 0 ms, index 673 ms: 17 candidates, 77846 repo-hours, 823 releases; waiting 182 ms; commit 0 ms)
2026-11-08T04:51:04Z [load_day 2024-02-26] 2024-02-26 hour 8: 278808 events in 0 files, snapshot none (task 9788 ms: download 6717 ms overlapping gunzip 1639 ms, parse 6642 ms, sort 0 ms, write 0 ms, index 699 ms: 14 candidates, 84461 repo-hours, 1012 releases; waiting 504 ms; commit 0 ms)
2026-11-08T04:51:05Z [load_day 2024-02-26] 2024-02-26 hour 9: 294307 events in 0 files, snapshot none (task 9726 ms: download 7101 ms overlapping gunzip 1703 ms, parse 6872 ms, sort 0 ms, write 0 ms, index 685 ms: 6 candidates, 89718 repo-hours, 1183 releases; waiting 213 ms; commit 0 ms)
2026-11-08T04:51:14Z [load_day 2024-02-26] 2024-02-26 hour 10: 292429 events in 0 files, snapshot none (task 9571 ms: download 6747 ms overlapping gunzip 1534 ms, parse 6561 ms, sort 0 ms, write 0 ms, index 730 ms: 15 candidates, 89979 repo-hours, 1157 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:51:15Z [load_day 2024-02-26] 2024-02-26 hour 11: 289446 events in 0 files, snapshot none (task 9364 ms: download 6792 ms overlapping gunzip 1544 ms, parse 6409 ms, sort 0 ms, write 0 ms, index 650 ms: 15 candidates, 85887 repo-hours, 1028 releases; waiting 506 ms; commit 0 ms)
2026-11-08T04:51:25Z [load_day 2024-02-26] 2024-02-26 hour 12: 319272 events in 0 files, snapshot none (task 10256 ms: download 7138 ms overlapping gunzip 1583 ms, parse 6835 ms, sort 0 ms, write 0 ms, index 1148 ms: 10 candidates, 114205 repo-hours, 1271 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:51:27Z [load_day 2024-02-26] 2024-02-26 hour 13: 307881 events in 0 files, snapshot none (task 11063 ms: download 7782 ms overlapping gunzip 1694 ms, parse 7297 ms, sort 0 ms, write 0 ms, index 1298 ms: 15 candidates, 108204 repo-hours, 1387 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:51:36Z [load_day 2024-02-26] 2024-02-26 hour 14: 304919 events in 0 files, snapshot none (task 10813 ms: download 7875 ms overlapping gunzip 1789 ms, parse 7392 ms, sort 0 ms, write 0 ms, index 773 ms: 14 candidates, 100660 repo-hours, 1198 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:51:37Z [load_day 2024-02-26] 2024-02-26 hour 15: 303520 events in 0 files, snapshot none (task 9745 ms: download 7083 ms overlapping gunzip 1609 ms, parse 6526 ms, sort 0 ms, write 0 ms, index 741 ms: 12 candidates, 102438 repo-hours, 1320 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:51:46Z [load_day 2024-02-26] 2024-02-26 hour 16: 306789 events in 0 files, snapshot none (task 8580 ms: download 6105 ms overlapping gunzip 1439 ms, parse 5839 ms, sort 0 ms, write 0 ms, index 766 ms: 12 candidates, 101089 repo-hours, 1216 releases; waiting 327 ms; commit 0 ms)
2026-11-08T04:51:46Z [load_day 2024-02-26] 2024-02-26 hour 17: 298791 events in 0 files, snapshot none (task 8392 ms: download 5789 ms overlapping gunzip 1375 ms, parse 5507 ms, sort 0 ms, write 0 ms, index 756 ms: 11 candidates, 92950 repo-hours, 1103 releases; waiting 490 ms; commit 0 ms)
2026-11-08T04:51:55Z [load_day 2024-02-26] 2024-02-26 hour 18: 220512 events in 0 files, snapshot none (task 9137 ms: download 5510 ms overlapping gunzip 1393 ms, parse 6187 ms, sort 0 ms, write 0 ms, index 816 ms: 6 candidates, 81823 repo-hours, 1117 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:51:57Z [load_day 2024-02-26] 2024-02-26 hour 19: 260974 events in 0 files, snapshot none (task 10107 ms: download 7484 ms overlapping gunzip 1731 ms, parse 6868 ms, sort 0 ms, write 0 ms, index 687 ms: 15 candidates, 80389 repo-hours, 1023 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:52:05Z [load_day 2024-02-26] 2024-02-26 hour 20: 279964 events in 0 files, snapshot none (task 9315 ms: download 6335 ms overlapping gunzip 1494 ms, parse 6362 ms, sort 0 ms, write 0 ms, index 698 ms: 9 candidates, 84200 repo-hours, 1062 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:52:07Z [load_day 2024-02-26] 2024-02-26 hour 21: 263702 events in 0 files, snapshot none (task 9339 ms: download 6854 ms overlapping gunzip 1546 ms, parse 6431 ms, sort 0 ms, write 0 ms, index 576 ms: 8 candidates, 78301 repo-hours, 1071 releases; waiting 525 ms; commit 0 ms)
2026-11-08T04:52:15Z [load_day 2024-02-26] 2024-02-26 hour 22: 265710 events in 0 files, snapshot none (task 9104 ms: download 6506 ms overlapping gunzip 1448 ms, parse 6312 ms, sort 0 ms, write 0 ms, index 541 ms: 8 candidates, 73939 repo-hours, 1001 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:52:15Z [load_day 2024-02-26] 2024-02-26 hour 23: 245656 events in 0 files, snapshot none (task 7909 ms: download 5652 ms overlapping gunzip 1412 ms, parse 5592 ms, sort 0 ms, write 0 ms, index 492 ms: 8 candidates, 65590 repo-hours, 773 releases; waiting 165 ms; commit 0 ms)
2026-11-08T04:52:24Z [load_day 2024-02-26] 2024-02-26: repo_hour merged from 24 files to 1 (2013944 rows, 9444 ms)
2026-11-08T04:52:27Z [load_day 2024-02-26] 2024-02-26: index committed in 12055 ms (24 + 1 + 24 files)
2026-11-08T04:52:27Z [load_day 2024-02-26] 2024-02-26: 6543772 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:52:27Z [load_day 2024-02-26] attempt 1 succeeded