orcaLog in

Runs · run 2112

load_day 2024-02-21, attempt 1 succeeded

Host
73ccef5e07c2:89791
Started
2026-11-08T04:46:03Z
Ended
2026-11-08T04:48:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
713 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
200.8 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2112/load_day/2024-02-21/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:46:03Z [load_day 2024-02-21] attempt 1 started
2026-11-08T04:46:04Z [load_day 2024-02-21] 2024-02-21: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:46:14Z [load_day 2024-02-21] 2024-02-21 hour 0: 266291 events in 0 files, snapshot none (task 9565 ms: download 6571 ms overlapping gunzip 1566 ms, parse 6397 ms, sort 0 ms, write 0 ms, index 756 ms: 15 candidates, 98935 repo-hours, 1098 releases; waiting 513 ms; commit 0 ms)
2026-11-08T04:46:14Z [load_day 2024-02-21] 2024-02-21 hour 1: 268393 events in 0 files, snapshot none (task 9094 ms: download 6525 ms overlapping gunzip 1376 ms, parse 6247 ms, sort 0 ms, write 0 ms, index 734 ms: 4 candidates, 99916 repo-hours, 798 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:46:22Z [load_day 2024-02-21] 2024-02-21 hour 2: 242962 events in 0 files, snapshot none (task 7757 ms: download 5070 ms overlapping gunzip 1245 ms, parse 5148 ms, sort 0 ms, write 0 ms, index 511 ms: 10 candidates, 69743 repo-hours, 709 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:46:23Z [load_day 2024-02-21] 2024-02-21 hour 3: 248484 events in 0 files, snapshot none (task 8648 ms: download 6167 ms overlapping gunzip 1466 ms, parse 5800 ms, sort 0 ms, write 0 ms, index 533 ms: 6 candidates, 70589 repo-hours, 794 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:46:29Z [load_day 2024-02-21] 2024-02-21 hour 4: 236534 events in 0 files, snapshot none (task 6474 ms: download 4171 ms overlapping gunzip 928 ms, parse 3895 ms, sort 0 ms, write 0 ms, index 444 ms: 5 candidates, 62334 repo-hours, 706 releases; waiting 860 ms; commit 0 ms)
2026-11-08T04:46:29Z [load_day 2024-02-21] 2024-02-21 hour 5: 240161 events in 0 files, snapshot none (task 5855 ms: download 3381 ms overlapping gunzip 870 ms, parse 3581 ms, sort 0 ms, write 0 ms, index 564 ms: 3 candidates, 66163 repo-hours, 666 releases; waiting 537 ms; commit 0 ms)
2026-11-08T04:46:36Z [load_day 2024-02-21] 2024-02-21 hour 6: 263905 events in 0 files, snapshot none (task 6205 ms: download 3721 ms overlapping gunzip 907 ms, parse 3854 ms, sort 0 ms, write 0 ms, index 593 ms: 3 candidates, 80601 repo-hours, 787 releases; waiting 550 ms; commit 0 ms)
2026-11-08T04:46:36Z [load_day 2024-02-21] 2024-02-21 hour 7: 264593 events in 0 files, snapshot none (task 6483 ms: download 4015 ms overlapping gunzip 983 ms, parse 4124 ms, sort 0 ms, write 0 ms, index 581 ms: 11 candidates, 78724 repo-hours, 854 releases; waiting 515 ms; commit 0 ms)
2026-11-08T04:46:45Z [load_day 2024-02-21] 2024-02-21 hour 8: 262231 events in 0 files, snapshot none (task 8816 ms: download 5728 ms overlapping gunzip 1404 ms, parse 5937 ms, sort 0 ms, write 0 ms, index 692 ms: 15 candidates, 83393 repo-hours, 1020 releases; waiting 530 ms; commit 0 ms)
2026-11-08T04:46:47Z [load_day 2024-02-21] 2024-02-21 hour 9: 284070 events in 0 files, snapshot none (task 10474 ms: download 7227 ms overlapping gunzip 1542 ms, parse 6906 ms, sort 0 ms, write 0 ms, index 1152 ms: 11 candidates, 91218 repo-hours, 1347 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:46:58Z [load_day 2024-02-21] 2024-02-21 hour 10: 285241 events in 0 files, snapshot none (task 12203 ms: download 8797 ms overlapping gunzip 1993 ms, parse 8174 ms, sort 0 ms, write 0 ms, index 1239 ms: 13 candidates, 90224 repo-hours, 1065 releases; waiting 505 ms; commit 0 ms)
2026-11-08T04:46:59Z [load_day 2024-02-21] 2024-02-21 hour 11: 282699 events in 0 files, snapshot none (task 11708 ms: download 8015 ms overlapping gunzip 1811 ms, parse 7956 ms, sort 0 ms, write 0 ms, index 1071 ms: 8 candidates, 86129 repo-hours, 1000 releases; waiting 556 ms; commit 0 ms)
2026-11-08T04:47:09Z [load_day 2024-02-21] 2024-02-21 hour 12: 317150 events in 0 files, snapshot none (task 10854 ms: download 6334 ms overlapping gunzip 1562 ms, parse 7143 ms, sort 0 ms, write 0 ms, index 1391 ms: 11 candidates, 116313 repo-hours, 1081 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:47:11Z [load_day 2024-02-21] 2024-02-21 hour 13: 304252 events in 0 files, snapshot none (task 11260 ms: download 7704 ms overlapping gunzip 1713 ms, parse 7559 ms, sort 0 ms, write 0 ms, index 1197 ms: 12 candidates, 109492 repo-hours, 1194 releases; waiting 487 ms; commit 0 ms)
2026-11-08T04:47:20Z [load_day 2024-02-21] 2024-02-21 hour 14: 301965 events in 0 files, snapshot none (task 10567 ms: download 6838 ms overlapping gunzip 1583 ms, parse 7113 ms, sort 0 ms, write 0 ms, index 1123 ms: 10 candidates, 101344 repo-hours, 1223 releases; waiting 496 ms; commit 0 ms)
2026-11-08T04:47:23Z [load_day 2024-02-21] 2024-02-21 hour 15: 298410 events in 0 files, snapshot none (task 10784 ms: download 7876 ms overlapping gunzip 1603 ms, parse 7354 ms, sort 0 ms, write 0 ms, index 1034 ms: 7 candidates, 101888 repo-hours, 1375 releases; waiting 519 ms; commit 0 ms)
2026-11-08T04:47:32Z [load_day 2024-02-21] 2024-02-21 hour 16: 301964 events in 0 files, snapshot none (task 11530 ms: download 7697 ms overlapping gunzip 1926 ms, parse 7846 ms, sort 0 ms, write 0 ms, index 874 ms: 21 candidates, 99536 repo-hours, 1365 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:47:34Z [load_day 2024-02-21] 2024-02-21 hour 17: 287741 events in 0 files, snapshot none (task 10549 ms: download 7839 ms overlapping gunzip 1683 ms, parse 7488 ms, sort 0 ms, write 0 ms, index 677 ms: 15 candidates, 91737 repo-hours, 1113 releases; waiting 455 ms; commit 0 ms)
2026-11-08T04:47:43Z [load_day 2024-02-21] 2024-02-21 hour 18: 283047 events in 0 files, snapshot none (task 10402 ms: download 7253 ms overlapping gunzip 1625 ms, parse 7266 ms, sort 0 ms, write 0 ms, index 736 ms: 8 candidates, 93930 repo-hours, 1209 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:47:44Z [load_day 2024-02-21] 2024-02-21 hour 19: 268332 events in 0 files, snapshot none (task 9957 ms: download 7337 ms overlapping gunzip 1660 ms, parse 6775 ms, sort 0 ms, write 0 ms, index 735 ms: 11 candidates, 81357 repo-hours, 972 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:47:55Z [load_day 2024-02-21] 2024-02-21 hour 20: 274626 events in 0 files, snapshot none (task 11436 ms: download 8605 ms overlapping gunzip 1948 ms, parse 8019 ms, sort 0 ms, write 0 ms, index 730 ms: 15 candidates, 84529 repo-hours, 919 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:47:55Z [load_day 2024-02-21] 2024-02-21 hour 21: 256378 events in 0 files, snapshot none (task 9269 ms: download 6063 ms overlapping gunzip 1511 ms, parse 6172 ms, sort 0 ms, write 0 ms, index 737 ms: 12 candidates, 75181 repo-hours, 965 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:48:05Z [load_day 2024-02-21] 2024-02-21 hour 22: 254939 events in 0 files, snapshot none (task 9698 ms: download 6289 ms overlapping gunzip 1523 ms, parse 6687 ms, sort 0 ms, write 0 ms, index 691 ms: 8 candidates, 69719 repo-hours, 968 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:48:05Z [load_day 2024-02-21] 2024-02-21 hour 23: 231569 events in 0 files, snapshot none (task 8860 ms: download 5657 ms overlapping gunzip 1326 ms, parse 6028 ms, sort 0 ms, write 0 ms, index 656 ms: 10 candidates, 61931 repo-hours, 670 releases; waiting 580 ms; commit 0 ms)
2026-11-08T04:48:15Z [load_day 2024-02-21] 2024-02-21: repo_hour merged from 24 files to 1 (2064926 rows, 9602 ms)
2026-11-08T04:48:17Z [load_day 2024-02-21] 2024-02-21: index committed in 12068 ms (24 + 1 + 24 files)
2026-11-08T04:48:17Z [load_day 2024-02-21] 2024-02-21: 6525937 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:48:17Z [load_day 2024-02-21] attempt 1 succeeded