orcaLog in

Runs · run 2773

load_day 2024-07-29, attempt 1 succeeded

Host
73ccef5e07c2:156063
Started
2026-11-08T07:12:01Z
Ended
2026-11-08T07:14:09Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
740 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
201.8 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2773/load_day/2024-07-29/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:12:02Z [load_day 2024-07-29] attempt 1 started
2026-11-08T07:12:03Z [load_day 2024-07-29] 2024-07-29: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:12:11Z [load_day 2024-07-29] 2024-07-29 hour 0: 167080 events in 0 files, snapshot none (task 7158 ms: download 3926 ms overlapping gunzip 1045 ms, parse 4275 ms, sort 0 ms, write 0 ms, index 682 ms: 8 candidates, 81933 repo-hours, 1091 releases; waiting 444 ms; commit 0 ms)
2026-11-08T07:12:11Z [load_day 2024-07-29] 2024-07-29 hour 1: 181666 events in 0 files, snapshot none (task 6701 ms: download 3892 ms overlapping gunzip 972 ms, parse 3936 ms, sort 0 ms, write 0 ms, index 1023 ms: 6 candidates, 99873 repo-hours, 869 releases; waiting 469 ms; commit 0 ms)
2026-11-08T07:12:18Z [load_day 2024-07-29] 2024-07-29 hour 2: 155483 events in 0 files, snapshot none (task 6828 ms: download 3618 ms overlapping gunzip 1073 ms, parse 4059 ms, sort 0 ms, write 0 ms, index 852 ms: 5 candidates, 65943 repo-hours, 817 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:12:19Z [load_day 2024-07-29] 2024-07-29 hour 3: 180717 events in 0 files, snapshot none (task 7394 ms: download 4704 ms overlapping gunzip 1240 ms, parse 4693 ms, sort 0 ms, write 0 ms, index 560 ms: 4 candidates, 73587 repo-hours, 5354 releases; waiting 578 ms; commit 0 ms)
2026-11-08T07:12:26Z [load_day 2024-07-29] 2024-07-29 hour 4: 162223 events in 0 files, snapshot none (task 7628 ms: download 4475 ms overlapping gunzip 1315 ms, parse 4940 ms, sort 0 ms, write 0 ms, index 708 ms: 2 candidates, 60079 repo-hours, 633 releases; waiting 335 ms; commit 0 ms)
2026-11-08T07:12:28Z [load_day 2024-07-29] 2024-07-29 hour 5: 172146 events in 0 files, snapshot none (task 8983 ms: download 6118 ms overlapping gunzip 1491 ms, parse 5706 ms, sort 0 ms, write 0 ms, index 639 ms: 6 candidates, 66750 repo-hours, 809 releases; waiting 552 ms; commit 0 ms)
2026-11-08T07:12:36Z [load_day 2024-07-29] 2024-07-29 hour 6: 209410 events in 0 files, snapshot none (task 9195 ms: download 6394 ms overlapping gunzip 1492 ms, parse 6032 ms, sort 0 ms, write 0 ms, index 898 ms: 5 candidates, 94065 repo-hours, 957 releases; waiting 531 ms; commit 0 ms)
2026-11-08T07:12:37Z [load_day 2024-07-29] 2024-07-29 hour 7: 205011 events in 0 files, snapshot none (task 8515 ms: download 5690 ms overlapping gunzip 1435 ms, parse 5539 ms, sort 0 ms, write 0 ms, index 643 ms: 3 candidates, 83205 repo-hours, 1185 releases; waiting 515 ms; commit 0 ms)
2026-11-08T07:12:45Z [load_day 2024-07-29] 2024-07-29 hour 8: 221736 events in 0 files, snapshot none (task 8455 ms: download 5945 ms overlapping gunzip 1457 ms, parse 5464 ms, sort 0 ms, write 0 ms, index 669 ms: 7 candidates, 91660 repo-hours, 1201 releases; waiting 573 ms; commit 0 ms)
2026-11-08T07:12:46Z [load_day 2024-07-29] 2024-07-29 hour 9: 224477 events in 0 files, snapshot none (task 8330 ms: download 5725 ms overlapping gunzip 1365 ms, parse 5426 ms, sort 0 ms, write 0 ms, index 698 ms: 11 candidates, 97558 repo-hours, 1427 releases; waiting 552 ms; commit 0 ms)
2026-11-08T07:12:53Z [load_day 2024-07-29] 2024-07-29 hour 10: 215430 events in 0 files, snapshot none (task 8088 ms: download 4904 ms overlapping gunzip 1322 ms, parse 5192 ms, sort 0 ms, write 0 ms, index 1129 ms: 1 candidates, 88065 repo-hours, 1026 releases; waiting 173 ms; commit 0 ms)
2026-11-08T07:12:54Z [load_day 2024-07-29] 2024-07-29 hour 11: 215063 events in 0 files, snapshot none (task 8040 ms: download 5122 ms overlapping gunzip 1263 ms, parse 5148 ms, sort 0 ms, write 0 ms, index 873 ms: 10 candidates, 84975 repo-hours, 1070 releases; waiting 523 ms; commit 0 ms)
2026-11-08T07:13:04Z [load_day 2024-07-29] 2024-07-29 hour 12: 267161 events in 0 files, snapshot none (task 10400 ms: download 6725 ms overlapping gunzip 1688 ms, parse 7250 ms, sort 0 ms, write 0 ms, index 1023 ms: 11 candidates, 131344 repo-hours, 1280 releases; waiting 174 ms; commit 0 ms)
2026-11-08T07:13:05Z [load_day 2024-07-29] 2024-07-29 hour 13: 253663 events in 0 files, snapshot none (task 10284 ms: download 7459 ms overlapping gunzip 1660 ms, parse 6916 ms, sort 0 ms, write 0 ms, index 836 ms: 8 candidates, 116862 repo-hours, 1284 releases; waiting 492 ms; commit 0 ms)
2026-11-08T07:13:16Z [load_day 2024-07-29] 2024-07-29 hour 14: 238870 events in 0 files, snapshot none (task 11806 ms: download 8357 ms overlapping gunzip 2008 ms, parse 7915 ms, sort 0 ms, write 0 ms, index 1095 ms: 8 candidates, 102386 repo-hours, 1425 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:13:18Z [load_day 2024-07-29] 2024-07-29 hour 15: 244731 events in 0 files, snapshot none (task 12034 ms: download 8594 ms overlapping gunzip 2013 ms, parse 8258 ms, sort 0 ms, write 0 ms, index 930 ms: 18 candidates, 105281 repo-hours, 1415 releases; waiting 549 ms; commit 0 ms)
2026-11-08T07:13:27Z [load_day 2024-07-29] 2024-07-29 hour 16: 227594 events in 0 files, snapshot none (task 10088 ms: download 6573 ms overlapping gunzip 1662 ms, parse 6777 ms, sort 0 ms, write 0 ms, index 861 ms: 5 candidates, 94973 repo-hours, 1139 releases; waiting 493 ms; commit 0 ms)
2026-11-08T07:13:27Z [load_day 2024-07-29] 2024-07-29 hour 17: 212065 events in 0 files, snapshot none (task 8764 ms: download 5587 ms overlapping gunzip 1455 ms, parse 5573 ms, sort 0 ms, write 0 ms, index 806 ms: 12 candidates, 86022 repo-hours, 979 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:13:38Z [load_day 2024-07-29] 2024-07-29 hour 18: 226843 events in 0 files, snapshot none (task 10751 ms: download 7142 ms overlapping gunzip 1737 ms, parse 6988 ms, sort 0 ms, write 0 ms, index 963 ms: 9 candidates, 100650 repo-hours, 1153 releases; waiting 366 ms; commit 0 ms)
2026-11-08T07:13:38Z [load_day 2024-07-29] 2024-07-29 hour 19: 205033 events in 0 files, snapshot none (task 9596 ms: download 6456 ms overlapping gunzip 1598 ms, parse 6481 ms, sort 0 ms, write 0 ms, index 668 ms: 6 candidates, 78958 repo-hours, 1060 releases; waiting 554 ms; commit 0 ms)
2026-11-08T07:13:49Z [load_day 2024-07-29] 2024-07-29 hour 20: 195142 events in 0 files, snapshot none (task 9791 ms: download 6948 ms overlapping gunzip 1586 ms, parse 6813 ms, sort 0 ms, write 0 ms, index 669 ms: 6 candidates, 77674 repo-hours, 1007 releases; waiting 510 ms; commit 0 ms)
2026-11-08T07:13:50Z [load_day 2024-07-29] 2024-07-29 hour 21: 189949 events in 0 files, snapshot none (task 10118 ms: download 7681 ms overlapping gunzip 1818 ms, parse 6866 ms, sort 0 ms, write 0 ms, index 621 ms: 6 candidates, 76016 repo-hours, 1067 releases; waiting 535 ms; commit 0 ms)
2026-11-08T07:13:58Z [load_day 2024-07-29] 2024-07-29 hour 22: 173221 events in 0 files, snapshot none (task 7828 ms: download 5273 ms overlapping gunzip 1403 ms, parse 5160 ms, sort 0 ms, write 0 ms, index 550 ms: 4 candidates, 64730 repo-hours, 1129 releases; waiting 496 ms; commit 0 ms)
2026-11-08T07:13:58Z [load_day 2024-07-29] 2024-07-29 hour 23: 161112 events in 0 files, snapshot none (task 7313 ms: download 4654 ms overlapping gunzip 1160 ms, parse 4698 ms, sort 0 ms, write 0 ms, index 656 ms: 8 candidates, 58670 repo-hours, 769 releases; waiting 549 ms; commit 0 ms)
2026-11-08T07:14:07Z [load_day 2024-07-29] 2024-07-29: repo_hour merged from 24 files to 1 (2081259 rows, 9038 ms)
2026-11-08T07:14:09Z [load_day 2024-07-29] 2024-07-29: index committed in 11582 ms (24 + 1 + 24 files)
2026-11-08T07:14:09Z [load_day 2024-07-29] 2024-07-29: 4905826 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:14:09Z [load_day 2024-07-29] attempt 1 succeeded