orcaLog in

Runs · run 1987

load_day 2024-01-19, attempt 1 succeeded

Host
73ccef5e07c2:43298
Started
2026-11-08T04:13:23Z
Ended
2026-11-08T04:15:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
687 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
169.0 s, up to 2.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1987/load_day/2024-01-19/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:13:23Z [load_day 2024-01-19] attempt 1 started
2026-11-08T04:13:23Z [load_day 2024-01-19] 2024-01-19: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:13:32Z [load_day 2024-01-19] 2024-01-19 hour 0: 198653 events in 0 files, snapshot none (task 7993 ms: download 4553 ms overlapping gunzip 1250 ms, parse 5111 ms, sort 0 ms, write 0 ms, index 850 ms: 5 candidates, 84715 repo-hours, 991 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:13:32Z [load_day 2024-01-19] 2024-01-19 hour 1: 203958 events in 0 files, snapshot none (task 8330 ms: download 4864 ms overlapping gunzip 1254 ms, parse 5414 ms, sort 0 ms, write 0 ms, index 867 ms: 5 candidates, 93858 repo-hours, 937 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:13:39Z [load_day 2024-01-19] 2024-01-19 hour 2: 175888 events in 0 files, snapshot none (task 6912 ms: download 3546 ms overlapping gunzip 1014 ms, parse 4395 ms, sort 0 ms, write 0 ms, index 726 ms: 5 candidates, 63721 repo-hours, 837 releases; waiting 533 ms; commit 0 ms)
2026-11-08T04:13:40Z [load_day 2024-01-19] 2024-01-19 hour 3: 170312 events in 0 files, snapshot none (task 7098 ms: download 3406 ms overlapping gunzip 1062 ms, parse 4468 ms, sort 0 ms, write 0 ms, index 594 ms: 1 candidates, 59648 repo-hours, 871 releases; waiting 555 ms; commit 0 ms)
2026-11-08T04:13:46Z [load_day 2024-01-19] 2024-01-19 hour 4: 171515 events in 0 files, snapshot none (task 5865 ms: download 3299 ms overlapping gunzip 866 ms, parse 3715 ms, sort 0 ms, write 0 ms, index 516 ms: 4 candidates, 56567 repo-hours, 658 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:13:46Z [load_day 2024-01-19] 2024-01-19 hour 5: 180380 events in 0 files, snapshot none (task 6306 ms: download 3673 ms overlapping gunzip 1023 ms, parse 4030 ms, sort 0 ms, write 0 ms, index 458 ms: 5 candidates, 60705 repo-hours, 912 releases; waiting 514 ms; commit 0 ms)
2026-11-08T04:13:53Z [load_day 2024-01-19] 2024-01-19 hour 6: 193567 events in 0 files, snapshot none (task 7243 ms: download 4029 ms overlapping gunzip 1067 ms, parse 4494 ms, sort 0 ms, write 0 ms, index 663 ms: 6 candidates, 73679 repo-hours, 822 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:13:55Z [load_day 2024-01-19] 2024-01-19 hour 7: 199965 events in 0 files, snapshot none (task 7842 ms: download 4866 ms overlapping gunzip 1215 ms, parse 5339 ms, sort 0 ms, write 0 ms, index 802 ms: 7 candidates, 71182 repo-hours, 1018 releases; waiting 177 ms; commit 0 ms)
2026-11-08T04:14:02Z [load_day 2024-01-19] 2024-01-19 hour 8: 196228 events in 0 files, snapshot none (task 8421 ms: download 4641 ms overlapping gunzip 1269 ms, parse 5423 ms, sort 0 ms, write 0 ms, index 969 ms: 6 candidates, 75186 repo-hours, 789 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:14:06Z [load_day 2024-01-19] 2024-01-19 hour 9: 224301 events in 0 files, snapshot none (task 10080 ms: download 6687 ms overlapping gunzip 1581 ms, parse 6546 ms, sort 0 ms, write 0 ms, index 1199 ms: 10 candidates, 84124 repo-hours, 1144 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:14:12Z [load_day 2024-01-19] 2024-01-19 hour 10: 221157 events in 0 files, snapshot none (task 8800 ms: download 5275 ms overlapping gunzip 1454 ms, parse 5853 ms, sort 0 ms, write 0 ms, index 781 ms: 4 candidates, 83607 repo-hours, 1059 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:14:15Z [load_day 2024-01-19] 2024-01-19 hour 11: 213720 events in 0 files, snapshot none (task 9311 ms: download 6003 ms overlapping gunzip 1426 ms, parse 6076 ms, sort 0 ms, write 0 ms, index 1070 ms: 5 candidates, 78061 repo-hours, 883 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:14:21Z [load_day 2024-01-19] 2024-01-19 hour 12: 257295 events in 0 files, snapshot none (task 8440 ms: download 4586 ms overlapping gunzip 1140 ms, parse 5032 ms, sort 0 ms, write 0 ms, index 1466 ms: 8 candidates, 108131 repo-hours, 1205 releases; waiting 480 ms; commit 0 ms)
2026-11-08T04:14:26Z [load_day 2024-01-19] 2024-01-19 hour 13: 243436 events in 0 files, snapshot none (task 10125 ms: download 6915 ms overlapping gunzip 1566 ms, parse 6891 ms, sort 0 ms, write 0 ms, index 871 ms: 5 candidates, 103070 repo-hours, 1096 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:14:30Z [load_day 2024-01-19] 2024-01-19 hour 14: 234669 events in 0 files, snapshot none (task 9096 ms: download 5123 ms overlapping gunzip 1445 ms, parse 5806 ms, sort 0 ms, write 0 ms, index 1108 ms: 6 candidates, 91557 repo-hours, 1123 releases; waiting 456 ms; commit 0 ms)
2026-11-08T04:14:37Z [load_day 2024-01-19] 2024-01-19 hour 15: 235225 events in 0 files, snapshot none (task 10014 ms: download 7280 ms overlapping gunzip 1651 ms, parse 6845 ms, sort 0 ms, write 0 ms, index 738 ms: 7 candidates, 93068 repo-hours, 1294 releases; waiting 459 ms; commit 0 ms)
2026-11-08T04:14:40Z [load_day 2024-01-19] 2024-01-19 hour 16: 239471 events in 0 files, snapshot none (task 9351 ms: download 6219 ms overlapping gunzip 1506 ms, parse 6190 ms, sort 0 ms, write 0 ms, index 939 ms: 3 candidates, 95217 repo-hours, 1181 releases; waiting 470 ms; commit 0 ms)
2026-11-08T04:14:45Z [load_day 2024-01-19] 2024-01-19 hour 17: 226379 events in 0 files, snapshot none (task 7561 ms: download 4673 ms overlapping gunzip 1214 ms, parse 5057 ms, sort 0 ms, write 0 ms, index 651 ms: 4 candidates, 83507 repo-hours, 1148 releases; waiting 363 ms; commit 0 ms)
2026-11-08T04:14:48Z [load_day 2024-01-19] 2024-01-19 hour 18: 221725 events in 0 files, snapshot none (task 7324 ms: download 4578 ms overlapping gunzip 1096 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 813 ms: 3 candidates, 86068 repo-hours, 1187 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:14:54Z [load_day 2024-01-19] 2024-01-19 hour 19: 204257 events in 0 files, snapshot none (task 8482 ms: download 4516 ms overlapping gunzip 1282 ms, parse 5613 ms, sort 0 ms, write 0 ms, index 715 ms: 8 candidates, 72277 repo-hours, 1118 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:14:57Z [load_day 2024-01-19] 2024-01-19 hour 20: 197912 events in 0 files, snapshot none (task 8845 ms: download 5352 ms overlapping gunzip 1305 ms, parse 5760 ms, sort 0 ms, write 0 ms, index 839 ms: 8 candidates, 70132 repo-hours, 788 releases; waiting 581 ms; commit 0 ms)
2026-11-08T04:15:03Z [load_day 2024-01-19] 2024-01-19 hour 21: 188922 events in 0 files, snapshot none (task 8695 ms: download 4930 ms overlapping gunzip 1370 ms, parse 5822 ms, sort 0 ms, write 0 ms, index 676 ms: 12 candidates, 64658 repo-hours, 931 releases; waiting 531 ms; commit 0 ms)
2026-11-08T04:15:08Z [load_day 2024-01-19] 2024-01-19 hour 22: 188482 events in 0 files, snapshot none (task 10017 ms: download 6056 ms overlapping gunzip 1755 ms, parse 6682 ms, sort 0 ms, write 0 ms, index 801 ms: 7 candidates, 64452 repo-hours, 848 releases; waiting 507 ms; commit 0 ms)
2026-11-08T04:15:11Z [load_day 2024-01-19] 2024-01-19 hour 23: 167253 events in 0 files, snapshot none (task 7301 ms: download 5007 ms overlapping gunzip 1217 ms, parse 4797 ms, sort 0 ms, write 0 ms, index 407 ms: 7 candidates, 56324 repo-hours, 746 releases; waiting 561 ms; commit 0 ms)
2026-11-08T04:15:21Z [load_day 2024-01-19] 2024-01-19: repo_hour merged from 24 files to 1 (1873514 rows, 9837 ms)
2026-11-08T04:15:23Z [load_day 2024-01-19] 2024-01-19: index committed in 12407 ms (24 + 1 + 24 files)
2026-11-08T04:15:23Z [load_day 2024-01-19] 2024-01-19: 4954670 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:15:23Z [load_day 2024-01-19] attempt 1 succeeded