orcaLog in

Runs · run 2031

load_day 2024-01-31, attempt 1 succeeded

Host
73ccef5e07c2:78691
Started
2026-11-08T04:24:54Z
Ended
2026-11-08T04:27:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
721 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
185.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2031/load_day/2024-01-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:24:54Z [load_day 2024-01-31] attempt 1 started
2026-11-08T04:24:55Z [load_day 2024-01-31] 2024-01-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:25:05Z [load_day 2024-01-31] 2024-01-31 hour 0: 241030 events in 0 files, snapshot none (task 9753 ms: download 6061 ms overlapping gunzip 1536 ms, parse 6597 ms, sort 0 ms, write 0 ms, index 811 ms: 15 candidates, 92916 repo-hours, 1200 releases; waiting 293 ms; commit 0 ms)
2026-11-08T04:25:05Z [load_day 2024-01-31] 2024-01-31 hour 1: 208819 events in 0 files, snapshot none (task 9692 ms: download 6050 ms overlapping gunzip 1433 ms, parse 6367 ms, sort 0 ms, write 0 ms, index 943 ms: 8 candidates, 97343 repo-hours, 811 releases; waiting 556 ms; commit 0 ms)
2026-11-08T04:25:13Z [load_day 2024-01-31] 2024-01-31 hour 2: 158235 events in 0 files, snapshot none (task 7017 ms: download 3562 ms overlapping gunzip 1113 ms, parse 4270 ms, sort 0 ms, write 0 ms, index 800 ms: 9 candidates, 65031 repo-hours, 731 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:25:13Z [load_day 2024-01-31] 2024-01-31 hour 3: 155478 events in 0 files, snapshot none (task 7422 ms: download 3911 ms overlapping gunzip 1233 ms, parse 4770 ms, sort 0 ms, write 0 ms, index 582 ms: 4 candidates, 63031 repo-hours, 823 releases; waiting 501 ms; commit 0 ms)
2026-11-08T04:25:19Z [load_day 2024-01-31] 2024-01-31 hour 4: 173943 events in 0 files, snapshot none (task 6531 ms: download 3935 ms overlapping gunzip 968 ms, parse 4054 ms, sort 0 ms, write 0 ms, index 538 ms: 3 candidates, 59781 repo-hours, 745 releases; waiting 676 ms; commit 0 ms)
2026-11-08T04:25:20Z [load_day 2024-01-31] 2024-01-31 hour 5: 192797 events in 0 files, snapshot none (task 6291 ms: download 3935 ms overlapping gunzip 957 ms, parse 4122 ms, sort 0 ms, write 0 ms, index 456 ms: 6 candidates, 63216 repo-hours, 715 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:25:29Z [load_day 2024-01-31] 2024-01-31 hour 6: 214060 events in 0 files, snapshot none (task 8800 ms: download 5426 ms overlapping gunzip 1402 ms, parse 5951 ms, sort 0 ms, write 0 ms, index 661 ms: 7 candidates, 77199 repo-hours, 808 releases; waiting 478 ms; commit 0 ms)
2026-11-08T04:25:29Z [load_day 2024-01-31] 2024-01-31 hour 7: 217562 events in 0 files, snapshot none (task 8824 ms: download 5644 ms overlapping gunzip 1396 ms, parse 5918 ms, sort 0 ms, write 0 ms, index 708 ms: 5 candidates, 76454 repo-hours, 1201 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:25:39Z [load_day 2024-01-31] 2024-01-31 hour 8: 233603 events in 0 files, snapshot none (task 10045 ms: download 6552 ms overlapping gunzip 1514 ms, parse 6725 ms, sort 0 ms, write 0 ms, index 937 ms: 13 candidates, 84426 repo-hours, 1032 releases; waiting 579 ms; commit 0 ms)
2026-11-08T04:25:40Z [load_day 2024-01-31] 2024-01-31 hour 9: 246288 events in 0 files, snapshot none (task 10158 ms: download 7116 ms overlapping gunzip 1566 ms, parse 6956 ms, sort 0 ms, write 0 ms, index 779 ms: 5 candidates, 90113 repo-hours, 1423 releases; waiting 509 ms; commit 0 ms)
2026-11-08T04:25:51Z [load_day 2024-01-31] 2024-01-31 hour 10: 242974 events in 0 files, snapshot none (task 11336 ms: download 7100 ms overlapping gunzip 1881 ms, parse 7845 ms, sort 0 ms, write 0 ms, index 768 ms: 4 candidates, 91011 repo-hours, 1297 releases; waiting 524 ms; commit 0 ms)
2026-11-08T04:25:51Z [load_day 2024-01-31] 2024-01-31 hour 11: 235523 events in 0 files, snapshot none (task 10552 ms: download 5836 ms overlapping gunzip 1604 ms, parse 7179 ms, sort 0 ms, write 0 ms, index 955 ms: 5 candidates, 83968 repo-hours, 1028 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:26:01Z [load_day 2024-01-31] 2024-01-31 hour 12: 292708 events in 0 files, snapshot none (task 9555 ms: download 6233 ms overlapping gunzip 1421 ms, parse 6457 ms, sort 0 ms, write 0 ms, index 905 ms: 7 candidates, 116450 repo-hours, 1199 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:26:02Z [load_day 2024-01-31] 2024-01-31 hour 13: 247681 events in 0 files, snapshot none (task 10190 ms: download 7129 ms overlapping gunzip 1665 ms, parse 6779 ms, sort 0 ms, write 0 ms, index 877 ms: 12 candidates, 113146 repo-hours, 1399 releases; waiting 566 ms; commit 0 ms)
2026-11-08T04:26:11Z [load_day 2024-01-31] 2024-01-31 hour 14: 236657 events in 0 files, snapshot none (task 9326 ms: download 6442 ms overlapping gunzip 1426 ms, parse 5988 ms, sort 0 ms, write 0 ms, index 903 ms: 5 candidates, 101702 repo-hours, 1343 releases; waiting 630 ms; commit 0 ms)
2026-11-08T04:26:11Z [load_day 2024-01-31] 2024-01-31 hour 15: 259884 events in 0 files, snapshot none (task 8666 ms: download 5656 ms overlapping gunzip 1359 ms, parse 5428 ms, sort 0 ms, write 0 ms, index 782 ms: 8 candidates, 102630 repo-hours, 1508 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:26:22Z [load_day 2024-01-31] 2024-01-31 hour 16: 260154 events in 0 files, snapshot none (task 9838 ms: download 6150 ms overlapping gunzip 1486 ms, parse 6259 ms, sort 0 ms, write 0 ms, index 1195 ms: 5 candidates, 99095 repo-hours, 1201 releases; waiting 539 ms; commit 0 ms)
2026-11-08T04:26:22Z [load_day 2024-01-31] 2024-01-31 hour 17: 245146 events in 0 files, snapshot none (task 8816 ms: download 5355 ms overlapping gunzip 1258 ms, parse 5421 ms, sort 0 ms, write 0 ms, index 1326 ms: 4 candidates, 90557 repo-hours, 1088 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:26:33Z [load_day 2024-01-31] 2024-01-31 hour 18: 247064 events in 0 files, snapshot none (task 10476 ms: download 6973 ms overlapping gunzip 1666 ms, parse 6997 ms, sort 0 ms, write 0 ms, index 970 ms: 5 candidates, 95101 repo-hours, 1270 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:26:33Z [load_day 2024-01-31] 2024-01-31 hour 19: 238473 events in 0 files, snapshot none (task 10944 ms: download 7248 ms overlapping gunzip 1739 ms, parse 7425 ms, sort 0 ms, write 0 ms, index 945 ms: 4 candidates, 83397 repo-hours, 1095 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:26:42Z [load_day 2024-01-31] 2024-01-31 hour 20: 229461 events in 0 files, snapshot none (task 9403 ms: download 5511 ms overlapping gunzip 1456 ms, parse 6217 ms, sort 0 ms, write 0 ms, index 892 ms: 9 candidates, 81393 repo-hours, 1023 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:26:43Z [load_day 2024-01-31] 2024-01-31 hour 21: 218264 events in 0 files, snapshot none (task 9195 ms: download 5593 ms overlapping gunzip 1471 ms, parse 6158 ms, sort 0 ms, write 0 ms, index 788 ms: 6 candidates, 75552 repo-hours, 1079 releases; waiting 474 ms; commit 0 ms)
2026-11-08T04:26:52Z [load_day 2024-01-31] 2024-01-31 hour 22: 210662 events in 0 files, snapshot none (task 8832 ms: download 6035 ms overlapping gunzip 1494 ms, parse 5972 ms, sort 0 ms, write 0 ms, index 553 ms: 8 candidates, 69680 repo-hours, 1100 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:26:52Z [load_day 2024-01-31] 2024-01-31 hour 23: 195482 events in 0 files, snapshot none (task 8153 ms: download 4881 ms overlapping gunzip 1246 ms, parse 5269 ms, sort 0 ms, write 0 ms, index 816 ms: 6 candidates, 63437 repo-hours, 838 releases; waiting 543 ms; commit 0 ms)
2026-11-08T04:27:01Z [load_day 2024-01-31] 2024-01-31: repo_hour merged from 24 files to 1 (2036629 rows, 9071 ms)
2026-11-08T04:27:03Z [load_day 2024-01-31] 2024-01-31: index committed in 11539 ms (24 + 1 + 24 files)
2026-11-08T04:27:03Z [load_day 2024-01-31] 2024-01-31: 5401948 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:27:03Z [load_day 2024-01-31] attempt 1 succeeded