orcaLog in

Runs · run 1974

load_day 2024-01-16, attempt 1 succeeded

Host
73ccef5e07c2:29823
Started
2026-11-08T04:10:35Z
Ended
2026-11-08T04:12:42Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
696 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
174.9 s, up to 2.6 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/1974/load_day/2024-01-16/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:10:35Z [load_day 2024-01-16] attempt 1 started
2026-11-08T04:10:36Z [load_day 2024-01-16] 2024-01-16: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:10:45Z [load_day 2024-01-16] 2024-01-16 hour 0: 212804 events in 0 files, snapshot none (task 8430 ms: download 5489 ms overlapping gunzip 1291 ms, parse 5685 ms, sort 0 ms, write 0 ms, index 754 ms: 10 candidates, 82722 repo-hours, 909 releases; waiting 444 ms; commit 0 ms)
2026-11-08T04:10:45Z [load_day 2024-01-16] 2024-01-16 hour 1: 220784 events in 0 files, snapshot none (task 8433 ms: download 4680 ms overlapping gunzip 1276 ms, parse 5468 ms, sort 0 ms, write 0 ms, index 939 ms: 8 candidates, 91150 repo-hours, 1044 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:10:53Z [load_day 2024-01-16] 2024-01-16 hour 2: 192372 events in 0 files, snapshot none (task 7366 ms: download 4015 ms overlapping gunzip 1200 ms, parse 4824 ms, sort 0 ms, write 0 ms, index 623 ms: 3 candidates, 60614 repo-hours, 683 releases; waiting 483 ms; commit 0 ms)
2026-11-08T04:10:54Z [load_day 2024-01-16] 2024-01-16 hour 3: 193073 events in 0 files, snapshot none (task 8293 ms: download 4983 ms overlapping gunzip 1382 ms, parse 5561 ms, sort 0 ms, write 0 ms, index 628 ms: 4 candidates, 59235 repo-hours, 842 releases; waiting 468 ms; commit 0 ms)
2026-11-08T04:11:01Z [load_day 2024-01-16] 2024-01-16 hour 4: 186994 events in 0 files, snapshot none (task 7584 ms: download 4230 ms overlapping gunzip 1130 ms, parse 5069 ms, sort 0 ms, write 0 ms, index 539 ms: 7 candidates, 55297 repo-hours, 622 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:11:01Z [load_day 2024-01-16] 2024-01-16 hour 5: 199577 events in 0 files, snapshot none (task 7224 ms: download 4253 ms overlapping gunzip 1122 ms, parse 4707 ms, sort 0 ms, write 0 ms, index 554 ms: 5 candidates, 62323 repo-hours, 604 releases; waiting 572 ms; commit 0 ms)
2026-11-08T04:11:08Z [load_day 2024-01-16] 2024-01-16 hour 6: 217672 events in 0 files, snapshot none (task 6431 ms: download 3440 ms overlapping gunzip 937 ms, parse 4037 ms, sort 0 ms, write 0 ms, index 657 ms: 6 candidates, 75419 repo-hours, 985 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:11:08Z [load_day 2024-01-16] 2024-01-16 hour 7: 218130 events in 0 files, snapshot none (task 6397 ms: download 3759 ms overlapping gunzip 963 ms, parse 4013 ms, sort 0 ms, write 0 ms, index 622 ms: 9 candidates, 73179 repo-hours, 887 releases; waiting 517 ms; commit 0 ms)
2026-11-08T04:11:16Z [load_day 2024-01-16] 2024-01-16 hour 8: 244993 events in 0 files, snapshot none (task 7623 ms: download 4923 ms overlapping gunzip 1175 ms, parse 4990 ms, sort 0 ms, write 0 ms, index 670 ms: 8 candidates, 79284 repo-hours, 962 releases; waiting 488 ms; commit 0 ms)
2026-11-08T04:11:17Z [load_day 2024-01-16] 2024-01-16 hour 9: 247399 events in 0 files, snapshot none (task 8189 ms: download 5518 ms overlapping gunzip 1255 ms, parse 5468 ms, sort 0 ms, write 0 ms, index 671 ms: 7 candidates, 87012 repo-hours, 1212 releases; waiting 554 ms; commit 0 ms)
2026-11-08T04:11:28Z [load_day 2024-01-16] 2024-01-16 hour 10: 246322 events in 0 files, snapshot none (task 11236 ms: download 8151 ms overlapping gunzip 1852 ms, parse 7835 ms, sort 0 ms, write 0 ms, index 788 ms: 8 candidates, 86893 repo-hours, 1148 releases; waiting 503 ms; commit 0 ms)
2026-11-08T04:11:28Z [load_day 2024-01-16] 2024-01-16 hour 11: 240452 events in 0 files, snapshot none (task 11101 ms: download 7585 ms overlapping gunzip 1729 ms, parse 7494 ms, sort 0 ms, write 0 ms, index 1090 ms: 7 candidates, 83932 repo-hours, 969 releases; waiting 459 ms; commit 0 ms)
2026-11-08T04:11:39Z [load_day 2024-01-16] 2024-01-16 hour 12: 277449 events in 0 files, snapshot none (task 10595 ms: download 6577 ms overlapping gunzip 1582 ms, parse 7036 ms, sort 0 ms, write 0 ms, index 1222 ms: 5 candidates, 113908 repo-hours, 1229 releases; waiting 479 ms; commit 0 ms)
2026-11-08T04:11:40Z [load_day 2024-01-16] 2024-01-16 hour 13: 268025 events in 0 files, snapshot none (task 11576 ms: download 7539 ms overlapping gunzip 1800 ms, parse 7987 ms, sort 0 ms, write 0 ms, index 925 ms: 6 candidates, 109305 repo-hours, 1179 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:11:50Z [load_day 2024-01-16] 2024-01-16 hour 14: 259835 events in 0 files, snapshot none (task 10617 ms: download 7249 ms overlapping gunzip 1645 ms, parse 7429 ms, sort 0 ms, write 0 ms, index 778 ms: 2 candidates, 97471 repo-hours, 1496 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:11:51Z [load_day 2024-01-16] 2024-01-16 hour 15: 269130 events in 0 files, snapshot none (task 10312 ms: download 7311 ms overlapping gunzip 1645 ms, parse 6948 ms, sort 0 ms, write 0 ms, index 836 ms: 8 candidates, 99941 repo-hours, 1475 releases; waiting 528 ms; commit 0 ms)
2026-11-08T04:12:01Z [load_day 2024-01-16] 2024-01-16 hour 16: 253174 events in 0 files, snapshot none (task 10683 ms: download 7220 ms overlapping gunzip 1694 ms, parse 7287 ms, sort 0 ms, write 0 ms, index 913 ms: 11 candidates, 97835 repo-hours, 1224 releases; waiting 511 ms; commit 0 ms)
2026-11-08T04:12:01Z [load_day 2024-01-16] 2024-01-16 hour 17: 221348 events in 0 files, snapshot none (task 9448 ms: download 6541 ms overlapping gunzip 1644 ms, parse 6532 ms, sort 0 ms, write 0 ms, index 802 ms: 5 candidates, 89396 repo-hours, 1275 releases; waiting 246 ms; commit 0 ms)
2026-11-08T04:12:09Z [load_day 2024-01-16] 2024-01-16 hour 18: 144487 events in 0 files, snapshot none (task 7008 ms: download 3916 ms overlapping gunzip 1038 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 806 ms: 5 candidates, 69930 repo-hours, 801 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:12:12Z [load_day 2024-01-16] 2024-01-16 hour 19: 217978 events in 0 files, snapshot none (task 9786 ms: download 6624 ms overlapping gunzip 1534 ms, parse 6437 ms, sort 0 ms, write 0 ms, index 1022 ms: 8 candidates, 81401 repo-hours, 1016 releases; waiting 526 ms; commit 0 ms)
2026-11-08T04:12:19Z [load_day 2024-01-16] 2024-01-16 hour 20: 227032 events in 0 files, snapshot none (task 9795 ms: download 6717 ms overlapping gunzip 1577 ms, parse 6606 ms, sort 0 ms, write 0 ms, index 849 ms: 4 candidates, 80949 repo-hours, 903 releases; waiting 523 ms; commit 0 ms)
2026-11-08T04:12:21Z [load_day 2024-01-16] 2024-01-16 hour 21: 209996 events in 0 files, snapshot none (task 8766 ms: download 5717 ms overlapping gunzip 1483 ms, parse 5986 ms, sort 0 ms, write 0 ms, index 618 ms: 10 candidates, 71373 repo-hours, 1156 releases; waiting 309 ms; commit 0 ms)
2026-11-08T04:12:28Z [load_day 2024-01-16] 2024-01-16 hour 22: 201057 events in 0 files, snapshot none (task 8680 ms: download 4845 ms overlapping gunzip 1330 ms, parse 5792 ms, sort 0 ms, write 0 ms, index 838 ms: 6 candidates, 64802 repo-hours, 1091 releases; waiting 508 ms; commit 0 ms)
2026-11-08T04:12:29Z [load_day 2024-01-16] 2024-01-16 hour 23: 187138 events in 0 files, snapshot none (task 7444 ms: download 4129 ms overlapping gunzip 1095 ms, parse 5015 ms, sort 0 ms, write 0 ms, index 556 ms: 3 candidates, 60031 repo-hours, 825 releases; waiting 500 ms; commit 0 ms)
2026-11-08T04:12:40Z [load_day 2024-01-16] 2024-01-16: repo_hour merged from 24 files to 1 (1933402 rows, 11171 ms)
2026-11-08T04:12:42Z [load_day 2024-01-16] 2024-01-16: index committed in 13393 ms (24 + 1 + 24 files)
2026-11-08T04:12:42Z [load_day 2024-01-16] 2024-01-16: 5357221 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:12:42Z [load_day 2024-01-16] attempt 1 succeeded