orcaLog in

Runs · run 3504

load_day 2025-02-01, attempt 1 succeeded

Host
73ccef5e07c2:247270
Started
2026-11-08T10:06:33Z
Ended
2026-11-08T10:08:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
687 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
145.1 s, up to 3.2 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3504/load_day/2025-02-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T10:06:33Z [load_day 2025-02-01] attempt 1 started
2026-11-08T10:06:34Z [load_day 2025-02-01] 2025-02-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T10:06:45Z [load_day 2025-02-01] 2025-02-01 hour 0: 185480 events in 0 files, snapshot none (task 10072 ms: download 6661 ms overlapping gunzip 1715 ms, parse 6733 ms, sort 0 ms, write 0 ms, index 830 ms: 8 candidates, 88146 repo-hours, 1486 releases; waiting 474 ms; commit 0 ms)
2026-11-08T10:06:45Z [load_day 2025-02-01] 2025-02-01 hour 1: 198586 events in 0 files, snapshot none (task 9548 ms: download 5685 ms overlapping gunzip 1508 ms, parse 6079 ms, sort 0 ms, write 0 ms, index 1051 ms: 11 candidates, 105400 repo-hours, 1261 releases; waiting 471 ms; commit 0 ms)
2026-11-08T10:06:52Z [load_day 2025-02-01] 2025-02-01 hour 2: 154701 events in 0 files, snapshot none (task 7049 ms: download 3936 ms overlapping gunzip 1132 ms, parse 4509 ms, sort 0 ms, write 0 ms, index 536 ms: 13 candidates, 66317 repo-hours, 1156 releases; waiting 289 ms; commit 0 ms)
2026-11-08T10:06:52Z [load_day 2025-02-01] 2025-02-01 hour 3: 172807 events in 0 files, snapshot none (task 7328 ms: download 4168 ms overlapping gunzip 1295 ms, parse 4964 ms, sort 0 ms, write 0 ms, index 525 ms: 4 candidates, 64680 repo-hours, 4006 releases; waiting 244 ms; commit 0 ms)
2026-11-08T10:06:59Z [load_day 2025-02-01] 2025-02-01 hour 4: 162233 events in 0 files, snapshot none (task 6549 ms: download 3083 ms overlapping gunzip 1046 ms, parse 4152 ms, sort 0 ms, write 0 ms, index 545 ms: 2 candidates, 58092 repo-hours, 757 releases; waiting 513 ms; commit 0 ms)
2026-11-08T10:07:00Z [load_day 2025-02-01] 2025-02-01 hour 5: 165155 events in 0 files, snapshot none (task 6836 ms: download 3656 ms overlapping gunzip 1043 ms, parse 4215 ms, sort 0 ms, write 0 ms, index 725 ms: 5 candidates, 59265 repo-hours, 882 releases; waiting 543 ms; commit 0 ms)
2026-11-08T10:07:06Z [load_day 2025-02-01] 2025-02-01 hour 6: 178322 events in 0 files, snapshot none (task 5839 ms: download 3054 ms overlapping gunzip 820 ms, parse 3599 ms, sort 0 ms, write 0 ms, index 836 ms: 4 candidates, 74194 repo-hours, 1093 releases; waiting 272 ms; commit 0 ms)
2026-11-08T10:07:06Z [load_day 2025-02-01] 2025-02-01 hour 7: 166700 events in 0 files, snapshot none (task 6142 ms: download 3397 ms overlapping gunzip 911 ms, parse 3702 ms, sort 0 ms, write 0 ms, index 546 ms: 4 candidates, 59737 repo-hours, 1004 releases; waiting 625 ms; commit 0 ms)
2026-11-08T10:07:13Z [load_day 2025-02-01] 2025-02-01 hour 8: 173273 events in 0 files, snapshot none (task 6747 ms: download 3909 ms overlapping gunzip 1064 ms, parse 4377 ms, sort 0 ms, write 0 ms, index 505 ms: 2 candidates, 64921 repo-hours, 1003 releases; waiting 531 ms; commit 0 ms)
2026-11-08T10:07:13Z [load_day 2025-02-01] 2025-02-01 hour 9: 182923 events in 0 files, snapshot none (task 6287 ms: download 3690 ms overlapping gunzip 910 ms, parse 3981 ms, sort 0 ms, write 0 ms, index 538 ms: 2 candidates, 71746 repo-hours, 1211 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:07:20Z [load_day 2025-02-01] 2025-02-01 hour 10: 182592 events in 0 files, snapshot none (task 6584 ms: download 3793 ms overlapping gunzip 1067 ms, parse 4168 ms, sort 0 ms, write 0 ms, index 577 ms: 5 candidates, 68326 repo-hours, 955 releases; waiting 501 ms; commit 0 ms)
2026-11-08T10:07:20Z [load_day 2025-02-01] 2025-02-01 hour 11: 181541 events in 0 files, snapshot none (task 6634 ms: download 3650 ms overlapping gunzip 1045 ms, parse 4210 ms, sort 0 ms, write 0 ms, index 497 ms: 8 candidates, 64513 repo-hours, 864 releases; waiting 549 ms; commit 0 ms)
2026-11-08T10:07:26Z [load_day 2025-02-01] 2025-02-01 hour 12: 247562 events in 0 files, snapshot none (task 5957 ms: download 3130 ms overlapping gunzip 829 ms, parse 3696 ms, sort 0 ms, write 0 ms, index 792 ms: 9 candidates, 115581 repo-hours, 960 releases; waiting 297 ms; commit 0 ms)
2026-11-08T10:07:26Z [load_day 2025-02-01] 2025-02-01 hour 13: 210236 events in 0 files, snapshot none (task 5588 ms: download 3046 ms overlapping gunzip 784 ms, parse 3271 ms, sort 0 ms, write 0 ms, index 707 ms: 6 candidates, 93349 repo-hours, 838 releases; waiting 521 ms; commit 0 ms)
2026-11-08T10:07:33Z [load_day 2025-02-01] 2025-02-01 hour 14: 202012 events in 0 files, snapshot none (task 6097 ms: download 3891 ms overlapping gunzip 828 ms, parse 3366 ms, sort 0 ms, write 0 ms, index 547 ms: 8 candidates, 77231 repo-hours, 928 releases; waiting 1040 ms; commit 0 ms)
2026-11-08T10:07:33Z [load_day 2025-02-01] 2025-02-01 hour 15: 212377 events in 0 files, snapshot none (task 5872 ms: download 3399 ms overlapping gunzip 900 ms, parse 3540 ms, sort 0 ms, write 0 ms, index 649 ms: 8 candidates, 85486 repo-hours, 1152 releases; waiting 534 ms; commit 0 ms)
2026-11-08T10:07:39Z [load_day 2025-02-01] 2025-02-01 hour 16: 205601 events in 0 files, snapshot none (task 5438 ms: download 3037 ms overlapping gunzip 802 ms, parse 3211 ms, sort 0 ms, write 0 ms, index 593 ms: 8 candidates, 80873 repo-hours, 1056 releases; waiting 553 ms; commit 0 ms)
2026-11-08T10:07:39Z [load_day 2025-02-01] 2025-02-01 hour 17: 202457 events in 0 files, snapshot none (task 5754 ms: download 3336 ms overlapping gunzip 848 ms, parse 3462 ms, sort 0 ms, write 0 ms, index 621 ms: 8 candidates, 77385 repo-hours, 1007 releases; waiting 577 ms; commit 0 ms)
2026-11-08T10:07:45Z [load_day 2025-02-01] 2025-02-01 hour 18: 213694 events in 0 files, snapshot none (task 5963 ms: download 3359 ms overlapping gunzip 841 ms, parse 3518 ms, sort 0 ms, write 0 ms, index 699 ms: 12 candidates, 92135 repo-hours, 1136 releases; waiting 562 ms; commit 0 ms)
2026-11-08T10:07:45Z [load_day 2025-02-01] 2025-02-01 hour 19: 189119 events in 0 files, snapshot none (task 5112 ms: download 2699 ms overlapping gunzip 776 ms, parse 3071 ms, sort 0 ms, write 0 ms, index 558 ms: 10 candidates, 69202 repo-hours, 939 releases; waiting 481 ms; commit 0 ms)
2026-11-08T10:07:54Z [load_day 2025-02-01] 2025-02-01 hour 20: 193681 events in 0 files, snapshot none (task 7840 ms: download 5489 ms overlapping gunzip 1244 ms, parse 5251 ms, sort 0 ms, write 0 ms, index 604 ms: 7 candidates, 71417 repo-hours, 931 releases; waiting 468 ms; commit 0 ms)
2026-11-08T10:07:54Z [load_day 2025-02-01] 2025-02-01 hour 21: 190607 events in 0 files, snapshot none (task 7669 ms: download 5381 ms overlapping gunzip 1249 ms, parse 5152 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 72884 repo-hours, 1110 releases; waiting 483 ms; commit 0 ms)
2026-11-08T10:08:00Z [load_day 2025-02-01] 2025-02-01 hour 22: 167457 events in 0 files, snapshot none (task 5713 ms: download 2863 ms overlapping gunzip 861 ms, parse 3430 ms, sort 0 ms, write 0 ms, index 903 ms: 5 candidates, 61099 repo-hours, 1079 releases; waiting 185 ms; commit 0 ms)
2026-11-08T10:08:00Z [load_day 2025-02-01] 2025-02-01 hour 23: 154884 events in 0 files, snapshot none (task 5647 ms: download 3273 ms overlapping gunzip 830 ms, parse 3529 ms, sort 0 ms, write 0 ms, index 476 ms: 8 candidates, 56269 repo-hours, 923 releases; waiting 516 ms; commit 0 ms)
2026-11-08T10:08:08Z [load_day 2025-02-01] 2025-02-01: repo_hour merged from 24 files to 1 (1798248 rows, 8326 ms)
2026-11-08T10:08:11Z [load_day 2025-02-01] 2025-02-01: index committed in 11333 ms (24 + 1 + 24 files)
2026-11-08T10:08:11Z [load_day 2025-02-01] 2025-02-01: 4494000 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T10:08:11Z [load_day 2025-02-01] attempt 1 succeeded