orcaLog in

Runs · run 3869

load_day 2025-05-07, attempt 1 succeeded

Host
73ccef5e07c2:299960
Started
2026-11-08T11:48:45Z
Ended
2026-11-08T11:51:18Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
892 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
215.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3869/load_day/2025-05-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:48:45Z [load_day 2025-05-07] attempt 1 started
2026-11-08T11:48:46Z [load_day 2025-05-07] 2025-05-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:48:54Z [load_day 2025-05-07] 2025-05-07 hour 0: 205822 events in 0 files, snapshot none (task 7847 ms: download 4702 ms overlapping gunzip 1252 ms, parse 5149 ms, sort 0 ms, write 0 ms, index 998 ms: 21 candidates, 94626 repo-hours, 1287 releases; waiting 180 ms; commit 0 ms)
2026-11-08T11:48:55Z [load_day 2025-05-07] 2025-05-07 hour 1: 233370 events in 0 files, snapshot none (task 8480 ms: download 5210 ms overlapping gunzip 1224 ms, parse 5172 ms, sort 0 ms, write 0 ms, index 1234 ms: 10 candidates, 126342 repo-hours, 1025 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:49:02Z [load_day 2025-05-07] 2025-05-07 hour 2: 206432 events in 0 files, snapshot none (task 7170 ms: download 4876 ms overlapping gunzip 1082 ms, parse 4467 ms, sort 0 ms, write 0 ms, index 835 ms: 10 candidates, 94428 repo-hours, 1114 releases; waiting 484 ms; commit 0 ms)
2026-11-08T11:49:08Z [load_day 2025-05-07] 2025-05-07 hour 3: 211425 events in 0 files, snapshot none (task 12126 ms: download 8611 ms overlapping gunzip 1208 ms, parse 5233 ms, sort 0 ms, write 0 ms, index 968 ms: 12 candidates, 89614 repo-hours, 2907 releases; waiting 4465 ms; commit 0 ms)
2026-11-08T11:49:11Z [load_day 2025-05-07] 2025-05-07 hour 4: 197004 events in 0 files, snapshot none (task 7894 ms: download 4923 ms overlapping gunzip 1177 ms, parse 5348 ms, sort 0 ms, write 0 ms, index 670 ms: 12 candidates, 75788 repo-hours, 908 releases; waiting 363 ms; commit 0 ms)
2026-11-08T11:49:15Z [load_day 2025-05-07] 2025-05-07 hour 5: 212559 events in 0 files, snapshot none (task 6631 ms: download 3758 ms overlapping gunzip 1082 ms, parse 4180 ms, sort 0 ms, write 0 ms, index 784 ms: 9 candidates, 83150 repo-hours, 923 releases; waiting 211 ms; commit 0 ms)
2026-11-08T11:49:18Z [load_day 2025-05-07] 2025-05-07 hour 6: 239107 events in 0 files, snapshot none (task 7217 ms: download 4678 ms overlapping gunzip 1133 ms, parse 4739 ms, sort 0 ms, write 0 ms, index 719 ms: 2 candidates, 106509 repo-hours, 1129 releases; waiting 338 ms; commit 0 ms)
2026-11-08T11:49:27Z [load_day 2025-05-07] 2025-05-07 hour 7: 246644 events in 0 files, snapshot none (task 12185 ms: download 9430 ms overlapping gunzip 1284 ms, parse 5215 ms, sort 0 ms, write 0 ms, index 864 ms: 12 candidates, 104370 repo-hours, 1216 releases; waiting 4500 ms; commit 0 ms)
2026-11-08T11:49:28Z [load_day 2025-05-07] 2025-05-07 hour 8: 257649 events in 0 files, snapshot none (task 8790 ms: download 6086 ms overlapping gunzip 1340 ms, parse 5409 ms, sort 0 ms, write 0 ms, index 911 ms: 6 candidates, 111505 repo-hours, 1300 releases; waiting 881 ms; commit 0 ms)
2026-11-08T11:49:40Z [load_day 2025-05-07] 2025-05-07 hour 9: 256285 events in 0 files, snapshot none (task 12265 ms: download 8271 ms overlapping gunzip 2017 ms, parse 8640 ms, sort 0 ms, write 0 ms, index 996 ms: 7 candidates, 113979 repo-hours, 1403 releases; waiting 283 ms; commit 0 ms)
2026-11-08T11:49:40Z [load_day 2025-05-07] 2025-05-07 hour 10: 242082 events in 0 files, snapshot none (task 9714 ms: download 6626 ms overlapping gunzip 1498 ms, parse 6484 ms, sort 0 ms, write 0 ms, index 904 ms: 10 candidates, 104544 repo-hours, 1220 releases; waiting 488 ms; commit 0 ms)
2026-11-08T11:49:54Z [load_day 2025-05-07] 2025-05-07 hour 11: 249145 events in 0 files, snapshot none (task 13236 ms: download 9609 ms overlapping gunzip 2059 ms, parse 8486 ms, sort 0 ms, write 0 ms, index 936 ms: 10 candidates, 103378 repo-hours, 1281 releases; waiting 1445 ms; commit 0 ms)
2026-11-08T11:49:54Z [load_day 2025-05-07] 2025-05-07 hour 12: 278925 events in 0 files, snapshot none (task 13100 ms: download 8879 ms overlapping gunzip 2083 ms, parse 8905 ms, sort 0 ms, write 0 ms, index 1335 ms: 10 candidates, 145151 repo-hours, 1567 releases; waiting 460 ms; commit 0 ms)
2026-11-08T11:50:08Z [load_day 2025-05-07] 2025-05-07 hour 13: 276099 events in 0 files, snapshot none (task 13817 ms: download 10500 ms overlapping gunzip 2152 ms, parse 9782 ms, sort 0 ms, write 0 ms, index 1032 ms: 15 candidates, 134685 repo-hours, 1424 releases; waiting 481 ms; commit 0 ms)
2026-11-08T11:50:09Z [load_day 2025-05-07] 2025-05-07 hour 14: 266742 events in 0 files, snapshot none (task 14101 ms: download 10894 ms overlapping gunzip 2334 ms, parse 9862 ms, sort 0 ms, write 0 ms, index 1134 ms: 16 candidates, 117769 repo-hours, 1483 releases; waiting 454 ms; commit 0 ms)
2026-11-08T11:50:21Z [load_day 2025-05-07] 2025-05-07 hour 15: 263737 events in 0 files, snapshot none (task 12086 ms: download 8999 ms overlapping gunzip 1910 ms, parse 8157 ms, sort 0 ms, write 0 ms, index 1223 ms: 13 candidates, 118102 repo-hours, 1457 releases; waiting 577 ms; commit 0 ms)
2026-11-08T11:50:21Z [load_day 2025-05-07] 2025-05-07 hour 16: 256915 events in 0 files, snapshot none (task 12004 ms: download 8514 ms overlapping gunzip 1975 ms, parse 8058 ms, sort 0 ms, write 0 ms, index 1214 ms: 9 candidates, 111557 repo-hours, 1336 releases; waiting 459 ms; commit 0 ms)
2026-11-08T11:50:33Z [load_day 2025-05-07] 2025-05-07 hour 17: 253475 events in 0 files, snapshot none (task 11187 ms: download 7612 ms overlapping gunzip 1719 ms, parse 7486 ms, sort 0 ms, write 0 ms, index 1204 ms: 6 candidates, 103333 repo-hours, 1212 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:50:33Z [load_day 2025-05-07] 2025-05-07 hour 18: 254319 events in 0 files, snapshot none (task 10410 ms: download 7404 ms overlapping gunzip 1619 ms, parse 6960 ms, sort 0 ms, write 0 ms, index 1105 ms: 4 candidates, 112045 repo-hours, 1343 releases; waiting 492 ms; commit 0 ms)
2026-11-08T11:50:46Z [load_day 2025-05-07] 2025-05-07 hour 19: 239509 events in 0 files, snapshot none (task 12755 ms: download 9929 ms overlapping gunzip 1503 ms, parse 6383 ms, sort 0 ms, write 0 ms, index 876 ms: 12 candidates, 93630 repo-hours, 1080 releases; waiting 3694 ms; commit 0 ms)
2026-11-08T11:50:46Z [load_day 2025-05-07] 2025-05-07 hour 20: 231127 events in 0 files, snapshot none (task 9010 ms: download 5958 ms overlapping gunzip 1414 ms, parse 5791 ms, sort 0 ms, write 0 ms, index 969 ms: 9 candidates, 93498 repo-hours, 1199 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:50:56Z [load_day 2025-05-07] 2025-05-07 hour 21: 211889 events in 0 files, snapshot none (task 9059 ms: download 6139 ms overlapping gunzip 1361 ms, parse 5897 ms, sort 0 ms, write 0 ms, index 995 ms: 11 candidates, 82533 repo-hours, 1190 releases; waiting 493 ms; commit 0 ms)
2026-11-08T11:50:56Z [load_day 2025-05-07] 2025-05-07 hour 22: 194119 events in 0 files, snapshot none (task 8859 ms: download 5954 ms overlapping gunzip 1451 ms, parse 5669 ms, sort 0 ms, write 0 ms, index 823 ms: 7 candidates, 75450 repo-hours, 1543 releases; waiting 508 ms; commit 0 ms)
2026-11-08T11:51:04Z [load_day 2025-05-07] 2025-05-07 hour 23: 190823 events in 0 files, snapshot none (task 7698 ms: download 4456 ms overlapping gunzip 1187 ms, parse 4965 ms, sort 0 ms, write 0 ms, index 695 ms: 9 candidates, 71458 repo-hours, 1447 releases; waiting 495 ms; commit 0 ms)
2026-11-08T11:51:15Z [load_day 2025-05-07] 2025-05-07: repo_hour merged from 24 files to 1 (2467444 rows, 10744 ms)
2026-11-08T11:51:18Z [load_day 2025-05-07] 2025-05-07: index committed in 13695 ms (24 + 1 + 24 files)
2026-11-08T11:51:18Z [load_day 2025-05-07] 2025-05-07: 5675203 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:51:18Z [load_day 2025-05-07] attempt 1 succeeded