orcaLog in

Runs · run 2338

load_day 2024-04-17, attempt 1 succeeded

Host
73ccef5e07c2:110999
Started
2026-11-08T05:39:11Z
Ended
2026-11-08T05:41:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
717 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
212.0 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2338/load_day/2024-04-17/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:39:11Z [load_day 2024-04-17] attempt 1 started
2026-11-08T05:39:12Z [load_day 2024-04-17] 2024-04-17: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:39:22Z [load_day 2024-04-17] 2024-04-17 hour 0: 214049 events in 0 files, snapshot none (task 9075 ms: download 6356 ms overlapping gunzip 1412 ms, parse 6192 ms, sort 0 ms, write 0 ms, index 736 ms: 13 candidates, 98228 repo-hours, 1104 releases; waiting 470 ms; commit 0 ms)
2026-11-08T05:39:22Z [load_day 2024-04-17] 2024-04-17 hour 1: 217181 events in 0 files, snapshot none (task 8202 ms: download 5178 ms overlapping gunzip 1222 ms, parse 5370 ms, sort 0 ms, write 0 ms, index 765 ms: 9 candidates, 102760 repo-hours, 903 releases; waiting 441 ms; commit 0 ms)
2026-11-08T05:39:31Z [load_day 2024-04-17] 2024-04-17 hour 2: 202001 events in 0 files, snapshot none (task 8250 ms: download 5747 ms overlapping gunzip 1352 ms, parse 5493 ms, sort 0 ms, write 0 ms, index 553 ms: 13 candidates, 72067 repo-hours, 844 releases; waiting 459 ms; commit 0 ms)
2026-11-08T05:39:31Z [load_day 2024-04-17] 2024-04-17 hour 3: 209884 events in 0 files, snapshot none (task 8771 ms: download 6113 ms overlapping gunzip 1148 ms, parse 6649 ms, sort 0 ms, write 0 ms, index 495 ms: 7 candidates, 66009 repo-hours, 919 releases; waiting 233 ms; commit 0 ms)
2026-11-08T05:39:37Z [load_day 2024-04-17] 2024-04-17 hour 4: 183784 events in 0 files, snapshot none (task 5719 ms: download 3349 ms overlapping gunzip 892 ms, parse 3611 ms, sort 0 ms, write 0 ms, index 488 ms: 5 candidates, 61946 repo-hours, 800 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:39:39Z [load_day 2024-04-17] 2024-04-17 hour 5: 200379 events in 0 files, snapshot none (task 6925 ms: download 4708 ms overlapping gunzip 1049 ms, parse 4204 ms, sort 0 ms, write 0 ms, index 502 ms: 8 candidates, 68239 repo-hours, 879 releases; waiting 859 ms; commit 0 ms)
2026-11-08T05:39:44Z [load_day 2024-04-17] 2024-04-17 hour 6: 226678 events in 0 files, snapshot none (task 6838 ms: download 4324 ms overlapping gunzip 1028 ms, parse 4416 ms, sort 0 ms, write 0 ms, index 604 ms: 3 candidates, 87374 repo-hours, 1016 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:39:47Z [load_day 2024-04-17] 2024-04-17 hour 7: 238034 events in 0 files, snapshot none (task 8315 ms: download 4996 ms overlapping gunzip 1251 ms, parse 5256 ms, sort 0 ms, write 0 ms, index 992 ms: 11 candidates, 87245 repo-hours, 972 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:39:55Z [load_day 2024-04-17] 2024-04-17 hour 8: 261766 events in 0 files, snapshot none (task 10511 ms: download 7132 ms overlapping gunzip 1626 ms, parse 7283 ms, sort 0 ms, write 0 ms, index 880 ms: 14 candidates, 95602 repo-hours, 1273 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:39:58Z [load_day 2024-04-17] 2024-04-17 hour 9: 263726 events in 0 files, snapshot none (task 10260 ms: download 7437 ms overlapping gunzip 1607 ms, parse 6978 ms, sort 0 ms, write 0 ms, index 935 ms: 12 candidates, 94425 repo-hours, 1256 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:40:06Z [load_day 2024-04-17] 2024-04-17 hour 10: 253383 events in 0 files, snapshot none (task 10139 ms: download 6925 ms overlapping gunzip 1514 ms, parse 6971 ms, sort 0 ms, write 0 ms, index 788 ms: 11 candidates, 90493 repo-hours, 1148 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:40:09Z [load_day 2024-04-17] 2024-04-17 hour 11: 254504 events in 0 files, snapshot none (task 10019 ms: download 7476 ms overlapping gunzip 1553 ms, parse 7034 ms, sort 0 ms, write 0 ms, index 675 ms: 9 candidates, 88944 repo-hours, 1284 releases; waiting 500 ms; commit 0 ms)
2026-11-08T05:40:18Z [load_day 2024-04-17] 2024-04-17 hour 12: 297054 events in 0 files, snapshot none (task 11452 ms: download 8369 ms overlapping gunzip 1682 ms, parse 8121 ms, sort 0 ms, write 0 ms, index 861 ms: 10 candidates, 122577 repo-hours, 1351 releases; waiting 513 ms; commit 0 ms)
2026-11-08T05:40:22Z [load_day 2024-04-17] 2024-04-17 hour 13: 284128 events in 0 files, snapshot none (task 12542 ms: download 9084 ms overlapping gunzip 1875 ms, parse 8395 ms, sort 0 ms, write 0 ms, index 1582 ms: 19 candidates, 116449 repo-hours, 1399 releases; waiting 449 ms; commit 0 ms)
2026-11-08T05:40:31Z [load_day 2024-04-17] 2024-04-17 hour 14: 283194 events in 0 files, snapshot none (task 12086 ms: download 8896 ms overlapping gunzip 1888 ms, parse 8361 ms, sort 0 ms, write 0 ms, index 994 ms: 13 candidates, 106227 repo-hours, 1396 releases; waiting 519 ms; commit 0 ms)
2026-11-08T05:40:33Z [load_day 2024-04-17] 2024-04-17 hour 15: 274508 events in 0 files, snapshot none (task 10582 ms: download 7471 ms overlapping gunzip 1675 ms, parse 7180 ms, sort 0 ms, write 0 ms, index 934 ms: 16 candidates, 103159 repo-hours, 1670 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:40:42Z [load_day 2024-04-17] 2024-04-17 hour 16: 269396 events in 0 files, snapshot none (task 10254 ms: download 7052 ms overlapping gunzip 1524 ms, parse 7103 ms, sort 0 ms, write 0 ms, index 1022 ms: 21 candidates, 98497 repo-hours, 1416 releases; waiting 364 ms; commit 0 ms)
2026-11-08T05:40:43Z [load_day 2024-04-17] 2024-04-17 hour 17: 261555 events in 0 files, snapshot none (task 9416 ms: download 5985 ms overlapping gunzip 1549 ms, parse 6345 ms, sort 0 ms, write 0 ms, index 721 ms: 18 candidates, 89130 repo-hours, 1178 releases; waiting 471 ms; commit 0 ms)
2026-11-08T05:40:53Z [load_day 2024-04-17] 2024-04-17 hour 18: 264387 events in 0 files, snapshot none (task 10881 ms: download 7443 ms overlapping gunzip 1699 ms, parse 7212 ms, sort 0 ms, write 0 ms, index 1204 ms: 17 candidates, 95318 repo-hours, 1304 releases; waiting 495 ms; commit 0 ms)
2026-11-08T05:40:53Z [load_day 2024-04-17] 2024-04-17 hour 19: 239176 events in 0 files, snapshot none (task 10104 ms: download 6579 ms overlapping gunzip 1510 ms, parse 7078 ms, sort 0 ms, write 0 ms, index 876 ms: 17 candidates, 80697 repo-hours, 1103 releases; waiting 338 ms; commit 0 ms)
2026-11-08T05:41:03Z [load_day 2024-04-17] 2024-04-17 hour 20: 227824 events in 0 files, snapshot none (task 9655 ms: download 7104 ms overlapping gunzip 1537 ms, parse 6706 ms, sort 0 ms, write 0 ms, index 604 ms: 14 candidates, 78346 repo-hours, 1174 releases; waiting 476 ms; commit 0 ms)
2026-11-08T05:41:03Z [load_day 2024-04-17] 2024-04-17 hour 21: 210511 events in 0 files, snapshot none (task 8560 ms: download 6032 ms overlapping gunzip 1233 ms, parse 5890 ms, sort 0 ms, write 0 ms, index 530 ms: 16 candidates, 69470 repo-hours, 1165 releases; waiting 544 ms; commit 0 ms)
2026-11-08T05:41:12Z [load_day 2024-04-17] 2024-04-17 hour 22: 199367 events in 0 files, snapshot none (task 7767 ms: download 5205 ms overlapping gunzip 1210 ms, parse 5331 ms, sort 0 ms, write 0 ms, index 481 ms: 11 candidates, 62535 repo-hours, 954 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:41:12Z [load_day 2024-04-17] 2024-04-17 hour 23: 183405 events in 0 files, snapshot none (task 7247 ms: download 4233 ms overlapping gunzip 1162 ms, parse 4811 ms, sort 0 ms, write 0 ms, index 651 ms: 15 candidates, 59696 repo-hours, 720 releases; waiting 373 ms; commit 0 ms)
2026-11-08T05:41:21Z [load_day 2024-04-17] 2024-04-17: repo_hour merged from 24 files to 1 (2095433 rows, 9063 ms)
2026-11-08T05:41:23Z [load_day 2024-04-17] 2024-04-17: index committed in 11235 ms (24 + 1 + 24 files)
2026-11-08T05:41:23Z [load_day 2024-04-17] 2024-04-17: 5719874 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:41:23Z [load_day 2024-04-17] attempt 1 succeeded