orcaLog in

Runs · run 2242

load_day 2024-03-26, attempt 1 succeeded

Host
73ccef5e07c2:102012
Started
2026-11-08T05:18:49Z
Ended
2026-11-08T05:20:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
777 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.5 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2242/load_day/2024-03-26/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:18:49Z [load_day 2024-03-26] attempt 1 started
2026-11-08T05:18:50Z [load_day 2024-03-26] 2024-03-26: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:18:59Z [load_day 2024-03-26] 2024-03-26 hour 0: 215178 events in 0 files, snapshot none (task 8415 ms: download 4440 ms overlapping gunzip 1276 ms, parse 5407 ms, sort 0 ms, write 0 ms, index 896 ms: 8 candidates, 102788 repo-hours, 1141 releases; waiting 514 ms; commit 0 ms)
2026-11-08T05:18:59Z [load_day 2024-03-26] 2024-03-26 hour 1: 212674 events in 0 files, snapshot none (task 8296 ms: download 4665 ms overlapping gunzip 1190 ms, parse 5211 ms, sort 0 ms, write 0 ms, index 1039 ms: 12 candidates, 102595 repo-hours, 833 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:19:06Z [load_day 2024-03-26] 2024-03-26 hour 2: 181359 events in 0 files, snapshot none (task 6555 ms: download 3708 ms overlapping gunzip 962 ms, parse 4049 ms, sort 0 ms, write 0 ms, index 764 ms: 9 candidates, 69367 repo-hours, 886 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:19:06Z [load_day 2024-03-26] 2024-03-26 hour 3: 174863 events in 0 files, snapshot none (task 5713 ms: download 3066 ms overlapping gunzip 822 ms, parse 3391 ms, sort 0 ms, write 0 ms, index 710 ms: 4 candidates, 66426 repo-hours, 878 releases; waiting 518 ms; commit 0 ms)
2026-11-08T05:19:13Z [load_day 2024-03-26] 2024-03-26 hour 4: 164974 events in 0 files, snapshot none (task 5657 ms: download 3383 ms overlapping gunzip 844 ms, parse 3574 ms, sort 0 ms, write 0 ms, index 416 ms: 7 candidates, 60206 repo-hours, 627 releases; waiting 540 ms; commit 0 ms)
2026-11-08T05:19:13Z [load_day 2024-03-26] 2024-03-26 hour 5: 175496 events in 0 files, snapshot none (task 6194 ms: download 3995 ms overlapping gunzip 1038 ms, parse 4195 ms, sort 0 ms, write 0 ms, index 441 ms: 6 candidates, 64844 repo-hours, 759 releases; waiting 237 ms; commit 0 ms)
2026-11-08T05:19:19Z [load_day 2024-03-26] 2024-03-26 hour 6: 201506 events in 0 files, snapshot none (task 5748 ms: download 3389 ms overlapping gunzip 848 ms, parse 3674 ms, sort 0 ms, write 0 ms, index 546 ms: 11 candidates, 80612 repo-hours, 894 releases; waiting 408 ms; commit 0 ms)
2026-11-08T05:19:20Z [load_day 2024-03-26] 2024-03-26 hour 7: 209741 events in 0 files, snapshot none (task 6333 ms: download 3864 ms overlapping gunzip 979 ms, parse 3923 ms, sort 0 ms, write 0 ms, index 652 ms: 9 candidates, 80775 repo-hours, 957 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:19:26Z [load_day 2024-03-26] 2024-03-26 hour 8: 227997 events in 0 files, snapshot none (task 7133 ms: download 4473 ms overlapping gunzip 1083 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 861 ms: 3 candidates, 89793 repo-hours, 1106 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:19:28Z [load_day 2024-03-26] 2024-03-26 hour 9: 239014 events in 0 files, snapshot none (task 7474 ms: download 4669 ms overlapping gunzip 1138 ms, parse 4717 ms, sort 0 ms, write 0 ms, index 912 ms: 0 candidates, 93878 repo-hours, 1308 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:19:38Z [load_day 2024-03-26] 2024-03-26 hour 10: 243028 events in 0 files, snapshot none (task 10867 ms: download 6864 ms overlapping gunzip 1723 ms, parse 7255 ms, sort 0 ms, write 0 ms, index 1058 ms: 1 candidates, 95788 repo-hours, 1166 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:19:38Z [load_day 2024-03-26] 2024-03-26 hour 11: 240414 events in 0 files, snapshot none (task 9033 ms: download 4995 ms overlapping gunzip 1392 ms, parse 5510 ms, sort 0 ms, write 0 ms, index 1291 ms: 4 candidates, 92578 repo-hours, 1088 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:19:46Z [load_day 2024-03-26] 2024-03-26 hour 12: 293154 events in 0 files, snapshot none (task 8084 ms: download 5363 ms overlapping gunzip 1265 ms, parse 5449 ms, sort 0 ms, write 0 ms, index 844 ms: 6 candidates, 125383 repo-hours, 1261 releases; waiting 315 ms; commit 0 ms)
2026-11-08T05:19:47Z [load_day 2024-03-26] 2024-03-26 hour 13: 269187 events in 0 files, snapshot none (task 8177 ms: download 5578 ms overlapping gunzip 1300 ms, parse 5324 ms, sort 0 ms, write 0 ms, index 765 ms: 6 candidates, 119815 repo-hours, 1165 releases; waiting 475 ms; commit 0 ms)
2026-11-08T05:19:58Z [load_day 2024-03-26] 2024-03-26 hour 14: 273133 events in 0 files, snapshot none (task 11194 ms: download 8077 ms overlapping gunzip 1748 ms, parse 7484 ms, sort 0 ms, write 0 ms, index 1135 ms: 10 candidates, 112239 repo-hours, 1348 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:19:59Z [load_day 2024-03-26] 2024-03-26 hour 15: 268196 events in 0 files, snapshot none (task 11964 ms: download 8516 ms overlapping gunzip 1894 ms, parse 8373 ms, sort 0 ms, write 0 ms, index 1028 ms: 10 candidates, 108352 repo-hours, 1441 releases; waiting 361 ms; commit 0 ms)
2026-11-08T05:20:09Z [load_day 2024-03-26] 2024-03-26 hour 16: 261262 events in 0 files, snapshot none (task 10278 ms: download 7177 ms overlapping gunzip 1582 ms, parse 6804 ms, sort 0 ms, write 0 ms, index 1006 ms: 8 candidates, 103017 repo-hours, 1185 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:20:09Z [load_day 2024-03-26] 2024-03-26 hour 17: 246377 events in 0 files, snapshot none (task 9437 ms: download 6023 ms overlapping gunzip 1533 ms, parse 6049 ms, sort 0 ms, write 0 ms, index 896 ms: 9 candidates, 94856 repo-hours, 1050 releases; waiting 479 ms; commit 0 ms)
2026-11-08T05:20:18Z [load_day 2024-03-26] 2024-03-26 hour 18: 246799 events in 0 files, snapshot none (task 8669 ms: download 5794 ms overlapping gunzip 1375 ms, parse 5690 ms, sort 0 ms, write 0 ms, index 783 ms: 5 candidates, 97406 repo-hours, 1215 releases; waiting 538 ms; commit 0 ms)
2026-11-08T05:20:18Z [load_day 2024-03-26] 2024-03-26 hour 19: 233434 events in 0 files, snapshot none (task 8882 ms: download 5776 ms overlapping gunzip 1459 ms, parse 5992 ms, sort 0 ms, write 0 ms, index 625 ms: 4 candidates, 84837 repo-hours, 1032 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:20:28Z [load_day 2024-03-26] 2024-03-26 hour 20: 227102 events in 0 files, snapshot none (task 8844 ms: download 5969 ms overlapping gunzip 1297 ms, parse 5633 ms, sort 0 ms, write 0 ms, index 840 ms: 5 candidates, 84609 repo-hours, 1007 releases; waiting 766 ms; commit 0 ms)
2026-11-08T05:20:28Z [load_day 2024-03-26] 2024-03-26 hour 21: 209379 events in 0 files, snapshot none (task 8795 ms: download 5864 ms overlapping gunzip 1430 ms, parse 5936 ms, sort 0 ms, write 0 ms, index 597 ms: 5 candidates, 74390 repo-hours, 1072 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:20:35Z [load_day 2024-03-26] 2024-03-26 hour 22: 197959 events in 0 files, snapshot none (task 7101 ms: download 4299 ms overlapping gunzip 1132 ms, parse 4517 ms, sort 0 ms, write 0 ms, index 631 ms: 6 candidates, 69842 repo-hours, 1110 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:20:35Z [load_day 2024-03-26] 2024-03-26 hour 23: 181602 events in 0 files, snapshot none (task 6867 ms: download 4127 ms overlapping gunzip 1042 ms, parse 4394 ms, sort 0 ms, write 0 ms, index 508 ms: 10 candidates, 64314 repo-hours, 735 releases; waiting 593 ms; commit 0 ms)
2026-11-08T05:20:45Z [load_day 2024-03-26] 2024-03-26: repo_hour merged from 24 files to 1 (2138710 rows, 9444 ms)
2026-11-08T05:20:47Z [load_day 2024-03-26] 2024-03-26: index committed in 11885 ms (23 + 1 + 24 files)
2026-11-08T05:20:47Z [load_day 2024-03-26] 2024-03-26: 5393828 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:20:47Z [load_day 2024-03-26] attempt 1 succeeded