orcaLog in

Runs · run 2147

load_day 2024-03-01, attempt 1 succeeded

Host
73ccef5e07c2:93301
Started
2026-11-08T04:54:27Z
Ended
2026-11-08T04:56:23Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
686 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
184.2 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2147/load_day/2024-03-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T04:54:27Z [load_day 2024-03-01] attempt 1 started
2026-11-08T04:54:28Z [load_day 2024-03-01] 2024-03-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T04:54:37Z [load_day 2024-03-01] 2024-03-01 hour 0: 230794 events in 0 files, snapshot none (task 8466 ms: download 5683 ms overlapping gunzip 1303 ms, parse 5643 ms, sort 0 ms, write 0 ms, index 708 ms: 16 candidates, 95102 repo-hours, 1242 releases; waiting 530 ms; commit 0 ms)
2026-11-08T04:54:37Z [load_day 2024-03-01] 2024-03-01 hour 1: 231932 events in 0 files, snapshot none (task 8689 ms: download 5853 ms overlapping gunzip 1366 ms, parse 5748 ms, sort 0 ms, write 0 ms, index 796 ms: 9 candidates, 102615 repo-hours, 1264 releases; waiting 516 ms; commit 0 ms)
2026-11-08T04:54:46Z [load_day 2024-03-01] 2024-03-01 hour 2: 203437 events in 0 files, snapshot none (task 8100 ms: download 5096 ms overlapping gunzip 1365 ms, parse 5363 ms, sort 0 ms, write 0 ms, index 670 ms: 11 candidates, 68347 repo-hours, 729 releases; waiting 454 ms; commit 0 ms)
2026-11-08T04:54:46Z [load_day 2024-03-01] 2024-03-01 hour 3: 208015 events in 0 files, snapshot none (task 8396 ms: download 5497 ms overlapping gunzip 1417 ms, parse 5669 ms, sort 0 ms, write 0 ms, index 499 ms: 5 candidates, 64696 repo-hours, 873 releases; waiting 522 ms; commit 0 ms)
2026-11-08T04:54:54Z [load_day 2024-03-01] 2024-03-01 hour 4: 205812 events in 0 files, snapshot none (task 7992 ms: download 4031 ms overlapping gunzip 1279 ms, parse 5249 ms, sort 0 ms, write 0 ms, index 696 ms: 8 candidates, 62660 repo-hours, 604 releases; waiting 502 ms; commit 0 ms)
2026-11-08T04:54:56Z [load_day 2024-03-01] 2024-03-01 hour 5: 212479 events in 0 files, snapshot none (task 9102 ms: download 6060 ms overlapping gunzip 1461 ms, parse 6236 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 64346 repo-hours, 658 releases; waiting 512 ms; commit 0 ms)
2026-11-08T04:55:02Z [load_day 2024-03-01] 2024-03-01 hour 6: 220074 events in 0 files, snapshot none (task 7245 ms: download 4433 ms overlapping gunzip 1152 ms, parse 4679 ms, sort 0 ms, write 0 ms, index 891 ms: 6 candidates, 78457 repo-hours, 763 releases; waiting 207 ms; commit 0 ms)
2026-11-08T04:55:03Z [load_day 2024-03-01] 2024-03-01 hour 7: 224605 events in 0 files, snapshot none (task 6666 ms: download 3869 ms overlapping gunzip 1110 ms, parse 4428 ms, sort 0 ms, write 0 ms, index 687 ms: 11 candidates, 77574 repo-hours, 924 releases; waiting 172 ms; commit 0 ms)
2026-11-08T04:55:10Z [load_day 2024-03-01] 2024-03-01 hour 8: 220275 events in 0 files, snapshot none (task 7900 ms: download 5269 ms overlapping gunzip 1238 ms, parse 5547 ms, sort 0 ms, write 0 ms, index 593 ms: 7 candidates, 80611 repo-hours, 929 releases; waiting 274 ms; commit 0 ms)
2026-11-08T04:55:13Z [load_day 2024-03-01] 2024-03-01 hour 9: 251884 events in 0 files, snapshot none (task 9484 ms: download 6313 ms overlapping gunzip 1479 ms, parse 5877 ms, sort 0 ms, write 0 ms, index 1375 ms: 10 candidates, 90632 repo-hours, 1205 releases; waiting 482 ms; commit 0 ms)
2026-11-08T04:55:20Z [load_day 2024-03-01] 2024-03-01 hour 10: 257284 events in 0 files, snapshot none (task 9425 ms: download 6885 ms overlapping gunzip 1456 ms, parse 6503 ms, sort 0 ms, write 0 ms, index 714 ms: 8 candidates, 95450 repo-hours, 1072 releases; waiting 495 ms; commit 0 ms)
2026-11-08T04:55:22Z [load_day 2024-03-01] 2024-03-01 hour 11: 248582 events in 0 files, snapshot none (task 8405 ms: download 5418 ms overlapping gunzip 1248 ms, parse 5409 ms, sort 0 ms, write 0 ms, index 999 ms: 10 candidates, 85246 repo-hours, 1194 releases; waiting 484 ms; commit 0 ms)
2026-11-08T04:55:31Z [load_day 2024-03-01] 2024-03-01 hour 12: 299194 events in 0 files, snapshot none (task 9635 ms: download 6287 ms overlapping gunzip 1439 ms, parse 5987 ms, sort 0 ms, write 0 ms, index 1195 ms: 10 candidates, 115651 repo-hours, 1104 releases; waiting 534 ms; commit 0 ms)
2026-11-08T04:55:31Z [load_day 2024-03-01] 2024-03-01 hour 13: 274949 events in 0 files, snapshot none (task 8751 ms: download 5707 ms overlapping gunzip 1405 ms, parse 5544 ms, sort 0 ms, write 0 ms, index 936 ms: 13 candidates, 109513 repo-hours, 1103 releases; waiting 541 ms; commit 0 ms)
2026-11-08T04:55:38Z [load_day 2024-03-01] 2024-03-01 hour 14: 174130 events in 0 files, snapshot none (task 6949 ms: download 4634 ms overlapping gunzip 1123 ms, parse 4407 ms, sort 0 ms, write 0 ms, index 567 ms: 4 candidates, 82587 repo-hours, 960 releases; waiting 580 ms; commit 0 ms)
2026-11-08T04:55:39Z [load_day 2024-03-01] 2024-03-01 hour 15: 213338 events in 0 files, snapshot none (task 7006 ms: download 4404 ms overlapping gunzip 1122 ms, parse 4422 ms, sort 0 ms, write 0 ms, index 734 ms: 11 candidates, 91061 repo-hours, 1089 releases; waiting 477 ms; commit 0 ms)
2026-11-08T04:55:46Z [load_day 2024-03-01] 2024-03-01 hour 16: 263218 events in 0 files, snapshot none (task 7828 ms: download 5469 ms overlapping gunzip 1269 ms, parse 5114 ms, sort 0 ms, write 0 ms, index 669 ms: 4 candidates, 95839 repo-hours, 1196 releases; waiting 527 ms; commit 0 ms)
2026-11-08T04:55:47Z [load_day 2024-03-01] 2024-03-01 hour 17: 247068 events in 0 files, snapshot none (task 7585 ms: download 5209 ms overlapping gunzip 1230 ms, parse 4936 ms, sort 0 ms, write 0 ms, index 623 ms: 10 candidates, 88235 repo-hours, 1047 releases; waiting 535 ms; commit 0 ms)
2026-11-08T04:55:56Z [load_day 2024-03-01] 2024-03-01 hour 18: 245105 events in 0 files, snapshot none (task 8365 ms: download 5355 ms overlapping gunzip 1351 ms, parse 5499 ms, sort 0 ms, write 0 ms, index 727 ms: 15 candidates, 90073 repo-hours, 1153 releases; waiting 492 ms; commit 0 ms)
2026-11-08T04:55:56Z [load_day 2024-03-01] 2024-03-01 hour 19: 226694 events in 0 files, snapshot none (task 7916 ms: download 4684 ms overlapping gunzip 1213 ms, parse 5183 ms, sort 0 ms, write 0 ms, index 745 ms: 9 candidates, 76674 repo-hours, 938 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:56:04Z [load_day 2024-03-01] 2024-03-01 hour 20: 220025 events in 0 files, snapshot none (task 7738 ms: download 5332 ms overlapping gunzip 1206 ms, parse 5212 ms, sort 0 ms, write 0 ms, index 602 ms: 8 candidates, 77138 repo-hours, 940 releases; waiting 469 ms; commit 0 ms)
2026-11-08T04:56:04Z [load_day 2024-03-01] 2024-03-01 hour 21: 220708 events in 0 files, snapshot none (task 7460 ms: download 4912 ms overlapping gunzip 1201 ms, parse 4891 ms, sort 0 ms, write 0 ms, index 596 ms: 9 candidates, 77586 repo-hours, 958 releases; waiting 518 ms; commit 0 ms)
2026-11-08T04:56:11Z [load_day 2024-03-01] 2024-03-01 hour 22: 194748 events in 0 files, snapshot none (task 6569 ms: download 4117 ms overlapping gunzip 1056 ms, parse 4053 ms, sort 0 ms, write 0 ms, index 686 ms: 4 candidates, 60368 repo-hours, 790 releases; waiting 529 ms; commit 0 ms)
2026-11-08T04:56:12Z [load_day 2024-03-01] 2024-03-01 hour 23: 186285 events in 0 files, snapshot none (task 6973 ms: download 4335 ms overlapping gunzip 1100 ms, parse 4515 ms, sort 0 ms, write 0 ms, index 586 ms: 4 candidates, 57310 repo-hours, 671 releases; waiting 338 ms; commit 0 ms)
2026-11-08T04:56:20Z [load_day 2024-03-01] 2024-03-01: repo_hour merged from 24 files to 1 (1987771 rows, 8475 ms)
2026-11-08T04:56:23Z [load_day 2024-03-01] 2024-03-01: index committed in 10796 ms (24 + 1 + 24 files)
2026-11-08T04:56:23Z [load_day 2024-03-01] 2024-03-01: 5480635 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T04:56:23Z [load_day 2024-03-01] attempt 1 succeeded