orcaLog in

Runs · run 2312

load_day 2024-04-11, attempt 1 succeeded

Host
73ccef5e07c2:108512
Started
2026-11-08T05:33:40Z
Ended
2026-11-08T05:35:45Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
712 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
189.9 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2312/load_day/2024-04-11/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:33:40Z [load_day 2024-04-11] attempt 1 started
2026-11-08T05:33:41Z [load_day 2024-04-11] 2024-04-11: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:33:49Z [load_day 2024-04-11] 2024-04-11 hour 0: 236015 events in 0 files, snapshot none (task 8040 ms: download 4943 ms overlapping gunzip 1176 ms, parse 5482 ms, sort 0 ms, write 0 ms, index 692 ms: 8 candidates, 96289 repo-hours, 1129 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:33:49Z [load_day 2024-04-11] 2024-04-11 hour 1: 234348 events in 0 files, snapshot none (task 7652 ms: download 4368 ms overlapping gunzip 1114 ms, parse 4977 ms, sort 0 ms, write 0 ms, index 808 ms: 8 candidates, 101035 repo-hours, 1017 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:33:57Z [load_day 2024-04-11] 2024-04-11 hour 2: 213785 events in 0 files, snapshot none (task 7380 ms: download 4135 ms overlapping gunzip 1064 ms, parse 4613 ms, sort 0 ms, write 0 ms, index 765 ms: 7 candidates, 67212 repo-hours, 871 releases; waiting 661 ms; commit 0 ms)
2026-11-08T05:33:58Z [load_day 2024-04-11] 2024-04-11 hour 3: 208923 events in 0 files, snapshot none (task 7717 ms: download 4604 ms overlapping gunzip 1146 ms, parse 4811 ms, sort 0 ms, write 0 ms, index 605 ms: 8 candidates, 64438 repo-hours, 911 releases; waiting 849 ms; commit 0 ms)
2026-11-08T05:34:04Z [load_day 2024-04-11] 2024-04-11 hour 4: 210909 events in 0 files, snapshot none (task 6044 ms: download 3246 ms overlapping gunzip 942 ms, parse 3751 ms, sort 0 ms, write 0 ms, index 587 ms: 8 candidates, 61221 repo-hours, 993 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:34:06Z [load_day 2024-04-11] 2024-04-11 hour 5: 218527 events in 0 files, snapshot none (task 7457 ms: download 4385 ms overlapping gunzip 1222 ms, parse 4840 ms, sort 0 ms, write 0 ms, index 597 ms: 6 candidates, 66523 repo-hours, 799 releases; waiting 490 ms; commit 0 ms)
2026-11-08T05:34:11Z [load_day 2024-04-11] 2024-04-11 hour 6: 245296 events in 0 files, snapshot none (task 6837 ms: download 4315 ms overlapping gunzip 961 ms, parse 4113 ms, sort 0 ms, write 0 ms, index 608 ms: 5 candidates, 82821 repo-hours, 918 releases; waiting 821 ms; commit 0 ms)
2026-11-08T05:34:13Z [load_day 2024-04-11] 2024-04-11 hour 7: 247606 events in 0 files, snapshot none (task 6814 ms: download 4379 ms overlapping gunzip 1070 ms, parse 4364 ms, sort 0 ms, write 0 ms, index 608 ms: 8 candidates, 82930 repo-hours, 1035 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:34:19Z [load_day 2024-04-11] 2024-04-11 hour 8: 267555 events in 0 files, snapshot none (task 7502 ms: download 5032 ms overlapping gunzip 1208 ms, parse 4840 ms, sort 0 ms, write 0 ms, index 680 ms: 19 candidates, 90192 repo-hours, 1224 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:34:21Z [load_day 2024-04-11] 2024-04-11 hour 9: 255652 events in 0 files, snapshot none (task 7546 ms: download 5021 ms overlapping gunzip 1179 ms, parse 4899 ms, sort 0 ms, write 0 ms, index 648 ms: 12 candidates, 89980 repo-hours, 1284 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:34:30Z [load_day 2024-04-11] 2024-04-11 hour 10: 246619 events in 0 files, snapshot none (task 10232 ms: download 7454 ms overlapping gunzip 1724 ms, parse 7049 ms, sort 0 ms, write 0 ms, index 681 ms: 8 candidates, 85273 repo-hours, 1713 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:34:31Z [load_day 2024-04-11] 2024-04-11 hour 11: 242363 events in 0 files, snapshot none (task 9203 ms: download 6646 ms overlapping gunzip 1623 ms, parse 6262 ms, sort 0 ms, write 0 ms, index 602 ms: 8 candidates, 83592 repo-hours, 1057 releases; waiting 473 ms; commit 0 ms)
2026-11-08T05:34:42Z [load_day 2024-04-11] 2024-04-11 hour 12: 302339 events in 0 files, snapshot none (task 10766 ms: download 7371 ms overlapping gunzip 1639 ms, parse 7219 ms, sort 0 ms, write 0 ms, index 1109 ms: 12 candidates, 122279 repo-hours, 1434 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:34:43Z [load_day 2024-04-11] 2024-04-11 hour 13: 269726 events in 0 files, snapshot none (task 11388 ms: download 7772 ms overlapping gunzip 1761 ms, parse 7868 ms, sort 0 ms, write 0 ms, index 1031 ms: 9 candidates, 117797 repo-hours, 1446 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:34:53Z [load_day 2024-04-11] 2024-04-11 hour 14: 263523 events in 0 files, snapshot none (task 10864 ms: download 7495 ms overlapping gunzip 1662 ms, parse 6942 ms, sort 0 ms, write 0 ms, index 1398 ms: 12 candidates, 105721 repo-hours, 1363 releases; waiting 536 ms; commit 0 ms)
2026-11-08T05:34:53Z [load_day 2024-04-11] 2024-04-11 hour 15: 265679 events in 0 files, snapshot none (task 10101 ms: download 6619 ms overlapping gunzip 1516 ms, parse 6294 ms, sort 0 ms, write 0 ms, index 1454 ms: 4 candidates, 103594 repo-hours, 1487 releases; waiting 522 ms; commit 0 ms)
2026-11-08T05:35:06Z [load_day 2024-04-11] 2024-04-11 hour 16: 248253 events in 0 files, snapshot none (task 9252 ms: download 6629 ms overlapping gunzip 1396 ms, parse 6333 ms, sort 0 ms, write 0 ms, index 708 ms: 9 candidates, 94684 repo-hours, 1273 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:35:06Z [load_day 2024-04-11] 2024-04-11 hour 17: 236552 events in 0 files, snapshot none (task 8920 ms: download 6267 ms overlapping gunzip 1514 ms, parse 6236 ms, sort 0 ms, write 0 ms, index 676 ms: 19 candidates, 88366 repo-hours, 1127 releases; waiting 180 ms; commit 0 ms)
2026-11-08T05:35:15Z [load_day 2024-04-11] 2024-04-11 hour 18: 244773 events in 0 files, snapshot none (task 9196 ms: download 6550 ms overlapping gunzip 1424 ms, parse 6307 ms, sort 0 ms, write 0 ms, index 703 ms: 11 candidates, 95503 repo-hours, 1303 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:35:15Z [load_day 2024-04-11] 2024-04-11 hour 19: 225021 events in 0 files, snapshot none (task 8921 ms: download 6454 ms overlapping gunzip 1455 ms, parse 5997 ms, sort 0 ms, write 0 ms, index 608 ms: 12 candidates, 79886 repo-hours, 1153 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:35:24Z [load_day 2024-04-11] 2024-04-11 hour 20: 221388 events in 0 files, snapshot none (task 8811 ms: download 6352 ms overlapping gunzip 1463 ms, parse 5862 ms, sort 0 ms, write 0 ms, index 660 ms: 14 candidates, 80918 repo-hours, 1013 releases; waiting 558 ms; commit 0 ms)
2026-11-08T05:35:24Z [load_day 2024-04-11] 2024-04-11 hour 21: 208235 events in 0 files, snapshot none (task 8366 ms: download 5964 ms overlapping gunzip 1328 ms, parse 5676 ms, sort 0 ms, write 0 ms, index 547 ms: 10 candidates, 75776 repo-hours, 1039 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:35:33Z [load_day 2024-04-11] 2024-04-11 hour 22: 189027 events in 0 files, snapshot none (task 7726 ms: download 4941 ms overlapping gunzip 1247 ms, parse 5084 ms, sort 0 ms, write 0 ms, index 547 ms: 14 candidates, 64921 repo-hours, 925 releases; waiting 539 ms; commit 0 ms)
2026-11-08T05:35:33Z [load_day 2024-04-11] 2024-04-11 hour 23: 185210 events in 0 files, snapshot none (task 7264 ms: download 4418 ms overlapping gunzip 1190 ms, parse 4701 ms, sort 0 ms, write 0 ms, index 558 ms: 9 candidates, 62957 repo-hours, 744 releases; waiting 521 ms; commit 0 ms)
2026-11-08T05:35:42Z [load_day 2024-04-11] 2024-04-11: repo_hour merged from 24 files to 1 (2063908 rows, 9086 ms)
2026-11-08T05:35:45Z [load_day 2024-04-11] 2024-04-11: index committed in 11892 ms (24 + 1 + 24 files)
2026-11-08T05:35:45Z [load_day 2024-04-11] 2024-04-11: 5687324 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:35:45Z [load_day 2024-04-11] attempt 1 succeeded