orcaLog in

Runs · run 2365

load_day 2024-04-24, attempt 1 succeeded

Host
73ccef5e07c2:113583
Started
2026-11-08T05:45:53Z
Ended
2026-11-08T05:48:03Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
708 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
208.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2365/load_day/2024-04-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:45:53Z [load_day 2024-04-24] attempt 1 started
2026-11-08T05:45:54Z [load_day 2024-04-24] 2024-04-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:46:03Z [load_day 2024-04-24] 2024-04-24 hour 0: 206445 events in 0 files, snapshot none (task 8298 ms: download 5192 ms overlapping gunzip 1199 ms, parse 5555 ms, sort 0 ms, write 0 ms, index 771 ms: 11 candidates, 92949 repo-hours, 1243 releases; waiting 488 ms; commit 0 ms)
2026-11-08T05:46:03Z [load_day 2024-04-24] 2024-04-24 hour 1: 208249 events in 0 files, snapshot none (task 8235 ms: download 4932 ms overlapping gunzip 1187 ms, parse 5343 ms, sort 0 ms, write 0 ms, index 912 ms: 8 candidates, 99819 repo-hours, 968 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:46:12Z [load_day 2024-04-24] 2024-04-24 hour 2: 204101 events in 0 files, snapshot none (task 8579 ms: download 4899 ms overlapping gunzip 1300 ms, parse 5905 ms, sort 0 ms, write 0 ms, index 601 ms: 5 candidates, 71953 repo-hours, 1105 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:46:12Z [load_day 2024-04-24] 2024-04-24 hour 3: 195855 events in 0 files, snapshot none (task 7793 ms: download 4635 ms overlapping gunzip 1126 ms, parse 5054 ms, sort 0 ms, write 0 ms, index 850 ms: 22 candidates, 69358 repo-hours, 1527 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:46:19Z [load_day 2024-04-24] 2024-04-24 hour 4: 189609 events in 0 files, snapshot none (task 6503 ms: download 3850 ms overlapping gunzip 983 ms, parse 4307 ms, sort 0 ms, write 0 ms, index 461 ms: 12 candidates, 64347 repo-hours, 816 releases; waiting 486 ms; commit 0 ms)
2026-11-08T05:46:20Z [load_day 2024-04-24] 2024-04-24 hour 5: 190420 events in 0 files, snapshot none (task 7841 ms: download 5010 ms overlapping gunzip 1215 ms, parse 5148 ms, sort 0 ms, write 0 ms, index 701 ms: 17 candidates, 69785 repo-hours, 977 releases; waiting 477 ms; commit 0 ms)
2026-11-08T05:46:29Z [load_day 2024-04-24] 2024-04-24 hour 6: 220648 events in 0 files, snapshot none (task 9319 ms: download 5960 ms overlapping gunzip 1381 ms, parse 6058 ms, sort 0 ms, write 0 ms, index 1071 ms: 13 candidates, 90189 repo-hours, 1319 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:46:30Z [load_day 2024-04-24] 2024-04-24 hour 7: 242940 events in 0 files, snapshot none (task 9186 ms: download 6286 ms overlapping gunzip 1458 ms, parse 6283 ms, sort 0 ms, write 0 ms, index 648 ms: 14 candidates, 86346 repo-hours, 1791 releases; waiting 507 ms; commit 0 ms)
2026-11-08T05:46:40Z [load_day 2024-04-24] 2024-04-24 hour 8: 254559 events in 0 files, snapshot none (task 11036 ms: download 7165 ms overlapping gunzip 1578 ms, parse 7842 ms, sort 0 ms, write 0 ms, index 829 ms: 12 candidates, 95114 repo-hours, 1415 releases; waiting 525 ms; commit 0 ms)
2026-11-08T05:46:42Z [load_day 2024-04-24] 2024-04-24 hour 9: 251969 events in 0 files, snapshot none (task 12018 ms: download 8866 ms overlapping gunzip 1926 ms, parse 8209 ms, sort 0 ms, write 0 ms, index 1010 ms: 11 candidates, 92618 repo-hours, 1521 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:46:48Z [load_day 2024-04-24] 2024-04-24 hour 10: 216208 events in 0 files, snapshot none (task 7543 ms: download 4534 ms overlapping gunzip 1113 ms, parse 4957 ms, sort 0 ms, write 0 ms, index 948 ms: 13 candidates, 85125 repo-hours, 1130 releases; waiting 306 ms; commit 0 ms)
2026-11-08T05:46:51Z [load_day 2024-04-24] 2024-04-24 hour 11: 228469 events in 0 files, snapshot none (task 8314 ms: download 5746 ms overlapping gunzip 1310 ms, parse 5444 ms, sort 0 ms, write 0 ms, index 655 ms: 7 candidates, 87325 repo-hours, 1098 releases; waiting 547 ms; commit 0 ms)
2026-11-08T05:46:58Z [load_day 2024-04-24] 2024-04-24 hour 12: 267331 events in 0 files, snapshot none (task 9699 ms: download 6921 ms overlapping gunzip 1307 ms, parse 5596 ms, sort 0 ms, write 0 ms, index 846 ms: 20 candidates, 120062 repo-hours, 1272 releases; waiting 1679 ms; commit 0 ms)
2026-11-08T05:47:02Z [load_day 2024-04-24] 2024-04-24 hour 13: 264889 events in 0 files, snapshot none (task 8986 ms: download 6250 ms overlapping gunzip 1365 ms, parse 5801 ms, sort 0 ms, write 0 ms, index 824 ms: 15 candidates, 114375 repo-hours, 1842 releases; waiting 616 ms; commit 0 ms)
2026-11-08T05:47:08Z [load_day 2024-04-24] 2024-04-24 hour 14: 252878 events in 0 files, snapshot none (task 9084 ms: download 6143 ms overlapping gunzip 1379 ms, parse 5775 ms, sort 0 ms, write 0 ms, index 1089 ms: 12 candidates, 102165 repo-hours, 1490 releases; waiting 527 ms; commit 0 ms)
2026-11-08T05:47:12Z [load_day 2024-04-24] 2024-04-24 hour 15: 268770 events in 0 files, snapshot none (task 10494 ms: download 6750 ms overlapping gunzip 1642 ms, parse 7069 ms, sort 0 ms, write 0 ms, index 1009 ms: 20 candidates, 105097 repo-hours, 1539 releases; waiting 492 ms; commit 0 ms)
2026-11-08T05:47:19Z [load_day 2024-04-24] 2024-04-24 hour 16: 265539 events in 0 files, snapshot none (task 10955 ms: download 7411 ms overlapping gunzip 1700 ms, parse 7453 ms, sort 0 ms, write 0 ms, index 1070 ms: 21 candidates, 100264 repo-hours, 1133 releases; waiting 475 ms; commit 0 ms)
2026-11-08T05:47:24Z [load_day 2024-04-24] 2024-04-24 hour 17: 247156 events in 0 files, snapshot none (task 10987 ms: download 7616 ms overlapping gunzip 1626 ms, parse 7207 ms, sort 0 ms, write 0 ms, index 1371 ms: 10 candidates, 91466 repo-hours, 1146 releases; waiting 509 ms; commit 0 ms)
2026-11-08T05:47:30Z [load_day 2024-04-24] 2024-04-24 hour 18: 251406 events in 0 files, snapshot none (task 10439 ms: download 7689 ms overlapping gunzip 1533 ms, parse 6822 ms, sort 0 ms, write 0 ms, index 762 ms: 6 candidates, 98352 repo-hours, 1378 releases; waiting 964 ms; commit 0 ms)
2026-11-08T05:47:34Z [load_day 2024-04-24] 2024-04-24 hour 19: 230681 events in 0 files, snapshot none (task 9439 ms: download 6074 ms overlapping gunzip 1475 ms, parse 6370 ms, sort 0 ms, write 0 ms, index 773 ms: 14 candidates, 85361 repo-hours, 1277 releases; waiting 462 ms; commit 0 ms)
2026-11-08T05:47:40Z [load_day 2024-04-24] 2024-04-24 hour 20: 228610 events in 0 files, snapshot none (task 9124 ms: download 6448 ms overlapping gunzip 1426 ms, parse 6124 ms, sort 0 ms, write 0 ms, index 791 ms: 13 candidates, 80959 repo-hours, 1192 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:47:43Z [load_day 2024-04-24] 2024-04-24 hour 21: 216718 events in 0 files, snapshot none (task 7943 ms: download 5312 ms overlapping gunzip 1243 ms, parse 5009 ms, sort 0 ms, write 0 ms, index 858 ms: 11 candidates, 71937 repo-hours, 1050 releases; waiting 499 ms; commit 0 ms)
2026-11-08T05:47:48Z [load_day 2024-04-24] 2024-04-24 hour 22: 199133 events in 0 files, snapshot none (task 7755 ms: download 4688 ms overlapping gunzip 1291 ms, parse 5258 ms, sort 0 ms, write 0 ms, index 521 ms: 7 candidates, 64114 repo-hours, 929 releases; waiting 324 ms; commit 0 ms)
2026-11-08T05:47:50Z [load_day 2024-04-24] 2024-04-24 hour 23: 186620 events in 0 files, snapshot none (task 6346 ms: download 3860 ms overlapping gunzip 934 ms, parse 4133 ms, sort 0 ms, write 0 ms, index 438 ms: 5 candidates, 58914 repo-hours, 696 releases; waiting 515 ms; commit 0 ms)
2026-11-08T05:47:59Z [load_day 2024-04-24] 2024-04-24: repo_hour merged from 24 files to 1 (2097994 rows, 9823 ms)
2026-11-08T05:48:03Z [load_day 2024-04-24] 2024-04-24: index committed in 13227 ms (24 + 1 + 24 files)
2026-11-08T05:48:03Z [load_day 2024-04-24] 2024-04-24: 5489203 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:48:03Z [load_day 2024-04-24] attempt 1 succeeded