orcaLog in

Runs · run 3195

load_day 2024-11-12, attempt 1 succeeded

Host
73ccef5e07c2:206393
Started
2026-11-08T08:47:15Z
Ended
2026-11-08T08:49:34Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
839 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
225.7 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3195/load_day/2024-11-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T08:47:15Z [load_day 2024-11-12] attempt 1 started
2026-11-08T08:47:15Z [load_day 2024-11-12] 2024-11-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T08:47:25Z [load_day 2024-11-12] 2024-11-12 hour 0: 197270 events in 0 files, snapshot none (task 8805 ms: download 5409 ms overlapping gunzip 1439 ms, parse 5760 ms, sort 0 ms, write 0 ms, index 813 ms: 7 candidates, 97165 repo-hours, 1309 releases; waiting 546 ms; commit 0 ms)
2026-11-08T08:47:25Z [load_day 2024-11-12] 2024-11-12 hour 1: 210323 events in 0 files, snapshot none (task 9058 ms: download 5432 ms overlapping gunzip 1337 ms, parse 5954 ms, sort 0 ms, write 0 ms, index 1146 ms: 12 candidates, 114078 repo-hours, 909 releases; waiting 332 ms; commit 0 ms)
2026-11-08T08:47:33Z [load_day 2024-11-12] 2024-11-12 hour 2: 196347 events in 0 files, snapshot none (task 8086 ms: download 4884 ms overlapping gunzip 1338 ms, parse 5343 ms, sort 0 ms, write 0 ms, index 716 ms: 5 candidates, 83139 repo-hours, 919 releases; waiting 402 ms; commit 0 ms)
2026-11-08T08:47:34Z [load_day 2024-11-12] 2024-11-12 hour 3: 212553 events in 0 files, snapshot none (task 9133 ms: download 5973 ms overlapping gunzip 1422 ms, parse 6024 ms, sort 0 ms, write 0 ms, index 818 ms: 7 candidates, 81646 repo-hours, 3714 releases; waiting 530 ms; commit 0 ms)
2026-11-08T08:47:43Z [load_day 2024-11-12] 2024-11-12 hour 4: 193122 events in 0 files, snapshot none (task 8454 ms: download 5055 ms overlapping gunzip 1346 ms, parse 5376 ms, sort 0 ms, write 0 ms, index 1020 ms: 3 candidates, 68341 repo-hours, 669 releases; waiting 490 ms; commit 0 ms)
2026-11-08T08:47:44Z [load_day 2024-11-12] 2024-11-12 hour 5: 206017 events in 0 files, snapshot none (task 8626 ms: download 5772 ms overlapping gunzip 1414 ms, parse 5792 ms, sort 0 ms, write 0 ms, index 623 ms: 0 candidates, 72534 repo-hours, 807 releases; waiting 519 ms; commit 0 ms)
2026-11-08T08:47:52Z [load_day 2024-11-12] 2024-11-12 hour 6: 223681 events in 0 files, snapshot none (task 9020 ms: download 6226 ms overlapping gunzip 1325 ms, parse 5898 ms, sort 0 ms, write 0 ms, index 1007 ms: 4 candidates, 94419 repo-hours, 991 releases; waiting 504 ms; commit 0 ms)
2026-11-08T08:47:53Z [load_day 2024-11-12] 2024-11-12 hour 7: 220008 events in 0 files, snapshot none (task 8718 ms: download 6267 ms overlapping gunzip 1404 ms, parse 5923 ms, sort 0 ms, write 0 ms, index 600 ms: 7 candidates, 83526 repo-hours, 989 releases; waiting 472 ms; commit 0 ms)
2026-11-08T08:48:02Z [load_day 2024-11-12] 2024-11-12 hour 8: 233878 events in 0 files, snapshot none (task 9207 ms: download 6704 ms overlapping gunzip 1550 ms, parse 6460 ms, sort 0 ms, write 0 ms, index 694 ms: 10 candidates, 92674 repo-hours, 1002 releases; waiting 185 ms; commit 0 ms)
2026-11-08T08:48:04Z [load_day 2024-11-12] 2024-11-12 hour 9: 250537 events in 0 files, snapshot none (task 10159 ms: download 7657 ms overlapping gunzip 1778 ms, parse 7057 ms, sort 0 ms, write 0 ms, index 720 ms: 10 candidates, 100964 repo-hours, 1293 releases; waiting 244 ms; commit 0 ms)
2026-11-08T08:48:12Z [load_day 2024-11-12] 2024-11-12 hour 10: 244827 events in 0 files, snapshot none (task 9294 ms: download 6804 ms overlapping gunzip 1491 ms, parse 5990 ms, sort 0 ms, write 0 ms, index 696 ms: 14 candidates, 94678 repo-hours, 1293 releases; waiting 744 ms; commit 0 ms)
2026-11-08T08:48:13Z [load_day 2024-11-12] 2024-11-12 hour 11: 243764 events in 0 files, snapshot none (task 8732 ms: download 6360 ms overlapping gunzip 1448 ms, parse 5784 ms, sort 0 ms, write 0 ms, index 649 ms: 8 candidates, 90898 repo-hours, 1165 releases; waiting 539 ms; commit 0 ms)
2026-11-08T08:48:22Z [load_day 2024-11-12] 2024-11-12 hour 12: 276157 events in 0 files, snapshot none (task 10238 ms: download 5937 ms overlapping gunzip 1406 ms, parse 6584 ms, sort 0 ms, write 0 ms, index 1413 ms: 11 candidates, 138756 repo-hours, 1455 releases; waiting 529 ms; commit 0 ms)
2026-11-08T08:48:24Z [load_day 2024-11-12] 2024-11-12 hour 13: 278063 events in 0 files, snapshot none (task 11104 ms: download 8299 ms overlapping gunzip 1826 ms, parse 7295 ms, sort 0 ms, write 0 ms, index 950 ms: 12 candidates, 122091 repo-hours, 1169 releases; waiting 710 ms; commit 0 ms)
2026-11-08T08:48:35Z [load_day 2024-11-12] 2024-11-12 hour 14: 262690 events in 0 files, snapshot none (task 11589 ms: download 8935 ms overlapping gunzip 1994 ms, parse 8027 ms, sort 0 ms, write 0 ms, index 784 ms: 5 candidates, 106009 repo-hours, 1311 releases; waiting 536 ms; commit 0 ms)
2026-11-08T08:48:38Z [load_day 2024-11-12] 2024-11-12 hour 15: 272403 events in 0 files, snapshot none (task 12945 ms: download 9694 ms overlapping gunzip 2079 ms, parse 8723 ms, sort 0 ms, write 0 ms, index 1329 ms: 7 candidates, 115276 repo-hours, 1548 releases; waiting 472 ms; commit 0 ms)
2026-11-08T08:48:46Z [load_day 2024-11-12] 2024-11-12 hour 16: 256412 events in 0 files, snapshot none (task 11364 ms: download 8542 ms overlapping gunzip 1788 ms, parse 7665 ms, sort 0 ms, write 0 ms, index 1049 ms: 12 candidates, 106479 repo-hours, 1275 releases; waiting 537 ms; commit 0 ms)
2026-11-08T08:48:50Z [load_day 2024-11-12] 2024-11-12 hour 17: 246798 events in 0 files, snapshot none (task 11583 ms: download 8247 ms overlapping gunzip 1940 ms, parse 7919 ms, sort 0 ms, write 0 ms, index 959 ms: 8 candidates, 96483 repo-hours, 1163 releases; waiting 511 ms; commit 0 ms)
2026-11-08T08:48:57Z [load_day 2024-11-12] 2024-11-12 hour 18: 257187 events in 0 files, snapshot none (task 10052 ms: download 6891 ms overlapping gunzip 1639 ms, parse 6831 ms, sort 0 ms, write 0 ms, index 1086 ms: 14 candidates, 109633 repo-hours, 1303 releases; waiting 275 ms; commit 0 ms)
2026-11-08T08:49:01Z [load_day 2024-11-12] 2024-11-12 hour 19: 238896 events in 0 files, snapshot none (task 10705 ms: download 7236 ms overlapping gunzip 1647 ms, parse 7071 ms, sort 0 ms, write 0 ms, index 1140 ms: 8 candidates, 89865 repo-hours, 1138 releases; waiting 564 ms; commit 0 ms)
2026-11-08T08:49:08Z [load_day 2024-11-12] 2024-11-12 hour 20: 240353 events in 0 files, snapshot none (task 10208 ms: download 6966 ms overlapping gunzip 1625 ms, parse 6308 ms, sort 0 ms, write 0 ms, index 1466 ms: 7 candidates, 98068 repo-hours, 972 releases; waiting 475 ms; commit 0 ms)
2026-11-08T08:49:12Z [load_day 2024-11-12] 2024-11-12 hour 21: 236883 events in 0 files, snapshot none (task 10762 ms: download 7314 ms overlapping gunzip 1835 ms, parse 7067 ms, sort 0 ms, write 0 ms, index 925 ms: 4 candidates, 96845 repo-hours, 1178 releases; waiting 489 ms; commit 0 ms)
2026-11-08T08:49:18Z [load_day 2024-11-12] 2024-11-12 hour 22: 213942 events in 0 files, snapshot none (task 9474 ms: download 6848 ms overlapping gunzip 1686 ms, parse 6487 ms, sort 0 ms, write 0 ms, index 671 ms: 2 candidates, 75848 repo-hours, 1105 releases; waiting 247 ms; commit 0 ms)
2026-11-08T08:49:20Z [load_day 2024-11-12] 2024-11-12 hour 23: 198914 events in 0 files, snapshot none (task 7688 ms: download 5540 ms overlapping gunzip 1244 ms, parse 4732 ms, sort 0 ms, write 0 ms, index 550 ms: 8 candidates, 70132 repo-hours, 843 releases; waiting 908 ms; commit 0 ms)
2026-11-08T08:49:31Z [load_day 2024-11-12] 2024-11-12: repo_hour merged from 24 files to 1 (2299547 rows, 10287 ms)
2026-11-08T08:49:34Z [load_day 2024-11-12] 2024-11-12: index committed in 13012 ms (23 + 1 + 24 files)
2026-11-08T08:49:34Z [load_day 2024-11-12] 2024-11-12: 5611025 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T08:49:34Z [load_day 2024-11-12] attempt 1 succeeded