orcaLog in

Runs · run 3736

load_day 2025-03-31, attempt 1 succeeded

Host
73ccef5e07c2:280346
Started
2026-11-08T11:08:47Z
Ended
2026-11-08T11:11:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
788 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
233.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3736/load_day/2025-03-31/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:08:47Z [load_day 2025-03-31] attempt 1 started
2026-11-08T11:08:48Z [load_day 2025-03-31] 2025-03-31: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:08:56Z [load_day 2025-03-31] 2025-03-31 hour 0: 193497 events in 0 files, snapshot none (task 7325 ms: download 4547 ms overlapping gunzip 1156 ms, parse 4574 ms, sort 0 ms, write 0 ms, index 764 ms: 7 candidates, 86059 repo-hours, 1343 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:08:57Z [load_day 2025-03-31] 2025-03-31 hour 1: 231893 events in 0 files, snapshot none (task 8330 ms: download 5414 ms overlapping gunzip 1314 ms, parse 5323 ms, sort 0 ms, write 0 ms, index 855 ms: 5 candidates, 121992 repo-hours, 961 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:09:05Z [load_day 2025-03-31] 2025-03-31 hour 2: 206094 events in 0 files, snapshot none (task 8780 ms: download 5922 ms overlapping gunzip 1477 ms, parse 5484 ms, sort 0 ms, write 0 ms, index 755 ms: 7 candidates, 87162 repo-hours, 973 releases; waiting 734 ms; commit 0 ms)
2026-11-08T11:09:06Z [load_day 2025-03-31] 2025-03-31 hour 3: 213286 events in 0 files, snapshot none (task 8689 ms: download 6054 ms overlapping gunzip 1489 ms, parse 5655 ms, sort 0 ms, write 0 ms, index 631 ms: 3 candidates, 87223 repo-hours, 2981 releases; waiting 645 ms; commit 0 ms)
2026-11-08T11:09:14Z [load_day 2025-03-31] 2025-03-31 hour 4: 192054 events in 0 files, snapshot none (task 8919 ms: download 5945 ms overlapping gunzip 1520 ms, parse 5985 ms, sort 0 ms, write 0 ms, index 596 ms: 6 candidates, 70247 repo-hours, 882 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:09:16Z [load_day 2025-03-31] 2025-03-31 hour 5: 206090 events in 0 files, snapshot none (task 9653 ms: download 7015 ms overlapping gunzip 1624 ms, parse 6562 ms, sort 0 ms, write 0 ms, index 723 ms: 3 candidates, 77893 repo-hours, 977 releases; waiting 497 ms; commit 0 ms)
2026-11-08T11:09:23Z [load_day 2025-03-31] 2025-03-31 hour 6: 234278 events in 0 files, snapshot none (task 8130 ms: download 5607 ms overlapping gunzip 1334 ms, parse 5250 ms, sort 0 ms, write 0 ms, index 739 ms: 4 candidates, 102427 repo-hours, 1152 releases; waiting 523 ms; commit 0 ms)
2026-11-08T11:09:26Z [load_day 2025-03-31] 2025-03-31 hour 7: 243860 events in 0 files, snapshot none (task 8738 ms: download 6201 ms overlapping gunzip 1447 ms, parse 5668 ms, sort 0 ms, write 0 ms, index 752 ms: 6 candidates, 95947 repo-hours, 1179 releases; waiting 558 ms; commit 0 ms)
2026-11-08T11:09:34Z [load_day 2025-03-31] 2025-03-31 hour 8: 254492 events in 0 files, snapshot none (task 10599 ms: download 6603 ms overlapping gunzip 1703 ms, parse 6934 ms, sort 0 ms, write 0 ms, index 1116 ms: 6 candidates, 104664 repo-hours, 1360 releases; waiting 544 ms; commit 0 ms)
2026-11-08T11:09:39Z [load_day 2025-03-31] 2025-03-31 hour 9: 262482 events in 0 files, snapshot none (task 12607 ms: download 9573 ms overlapping gunzip 1833 ms, parse 7671 ms, sort 0 ms, write 0 ms, index 845 ms: 3 candidates, 107646 repo-hours, 1495 releases; waiting 1905 ms; commit 0 ms)
2026-11-08T11:09:46Z [load_day 2025-03-31] 2025-03-31 hour 10: 250155 events in 0 files, snapshot none (task 11141 ms: download 7660 ms overlapping gunzip 1879 ms, parse 7562 ms, sort 0 ms, write 0 ms, index 1055 ms: 5 candidates, 101409 repo-hours, 1286 releases; waiting 322 ms; commit 0 ms)
2026-11-08T11:09:50Z [load_day 2025-03-31] 2025-03-31 hour 11: 259067 events in 0 files, snapshot none (task 10893 ms: download 8174 ms overlapping gunzip 1785 ms, parse 7537 ms, sort 0 ms, write 0 ms, index 843 ms: 10 candidates, 103529 repo-hours, 1327 releases; waiting 503 ms; commit 0 ms)
2026-11-08T11:09:59Z [load_day 2025-03-31] 2025-03-31 hour 12: 288888 events in 0 files, snapshot none (task 12201 ms: download 8703 ms overlapping gunzip 1925 ms, parse 7891 ms, sort 0 ms, write 0 ms, index 1197 ms: 6 candidates, 144613 repo-hours, 1487 releases; waiting 903 ms; commit 0 ms)
2026-11-08T11:10:01Z [load_day 2025-03-31] 2025-03-31 hour 13: 261868 events in 0 files, snapshot none (task 10806 ms: download 7778 ms overlapping gunzip 1682 ms, parse 7147 ms, sort 0 ms, write 0 ms, index 1105 ms: 12 candidates, 125019 repo-hours, 1233 releases; waiting 549 ms; commit 0 ms)
2026-11-08T11:10:11Z [load_day 2025-03-31] 2025-03-31 hour 14: 256346 events in 0 files, snapshot none (task 11711 ms: download 8269 ms overlapping gunzip 1937 ms, parse 7842 ms, sort 0 ms, write 0 ms, index 1209 ms: 8 candidates, 111152 repo-hours, 1356 releases; waiting 403 ms; commit 0 ms)
2026-11-08T11:10:15Z [load_day 2025-03-31] 2025-03-31 hour 15: 262460 events in 0 files, snapshot none (task 13081 ms: download 9270 ms overlapping gunzip 2042 ms, parse 7871 ms, sort 0 ms, write 0 ms, index 1475 ms: 4 candidates, 114587 repo-hours, 1491 releases; waiting 1389 ms; commit 0 ms)
2026-11-08T11:10:24Z [load_day 2025-03-31] 2025-03-31 hour 16: 272577 events in 0 files, snapshot none (task 11970 ms: download 8947 ms overlapping gunzip 1953 ms, parse 8199 ms, sort 0 ms, write 0 ms, index 1176 ms: 8 candidates, 112894 repo-hours, 1405 releases; waiting 399 ms; commit 0 ms)
2026-11-08T11:10:27Z [load_day 2025-03-31] 2025-03-31 hour 17: 269891 events in 0 files, snapshot none (task 11564 ms: download 8139 ms overlapping gunzip 1997 ms, parse 7840 ms, sort 0 ms, write 0 ms, index 1125 ms: 8 candidates, 106363 repo-hours, 1204 releases; waiting 327 ms; commit 0 ms)
2026-11-08T11:10:36Z [load_day 2025-03-31] 2025-03-31 hour 18: 275421 events in 0 files, snapshot none (task 11540 ms: download 8823 ms overlapping gunzip 1940 ms, parse 8071 ms, sort 0 ms, write 0 ms, index 963 ms: 9 candidates, 120943 repo-hours, 1293 releases; waiting 347 ms; commit 0 ms)
2026-11-08T11:10:39Z [load_day 2025-03-31] 2025-03-31 hour 19: 262421 events in 0 files, snapshot none (task 11335 ms: download 7785 ms overlapping gunzip 1799 ms, parse 7181 ms, sort 0 ms, write 0 ms, index 1289 ms: 3 candidates, 99823 repo-hours, 1369 releases; waiting 534 ms; commit 0 ms)
2026-11-08T11:10:48Z [load_day 2025-03-31] 2025-03-31 hour 20: 253397 events in 0 files, snapshot none (task 11846 ms: download 9061 ms overlapping gunzip 2066 ms, parse 8152 ms, sort 0 ms, write 0 ms, index 881 ms: 7 candidates, 97395 repo-hours, 1276 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:10:49Z [load_day 2025-03-31] 2025-03-31 hour 21: 239982 events in 0 files, snapshot none (task 9333 ms: download 6771 ms overlapping gunzip 1644 ms, parse 6479 ms, sort 0 ms, write 0 ms, index 754 ms: 28 candidates, 90113 repo-hours, 1206 releases; waiting 174 ms; commit 0 ms)
2026-11-08T11:10:58Z [load_day 2025-03-31] 2025-03-31 hour 22: 224630 events in 0 files, snapshot none (task 9833 ms: download 6949 ms overlapping gunzip 1552 ms, parse 6562 ms, sort 0 ms, write 0 ms, index 893 ms: 13 candidates, 80584 repo-hours, 1191 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:10:59Z [load_day 2025-03-31] 2025-03-31 hour 23: 207724 events in 0 files, snapshot none (task 8647 ms: download 6151 ms overlapping gunzip 1446 ms, parse 5690 ms, sort 0 ms, write 0 ms, index 607 ms: 8 candidates, 74820 repo-hours, 1075 releases; waiting 653 ms; commit 0 ms)
2026-11-08T11:11:09Z [load_day 2025-03-31] 2025-03-31: repo_hour merged from 24 files to 1 (2424504 rows, 10291 ms)
2026-11-08T11:11:12Z [load_day 2025-03-31] 2025-03-31: index committed in 13416 ms (24 + 1 + 24 files)
2026-11-08T11:11:12Z [load_day 2025-03-31] 2025-03-31: 5822853 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:11:12Z [load_day 2025-03-31] attempt 1 succeeded