orcaLog in

Runs · run 2266

load_day 2024-04-01, attempt 1 succeeded

Host
73ccef5e07c2:104350
Started
2026-11-08T05:24:08Z
Ended
2026-11-08T05:26:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
692 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
194.0 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2266/load_day/2024-04-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:24:08Z [load_day 2024-04-01] attempt 1 started
2026-11-08T05:24:10Z [load_day 2024-04-01] 2024-04-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:24:17Z [load_day 2024-04-01] 2024-04-01 hour 0: 204212 events in 0 files, snapshot none (task 7162 ms: download 4031 ms overlapping gunzip 991 ms, parse 4319 ms, sort 0 ms, write 0 ms, index 1060 ms: 11 candidates, 85099 repo-hours, 1161 releases; waiting 484 ms; commit 0 ms)
2026-11-08T05:24:18Z [load_day 2024-04-01] 2024-04-01 hour 1: 218822 events in 0 files, snapshot none (task 7815 ms: download 4875 ms overlapping gunzip 1244 ms, parse 5001 ms, sort 0 ms, write 0 ms, index 734 ms: 9 candidates, 97950 repo-hours, 1111 releases; waiting 489 ms; commit 0 ms)
2026-11-08T05:24:25Z [load_day 2024-04-01] 2024-04-01 hour 2: 206856 events in 0 files, snapshot none (task 7305 ms: download 4749 ms overlapping gunzip 1131 ms, parse 4283 ms, sort 0 ms, write 0 ms, index 524 ms: 4 candidates, 68399 repo-hours, 880 releases; waiting 837 ms; commit 0 ms)
2026-11-08T05:24:25Z [load_day 2024-04-01] 2024-04-01 hour 3: 198857 events in 0 files, snapshot none (task 5844 ms: download 3598 ms overlapping gunzip 945 ms, parse 3605 ms, sort 0 ms, write 0 ms, index 490 ms: 6 candidates, 64809 repo-hours, 804 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:24:32Z [load_day 2024-04-01] 2024-04-01 hour 4: 199670 events in 0 files, snapshot none (task 6169 ms: download 3996 ms overlapping gunzip 957 ms, parse 3612 ms, sort 0 ms, write 0 ms, index 449 ms: 7 candidates, 60194 repo-hours, 604 releases; waiting 889 ms; commit 0 ms)
2026-11-08T05:24:32Z [load_day 2024-04-01] 2024-04-01 hour 5: 205171 events in 0 files, snapshot none (task 6255 ms: download 3904 ms overlapping gunzip 1039 ms, parse 3858 ms, sort 0 ms, write 0 ms, index 448 ms: 6 candidates, 64672 repo-hours, 650 releases; waiting 478 ms; commit 0 ms)
2026-11-08T05:24:40Z [load_day 2024-04-01] 2024-04-01 hour 6: 214340 events in 0 files, snapshot none (task 7425 ms: download 4971 ms overlapping gunzip 1251 ms, parse 4883 ms, sort 0 ms, write 0 ms, index 564 ms: 4 candidates, 76341 repo-hours, 910 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:24:40Z [load_day 2024-04-01] 2024-04-01 hour 7: 221810 events in 0 files, snapshot none (task 7774 ms: download 5525 ms overlapping gunzip 1341 ms, parse 5106 ms, sort 0 ms, write 0 ms, index 530 ms: 3 candidates, 73911 repo-hours, 724 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:24:48Z [load_day 2024-04-01] 2024-04-01 hour 8: 225805 events in 0 files, snapshot none (task 7705 ms: download 5321 ms overlapping gunzip 1273 ms, parse 4993 ms, sort 0 ms, write 0 ms, index 615 ms: 14 candidates, 79881 repo-hours, 838 releases; waiting 545 ms; commit 0 ms)
2026-11-08T05:24:50Z [load_day 2024-04-01] 2024-04-01 hour 9: 229640 events in 0 files, snapshot none (task 9049 ms: download 5993 ms overlapping gunzip 1403 ms, parse 5748 ms, sort 0 ms, write 0 ms, index 1058 ms: 9 candidates, 79275 repo-hours, 1003 releases; waiting 526 ms; commit 0 ms)
2026-11-08T05:24:57Z [load_day 2024-04-01] 2024-04-01 hour 10: 228795 events in 0 files, snapshot none (task 8583 ms: download 5220 ms overlapping gunzip 1249 ms, parse 4955 ms, sort 0 ms, write 0 ms, index 1280 ms: 10 candidates, 79337 repo-hours, 838 releases; waiting 783 ms; commit 0 ms)
2026-11-08T05:25:00Z [load_day 2024-04-01] 2024-04-01 hour 11: 222810 events in 0 files, snapshot none (task 9260 ms: download 5354 ms overlapping gunzip 1493 ms, parse 5837 ms, sort 0 ms, write 0 ms, index 1133 ms: 3 candidates, 76745 repo-hours, 811 releases; waiting 494 ms; commit 0 ms)
2026-11-08T05:25:08Z [load_day 2024-04-01] 2024-04-01 hour 12: 286564 events in 0 files, snapshot none (task 10269 ms: download 6892 ms overlapping gunzip 1542 ms, parse 6682 ms, sort 0 ms, write 0 ms, index 1309 ms: 5 candidates, 122220 repo-hours, 977 releases; waiting 487 ms; commit 0 ms)
2026-11-08T05:25:11Z [load_day 2024-04-01] 2024-04-01 hour 13: 261941 events in 0 files, snapshot none (task 10445 ms: download 6224 ms overlapping gunzip 1661 ms, parse 6634 ms, sort 0 ms, write 0 ms, index 1543 ms: 8 candidates, 105937 repo-hours, 1071 releases; waiting 244 ms; commit 0 ms)
2026-11-08T05:25:18Z [load_day 2024-04-01] 2024-04-01 hour 14: 267768 events in 0 files, snapshot none (task 9988 ms: download 6678 ms overlapping gunzip 1598 ms, parse 6464 ms, sort 0 ms, write 0 ms, index 1106 ms: 4 candidates, 100218 repo-hours, 1034 releases; waiting 510 ms; commit 0 ms)
2026-11-08T05:25:21Z [load_day 2024-04-01] 2024-04-01 hour 15: 272191 events in 0 files, snapshot none (task 10029 ms: download 6795 ms overlapping gunzip 1706 ms, parse 6414 ms, sort 0 ms, write 0 ms, index 1135 ms: 7 candidates, 96809 repo-hours, 1200 releases; waiting 480 ms; commit 0 ms)
2026-11-08T05:25:28Z [load_day 2024-04-01] 2024-04-01 hour 16: 270018 events in 0 files, snapshot none (task 9502 ms: download 5984 ms overlapping gunzip 1522 ms, parse 6184 ms, sort 0 ms, write 0 ms, index 976 ms: 11 candidates, 91918 repo-hours, 1006 releases; waiting 502 ms; commit 0 ms)
2026-11-08T05:25:32Z [load_day 2024-04-01] 2024-04-01 hour 17: 269675 events in 0 files, snapshot none (task 10007 ms: download 6812 ms overlapping gunzip 1654 ms, parse 6702 ms, sort 0 ms, write 0 ms, index 866 ms: 10 candidates, 88911 repo-hours, 1008 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:25:37Z [load_day 2024-04-01] 2024-04-01 hour 18: 269460 events in 0 files, snapshot none (task 8495 ms: download 5729 ms overlapping gunzip 1395 ms, parse 5764 ms, sort 0 ms, write 0 ms, index 885 ms: 18 candidates, 95777 repo-hours, 1125 releases; waiting 179 ms; commit 0 ms)
2026-11-08T05:25:42Z [load_day 2024-04-01] 2024-04-01 hour 19: 227099 events in 0 files, snapshot none (task 9286 ms: download 5610 ms overlapping gunzip 1583 ms, parse 6001 ms, sort 0 ms, write 0 ms, index 746 ms: 10 candidates, 80947 repo-hours, 951 releases; waiting 611 ms; commit 0 ms)
2026-11-08T05:25:46Z [load_day 2024-04-01] 2024-04-01 hour 20: 231668 events in 0 files, snapshot none (task 8274 ms: download 5502 ms overlapping gunzip 1395 ms, parse 5446 ms, sort 0 ms, write 0 ms, index 617 ms: 12 candidates, 77984 repo-hours, 886 releases; waiting 222 ms; commit 0 ms)
2026-11-08T05:25:51Z [load_day 2024-04-01] 2024-04-01 hour 21: 233206 events in 0 files, snapshot none (task 8590 ms: download 5334 ms overlapping gunzip 1404 ms, parse 5632 ms, sort 0 ms, write 0 ms, index 717 ms: 15 candidates, 70640 repo-hours, 996 releases; waiting 523 ms; commit 0 ms)
2026-11-08T05:25:55Z [load_day 2024-04-01] 2024-04-01 hour 22: 227978 events in 0 files, snapshot none (task 8295 ms: download 5663 ms overlapping gunzip 1456 ms, parse 5522 ms, sort 0 ms, write 0 ms, index 695 ms: 11 candidates, 66946 repo-hours, 890 releases; waiting 327 ms; commit 0 ms)
2026-11-08T05:25:58Z [load_day 2024-04-01] 2024-04-01 hour 23: 219675 events in 0 files, snapshot none (task 6522 ms: download 4212 ms overlapping gunzip 1059 ms, parse 4099 ms, sort 0 ms, write 0 ms, index 518 ms: 9 candidates, 64120 repo-hours, 660 releases; waiting 531 ms; commit 0 ms)
2026-11-08T05:26:07Z [load_day 2024-04-01] 2024-04-01: repo_hour merged from 24 files to 1 (1969040 rows, 9279 ms)
2026-11-08T05:26:10Z [load_day 2024-04-01] 2024-04-01: index committed in 12049 ms (24 + 1 + 24 files)
2026-11-08T05:26:10Z [load_day 2024-04-01] 2024-04-01: 5614031 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:26:10Z [load_day 2024-04-01] attempt 1 succeeded