orcaLog in

Runs · run 2580

load_day 2024-06-12, attempt 1 succeeded

Host
73ccef5e07c2:135172
Started
2026-11-08T06:30:19Z
Ended
2026-11-08T06:32:14Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
729 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
183.5 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2580/load_day/2024-06-12/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:30:19Z [load_day 2024-06-12] attempt 1 started
2026-11-08T06:30:20Z [load_day 2024-06-12] 2024-06-12: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:30:28Z [load_day 2024-06-12] 2024-06-12 hour 0: 195352 events in 0 files, snapshot none (task 7061 ms: download 3306 ms overlapping gunzip 1126 ms, parse 4737 ms, sort 0 ms, write 0 ms, index 815 ms: 13 candidates, 103734 repo-hours, 1089 releases; waiting 5 ms; commit 0 ms)
2026-11-08T06:30:28Z [load_day 2024-06-12] 2024-06-12 hour 1: 201721 events in 0 files, snapshot none (task 6659 ms: download 3624 ms overlapping gunzip 1038 ms, parse 4433 ms, sort 0 ms, write 0 ms, index 970 ms: 7 candidates, 110471 repo-hours, 972 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:30:34Z [load_day 2024-06-12] 2024-06-12 hour 2: 170704 events in 0 files, snapshot none (task 5992 ms: download 3716 ms overlapping gunzip 948 ms, parse 4291 ms, sort 0 ms, write 0 ms, index 526 ms: 6 candidates, 75250 repo-hours, 869 releases; waiting 27 ms; commit 0 ms)
2026-11-08T06:30:34Z [load_day 2024-06-12] 2024-06-12 hour 3: 180147 events in 0 files, snapshot none (task 5674 ms: download 3080 ms overlapping gunzip 990 ms, parse 3904 ms, sort 0 ms, write 0 ms, index 544 ms: 6 candidates, 77889 repo-hours, 3114 releases; waiting 30 ms; commit 0 ms)
2026-11-08T06:30:41Z [load_day 2024-06-12] 2024-06-12 hour 4: 167156 events in 0 files, snapshot none (task 5719 ms: download 3218 ms overlapping gunzip 941 ms, parse 4029 ms, sort 0 ms, write 0 ms, index 527 ms: 4 candidates, 65037 repo-hours, 666 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:30:42Z [load_day 2024-06-12] 2024-06-12 hour 5: 185846 events in 0 files, snapshot none (task 6611 ms: download 4059 ms overlapping gunzip 1155 ms, parse 4574 ms, sort 0 ms, write 0 ms, index 679 ms: 11 candidates, 71198 repo-hours, 1294 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:30:47Z [load_day 2024-06-12] 2024-06-12 hour 6: 212412 events in 0 files, snapshot none (task 5842 ms: download 3362 ms overlapping gunzip 949 ms, parse 4041 ms, sort 0 ms, write 0 ms, index 650 ms: 9 candidates, 91987 repo-hours, 1000 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:30:49Z [load_day 2024-06-12] 2024-06-12 hour 7: 217476 events in 0 files, snapshot none (task 6376 ms: download 3965 ms overlapping gunzip 1078 ms, parse 4404 ms, sort 0 ms, write 0 ms, index 700 ms: 10 candidates, 89828 repo-hours, 1346 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:30:54Z [load_day 2024-06-12] 2024-06-12 hour 8: 227261 events in 0 files, snapshot none (task 6867 ms: download 4375 ms overlapping gunzip 1134 ms, parse 4796 ms, sort 0 ms, write 0 ms, index 730 ms: 12 candidates, 95407 repo-hours, 1616 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:30:56Z [load_day 2024-06-12] 2024-06-12 hour 9: 232553 events in 0 files, snapshot none (task 6609 ms: download 4030 ms overlapping gunzip 1095 ms, parse 4535 ms, sort 0 ms, write 0 ms, index 767 ms: 4 candidates, 101637 repo-hours, 1342 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:31:05Z [load_day 2024-06-12] 2024-06-12 hour 10: 223242 events in 0 files, snapshot none (task 9509 ms: download 6208 ms overlapping gunzip 1478 ms, parse 6374 ms, sort 0 ms, write 0 ms, index 1463 ms: 4 candidates, 96153 repo-hours, 1700 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:31:05Z [load_day 2024-06-12] 2024-06-12 hour 11: 220888 events in 0 files, snapshot none (task 8891 ms: download 5408 ms overlapping gunzip 1462 ms, parse 6208 ms, sort 0 ms, write 0 ms, index 992 ms: 6 candidates, 88673 repo-hours, 1511 releases; waiting 27 ms; commit 0 ms)
2026-11-08T06:31:16Z [load_day 2024-06-12] 2024-06-12 hour 12: 280408 events in 0 files, snapshot none (task 10527 ms: download 6724 ms overlapping gunzip 1560 ms, parse 7552 ms, sort 0 ms, write 0 ms, index 1201 ms: 12 candidates, 133178 repo-hours, 1366 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:31:17Z [load_day 2024-06-12] 2024-06-12 hour 13: 258738 events in 0 files, snapshot none (task 10844 ms: download 7876 ms overlapping gunzip 1804 ms, parse 7932 ms, sort 0 ms, write 0 ms, index 906 ms: 19 candidates, 118811 repo-hours, 1380 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:31:27Z [load_day 2024-06-12] 2024-06-12 hour 14: 257332 events in 0 files, snapshot none (task 10567 ms: download 7784 ms overlapping gunzip 1799 ms, parse 7616 ms, sort 0 ms, write 0 ms, index 910 ms: 10 candidates, 108895 repo-hours, 1590 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:31:27Z [load_day 2024-06-12] 2024-06-12 hour 15: 264870 events in 0 files, snapshot none (task 9947 ms: download 6858 ms overlapping gunzip 1575 ms, parse 6992 ms, sort 0 ms, write 0 ms, index 1171 ms: 18 candidates, 132394 repo-hours, 1371 releases; waiting 14 ms; commit 0 ms)
2026-11-08T06:31:35Z [load_day 2024-06-12] 2024-06-12 hour 16: 225446 events in 0 files, snapshot none (task 8224 ms: download 5738 ms overlapping gunzip 1432 ms, parse 5883 ms, sort 0 ms, write 0 ms, index 674 ms: 14 candidates, 95728 repo-hours, 1277 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:31:36Z [load_day 2024-06-12] 2024-06-12 hour 17: 211357 events in 0 files, snapshot none (task 7748 ms: download 5329 ms overlapping gunzip 1299 ms, parse 5598 ms, sort 0 ms, write 0 ms, index 619 ms: 19 candidates, 87395 repo-hours, 1141 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:31:44Z [load_day 2024-06-12] 2024-06-12 hour 18: 222620 events in 0 files, snapshot none (task 8373 ms: download 5245 ms overlapping gunzip 1353 ms, parse 5894 ms, sort 0 ms, write 0 ms, index 908 ms: 17 candidates, 100206 repo-hours, 1198 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:31:45Z [load_day 2024-06-12] 2024-06-12 hour 19: 206078 events in 0 files, snapshot none (task 8583 ms: download 5833 ms overlapping gunzip 1488 ms, parse 6206 ms, sort 0 ms, write 0 ms, index 644 ms: 14 candidates, 80314 repo-hours, 1093 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:31:53Z [load_day 2024-06-12] 2024-06-12 hour 20: 203584 events in 0 files, snapshot none (task 8808 ms: download 5841 ms overlapping gunzip 1491 ms, parse 6270 ms, sort 0 ms, write 0 ms, index 823 ms: 1 candidates, 80292 repo-hours, 1173 releases; waiting 30 ms; commit 0 ms)
2026-11-08T06:31:53Z [load_day 2024-06-12] 2024-06-12 hour 21: 194455 events in 0 files, snapshot none (task 8312 ms: download 5484 ms overlapping gunzip 1454 ms, parse 5931 ms, sort 0 ms, write 0 ms, index 734 ms: 5 candidates, 77395 repo-hours, 1097 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:32:01Z [load_day 2024-06-12] 2024-06-12 hour 22: 170281 events in 0 files, snapshot none (task 6884 ms: download 4111 ms overlapping gunzip 1152 ms, parse 4869 ms, sort 0 ms, write 0 ms, index 644 ms: 5 candidates, 61609 repo-hours, 1043 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:32:01Z [load_day 2024-06-12] 2024-06-12 hour 23: 162521 events in 0 files, snapshot none (task 6711 ms: download 3973 ms overlapping gunzip 1177 ms, parse 4830 ms, sort 0 ms, write 0 ms, index 469 ms: 11 candidates, 58960 repo-hours, 858 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:32:10Z [load_day 2024-06-12] 2024-06-12: repo_hour merged from 24 files to 1 (2202441 rows, 9527 ms)
2026-11-08T06:32:13Z [load_day 2024-06-12] 2024-06-12: index committed in 12430 ms (24 + 1 + 24 files)
2026-11-08T06:32:13Z [load_day 2024-06-12] 2024-06-12: 5092448 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:32:13Z [load_day 2024-06-12] attempt 1 succeeded