orcaLog in

Runs · run 3844

load_day 2025-04-30, attempt 1 succeeded

Host
73ccef5e07c2:296561
Started
2026-11-08T11:41:08Z
Ended
2026-11-08T11:43:26Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
803 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
211.2 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3844/load_day/2025-04-30/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:41:08Z [load_day 2025-04-30] attempt 1 started
2026-11-08T11:41:09Z [load_day 2025-04-30] 2025-04-30: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:41:19Z [load_day 2025-04-30] 2025-04-30 hour 0: 205964 events in 0 files, snapshot none (task 9061 ms: download 5499 ms overlapping gunzip 1325 ms, parse 6199 ms, sort 0 ms, write 0 ms, index 877 ms: 5 candidates, 93641 repo-hours, 1335 releases; waiting 318 ms; commit 0 ms)
2026-11-08T11:41:19Z [load_day 2025-04-30] 2025-04-30 hour 1: 228566 events in 0 files, snapshot none (task 9235 ms: download 5985 ms overlapping gunzip 1374 ms, parse 6122 ms, sort 0 ms, write 0 ms, index 1011 ms: 6 candidates, 123667 repo-hours, 1073 releases; waiting 505 ms; commit 0 ms)
2026-11-08T11:41:28Z [load_day 2025-04-30] 2025-04-30 hour 2: 196965 events in 0 files, snapshot none (task 8557 ms: download 4847 ms overlapping gunzip 1342 ms, parse 5654 ms, sort 0 ms, write 0 ms, index 797 ms: 5 candidates, 85912 repo-hours, 921 releases; waiting 486 ms; commit 0 ms)
2026-11-08T11:41:28Z [load_day 2025-04-30] 2025-04-30 hour 3: 211596 events in 0 files, snapshot none (task 8034 ms: download 4750 ms overlapping gunzip 1253 ms, parse 5245 ms, sort 0 ms, write 0 ms, index 853 ms: 8 candidates, 87243 repo-hours, 3102 releases; waiting 465 ms; commit 0 ms)
2026-11-08T11:41:36Z [load_day 2025-04-30] 2025-04-30 hour 4: 194460 events in 0 files, snapshot none (task 7062 ms: download 3762 ms overlapping gunzip 1079 ms, parse 4380 ms, sort 0 ms, write 0 ms, index 915 ms: 5 candidates, 76767 repo-hours, 765 releases; waiting 418 ms; commit 0 ms)
2026-11-08T11:41:36Z [load_day 2025-04-30] 2025-04-30 hour 5: 207453 events in 0 files, snapshot none (task 7892 ms: download 4761 ms overlapping gunzip 1188 ms, parse 5175 ms, sort 0 ms, write 0 ms, index 927 ms: 6 candidates, 81471 repo-hours, 830 releases; waiting 349 ms; commit 0 ms)
2026-11-08T11:41:46Z [load_day 2025-04-30] 2025-04-30 hour 6: 234690 events in 0 files, snapshot none (task 9858 ms: download 5778 ms overlapping gunzip 1498 ms, parse 6721 ms, sort 0 ms, write 0 ms, index 1074 ms: 7 candidates, 102513 repo-hours, 1072 releases; waiting 199 ms; commit 0 ms)
2026-11-08T11:41:48Z [load_day 2025-04-30] 2025-04-30 hour 7: 243821 events in 0 files, snapshot none (task 10802 ms: download 7341 ms overlapping gunzip 1660 ms, parse 7297 ms, sort 0 ms, write 0 ms, index 1013 ms: 6 candidates, 98631 repo-hours, 1145 releases; waiting 514 ms; commit 0 ms)
2026-11-08T11:41:57Z [load_day 2025-04-30] 2025-04-30 hour 8: 249843 events in 0 files, snapshot none (task 10303 ms: download 6751 ms overlapping gunzip 1594 ms, parse 6874 ms, sort 0 ms, write 0 ms, index 1348 ms: 8 candidates, 106081 repo-hours, 1368 releases; waiting 198 ms; commit 0 ms)
2026-11-08T11:41:59Z [load_day 2025-04-30] 2025-04-30 hour 9: 250799 events in 0 files, snapshot none (task 10552 ms: download 6935 ms overlapping gunzip 1683 ms, parse 7089 ms, sort 0 ms, write 0 ms, index 1027 ms: 9 candidates, 105732 repo-hours, 1527 releases; waiting 459 ms; commit 0 ms)
2026-11-08T11:42:06Z [load_day 2025-04-30] 2025-04-30 hour 10: 241522 events in 0 files, snapshot none (task 8254 ms: download 5360 ms overlapping gunzip 1274 ms, parse 5265 ms, sort 0 ms, write 0 ms, index 875 ms: 9 candidates, 101752 repo-hours, 1123 releases; waiting 512 ms; commit 0 ms)
2026-11-08T11:42:08Z [load_day 2025-04-30] 2025-04-30 hour 11: 240418 events in 0 files, snapshot none (task 8037 ms: download 5439 ms overlapping gunzip 1297 ms, parse 5205 ms, sort 0 ms, write 0 ms, index 743 ms: 8 candidates, 96467 repo-hours, 1259 releases; waiting 558 ms; commit 0 ms)
2026-11-08T11:42:15Z [load_day 2025-04-30] 2025-04-30 hour 12: 280516 events in 0 files, snapshot none (task 9158 ms: download 5979 ms overlapping gunzip 1335 ms, parse 5833 ms, sort 0 ms, write 0 ms, index 1109 ms: 11 candidates, 142197 repo-hours, 1429 releases; waiting 504 ms; commit 0 ms)
2026-11-08T11:42:17Z [load_day 2025-04-30] 2025-04-30 hour 13: 270754 events in 0 files, snapshot none (task 8953 ms: download 6085 ms overlapping gunzip 1400 ms, parse 5790 ms, sort 0 ms, write 0 ms, index 983 ms: 8 candidates, 129326 repo-hours, 1461 releases; waiting 461 ms; commit 0 ms)
2026-11-08T11:42:29Z [load_day 2025-04-30] 2025-04-30 hour 14: 262457 events in 0 files, snapshot none (task 12703 ms: download 8402 ms overlapping gunzip 1990 ms, parse 8609 ms, sort 0 ms, write 0 ms, index 1245 ms: 6 candidates, 111384 repo-hours, 1444 releases; waiting 542 ms; commit 0 ms)
2026-11-08T11:42:30Z [load_day 2025-04-30] 2025-04-30 hour 15: 252781 events in 0 files, snapshot none (task 11786 ms: download 8673 ms overlapping gunzip 1937 ms, parse 8197 ms, sort 0 ms, write 0 ms, index 822 ms: 8 candidates, 110782 repo-hours, 1458 releases; waiting 521 ms; commit 0 ms)
2026-11-08T11:42:42Z [load_day 2025-04-30] 2025-04-30 hour 16: 255871 events in 0 files, snapshot none (task 12311 ms: download 9495 ms overlapping gunzip 2079 ms, parse 8564 ms, sort 0 ms, write 0 ms, index 804 ms: 17 candidates, 109422 repo-hours, 1272 releases; waiting 509 ms; commit 0 ms)
2026-11-08T11:42:42Z [load_day 2025-04-30] 2025-04-30 hour 17: 250515 events in 0 files, snapshot none (task 11917 ms: download 9266 ms overlapping gunzip 1979 ms, parse 8399 ms, sort 0 ms, write 0 ms, index 729 ms: 13 candidates, 103868 repo-hours, 1164 releases; waiting 346 ms; commit 0 ms)
2026-11-08T11:42:54Z [load_day 2025-04-30] 2025-04-30 hour 18: 255246 events in 0 files, snapshot none (task 11565 ms: download 8277 ms overlapping gunzip 1957 ms, parse 7571 ms, sort 0 ms, write 0 ms, index 1281 ms: 9 candidates, 112564 repo-hours, 1226 releases; waiting 447 ms; commit 0 ms)
2026-11-08T11:42:55Z [load_day 2025-04-30] 2025-04-30 hour 19: 243208 events in 0 files, snapshot none (task 12111 ms: download 9077 ms overlapping gunzip 2100 ms, parse 8536 ms, sort 0 ms, write 0 ms, index 955 ms: 9 candidates, 95442 repo-hours, 1060 releases; waiting 216 ms; commit 0 ms)
2026-11-08T11:43:04Z [load_day 2025-04-30] 2025-04-30 hour 20: 223481 events in 0 files, snapshot none (task 9862 ms: download 6399 ms overlapping gunzip 1535 ms, parse 6660 ms, sort 0 ms, write 0 ms, index 777 ms: 8 candidates, 88263 repo-hours, 1142 releases; waiting 520 ms; commit 0 ms)
2026-11-08T11:43:04Z [load_day 2025-04-30] 2025-04-30 hour 21: 213518 events in 0 files, snapshot none (task 8602 ms: download 5318 ms overlapping gunzip 1371 ms, parse 5626 ms, sort 0 ms, write 0 ms, index 827 ms: 6 candidates, 82467 repo-hours, 1161 releases; waiting 496 ms; commit 0 ms)
2026-11-08T11:43:13Z [load_day 2025-04-30] 2025-04-30 hour 22: 197729 events in 0 files, snapshot none (task 8112 ms: download 4804 ms overlapping gunzip 1209 ms, parse 5197 ms, sort 0 ms, write 0 ms, index 883 ms: 5 candidates, 75690 repo-hours, 1191 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:43:13Z [load_day 2025-04-30] 2025-04-30 hour 23: 184926 events in 0 files, snapshot none (task 7945 ms: download 4155 ms overlapping gunzip 1152 ms, parse 4974 ms, sort 0 ms, write 0 ms, index 906 ms: 4 candidates, 69334 repo-hours, 1147 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:43:23Z [load_day 2025-04-30] 2025-04-30: repo_hour merged from 24 files to 1 (2390616 rows, 10112 ms)
2026-11-08T11:43:26Z [load_day 2025-04-30] 2025-04-30: index committed in 12931 ms (24 + 1 + 24 files)
2026-11-08T11:43:26Z [load_day 2025-04-30] 2025-04-30: 5597099 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:43:26Z [load_day 2025-04-30] attempt 1 succeeded