orcaLog in

Runs · run 3707

load_day 2025-03-24, attempt 1 succeeded

Host
73ccef5e07c2:275706
Started
2026-11-08T11:00:27Z
Ended
2026-11-08T11:03:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
1040 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
238.8 s, up to 3.1 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/3707/load_day/2025-03-24/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T11:00:27Z [load_day 2025-03-24] attempt 1 started
2026-11-08T11:00:28Z [load_day 2025-03-24] 2025-03-24: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T11:00:37Z [load_day 2025-03-24] 2025-03-24 hour 0: 199111 events in 0 files, snapshot none (task 8403 ms: download 5506 ms overlapping gunzip 1334 ms, parse 5356 ms, sort 0 ms, write 0 ms, index 906 ms: 9 candidates, 88728 repo-hours, 1365 releases; waiting 482 ms; commit 0 ms)
2026-11-08T11:00:38Z [load_day 2025-03-24] 2025-03-24 hour 1: 224537 events in 0 files, snapshot none (task 9089 ms: download 5679 ms overlapping gunzip 1365 ms, parse 5693 ms, sort 0 ms, write 0 ms, index 1163 ms: 7 candidates, 119170 repo-hours, 962 releases; waiting 489 ms; commit 0 ms)
2026-11-08T11:00:44Z [load_day 2025-03-24] 2025-03-24 hour 2: 200840 events in 0 files, snapshot none (task 6365 ms: download 4029 ms overlapping gunzip 1042 ms, parse 3926 ms, sort 0 ms, write 0 ms, index 611 ms: 7 candidates, 84944 repo-hours, 892 releases; waiting 517 ms; commit 0 ms)
2026-11-08T11:01:01Z [load_day 2025-03-24] 2025-03-24 hour 3: 212271 events in 0 files, snapshot none (task 8355 ms: download 5768 ms overlapping gunzip 1399 ms, parse 5345 ms, sort 0 ms, write 0 ms, index 643 ms: 2 candidates, 86525 repo-hours, 3138 releases; waiting 530 ms; commit 0 ms)
2026-11-08T11:01:01Z [load_day 2025-03-24] 2025-03-24 hour 4: 194642 events in 0 files, snapshot none (task 8001 ms: download 5493 ms overlapping gunzip 1364 ms, parse 5182 ms, sort 0 ms, write 0 ms, index 626 ms: 5 candidates, 72674 repo-hours, 717 releases; waiting 531 ms; commit 0 ms)
2026-11-08T11:01:11Z [load_day 2025-03-24] 2025-03-24 hour 5: 206019 events in 0 files, snapshot none (task 9287 ms: download 5994 ms overlapping gunzip 1487 ms, parse 5570 ms, sort 0 ms, write 0 ms, index 1395 ms: 6 candidates, 78817 repo-hours, 801 releases; waiting 507 ms; commit 0 ms)
2026-11-08T11:01:11Z [load_day 2025-03-24] 2025-03-24 hour 6: 237111 events in 0 files, snapshot none (task 9691 ms: download 6511 ms overlapping gunzip 1570 ms, parse 6209 ms, sort 0 ms, write 0 ms, index 1227 ms: 8 candidates, 103775 repo-hours, 1000 releases; waiting 467 ms; commit 0 ms)
2026-11-08T11:01:21Z [load_day 2025-03-24] 2025-03-24 hour 7: 236720 events in 0 files, snapshot none (task 9430 ms: download 6706 ms overlapping gunzip 1596 ms, parse 6311 ms, sort 0 ms, write 0 ms, index 761 ms: 5 candidates, 94608 repo-hours, 999 releases; waiting 506 ms; commit 0 ms)
2026-11-08T11:01:22Z [load_day 2025-03-24] 2025-03-24 hour 8: 252516 events in 0 files, snapshot none (task 10045 ms: download 7469 ms overlapping gunzip 1686 ms, parse 6765 ms, sort 0 ms, write 0 ms, index 762 ms: 4 candidates, 104146 repo-hours, 1259 releases; waiting 510 ms; commit 0 ms)
2026-11-08T11:01:33Z [load_day 2025-03-24] 2025-03-24 hour 9: 266807 events in 0 files, snapshot none (task 11550 ms: download 8793 ms overlapping gunzip 1982 ms, parse 7738 ms, sort 0 ms, write 0 ms, index 957 ms: 3 candidates, 113530 repo-hours, 1426 releases; waiting 549 ms; commit 0 ms)
2026-11-08T11:01:35Z [load_day 2025-03-24] 2025-03-24 hour 10: 268511 events in 0 files, snapshot none (task 12116 ms: download 8799 ms overlapping gunzip 1964 ms, parse 8160 ms, sort 0 ms, write 0 ms, index 1307 ms: 9 candidates, 109828 repo-hours, 1378 releases; waiting 442 ms; commit 0 ms)
2026-11-08T11:01:47Z [load_day 2025-03-24] 2025-03-24 hour 11: 266429 events in 0 files, snapshot none (task 13079 ms: download 9448 ms overlapping gunzip 2229 ms, parse 9107 ms, sort 0 ms, write 0 ms, index 1024 ms: 3 candidates, 106150 repo-hours, 1256 releases; waiting 498 ms; commit 0 ms)
2026-11-08T11:01:49Z [load_day 2025-03-24] 2025-03-24 hour 12: 297921 events in 0 files, snapshot none (task 13653 ms: download 9865 ms overlapping gunzip 2280 ms, parse 9325 ms, sort 0 ms, write 0 ms, index 1367 ms: 11 candidates, 148855 repo-hours, 1537 releases; waiting 341 ms; commit 0 ms)
2026-11-08T11:02:00Z [load_day 2025-03-24] 2025-03-24 hour 13: 292059 events in 0 files, snapshot none (task 12757 ms: download 9649 ms overlapping gunzip 2170 ms, parse 8610 ms, sort 0 ms, write 0 ms, index 1175 ms: 6 candidates, 136078 repo-hours, 1378 releases; waiting 525 ms; commit 0 ms)
2026-11-08T11:02:01Z [load_day 2025-03-24] 2025-03-24 hour 14: 285587 events in 0 files, snapshot none (task 11960 ms: download 8967 ms overlapping gunzip 2014 ms, parse 8408 ms, sort 0 ms, write 0 ms, index 1147 ms: 13 candidates, 122399 repo-hours, 1464 releases; waiting 195 ms; commit 0 ms)
2026-11-08T11:02:13Z [load_day 2025-03-24] 2025-03-24 hour 15: 284645 events in 0 files, snapshot none (task 12070 ms: download 9204 ms overlapping gunzip 2005 ms, parse 8414 ms, sort 0 ms, write 0 ms, index 952 ms: 12 candidates, 126585 repo-hours, 1577 releases; waiting 388 ms; commit 0 ms)
2026-11-08T11:02:15Z [load_day 2025-03-24] 2025-03-24 hour 16: 282966 events in 0 files, snapshot none (task 12382 ms: download 9702 ms overlapping gunzip 2067 ms, parse 8585 ms, sort 0 ms, write 0 ms, index 878 ms: 10 candidates, 119590 repo-hours, 1382 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:02:24Z [load_day 2025-03-24] 2025-03-24 hour 17: 276271 events in 0 files, snapshot none (task 10016 ms: download 7373 ms overlapping gunzip 1674 ms, parse 6820 ms, sort 0 ms, write 0 ms, index 804 ms: 7 candidates, 111839 repo-hours, 1358 releases; waiting 398 ms; commit 0 ms)
2026-11-08T11:02:24Z [load_day 2025-03-24] 2025-03-24 hour 18: 272904 events in 0 files, snapshot none (task 9020 ms: download 6529 ms overlapping gunzip 1507 ms, parse 5902 ms, sort 0 ms, write 0 ms, index 794 ms: 7 candidates, 120129 repo-hours, 1490 releases; waiting 579 ms; commit 0 ms)
2026-11-08T11:02:35Z [load_day 2025-03-24] 2025-03-24 hour 19: 238950 events in 0 files, snapshot none (task 10509 ms: download 7381 ms overlapping gunzip 1784 ms, parse 7247 ms, sort 0 ms, write 0 ms, index 767 ms: 7 candidates, 96429 repo-hours, 1214 releases; waiting 501 ms; commit 0 ms)
2026-11-08T11:02:37Z [load_day 2025-03-24] 2025-03-24 hour 20: 243127 events in 0 files, snapshot none (task 12048 ms: download 9228 ms overlapping gunzip 1989 ms, parse 8164 ms, sort 0 ms, write 0 ms, index 974 ms: 6 candidates, 96022 repo-hours, 1320 releases; waiting 625 ms; commit 0 ms)
2026-11-08T11:02:47Z [load_day 2025-03-24] 2025-03-24 hour 21: 240461 events in 0 files, snapshot none (task 12155 ms: download 8901 ms overlapping gunzip 2088 ms, parse 8655 ms, sort 0 ms, write 0 ms, index 825 ms: 12 candidates, 93363 repo-hours, 1413 releases; waiting 338 ms; commit 0 ms)
2026-11-08T11:02:48Z [load_day 2025-03-24] 2025-03-24 hour 22: 220756 events in 0 files, snapshot none (task 11230 ms: download 7824 ms overlapping gunzip 2025 ms, parse 7748 ms, sort 0 ms, write 0 ms, index 788 ms: 7 candidates, 84147 repo-hours, 1410 releases; waiting 217 ms; commit 0 ms)
2026-11-08T11:02:56Z [load_day 2025-03-24] 2025-03-24 hour 23: 209172 events in 0 files, snapshot none (task 8362 ms: download 5959 ms overlapping gunzip 1357 ms, parse 5550 ms, sort 0 ms, write 0 ms, index 603 ms: 8 candidates, 79390 repo-hours, 1347 releases; waiting 538 ms; commit 0 ms)
2026-11-08T11:03:08Z [load_day 2025-03-24] 2025-03-24: repo_hour merged from 24 files to 1 (2497721 rows, 12153 ms)
2026-11-08T11:03:11Z [load_day 2025-03-24] 2025-03-24: index committed in 14834 ms (24 + 1 + 24 files)
2026-11-08T11:03:11Z [load_day 2025-03-24] 2025-03-24: 5910333 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T11:03:11Z [load_day 2025-03-24] attempt 1 succeeded