orcaLog in

Runs · run 2583

load_day 2024-06-13, attempt 1 succeeded

Host
73ccef5e07c2:135469
Started
2026-11-08T06:30:54Z
Ended
2026-11-08T06:32:47Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
752 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
181.7 s, up to 3.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2583/load_day/2024-06-13/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T06:30:54Z [load_day 2024-06-13] attempt 1 started
2026-11-08T06:30:55Z [load_day 2024-06-13] 2024-06-13: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T06:31:02Z [load_day 2024-06-13] 2024-06-13 hour 0: 184191 events in 0 files, snapshot none (task 6959 ms: download 3766 ms overlapping gunzip 1111 ms, parse 4825 ms, sort 0 ms, write 0 ms, index 805 ms: 10 candidates, 93377 repo-hours, 1057 releases; waiting 11 ms; commit 0 ms)
2026-11-08T06:31:02Z [load_day 2024-06-13] 2024-06-13 hour 1: 193799 events in 0 files, snapshot none (task 6671 ms: download 3708 ms overlapping gunzip 1053 ms, parse 4689 ms, sort 0 ms, write 0 ms, index 733 ms: 13 candidates, 105403 repo-hours, 971 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:31:10Z [load_day 2024-06-13] 2024-06-13 hour 2: 165076 events in 0 files, snapshot none (task 6850 ms: download 2916 ms overlapping gunzip 1069 ms, parse 4653 ms, sort 0 ms, write 0 ms, index 920 ms: 9 candidates, 67434 repo-hours, 937 releases; waiting 10 ms; commit 0 ms)
2026-11-08T06:31:10Z [load_day 2024-06-13] 2024-06-13 hour 3: 187581 events in 0 files, snapshot none (task 7371 ms: download 3333 ms overlapping gunzip 1165 ms, parse 5102 ms, sort 0 ms, write 0 ms, index 881 ms: 3 candidates, 79125 repo-hours, 5264 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:31:16Z [load_day 2024-06-13] 2024-06-13 hour 4: 161573 events in 0 files, snapshot none (task 5762 ms: download 3347 ms overlapping gunzip 930 ms, parse 4123 ms, sort 0 ms, write 0 ms, index 498 ms: 8 candidates, 61850 repo-hours, 641 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:31:17Z [load_day 2024-06-13] 2024-06-13 hour 5: 174075 events in 0 files, snapshot none (task 6110 ms: download 3631 ms overlapping gunzip 946 ms, parse 4254 ms, sort 0 ms, write 0 ms, index 678 ms: 10 candidates, 69159 repo-hours, 788 releases; waiting 25 ms; commit 0 ms)
2026-11-08T06:31:25Z [load_day 2024-06-13] 2024-06-13 hour 6: 209234 events in 0 files, snapshot none (task 8507 ms: download 5311 ms overlapping gunzip 1476 ms, parse 5974 ms, sort 0 ms, write 0 ms, index 853 ms: 10 candidates, 95304 repo-hours, 1030 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:31:26Z [load_day 2024-06-13] 2024-06-13 hour 7: 220625 events in 0 files, snapshot none (task 8598 ms: download 5825 ms overlapping gunzip 1428 ms, parse 6145 ms, sort 0 ms, write 0 ms, index 799 ms: 9 candidates, 90946 repo-hours, 1099 releases; waiting 23 ms; commit 0 ms)
2026-11-08T06:31:35Z [load_day 2024-06-13] 2024-06-13 hour 8: 226643 events in 0 files, snapshot none (task 9235 ms: download 6190 ms overlapping gunzip 1546 ms, parse 6707 ms, sort 0 ms, write 0 ms, index 770 ms: 14 candidates, 94881 repo-hours, 1246 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:31:35Z [load_day 2024-06-13] 2024-06-13 hour 9: 236615 events in 0 files, snapshot none (task 8653 ms: download 5975 ms overlapping gunzip 1347 ms, parse 6293 ms, sort 0 ms, write 0 ms, index 808 ms: 17 candidates, 102063 repo-hours, 1323 releases; waiting 15 ms; commit 0 ms)
2026-11-08T06:31:44Z [load_day 2024-06-13] 2024-06-13 hour 10: 223666 events in 0 files, snapshot none (task 8988 ms: download 5518 ms overlapping gunzip 1509 ms, parse 6331 ms, sort 0 ms, write 0 ms, index 945 ms: 16 candidates, 90480 repo-hours, 1304 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:31:45Z [load_day 2024-06-13] 2024-06-13 hour 11: 225022 events in 0 files, snapshot none (task 8921 ms: download 6218 ms overlapping gunzip 1648 ms, parse 6419 ms, sort 0 ms, write 0 ms, index 655 ms: 12 candidates, 87812 repo-hours, 1155 releases; waiting 8 ms; commit 0 ms)
2026-11-08T06:31:55Z [load_day 2024-06-13] 2024-06-13 hour 12: 274819 events in 0 files, snapshot none (task 10411 ms: download 6753 ms overlapping gunzip 1580 ms, parse 7307 ms, sort 0 ms, write 0 ms, index 1322 ms: 14 candidates, 132018 repo-hours, 1337 releases; waiting 7 ms; commit 0 ms)
2026-11-08T06:31:57Z [load_day 2024-06-13] 2024-06-13 hour 13: 251827 events in 0 files, snapshot none (task 11242 ms: download 7392 ms overlapping gunzip 1703 ms, parse 7409 ms, sort 0 ms, write 0 ms, index 1907 ms: 12 candidates, 117599 repo-hours, 1413 releases; waiting 0 ms; commit 0 ms)
2026-11-08T06:32:05Z [load_day 2024-06-13] 2024-06-13 hour 14: 241465 events in 0 files, snapshot none (task 9225 ms: download 6780 ms overlapping gunzip 1545 ms, parse 6772 ms, sort 0 ms, write 0 ms, index 699 ms: 25 candidates, 103473 repo-hours, 1432 releases; waiting 3 ms; commit 0 ms)
2026-11-08T06:32:06Z [load_day 2024-06-13] 2024-06-13 hour 15: 245761 events in 0 files, snapshot none (task 8463 ms: download 5810 ms overlapping gunzip 1432 ms, parse 5934 ms, sort 0 ms, write 0 ms, index 853 ms: 14 candidates, 109674 repo-hours, 1548 releases; waiting 21 ms; commit 0 ms)
2026-11-08T06:32:12Z [load_day 2024-06-13] 2024-06-13 hour 16: 225138 events in 0 files, snapshot none (task 6628 ms: download 4259 ms overlapping gunzip 1104 ms, parse 4648 ms, sort 0 ms, write 0 ms, index 657 ms: 12 candidates, 95513 repo-hours, 1143 releases; waiting 18 ms; commit 0 ms)
2026-11-08T06:32:13Z [load_day 2024-06-13] 2024-06-13 hour 17: 218381 events in 0 files, snapshot none (task 6522 ms: download 3991 ms overlapping gunzip 1080 ms, parse 4368 ms, sort 0 ms, write 0 ms, index 870 ms: 14 candidates, 88060 repo-hours, 1152 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:32:20Z [load_day 2024-06-13] 2024-06-13 hour 18: 223741 events in 0 files, snapshot none (task 7270 ms: download 4191 ms overlapping gunzip 1232 ms, parse 5040 ms, sort 0 ms, write 0 ms, index 782 ms: 13 candidates, 100016 repo-hours, 1149 releases; waiting 20 ms; commit 0 ms)
2026-11-08T06:32:20Z [load_day 2024-06-13] 2024-06-13 hour 19: 200518 events in 0 files, snapshot none (task 7085 ms: download 4456 ms overlapping gunzip 1228 ms, parse 4970 ms, sort 0 ms, write 0 ms, index 673 ms: 7 candidates, 80433 repo-hours, 1108 releases; waiting 19 ms; commit 0 ms)
2026-11-08T06:32:28Z [load_day 2024-06-13] 2024-06-13 hour 20: 195291 events in 0 files, snapshot none (task 7769 ms: download 5030 ms overlapping gunzip 1347 ms, parse 5500 ms, sort 0 ms, write 0 ms, index 714 ms: 11 candidates, 78241 repo-hours, 987 releases; waiting 16 ms; commit 0 ms)
2026-11-08T06:32:28Z [load_day 2024-06-13] 2024-06-13 hour 21: 185040 events in 0 files, snapshot none (task 7451 ms: download 4801 ms overlapping gunzip 1232 ms, parse 5326 ms, sort 0 ms, write 0 ms, index 674 ms: 8 candidates, 76794 repo-hours, 1147 releases; waiting 24 ms; commit 0 ms)
2026-11-08T06:32:35Z [load_day 2024-06-13] 2024-06-13 hour 22: 159413 events in 0 files, snapshot none (task 5883 ms: download 3537 ms overlapping gunzip 1006 ms, parse 4116 ms, sort 0 ms, write 0 ms, index 574 ms: 17 candidates, 62564 repo-hours, 931 releases; waiting 17 ms; commit 0 ms)
2026-11-08T06:32:35Z [load_day 2024-06-13] 2024-06-13 hour 23: 150655 events in 0 files, snapshot none (task 5881 ms: download 2972 ms overlapping gunzip 963 ms, parse 4242 ms, sort 0 ms, write 0 ms, index 477 ms: 4 candidates, 56899 repo-hours, 831 releases; waiting 13 ms; commit 0 ms)
2026-11-08T06:32:45Z [load_day 2024-06-13] 2024-06-13: repo_hour merged from 24 files to 1 (2139118 rows, 10093 ms)
2026-11-08T06:32:47Z [load_day 2024-06-13] 2024-06-13: index committed in 12732 ms (24 + 1 + 24 files)
2026-11-08T06:32:47Z [load_day 2024-06-13] 2024-06-13: 4980149 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T06:32:47Z [load_day 2024-06-13] attempt 1 succeeded