orcaLog in

Runs · run 2284

load_day 2024-04-05, attempt 1 succeeded

Host
73ccef5e07c2:105926
Started
2026-11-08T05:28:20Z
Ended
2026-11-08T05:30:11Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
683 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
176.8 s, up to 2.8 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2284/load_day/2024-04-05/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T05:28:20Z [load_day 2024-04-05] attempt 1 started
2026-11-08T05:28:21Z [load_day 2024-04-05] 2024-04-05: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T05:28:28Z [load_day 2024-04-05] 2024-04-05 hour 0: 238386 events in 0 files, snapshot none (task 6170 ms: download 3717 ms overlapping gunzip 828 ms, parse 3575 ms, sort 0 ms, write 0 ms, index 648 ms: 11 candidates, 94178 repo-hours, 1148 releases; waiting 732 ms; commit 0 ms)
2026-11-08T05:28:28Z [load_day 2024-04-05] 2024-04-05 hour 1: 231621 events in 0 files, snapshot none (task 5649 ms: download 3032 ms overlapping gunzip 767 ms, parse 3455 ms, sort 0 ms, write 0 ms, index 644 ms: 7 candidates, 93510 repo-hours, 790 releases; waiting 481 ms; commit 0 ms)
2026-11-08T05:28:34Z [load_day 2024-04-05] 2024-04-05 hour 2: 209562 events in 0 files, snapshot none (task 5408 ms: download 3101 ms overlapping gunzip 797 ms, parse 3370 ms, sort 0 ms, write 0 ms, index 428 ms: 11 candidates, 60242 repo-hours, 751 releases; waiting 506 ms; commit 0 ms)
2026-11-08T05:28:34Z [load_day 2024-04-05] 2024-04-05 hour 3: 202736 events in 0 files, snapshot none (task 5276 ms: download 2928 ms overlapping gunzip 769 ms, parse 3277 ms, sort 0 ms, write 0 ms, index 416 ms: 10 candidates, 59526 repo-hours, 880 releases; waiting 508 ms; commit 0 ms)
2026-11-08T05:28:41Z [load_day 2024-04-05] 2024-04-05 hour 4: 207204 events in 0 files, snapshot none (task 5639 ms: download 3695 ms overlapping gunzip 794 ms, parse 3244 ms, sort 0 ms, write 0 ms, index 519 ms: 8 candidates, 60811 repo-hours, 695 releases; waiting 700 ms; commit 0 ms)
2026-11-08T05:28:42Z [load_day 2024-04-05] 2024-04-05 hour 5: 215967 events in 0 files, snapshot none (task 6167 ms: download 3629 ms overlapping gunzip 931 ms, parse 3776 ms, sort 0 ms, write 0 ms, index 641 ms: 11 candidates, 63087 repo-hours, 811 releases; waiting 511 ms; commit 0 ms)
2026-11-08T05:28:49Z [load_day 2024-04-05] 2024-04-05 hour 6: 236158 events in 0 files, snapshot none (task 7450 ms: download 4023 ms overlapping gunzip 1129 ms, parse 4828 ms, sort 0 ms, write 0 ms, index 636 ms: 2 candidates, 76729 repo-hours, 914 releases; waiting 501 ms; commit 0 ms)
2026-11-08T05:28:50Z [load_day 2024-04-05] 2024-04-05 hour 7: 240235 events in 0 files, snapshot none (task 7585 ms: download 4517 ms overlapping gunzip 1153 ms, parse 5044 ms, sort 0 ms, write 0 ms, index 603 ms: 6 candidates, 76355 repo-hours, 1014 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:28:56Z [load_day 2024-04-05] 2024-04-05 hour 8: 199948 events in 0 files, snapshot none (task 6522 ms: download 3712 ms overlapping gunzip 983 ms, parse 4106 ms, sort 0 ms, write 0 ms, index 581 ms: 9 candidates, 71346 repo-hours, 902 releases; waiting 503 ms; commit 0 ms)
2026-11-08T05:28:59Z [load_day 2024-04-05] 2024-04-05 hour 9: 258582 events in 0 files, snapshot none (task 8886 ms: download 5899 ms overlapping gunzip 1268 ms, parse 5662 ms, sort 0 ms, write 0 ms, index 1117 ms: 9 candidates, 84011 repo-hours, 1353 releases; waiting 608 ms; commit 0 ms)
2026-11-08T05:29:06Z [load_day 2024-04-05] 2024-04-05 hour 10: 253940 events in 0 files, snapshot none (task 9336 ms: download 6002 ms overlapping gunzip 1367 ms, parse 5880 ms, sort 0 ms, write 0 ms, index 1272 ms: 9 candidates, 82432 repo-hours, 1081 releases; waiting 520 ms; commit 0 ms)
2026-11-08T05:29:08Z [load_day 2024-04-05] 2024-04-05 hour 11: 250087 events in 0 files, snapshot none (task 8605 ms: download 5018 ms overlapping gunzip 1263 ms, parse 5589 ms, sort 0 ms, write 0 ms, index 1045 ms: 2 candidates, 80147 repo-hours, 1114 releases; waiting 356 ms; commit 0 ms)
2026-11-08T05:29:16Z [load_day 2024-04-05] 2024-04-05 hour 12: 286971 events in 0 files, snapshot none (task 9220 ms: download 5346 ms overlapping gunzip 1368 ms, parse 6424 ms, sort 0 ms, write 0 ms, index 856 ms: 9 candidates, 109930 repo-hours, 1075 releases; waiting 244 ms; commit 0 ms)
2026-11-08T05:29:19Z [load_day 2024-04-05] 2024-04-05 hour 13: 281122 events in 0 files, snapshot none (task 10220 ms: download 6926 ms overlapping gunzip 1509 ms, parse 6542 ms, sort 0 ms, write 0 ms, index 1363 ms: 5 candidates, 105244 repo-hours, 1235 releases; waiting 496 ms; commit 0 ms)
2026-11-08T05:29:26Z [load_day 2024-04-05] 2024-04-05 hour 14: 275745 events in 0 files, snapshot none (task 9400 ms: download 6743 ms overlapping gunzip 1497 ms, parse 6276 ms, sort 0 ms, write 0 ms, index 846 ms: 9 candidates, 95757 repo-hours, 1285 releases; waiting 497 ms; commit 0 ms)
2026-11-08T05:29:29Z [load_day 2024-04-05] 2024-04-05 hour 15: 270216 events in 0 files, snapshot none (task 9640 ms: download 6140 ms overlapping gunzip 1532 ms, parse 6256 ms, sort 0 ms, write 0 ms, index 1036 ms: 16 candidates, 93462 repo-hours, 1360 releases; waiting 516 ms; commit 0 ms)
2026-11-08T05:29:35Z [load_day 2024-04-05] 2024-04-05 hour 16: 263720 events in 0 files, snapshot none (task 8876 ms: download 5421 ms overlapping gunzip 1420 ms, parse 5738 ms, sort 0 ms, write 0 ms, index 927 ms: 10 candidates, 90043 repo-hours, 1157 releases; waiting 493 ms; commit 0 ms)
2026-11-08T05:29:38Z [load_day 2024-04-05] 2024-04-05 hour 17: 250772 events in 0 files, snapshot none (task 8265 ms: download 5513 ms overlapping gunzip 1241 ms, parse 5198 ms, sort 0 ms, write 0 ms, index 858 ms: 6 candidates, 82616 repo-hours, 1005 releases; waiting 645 ms; commit 0 ms)
2026-11-08T05:29:43Z [load_day 2024-04-05] 2024-04-05 hour 18: 254434 events in 0 files, snapshot none (task 6981 ms: download 4006 ms overlapping gunzip 1139 ms, parse 4631 ms, sort 0 ms, write 0 ms, index 696 ms: 11 candidates, 87562 repo-hours, 1093 releases; waiting 204 ms; commit 0 ms)
2026-11-08T05:29:47Z [load_day 2024-04-05] 2024-04-05 hour 19: 233031 events in 0 files, snapshot none (task 7643 ms: download 4266 ms overlapping gunzip 1200 ms, parse 5066 ms, sort 0 ms, write 0 ms, index 851 ms: 10 candidates, 76198 repo-hours, 938 releases; waiting 204 ms; commit 0 ms)
2026-11-08T05:29:50Z [load_day 2024-04-05] 2024-04-05 hour 20: 236651 events in 0 files, snapshot none (task 7372 ms: download 4633 ms overlapping gunzip 1078 ms, parse 4588 ms, sort 0 ms, write 0 ms, index 724 ms: 12 candidates, 73972 repo-hours, 1236 releases; waiting 544 ms; commit 0 ms)
2026-11-08T05:29:54Z [load_day 2024-04-05] 2024-04-05 hour 21: 217468 events in 0 files, snapshot none (task 6938 ms: download 4666 ms overlapping gunzip 1167 ms, parse 4341 ms, sort 0 ms, write 0 ms, index 524 ms: 9 candidates, 66062 repo-hours, 998 releases; waiting 537 ms; commit 0 ms)
2026-11-08T05:29:57Z [load_day 2024-04-05] 2024-04-05 hour 22: 213413 events in 0 files, snapshot none (task 6146 ms: download 3826 ms overlapping gunzip 1044 ms, parse 3732 ms, sort 0 ms, write 0 ms, index 523 ms: 9 candidates, 59386 repo-hours, 927 releases; waiting 491 ms; commit 0 ms)
2026-11-08T05:30:00Z [load_day 2024-04-05] 2024-04-05 hour 23: 194596 events in 0 files, snapshot none (task 5387 ms: download 3119 ms overlapping gunzip 861 ms, parse 3098 ms, sort 0 ms, write 0 ms, index 408 ms: 7 candidates, 54820 repo-hours, 715 releases; waiting 557 ms; commit 0 ms)
2026-11-08T05:30:08Z [load_day 2024-04-05] 2024-04-05: repo_hour merged from 24 files to 1 (1897426 rows, 8473 ms)
2026-11-08T05:30:11Z [load_day 2024-04-05] 2024-04-05: index committed in 11170 ms (24 + 1 + 24 files)
2026-11-08T05:30:11Z [load_day 2024-04-05] 2024-04-05: 5722565 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T05:30:11Z [load_day 2024-04-05] attempt 1 succeeded