orcaLog in

Runs · run 2814

load_day 2024-08-07, attempt 1 succeeded

Host
73ccef5e07c2:160724
Started
2026-11-08T07:20:15Z
Ended
2026-11-08T07:22:10Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
780 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
184.3 s, up to 2.9 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/2814/load_day/2024-08-07/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T07:20:15Z [load_day 2024-08-07] attempt 1 started
2026-11-08T07:20:16Z [load_day 2024-08-07] 2024-08-07: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T07:20:24Z [load_day 2024-08-07] 2024-08-07 hour 0: 180498 events in 0 files, snapshot none (task 7067 ms: download 3905 ms overlapping gunzip 956 ms, parse 4267 ms, sort 0 ms, write 0 ms, index 1079 ms: 26 candidates, 93786 repo-hours, 1219 releases; waiting 532 ms; commit 0 ms)
2026-11-08T07:20:24Z [load_day 2024-08-07] 2024-08-07 hour 1: 194767 events in 0 files, snapshot none (task 7346 ms: download 4373 ms overlapping gunzip 1069 ms, parse 4484 ms, sort 0 ms, write 0 ms, index 1044 ms: 22 candidates, 108518 repo-hours, 949 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:20:31Z [load_day 2024-08-07] 2024-08-07 hour 2: 163762 events in 0 files, snapshot none (task 6815 ms: download 4357 ms overlapping gunzip 1159 ms, parse 4592 ms, sort 0 ms, write 0 ms, index 503 ms: 15 candidates, 69557 repo-hours, 886 releases; waiting 307 ms; commit 0 ms)
2026-11-08T07:20:31Z [load_day 2024-08-07] 2024-08-07 hour 3: 183135 events in 0 files, snapshot none (task 7100 ms: download 4169 ms overlapping gunzip 1051 ms, parse 4578 ms, sort 0 ms, write 0 ms, index 621 ms: 19 candidates, 76650 repo-hours, 5418 releases; waiting 504 ms; commit 0 ms)
2026-11-08T07:20:39Z [load_day 2024-08-07] 2024-08-07 hour 4: 158442 events in 0 files, snapshot none (task 7133 ms: download 3731 ms overlapping gunzip 1018 ms, parse 4604 ms, sort 0 ms, write 0 ms, index 714 ms: 9 candidates, 63881 repo-hours, 697 releases; waiting 544 ms; commit 0 ms)
2026-11-08T07:20:40Z [load_day 2024-08-07] 2024-08-07 hour 5: 176224 events in 0 files, snapshot none (task 8434 ms: download 5706 ms overlapping gunzip 1482 ms, parse 5632 ms, sort 0 ms, write 0 ms, index 547 ms: 23 candidates, 71918 repo-hours, 876 releases; waiting 507 ms; commit 0 ms)
2026-11-08T07:20:48Z [load_day 2024-08-07] 2024-08-07 hour 6: 206253 events in 0 files, snapshot none (task 8193 ms: download 4618 ms overlapping gunzip 1209 ms, parse 5249 ms, sort 0 ms, write 0 ms, index 893 ms: 32 candidates, 97198 repo-hours, 1015 releases; waiting 514 ms; commit 0 ms)
2026-11-08T07:20:49Z [load_day 2024-08-07] 2024-08-07 hour 7: 208475 events in 0 files, snapshot none (task 8330 ms: download 5536 ms overlapping gunzip 1314 ms, parse 5585 ms, sort 0 ms, write 0 ms, index 642 ms: 17 candidates, 89291 repo-hours, 1054 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:20:57Z [load_day 2024-08-07] 2024-08-07 hour 8: 217660 events in 0 files, snapshot none (task 8802 ms: download 5880 ms overlapping gunzip 1476 ms, parse 5813 ms, sort 0 ms, write 0 ms, index 732 ms: 27 candidates, 93712 repo-hours, 1331 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:20:59Z [load_day 2024-08-07] 2024-08-07 hour 9: 229217 events in 0 files, snapshot none (task 9437 ms: download 6700 ms overlapping gunzip 1486 ms, parse 6277 ms, sort 0 ms, write 0 ms, index 834 ms: 23 candidates, 101608 repo-hours, 1433 releases; waiting 538 ms; commit 0 ms)
2026-11-08T07:21:06Z [load_day 2024-08-07] 2024-08-07 hour 10: 208623 events in 0 files, snapshot none (task 8742 ms: download 5695 ms overlapping gunzip 1365 ms, parse 5848 ms, sort 0 ms, write 0 ms, index 877 ms: 20 candidates, 87955 repo-hours, 1012 releases; waiting 355 ms; commit 0 ms)
2026-11-08T07:21:08Z [load_day 2024-08-07] 2024-08-07 hour 11: 210403 events in 0 files, snapshot none (task 8758 ms: download 6155 ms overlapping gunzip 1432 ms, parse 5801 ms, sort 0 ms, write 0 ms, index 694 ms: 15 candidates, 84572 repo-hours, 1136 releases; waiting 483 ms; commit 0 ms)
2026-11-08T07:21:14Z [load_day 2024-08-07] 2024-08-07 hour 12: 270353 events in 0 files, snapshot none (task 8132 ms: download 4939 ms overlapping gunzip 1159 ms, parse 5127 ms, sort 0 ms, write 0 ms, index 1053 ms: 27 candidates, 132336 repo-hours, 1294 releases; waiting 497 ms; commit 0 ms)
2026-11-08T07:21:16Z [load_day 2024-08-07] 2024-08-07 hour 13: 244864 events in 0 files, snapshot none (task 8011 ms: download 5551 ms overlapping gunzip 1242 ms, parse 5314 ms, sort 0 ms, write 0 ms, index 765 ms: 15 candidates, 113380 repo-hours, 1254 releases; waiting 482 ms; commit 0 ms)
2026-11-08T07:21:23Z [load_day 2024-08-07] 2024-08-07 hour 14: 235519 events in 0 files, snapshot none (task 8183 ms: download 5018 ms overlapping gunzip 1200 ms, parse 4842 ms, sort 0 ms, write 0 ms, index 1293 ms: 13 candidates, 99536 repo-hours, 1210 releases; waiting 519 ms; commit 0 ms)
2026-11-08T07:21:26Z [load_day 2024-08-07] 2024-08-07 hour 15: 238162 events in 0 files, snapshot none (task 8793 ms: download 5126 ms overlapping gunzip 1289 ms, parse 5204 ms, sort 0 ms, write 0 ms, index 1230 ms: 14 candidates, 105345 repo-hours, 1391 releases; waiting 513 ms; commit 0 ms)
2026-11-08T07:21:33Z [load_day 2024-08-07] 2024-08-07 hour 16: 223586 events in 0 files, snapshot none (task 9801 ms: download 5607 ms overlapping gunzip 1586 ms, parse 6420 ms, sort 0 ms, write 0 ms, index 848 ms: 12 candidates, 92277 repo-hours, 1221 releases; waiting 214 ms; commit 0 ms)
2026-11-08T07:21:34Z [load_day 2024-08-07] 2024-08-07 hour 17: 212637 events in 0 files, snapshot none (task 7774 ms: download 4930 ms overlapping gunzip 1186 ms, parse 5096 ms, sort 0 ms, write 0 ms, index 693 ms: 16 candidates, 85126 repo-hours, 1010 releases; waiting 517 ms; commit 0 ms)
2026-11-08T07:21:42Z [load_day 2024-08-07] 2024-08-07 hour 18: 223570 events in 0 files, snapshot none (task 8848 ms: download 5807 ms overlapping gunzip 1370 ms, parse 5909 ms, sort 0 ms, write 0 ms, index 693 ms: 7 candidates, 100313 repo-hours, 1209 releases; waiting 522 ms; commit 0 ms)
2026-11-08T07:21:43Z [load_day 2024-08-07] 2024-08-07 hour 19: 199802 events in 0 files, snapshot none (task 8543 ms: download 6125 ms overlapping gunzip 1347 ms, parse 5867 ms, sort 0 ms, write 0 ms, index 573 ms: 11 candidates, 78802 repo-hours, 946 releases; waiting 495 ms; commit 0 ms)
2026-11-08T07:21:51Z [load_day 2024-08-07] 2024-08-07 hour 20: 192798 events in 0 files, snapshot none (task 8533 ms: download 5929 ms overlapping gunzip 1384 ms, parse 5761 ms, sort 0 ms, write 0 ms, index 587 ms: 23 candidates, 76642 repo-hours, 963 releases; waiting 503 ms; commit 0 ms)
2026-11-08T07:21:52Z [load_day 2024-08-07] 2024-08-07 hour 21: 184872 events in 0 files, snapshot none (task 8367 ms: download 5842 ms overlapping gunzip 1361 ms, parse 5586 ms, sort 0 ms, write 0 ms, index 576 ms: 18 candidates, 74531 repo-hours, 1075 releases; waiting 499 ms; commit 0 ms)
2026-11-08T07:21:59Z [load_day 2024-08-07] 2024-08-07 hour 22: 159683 events in 0 files, snapshot none (task 6914 ms: download 4125 ms overlapping gunzip 1118 ms, parse 4523 ms, sort 0 ms, write 0 ms, index 474 ms: 6 candidates, 60042 repo-hours, 1040 releases; waiting 516 ms; commit 0 ms)
2026-11-08T07:21:59Z [load_day 2024-08-07] 2024-08-07 hour 23: 152674 events in 0 files, snapshot none (task 6369 ms: download 3697 ms overlapping gunzip 990 ms, parse 4339 ms, sort 0 ms, write 0 ms, index 501 ms: 5 candidates, 57313 repo-hours, 734 releases; waiting 297 ms; commit 0 ms)
2026-11-08T07:22:08Z [load_day 2024-08-07] 2024-08-07: repo_hour merged from 24 files to 1 (2114289 rows, 9184 ms)
2026-11-08T07:22:10Z [load_day 2024-08-07] 2024-08-07: index committed in 11420 ms (24 + 1 + 24 files)
2026-11-08T07:22:10Z [load_day 2024-08-07] 2024-08-07: 4875979 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T07:22:10Z [load_day 2024-08-07] attempt 1 succeeded