orcaLog in

Runs · run 5014

load_day 2026-03-08, attempt 1 succeeded

Host
73ccef5e07c2:452737
Started
2026-11-08T15:31:13Z
Ended
2026-11-08T15:32:17Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
763 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
74.3 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/5014/load_day/2026-03-08/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:31:13Z [load_day 2026-03-08] attempt 1 started
2026-11-08T15:31:14Z [load_day 2026-03-08] 2026-03-08: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:31:19Z [load_day 2026-03-08] 2026-03-08 hour 0: 150774 events in 0 files, snapshot none (task 3654 ms: download 1865 ms overlapping gunzip 491 ms, parse 1507 ms, sort 0 ms, write 0 ms, index 839 ms: 16 candidates, 71266 repo-hours, 1037 releases; waiting 505 ms; commit 0 ms)
2026-11-08T15:31:19Z [load_day 2026-03-08] 2026-03-08 hour 1: 152675 events in 0 files, snapshot none (task 4426 ms: download 2881 ms overlapping gunzip 520 ms, parse 1686 ms, sort 0 ms, write 0 ms, index 676 ms: 16 candidates, 85093 repo-hours, 859 releases; waiting 1213 ms; commit 0 ms)
2026-11-08T15:31:23Z [load_day 2026-03-08] 2026-03-08 hour 2: 155111 events in 0 files, snapshot none (task 3767 ms: download 2464 ms overlapping gunzip 440 ms, parse 1273 ms, sort 0 ms, write 0 ms, index 679 ms: 14 candidates, 85095 repo-hours, 784 releases; waiting 1034 ms; commit 0 ms)
2026-11-08T15:31:23Z [load_day 2026-03-08] 2026-03-08 hour 3: 147396 events in 0 files, snapshot none (task 2813 ms: download 1587 ms overlapping gunzip 440 ms, parse 1261 ms, sort 0 ms, write 0 ms, index 564 ms: 17 candidates, 68217 repo-hours, 920 releases; waiting 207 ms; commit 0 ms)
2026-11-08T15:31:27Z [load_day 2026-03-08] 2026-03-08 hour 4: 150391 events in 0 files, snapshot none (task 3356 ms: download 1686 ms overlapping gunzip 451 ms, parse 1323 ms, sort 0 ms, write 0 ms, index 679 ms: 6 candidates, 71243 repo-hours, 970 releases; waiting 593 ms; commit 0 ms)
2026-11-08T15:31:27Z [load_day 2026-03-08] 2026-03-08 hour 5: 150510 events in 0 files, snapshot none (task 3394 ms: download 2158 ms overlapping gunzip 424 ms, parse 1253 ms, sort 0 ms, write 0 ms, index 630 ms: 5 candidates, 75035 repo-hours, 815 releases; waiting 743 ms; commit 0 ms)
2026-11-08T15:31:32Z [load_day 2026-03-08] 2026-03-08 hour 6: 151190 events in 0 files, snapshot none (task 4688 ms: download 3210 ms overlapping gunzip 416 ms, parse 1340 ms, sort 0 ms, write 0 ms, index 722 ms: 11 candidates, 74688 repo-hours, 832 releases; waiting 1858 ms; commit 0 ms)
2026-11-08T15:31:32Z [load_day 2026-03-08] 2026-03-08 hour 7: 149290 events in 0 files, snapshot none (task 3224 ms: download 2011 ms overlapping gunzip 438 ms, parse 1288 ms, sort 0 ms, write 0 ms, index 649 ms: 7 candidates, 73559 repo-hours, 798 releases; waiting 536 ms; commit 0 ms)
2026-11-08T15:31:37Z [load_day 2026-03-08] 2026-03-08 hour 8: 156913 events in 0 files, snapshot none (task 3884 ms: download 2572 ms overlapping gunzip 490 ms, parse 1476 ms, sort 0 ms, write 0 ms, index 646 ms: 14 candidates, 77573 repo-hours, 974 releases; waiting 957 ms; commit 0 ms)
2026-11-08T15:31:37Z [load_day 2026-03-08] 2026-03-08 hour 9: 155324 events in 0 files, snapshot none (task 3722 ms: download 2463 ms overlapping gunzip 519 ms, parse 1551 ms, sort 0 ms, write 0 ms, index 718 ms: 6 candidates, 77364 repo-hours, 910 releases; waiting 601 ms; commit 0 ms)
2026-11-08T15:31:41Z [load_day 2026-03-08] 2026-03-08 hour 10: 154579 events in 0 files, snapshot none (task 3581 ms: download 1939 ms overlapping gunzip 549 ms, parse 1570 ms, sort 0 ms, write 0 ms, index 663 ms: 15 candidates, 79716 repo-hours, 767 releases; waiting 522 ms; commit 0 ms)
2026-11-08T15:31:41Z [load_day 2026-03-08] 2026-03-08 hour 11: 153536 events in 0 files, snapshot none (task 4000 ms: download 2734 ms overlapping gunzip 511 ms, parse 1525 ms, sort 0 ms, write 0 ms, index 793 ms: 16 candidates, 76446 repo-hours, 821 releases; waiting 936 ms; commit 0 ms)
2026-11-08T15:31:44Z [load_day 2026-03-08] 2026-03-08 hour 12: 162308 events in 0 files, snapshot none (task 3062 ms: download 1671 ms overlapping gunzip 381 ms, parse 1163 ms, sort 0 ms, write 0 ms, index 868 ms: 12 candidates, 95583 repo-hours, 487 releases; waiting 355 ms; commit 0 ms)
2026-11-08T15:31:45Z [load_day 2026-03-08] 2026-03-08 hour 13: 163879 events in 0 files, snapshot none (task 3163 ms: download 2060 ms overlapping gunzip 372 ms, parse 1249 ms, sort 0 ms, write 0 ms, index 669 ms: 4 candidates, 95362 repo-hours, 405 releases; waiting 579 ms; commit 0 ms)
2026-11-08T15:31:48Z [load_day 2026-03-08] 2026-03-08 hour 14: 161449 events in 0 files, snapshot none (task 3483 ms: download 2211 ms overlapping gunzip 401 ms, parse 1277 ms, sort 0 ms, write 0 ms, index 666 ms: 7 candidates, 81987 repo-hours, 636 releases; waiting 840 ms; commit 0 ms)
2026-11-08T15:31:48Z [load_day 2026-03-08] 2026-03-08 hour 15: 163523 events in 0 files, snapshot none (task 2792 ms: download 1418 ms overlapping gunzip 399 ms, parse 1097 ms, sort 0 ms, write 0 ms, index 739 ms: 8 candidates, 85150 repo-hours, 689 releases; waiting 201 ms; commit 0 ms)
2026-11-08T15:31:52Z [load_day 2026-03-08] 2026-03-08 hour 16: 161899 events in 0 files, snapshot none (task 3041 ms: download 1571 ms overlapping gunzip 382 ms, parse 1271 ms, sort 0 ms, write 0 ms, index 625 ms: 5 candidates, 82241 repo-hours, 628 releases; waiting 412 ms; commit 0 ms)
2026-11-08T15:31:52Z [load_day 2026-03-08] 2026-03-08 hour 17: 158776 events in 0 files, snapshot none (task 3296 ms: download 2113 ms overlapping gunzip 368 ms, parse 1204 ms, sort 0 ms, write 0 ms, index 622 ms: 7 candidates, 80845 repo-hours, 635 releases; waiting 648 ms; commit 0 ms)
2026-11-08T15:31:56Z [load_day 2026-03-08] 2026-03-08 hour 18: 158785 events in 0 files, snapshot none (task 3136 ms: download 1795 ms overlapping gunzip 368 ms, parse 1108 ms, sort 0 ms, write 0 ms, index 652 ms: 5 candidates, 85132 repo-hours, 578 releases; waiting 679 ms; commit 0 ms)
2026-11-08T15:31:56Z [load_day 2026-03-08] 2026-03-08 hour 19: 158312 events in 0 files, snapshot none (task 2650 ms: download 1679 ms overlapping gunzip 369 ms, parse 1123 ms, sort 0 ms, write 0 ms, index 571 ms: 8 candidates, 77282 repo-hours, 756 releases; waiting 338 ms; commit 0 ms)
2026-11-08T15:31:59Z [load_day 2026-03-08] 2026-03-08 hour 20: 157916 events in 0 files, snapshot none (task 3114 ms: download 2004 ms overlapping gunzip 374 ms, parse 1144 ms, sort 0 ms, write 0 ms, index 636 ms: 7 candidates, 78921 repo-hours, 755 releases; waiting 678 ms; commit 0 ms)
2026-11-08T15:32:01Z [load_day 2026-03-08] 2026-03-08 hour 21: 152198 events in 0 files, snapshot none (task 4955 ms: download 3103 ms overlapping gunzip 410 ms, parse 1229 ms, sort 0 ms, write 0 ms, index 583 ms: 4 candidates, 72462 repo-hours, 902 releases; waiting 2123 ms; commit 0 ms)
2026-11-08T15:32:03Z [load_day 2026-03-08] 2026-03-08 hour 22: 152411 events in 0 files, snapshot none (task 2923 ms: download 1624 ms overlapping gunzip 397 ms, parse 1168 ms, sort 0 ms, write 0 ms, index 651 ms: 8 candidates, 71039 repo-hours, 986 releases; waiting 368 ms; commit 0 ms)
2026-11-08T15:32:05Z [load_day 2026-03-08] 2026-03-08 hour 23: 151848 events in 0 files, snapshot none (task 3597 ms: download 2670 ms overlapping gunzip 459 ms, parse 1399 ms, sort 0 ms, write 0 ms, index 551 ms: 5 candidates, 72581 repo-hours, 872 releases; waiting 849 ms; commit 0 ms)
2026-11-08T15:32:14Z [load_day 2026-03-08] 2026-03-08: repo_hour merged from 24 files to 1 (1893880 rows, 8179 ms)
2026-11-08T15:32:17Z [load_day 2026-03-08] 2026-03-08: index committed in 11603 ms (24 + 1 + 24 files)
2026-11-08T15:32:17Z [load_day 2026-03-08] 2026-03-08: 3730993 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:32:17Z [load_day 2026-03-08] attempt 1 succeeded