orcaLog in

Runs · run 4854

load_day 2026-01-22, attempt 1 succeeded

Host
73ccef5e07c2:433261
Started
2026-11-08T15:06:18Z
Ended
2026-11-08T15:07:29Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
712 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
73.6 s, up to 2.0 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4854/load_day/2026-01-22/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:06:18Z [load_day 2026-01-22] attempt 1 started
2026-11-08T15:06:20Z [load_day 2026-01-22] 2026-01-22: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:06:23Z [load_day 2026-01-22] 2026-01-22 hour 0: 148285 events in 0 files, snapshot none (task 3336 ms: download 2067 ms overlapping gunzip 515 ms, parse 1622 ms, sort 0 ms, write 0 ms, index 574 ms: 3 candidates, 75535 repo-hours, 584 releases; waiting 326 ms; commit 0 ms)
2026-11-08T15:06:23Z [load_day 2026-01-22] 2026-01-22 hour 1: 156241 events in 0 files, snapshot none (task 3422 ms: download 1925 ms overlapping gunzip 438 ms, parse 1479 ms, sort 0 ms, write 0 ms, index 677 ms: 7 candidates, 93922 repo-hours, 489 releases; waiting 495 ms; commit 0 ms)
2026-11-08T15:06:27Z [load_day 2026-01-22] 2026-01-22 hour 2: 145454 events in 0 files, snapshot none (task 3457 ms: download 2140 ms overlapping gunzip 427 ms, parse 1322 ms, sort 0 ms, write 0 ms, index 605 ms: 6 candidates, 80250 repo-hours, 582 releases; waiting 730 ms; commit 0 ms)
2026-11-08T15:06:28Z [load_day 2026-01-22] 2026-01-22 hour 3: 143618 events in 0 files, snapshot none (task 3747 ms: download 2364 ms overlapping gunzip 485 ms, parse 1465 ms, sort 0 ms, write 0 ms, index 580 ms: 12 candidates, 71862 repo-hours, 743 releases; waiting 850 ms; commit 0 ms)
2026-11-08T15:06:32Z [load_day 2026-01-22] 2026-01-22 hour 4: 141073 events in 0 files, snapshot none (task 4042 ms: download 2509 ms overlapping gunzip 517 ms, parse 1571 ms, sort 0 ms, write 0 ms, index 590 ms: 5 candidates, 69902 repo-hours, 1554 releases; waiting 1027 ms; commit 0 ms)
2026-11-08T15:06:32Z [load_day 2026-01-22] 2026-01-22 hour 5: 146720 events in 0 files, snapshot none (task 3635 ms: download 1776 ms overlapping gunzip 507 ms, parse 1377 ms, sort 0 ms, write 0 ms, index 692 ms: 9 candidates, 73746 repo-hours, 642 releases; waiting 596 ms; commit 0 ms)
2026-11-08T15:06:36Z [load_day 2026-01-22] 2026-01-22 hour 6: 143333 events in 0 files, snapshot none (task 3698 ms: download 2329 ms overlapping gunzip 515 ms, parse 1452 ms, sort 0 ms, write 0 ms, index 661 ms: 3 candidates, 77718 repo-hours, 671 releases; waiting 747 ms; commit 0 ms)
2026-11-08T15:06:41Z [load_day 2026-01-22] 2026-01-22 hour 7: 149940 events in 0 files, snapshot none (task 8860 ms: download 7637 ms overlapping gunzip 624 ms, parse 1979 ms, sort 0 ms, write 0 ms, index 604 ms: 11 candidates, 78696 repo-hours, 627 releases; waiting 5080 ms; commit 0 ms)
2026-11-08T15:06:41Z [load_day 2026-01-22] 2026-01-22 hour 8: 144837 events in 0 files, snapshot none (task 3682 ms: download 2007 ms overlapping gunzip 545 ms, parse 1602 ms, sort 0 ms, write 0 ms, index 848 ms: 3 candidates, 74550 repo-hours, 757 releases; waiting 436 ms; commit 0 ms)
2026-11-08T15:06:46Z [load_day 2026-01-22] 2026-01-22 hour 9: 144212 events in 0 files, snapshot none (task 3863 ms: download 2194 ms overlapping gunzip 556 ms, parse 1718 ms, sort 0 ms, write 0 ms, index 860 ms: 6 candidates, 79910 repo-hours, 629 releases; waiting 426 ms; commit 0 ms)
2026-11-08T15:06:46Z [load_day 2026-01-22] 2026-01-22 hour 10: 144668 events in 0 files, snapshot none (task 4550 ms: download 2893 ms overlapping gunzip 764 ms, parse 1990 ms, sort 0 ms, write 0 ms, index 673 ms: 5 candidates, 79508 repo-hours, 560 releases; waiting 779 ms; commit 0 ms)
2026-11-08T15:06:50Z [load_day 2026-01-22] 2026-01-22 hour 11: 144980 events in 0 files, snapshot none (task 4046 ms: download 2330 ms overlapping gunzip 564 ms, parse 1666 ms, sort 0 ms, write 0 ms, index 678 ms: 14 candidates, 78771 repo-hours, 668 releases; waiting 808 ms; commit 0 ms)
2026-11-08T15:06:51Z [load_day 2026-01-22] 2026-01-22 hour 12: 148526 events in 0 files, snapshot none (task 3605 ms: download 2194 ms overlapping gunzip 459 ms, parse 1404 ms, sort 0 ms, write 0 ms, index 811 ms: 7 candidates, 91178 repo-hours, 400 releases; waiting 657 ms; commit 0 ms)
2026-11-08T15:06:54Z [load_day 2026-01-22] 2026-01-22 hour 13: 152235 events in 0 files, snapshot none (task 3324 ms: download 1747 ms overlapping gunzip 380 ms, parse 1152 ms, sort 0 ms, write 0 ms, index 814 ms: 6 candidates, 94916 repo-hours, 382 releases; waiting 654 ms; commit 0 ms)
2026-11-08T15:06:55Z [load_day 2026-01-22] 2026-01-22 hour 14: 140123 events in 0 files, snapshot none (task 3543 ms: download 1899 ms overlapping gunzip 492 ms, parse 1620 ms, sort 0 ms, write 0 ms, index 638 ms: 12 candidates, 80837 repo-hours, 591 releases; waiting 564 ms; commit 0 ms)
2026-11-08T15:06:58Z [load_day 2026-01-22] 2026-01-22 hour 15: 145083 events in 0 files, snapshot none (task 3473 ms: download 2174 ms overlapping gunzip 355 ms, parse 1073 ms, sort 0 ms, write 0 ms, index 813 ms: 4 candidates, 84423 repo-hours, 551 releases; waiting 932 ms; commit 0 ms)
2026-11-08T15:06:59Z [load_day 2026-01-22] 2026-01-22 hour 16: 144356 events in 0 files, snapshot none (task 3473 ms: download 2162 ms overlapping gunzip 378 ms, parse 1168 ms, sort 0 ms, write 0 ms, index 703 ms: 5 candidates, 81617 repo-hours, 649 releases; waiting 938 ms; commit 0 ms)
2026-11-08T15:07:03Z [load_day 2026-01-22] 2026-01-22 hour 17: 145816 events in 0 files, snapshot none (task 4286 ms: download 2518 ms overlapping gunzip 351 ms, parse 1146 ms, sort 0 ms, write 0 ms, index 1071 ms: 10 candidates, 82342 repo-hours, 522 releases; waiting 1265 ms; commit 0 ms)
2026-11-08T15:07:03Z [load_day 2026-01-22] 2026-01-22 hour 18: 147855 events in 0 files, snapshot none (task 3455 ms: download 2202 ms overlapping gunzip 393 ms, parse 1240 ms, sort 0 ms, write 0 ms, index 880 ms: 13 candidates, 82625 repo-hours, 535 releases; waiting 645 ms; commit 0 ms)
2026-11-08T15:07:07Z [load_day 2026-01-22] 2026-01-22 hour 19: 145672 events in 0 files, snapshot none (task 3531 ms: download 2260 ms overlapping gunzip 462 ms, parse 1428 ms, sort 0 ms, write 0 ms, index 774 ms: 4 candidates, 74696 repo-hours, 660 releases; waiting 538 ms; commit 0 ms)
2026-11-08T15:07:08Z [load_day 2026-01-22] 2026-01-22 hour 20: 143481 events in 0 files, snapshot none (task 4160 ms: download 2375 ms overlapping gunzip 625 ms, parse 1660 ms, sort 0 ms, write 0 ms, index 867 ms: 12 candidates, 72736 repo-hours, 746 releases; waiting 707 ms; commit 0 ms)
2026-11-08T15:07:12Z [load_day 2026-01-22] 2026-01-22 hour 21: 143040 events in 0 files, snapshot none (task 4461 ms: download 2294 ms overlapping gunzip 503 ms, parse 1632 ms, sort 0 ms, write 0 ms, index 1141 ms: 8 candidates, 73314 repo-hours, 791 releases; waiting 893 ms; commit 0 ms)
2026-11-08T15:07:13Z [load_day 2026-01-22] 2026-01-22 hour 22: 145795 events in 0 files, snapshot none (task 4279 ms: download 2347 ms overlapping gunzip 537 ms, parse 1681 ms, sort 0 ms, write 0 ms, index 1092 ms: 10 candidates, 70173 repo-hours, 773 releases; waiting 727 ms; commit 0 ms)
2026-11-08T15:07:16Z [load_day 2026-01-22] 2026-01-22 hour 23: 139828 events in 0 files, snapshot none (task 3263 ms: download 1856 ms overlapping gunzip 399 ms, parse 1266 ms, sort 0 ms, write 0 ms, index 656 ms: 8 candidates, 65265 repo-hours, 926 releases; waiting 638 ms; commit 0 ms)
2026-11-08T15:07:25Z [load_day 2026-01-22] 2026-01-22: repo_hour merged from 24 files to 1 (1888492 rows, 8847 ms)
2026-11-08T15:07:29Z [load_day 2026-01-22] 2026-01-22: index committed in 12345 ms (24 + 1 + 24 files)
2026-11-08T15:07:29Z [load_day 2026-01-22] 2026-01-22: 3495171 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:07:29Z [load_day 2026-01-22] attempt 1 succeeded