orcaLog in

Runs · run 4891

load_day 2026-02-01, attempt 1 succeeded

Host
73ccef5e07c2:438077
Started
2026-11-08T15:12:09Z
Ended
2026-11-08T15:13:12Z
Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
677 MB
CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
71.2 s, up to 2.3 cores at once
Log file
s3://census-mlake-dev/logs/gharchive/4891/load_day/2026-02-01/1.log
Code
pipelines/gharchive.mojo:135

Log

2026-11-08T15:12:09Z [load_day 2026-02-01] attempt 1 started
2026-11-08T15:12:10Z [load_day 2026-02-01] 2026-02-01: 2 hours in flight, about 700 MB (GHARCHIVE_EVENTS=off: the index only)
2026-11-08T15:12:14Z [load_day 2026-02-01] 2026-02-01 hour 0: 142806 events in 0 files, snapshot none (task 3483 ms: download 2313 ms overlapping gunzip 397 ms, parse 1233 ms, sort 0 ms, write 0 ms, index 474 ms: 7 candidates, 62395 repo-hours, 998 releases; waiting 1012 ms; commit 0 ms)
2026-11-08T15:12:14Z [load_day 2026-02-01] 2026-02-01 hour 1: 147767 events in 0 files, snapshot none (task 3575 ms: download 2400 ms overlapping gunzip 369 ms, parse 1178 ms, sort 0 ms, write 0 ms, index 631 ms: 9 candidates, 79304 repo-hours, 805 releases; waiting 1113 ms; commit 0 ms)
2026-11-08T15:12:17Z [load_day 2026-02-01] 2026-02-01 hour 2: 147594 events in 0 files, snapshot none (task 3135 ms: download 1752 ms overlapping gunzip 353 ms, parse 1094 ms, sort 0 ms, write 0 ms, index 650 ms: 3 candidates, 78572 repo-hours, 824 releases; waiting 751 ms; commit 0 ms)
2026-11-08T15:12:17Z [load_day 2026-02-01] 2026-02-01 hour 3: 139798 events in 0 files, snapshot none (task 2952 ms: download 2076 ms overlapping gunzip 374 ms, parse 1129 ms, sort 0 ms, write 0 ms, index 476 ms: 15 candidates, 59891 repo-hours, 956 releases; waiting 663 ms; commit 0 ms)
2026-11-08T15:12:21Z [load_day 2026-02-01] 2026-02-01 hour 4: 144988 events in 0 files, snapshot none (task 2821 ms: download 1673 ms overlapping gunzip 413 ms, parse 1296 ms, sort 0 ms, write 0 ms, index 445 ms: 11 candidates, 64556 repo-hours, 763 releases; waiting 366 ms; commit 0 ms)
2026-11-08T15:12:21Z [load_day 2026-02-01] 2026-02-01 hour 5: 145178 events in 0 files, snapshot none (task 2764 ms: download 1641 ms overlapping gunzip 402 ms, parse 1269 ms, sort 0 ms, write 0 ms, index 493 ms: 10 candidates, 67682 repo-hours, 1559 releases; waiting 239 ms; commit 0 ms)
2026-11-08T15:12:25Z [load_day 2026-02-01] 2026-02-01 hour 6: 147488 events in 0 files, snapshot none (task 3355 ms: download 2294 ms overlapping gunzip 435 ms, parse 1395 ms, sort 0 ms, write 0 ms, index 508 ms: 8 candidates, 71890 repo-hours, 751 releases; waiting 627 ms; commit 0 ms)
2026-11-08T15:12:25Z [load_day 2026-02-01] 2026-02-01 hour 7: 147356 events in 0 files, snapshot none (task 2859 ms: download 1744 ms overlapping gunzip 421 ms, parse 1323 ms, sort 0 ms, write 0 ms, index 516 ms: 6 candidates, 65584 repo-hours, 701 releases; waiting 271 ms; commit 0 ms)
2026-11-08T15:12:29Z [load_day 2026-02-01] 2026-02-01 hour 8: 145030 events in 0 files, snapshot none (task 3301 ms: download 1987 ms overlapping gunzip 486 ms, parse 1523 ms, sort 0 ms, write 0 ms, index 522 ms: 10 candidates, 65910 repo-hours, 782 releases; waiting 503 ms; commit 0 ms)
2026-11-08T15:12:29Z [load_day 2026-02-01] 2026-02-01 hour 9: 148728 events in 0 files, snapshot none (task 3787 ms: download 2228 ms overlapping gunzip 600 ms, parse 1741 ms, sort 0 ms, write 0 ms, index 567 ms: 5 candidates, 69993 repo-hours, 815 releases; waiting 573 ms; commit 0 ms)
2026-11-08T15:12:33Z [load_day 2026-02-01] 2026-02-01 hour 10: 150371 events in 0 files, snapshot none (task 3066 ms: download 1679 ms overlapping gunzip 400 ms, parse 1267 ms, sort 0 ms, write 0 ms, index 697 ms: 4 candidates, 71917 repo-hours, 736 releases; waiting 435 ms; commit 0 ms)
2026-11-08T15:12:33Z [load_day 2026-02-01] 2026-02-01 hour 11: 152752 events in 0 files, snapshot none (task 3617 ms: download 1887 ms overlapping gunzip 483 ms, parse 1485 ms, sort 0 ms, write 0 ms, index 562 ms: 5 candidates, 72958 repo-hours, 779 releases; waiting 269 ms; commit 0 ms)
2026-11-08T15:12:37Z [load_day 2026-02-01] 2026-02-01 hour 12: 159234 events in 0 files, snapshot none (task 3915 ms: download 2597 ms overlapping gunzip 468 ms, parse 1387 ms, sort 0 ms, write 0 ms, index 837 ms: 9 candidates, 88361 repo-hours, 692 releases; waiting 906 ms; commit 0 ms)
2026-11-08T15:12:37Z [load_day 2026-02-01] 2026-02-01 hour 13: 155371 events in 0 files, snapshot none (task 3548 ms: download 2085 ms overlapping gunzip 478 ms, parse 1446 ms, sort 0 ms, write 0 ms, index 626 ms: 11 candidates, 86585 repo-hours, 553 releases; waiting 703 ms; commit 0 ms)
2026-11-08T15:12:41Z [load_day 2026-02-01] 2026-02-01 hour 14: 153145 events in 0 files, snapshot none (task 3924 ms: download 2316 ms overlapping gunzip 536 ms, parse 1555 ms, sort 0 ms, write 0 ms, index 675 ms: 6 candidates, 77024 repo-hours, 698 releases; waiting 889 ms; commit 0 ms)
2026-11-08T15:12:42Z [load_day 2026-02-01] 2026-02-01 hour 15: 151598 events in 0 files, snapshot none (task 4411 ms: download 2842 ms overlapping gunzip 472 ms, parse 1399 ms, sort 0 ms, write 0 ms, index 605 ms: 6 candidates, 77293 repo-hours, 706 releases; waiting 1599 ms; commit 0 ms)
2026-11-08T15:12:46Z [load_day 2026-02-01] 2026-02-01 hour 16: 155128 events in 0 files, snapshot none (task 3693 ms: download 2516 ms overlapping gunzip 475 ms, parse 1439 ms, sort 0 ms, write 0 ms, index 681 ms: 9 candidates, 78830 repo-hours, 657 releases; waiting 734 ms; commit 0 ms)
2026-11-08T15:12:46Z [load_day 2026-02-01] 2026-02-01 hour 17: 153369 events in 0 files, snapshot none (task 3411 ms: download 1990 ms overlapping gunzip 467 ms, parse 1540 ms, sort 0 ms, write 0 ms, index 583 ms: 6 candidates, 73104 repo-hours, 683 releases; waiting 497 ms; commit 0 ms)
2026-11-08T15:12:50Z [load_day 2026-02-01] 2026-02-01 hour 18: 150665 events in 0 files, snapshot none (task 3733 ms: download 2449 ms overlapping gunzip 519 ms, parse 1538 ms, sort 0 ms, write 0 ms, index 618 ms: 10 candidates, 76660 repo-hours, 711 releases; waiting 739 ms; commit 0 ms)
2026-11-08T15:12:50Z [load_day 2026-02-01] 2026-02-01 hour 19: 147465 events in 0 files, snapshot none (task 3580 ms: download 2007 ms overlapping gunzip 557 ms, parse 1625 ms, sort 0 ms, write 0 ms, index 557 ms: 15 candidates, 70440 repo-hours, 759 releases; waiting 520 ms; commit 0 ms)
2026-11-08T15:12:54Z [load_day 2026-02-01] 2026-02-01 hour 20: 152008 events in 0 files, snapshot none (task 3567 ms: download 2154 ms overlapping gunzip 490 ms, parse 1499 ms, sort 0 ms, write 0 ms, index 673 ms: 12 candidates, 71737 repo-hours, 827 releases; waiting 610 ms; commit 0 ms)
2026-11-08T15:12:54Z [load_day 2026-02-01] 2026-02-01 hour 21: 148784 events in 0 files, snapshot none (task 3590 ms: download 2275 ms overlapping gunzip 547 ms, parse 1613 ms, sort 0 ms, write 0 ms, index 585 ms: 11 candidates, 69650 repo-hours, 836 releases; waiting 541 ms; commit 0 ms)
2026-11-08T15:12:58Z [load_day 2026-02-01] 2026-02-01 hour 22: 146172 events in 0 files, snapshot none (task 3345 ms: download 2135 ms overlapping gunzip 419 ms, parse 1238 ms, sort 0 ms, write 0 ms, index 508 ms: 11 candidates, 63899 repo-hours, 813 releases; waiting 790 ms; commit 0 ms)
2026-11-08T15:13:00Z [load_day 2026-02-01] 2026-02-01 hour 23: 144691 events in 0 files, snapshot none (task 3143 ms: download 2138 ms overlapping gunzip 382 ms, parse 1230 ms, sort 0 ms, write 0 ms, index 502 ms: 11 candidates, 63570 repo-hours, 798 releases; waiting 760 ms; commit 0 ms)
2026-11-08T15:13:08Z [load_day 2026-02-01] 2026-02-01: repo_hour merged from 24 files to 1 (1727805 rows, 8513 ms)
2026-11-08T15:13:12Z [load_day 2026-02-01] 2026-02-01: index committed in 12287 ms (24 + 1 + 24 files)
2026-11-08T15:13:12Z [load_day 2026-02-01] 2026-02-01: 3577486 events in 24 hours (not kept: GHARCHIVE_EVENTS=off)
2026-11-08T15:13:12Z [load_day 2026-02-01] attempt 1 succeeded