orcaLog in

Pools

Every machine runs are placed on, by pool: ec2, the instances orca launches for runs; kubernetes, a run's pods on the Kubernetes runner; and worker:<pool>, the machines of your own running orca worker. The one machine that runs the scheduler, this UI and Postgres is Control; Watchdog lists the rules that pause pipelines.

This scheduler's runner is local: it runs every run on its own machine and launches no instances, so there are none to list and no per-instance cost. The machine is Control; its price is the server's fixed price.

Pool: all

MachinesA row per machine of each pool runs are placed on: the EC2 instances orca launches, a Kubernetes run's pods, and the machines running orca worker for a worker:<pool> pool, the worker in the row's last column. Refreshed every 10 s. Docs ↗

No machines in this view.

Range: 24h 7d (UTC, by the hour)

Hosts over time

Hosts that ran during each hour, by role.

1.0011-07 17:00 UTC; heads 0; workers 0; control 111-07 18:00 UTC; heads 0; workers 0; control 111-07 19:00 UTC; heads 0; workers 0; control 111-07 20:00 UTC; heads 0; workers 0; control 111-07 21:00 UTC; heads 0; workers 0; control 111-07 22:00 UTC; heads 0; workers 0; control 111-07 23:00 UTC; heads 0; workers 0; control 111-08 00:00 UTC; heads 0; workers 0; control 111-08 01:00 UTC; heads 0; workers 0; control 111-08 02:00 UTC; heads 0; workers 0; control 111-08 03:00 UTC; heads 0; workers 0; control 111-08 04:00 UTC; heads 0; workers 0; control 111-08 05:00 UTC; heads 0; workers 0; control 111-08 06:00 UTC; heads 0; workers 0; control 111-08 07:00 UTC; heads 0; workers 0; control 111-08 08:00 UTC; heads 0; workers 0; control 111-08 09:00 UTC; heads 0; workers 0; control 111-08 10:00 UTC; heads 0; workers 0; control 111-08 11:00 UTC; heads 0; workers 0; control 111-08 12:00 UTC; heads 0; workers 0; control 111-08 13:00 UTC; heads 0; workers 0; control 111-08 14:00 UTC; heads 0; workers 0; control 111-08 15:00 UTC; heads 0; workers 0; control 111-08 16:00 UTC; heads 0; workers 0; control 117:0023:0005:0011:00

heads   workers   control  

Runs per hour

Runs started and runs that ended each hour; failures (failed runs, and every failed step attempt, even one a retry fixed) are overlaid on the finished bar.

1000011-07 17:00 UTC; started 20; finished 20; failures (runs and attempts) 011-07 18:00 UTC; started 20; finished 20; failures (runs and attempts) 011-07 19:00 UTC; started 20; finished 20; failures (runs and attempts) 011-07 20:00 UTC; started 22; finished 762; failures (runs and attempts) 011-07 21:00 UTC; started 53; finished 52; failures (runs and attempts) 011-07 22:00 UTC; started 42; finished 42; failures (runs and attempts) 011-07 23:00 UTC; started 64; finished 63; failures (runs and attempts) 011-08 00:00 UTC; started 68; finished 69; failures (runs and attempts) 011-08 01:00 UTC; started 62; finished 62; failures (runs and attempts) 011-08 02:00 UTC; started 61; finished 60; failures (runs and attempts) 011-08 03:00 UTC; started 91; finished 92; failures (runs and attempts) 011-08 04:00 UTC; started 252; finished 249; failures (runs and attempts) 1311-08 05:00 UTC; started 134; finished 135; failures (runs and attempts) 011-08 06:00 UTC; started 145; finished 145; failures (runs and attempts) 011-08 07:00 UTC; started 143; finished 143; failures (runs and attempts) 011-08 08:00 UTC; started 138; finished 138; failures (runs and attempts) 011-08 09:00 UTC; started 133; finished 133; failures (runs and attempts) 011-08 10:00 UTC; started 120; finished 120; failures (runs and attempts) 111-08 11:00 UTC; started 121; finished 121; failures (runs and attempts) 011-08 12:00 UTC; started 126; finished 126; failures (runs and attempts) 1311-08 13:00 UTC; started 136; finished 140; failures (runs and attempts) 011-08 14:00 UTC; started 179; finished 181; failures (runs and attempts) 111-08 15:00 UTC; started 142; finished 144; failures (runs and attempts) 011-08 16:00 UTC; started 131; finished 129; failures (runs and attempts) 117:0023:0005:0011:00

started   finished   failures (runs and attempts)  

Fleet CPU

The vCPUs of all sampled hosts: busy, and available.

5.0011-07 17:00 UTC; vCPUs busy 2.23; vCPUs available 4.0011-07 18:00 UTC; vCPUs busy 2.22; vCPUs available 4.0011-07 19:00 UTC; vCPUs busy 2.22; vCPUs available 4.0011-07 20:00 UTC; vCPUs busy 2.22; vCPUs available 4.0011-07 21:00 UTC; vCPUs busy 2.33; vCPUs available 4.0011-07 22:00 UTC; vCPUs busy 2.32; vCPUs available 4.0011-07 23:00 UTC; vCPUs busy 3.61; vCPUs available 4.0011-08 00:00 UTC; vCPUs busy 3.63; vCPUs available 4.0011-08 01:00 UTC; vCPUs busy 3.61; vCPUs available 4.0011-08 02:00 UTC; vCPUs busy 3.64; vCPUs available 4.0011-08 03:00 UTC; vCPUs busy 3.52; vCPUs available 3.9911-08 04:00 UTC; vCPUs busy 3.69; vCPUs available 4.0011-08 05:00 UTC; vCPUs busy 3.43; vCPUs available 4.0011-08 06:00 UTC; vCPUs busy 3.54; vCPUs available 4.0011-08 07:00 UTC; vCPUs busy 3.49; vCPUs available 4.0011-08 08:00 UTC; vCPUs busy 3.53; vCPUs available 4.0011-08 09:00 UTC; vCPUs busy 3.58; vCPUs available 4.0011-08 10:00 UTC; vCPUs busy 3.56; vCPUs available 4.0011-08 11:00 UTC; vCPUs busy 3.56; vCPUs available 4.0011-08 12:00 UTC; vCPUs busy 3.49; vCPUs available 4.0011-08 13:00 UTC; vCPUs busy 3.49; vCPUs available 4.0011-08 14:00 UTC; vCPUs busy 3.02; vCPUs available 4.0011-08 15:00 UTC; vCPUs busy 2.28; vCPUs available 4.0011-08 16:00 UTC; vCPUs busy 0.88; vCPUs available 3.9617:0023:0005:0011:00

vCPUs busy   vCPUs available   vCPUs

Fleet network

Throughput summed over all sampled hosts.

200011-07 17:00 UTC; in (MB/s) 28.68; out (MB/s) 37.4811-07 18:00 UTC; in (MB/s) 29.04; out (MB/s) 38.1111-07 19:00 UTC; in (MB/s) 29.53; out (MB/s) 38.8711-07 20:00 UTC; in (MB/s) 29.95; out (MB/s) 39.3611-07 21:00 UTC; in (MB/s) 31.92; out (MB/s) 42.1011-07 22:00 UTC; in (MB/s) 31.17; out (MB/s) 41.5511-07 23:00 UTC; in (MB/s) 50.37; out (MB/s) 66.9211-08 00:00 UTC; in (MB/s) 50.45; out (MB/s) 67.0411-08 01:00 UTC; in (MB/s) 50.64; out (MB/s) 67.4911-08 02:00 UTC; in (MB/s) 52.48; out (MB/s) 70.2811-08 03:00 UTC; in (MB/s) 50.88; out (MB/s) 76.4911-08 04:00 UTC; in (MB/s) 59.30; out (MB/s) 113.2611-08 05:00 UTC; in (MB/s) 50.08; out (MB/s) 94.7211-08 06:00 UTC; in (MB/s) 51.49; out (MB/s) 97.2111-08 07:00 UTC; in (MB/s) 51.39; out (MB/s) 97.1211-08 08:00 UTC; in (MB/s) 53.96; out (MB/s) 101.9711-08 09:00 UTC; in (MB/s) 53.53; out (MB/s) 101.3611-08 10:00 UTC; in (MB/s) 52.79; out (MB/s) 99.7211-08 11:00 UTC; in (MB/s) 52.74; out (MB/s) 99.4411-08 12:00 UTC; in (MB/s) 52.05; out (MB/s) 97.9411-08 13:00 UTC; in (MB/s) 52.55; out (MB/s) 98.9111-08 14:00 UTC; in (MB/s) 46.41; out (MB/s) 85.3311-08 15:00 UTC; in (MB/s) 34.58; out (MB/s) 63.1811-08 16:00 UTC; in (MB/s) 11.20; out (MB/s) 21.0717:0023:0005:0011:00

in (MB/s)   out (MB/s)   MB/s