Runs · gharchive · ← run 1519 · run 1527 →
Run 1522 succeeded
Log in to rerunStatusWhere the run is: queued, running, then succeeded, failed or cancelled. Refreshed every 5 s while it goes on. Docs ↗
- DurationHow long the run took, from its start to its end, or to now while it goes on. Hover for the times.
- 4 min 12 s
- CreatedWhen the run was queued: by the schedule, a sensor, a backfill, a fill or a person.
- 2026-11-08T00:57:35Z
- StartedWhen its process started, once its turn in the queue came and its placement had room. Empty while it waits.
- 2026-11-08T00:57:35Z
- EndedWhen it finished, whatever the outcome. Empty while it goes on.
- 2026-11-08T01:01:47Z
- TriesTimes the run's process was started: 1 is normal; more means retries, a lost instance or a resume.
- 1
Partitions & triggerWhat this run does, and what made it start. Docs ↗
CodeThe code this run ran, at the commit its binary was built from. Hover a name to see its source; click it to open the file on its host. Docs ↗
- FunctionsThe pipeline, its steps in the order they run, and the dista tasks they fan out to, each linked to its line at the commit this run ran. Docs ↗
- gharchive · load_day · index_hour · hour_task · merge_repo_hour
- SourceThe commit its binary was built from (-D ORCA_COMMIT), in which repository, and the image it ran in, if any. Docs ↗
- ef76043fc282 of https://github.com/magmalake/mojo-census
- Driver logWhat the run's process printed: orca's lines and its steps' output, as the scheduler kept it. Each attempt under Steps has its own log too.
- driver.log
Code hash 0xe6cdc4870d3f3535A hash of what the binary says about itself: its steps, partitions and schedule. It changes when they do, not on every build. Docs ↗
ResourcesWhat this run's own processes used: its process and the ones it started, dista's local workers too, measured by the scheduler or worker that started it. Not the rest of the machine: the machine's numbers, where they are recorded, are in their own card further down. With a request, what it asked for and was granted too. Docs ↗
- Peak memoryThe most memory its processes held at once: the run's process and what it started (dista's local workers too), sampled every second by the scheduler or worker that started it, and at the end the largest single process. Not measured on EC2 or Kubernetes. Docs ↗
- not measured
- CPU usedThe CPU time its processes used, user and system, and the most cores they kept busy over one sample's second. macOS gives only the time, and only for a process that made one attempt. Docs ↗
- not measured
SettingsWhat the run was set up with, orca.toml and the flags applied: as its start recorded them, or else as the pipeline is registered. The pipeline's Config card says where each value came from. Docs ↗
As the pipeline is registered. Where each value came from
- PlacedWhere it ran: local (beside the scheduler, on its machine), control (on the control host, within its limits), ec2 (instances of its own), or a remote worker's pool. Docs ↗
- local
- Max runsThe most runs of this pipeline the scheduler starts at once (max_runs); the others wait in the queue.
- 1
- SpotWhether its EC2 instances are Spot: cheaper, and AWS can take them back.
- false
- EnvironmentThe variables orca.toml's env and the flags set in the run's environment.
DISTA_WORKER_SLOTS=2GHARCHIVE_EVENTS=offGHARCHIVE_PARALLEL=2
StepsEach step of each partition. Table: its status, attempts, times, what its latest attempt used, and its log. Timeline: the attempts on the clock, a row per step. Graph: the steps in the order they run, in this run's colours. Docs ↗succeeded
| StepA step of the pipeline: a function that runs once per partition (mapped) or once over all of them (gather). | PartitionThe partition this row is for; empty for a gather step, which runs once over all of them. | StatusWhere it stands. Hover a status for what it means. | AttemptsHow many times the step ran in this run: more than 1 means an attempt failed and it was retried. | StartedWhen it started; empty while it waits. | EndedWhen it finished, whatever the outcome. | PeakThe most memory the step's latest attempt held at once; its page has each attempt's. | CPUCPU used: for a step, its latest attempt's user and system seconds; for a machine, its busiest moment as a share of all cores. | LogIts output: an attempt's, an instance's or the run's process's. | ErrorWhy it failed, as the step or orca said. |
|---|---|---|---|---|---|---|---|---|---|
| load_day pipelines/gharchive.mojo:116 | 2023-09-19 | succeeded | 1 | 2026-11-08T00:57:35Z | 2026-11-08T01:01:47Z | attempt 1 |
MachinesSamples of the whole machine, every few seconds while the run ran (ORCA_SAMPLE_SECONDS, 5 by default): its CPU, memory, fullest disk, disk io and network, by a sampler the runner starts beside the run's process. They count everything on that machine, not just this run. What the run's own processes used is in Resources, above. The steps lane lines a busy stretch up with the step it came from. A run on a remote worker has none: the worker measures only its processes. Docs ↗
The whole machine, while this run ran: the scheduler's machine (the local runner). Not this run's own use; that is in Resources.
A shared machine: 4 other runs ran on it at the same time, so these numbers are theirs too.
user + system iowait steal memory fullest disk disk io network warning
| InstanceWhere the samples were taken: local (the scheduler's machine), control, an EC2 head or worker, or a pod. | SamplesHow many samples the sampler took. | CPUCPU used: for a step, its latest attempt's user and system seconds; for a machine, its busiest moment as a share of all cores. | Busiest coreThe busiest single core's use at its highest. | StealCPU time the hypervisor gave to other machines. | MemoryMemory used at its highest, of the machine's total. | DiskThe fullest disk the run writes to, at its fullest. | Disk ioDisk reads and writes, at their highest rate. | NetworkNetwork traffic in and out, at its highest rate. | WarningsStretches with memory or a disk over 90%, or CPU steal over 20%: what slows or fails most runs. |
|---|---|---|---|---|---|---|---|---|---|
local | 52 | 100% | 100% | 0% | 3.1 GB of 8.1 GB (38%) | 9.5 GB of 80 GB (12%) | 321 kB/s | 83 MB/s |
Timeline
The timeline loads as it comes into view.
Wheel to zoom, drag to zoom to a span of time, hover for a span's details.
SnapshotsThe table snapshots each step read, and the ones it wrote (committed). A dataset's snapshot links to its lineage: upstream, what it was written from, and downstream, what was written from it. Docs ↗
| StepA step of the pipeline: a function that runs once per partition (mapped) or once over all of them (gather). | PartitionThe partition this row is for; empty for a gather step, which runs once over all of them. | Read or wroteread: the step read this snapshot. wrote: it committed it, a new snapshot of the table. | TableThe table's name in the warehouse. | SnapshotA snapshot of a table: the table as one commit left it. Click for its lineage. |
|---|---|---|---|---|
| load_day | 2023-09-19 | wrote | gharchive.events | 3684564148179349275 |
| load_day | 2023-09-19 | wrote | gharchive.events | 460211237927153397 |
| load_day | 2023-09-19 | wrote | gharchive.events | 4844395229071899490 |
| load_day | 2023-09-19 | wrote | gharchive.events | 6195564505854414200 |
| load_day | 2023-09-19 | wrote | gharchive.events | 4222174822523200211 |
| load_day | 2023-09-19 | wrote | gharchive.events | 4779098462927681873 |
| load_day | 2023-09-19 | wrote | gharchive.events | 3542236053936285564 |
| load_day | 2023-09-19 | wrote | gharchive.events | 145958330469157325 |
| load_day | 2023-09-19 | wrote | gharchive.events | 7034200622755726128 |
| load_day | 2023-09-19 | wrote | gharchive.events | 97364745102751440 |
| load_day | 2023-09-19 | wrote | gharchive.events | 1669893461594818339 |
| load_day | 2023-09-19 | wrote | gharchive.events | 8930633174082278867 |
| load_day | 2023-09-19 | wrote | gharchive.events | 1416341767240915269 |
| load_day | 2023-09-19 | wrote | gharchive.events | 1616143005685404871 |
| load_day | 2023-09-19 | wrote | gharchive.events | 6462991851341319748 |
| load_day | 2023-09-19 | wrote | gharchive.events | 8765748580569842397 |
| load_day | 2023-09-19 | wrote | gharchive.events | 1411757304490261441 |
| load_day | 2023-09-19 | wrote | gharchive.events | 2444803532058525507 |
| load_day | 2023-09-19 | wrote | gharchive.events | 8274445376908224606 |
| load_day | 2023-09-19 | wrote | gharchive.events | 1677912993146433915 |
| load_day | 2023-09-19 | wrote | gharchive.events | 992864493127818414 |
| load_day | 2023-09-19 | wrote | gharchive.events | 956319300745913858 |
| load_day | 2023-09-19 | wrote | gharchive.events | 3438848404555018713 |
| load_day | 2023-09-19 | wrote | gharchive.events | 4320071617406900143 |
| load_day | 2023-09-19 | wrote | gharchive.candidates | 5760639711776248250 |
| load_day | 2023-09-19 | wrote | gharchive.repo_hour | 753967432625635118 |
| load_day | 2023-09-19 | wrote | gharchive.releases | 4049773338330126088 |