orcaLog in

Datasets · mojo.activity

mojo.activity @ 601802524012314914

LineageEach box is a snapshot of a dataset, an arrow a step that read the snapshot it starts at and wrote the one it points to, so data flows down: what this snapshot was written from is above it, what was written from it below, up to 20 steps away. A box's second line is the pipeline and partition that wrote it; hover for the run and step, click to open that snapshot's lineage. Docs ↗

this snapshot written by an orca run a source, written by something else another input of a step downstream ↓ read, to write

mojo.activity@601802524012314914: written by mojo_activity run 1135, step activity 2023-05-29mojo.activitymojo_activity 2023-05…gharchive.releases@2390260740265252585: written by gharchive run 2341, step load_day 2024-04-18gharchive.releasesgharchive 2024-04-18gharchive.repo_hour@747755077234127601: written by gharchive run 2341, step load_day 2024-04-18gharchive.repo_hourgharchive 2024-04-18mojo.repos@9015754231563232802: written by mojo_repos run 2343, step find_repos 2024-04-16mojo.reposmojo_repos 2024-04-16gharchive.candidates@4192422312430992004: written by gharchive run 2333, step load_day 2024-04-16gharchive.candidatesgharchive 2024-04-16

UpstreamThis snapshot, if an orca run wrote it, and every snapshot it was written from, directly or not: for each, the run and step that wrote it and the snapshots that step read. A source, written by something other than orca, is only in the Read column. back in the JSON. Docs ↗

SnapshotA snapshot of a table: the table as one commit left it. Click for its lineage.Written byThe pipeline, and its step, that wrote it.RunA run: one start of a pipeline over some partitions, with its steps and their attempts. Click for its page.StepA step of the pipeline: a function that runs once per partition (mapped) or once over all of them (gather).PartitionThe partition this row is for; empty for a gather step, which runs once over all of them.CodeThe code hash: what the binary says about itself (its steps, partitions and schedule). It changes when they do, not on every build.CommittedWhen the attempt that wrote it finished.ReadThe snapshots the step read when it wrote this one. Click one for its own lineage.
mojo.activity@601802524012314914mojo_activity1135activity2023-05-290x847d6f4604e8f292026-11-08T05:49:39Zgharchive.releases@2390260740265252585, gharchive.repo_hour@747755077234127601, mojo.repos@9015754231563232802
gharchive.releases@2390260740265252585gharchive2341load_day2024-04-180xe6cdc4870d3f35352026-11-08T05:41:50Z
gharchive.repo_hour@747755077234127601gharchive2341load_day2024-04-180xe6cdc4870d3f35352026-11-08T05:41:50Z
mojo.repos@9015754231563232802mojo_repos2343find_repos2024-04-160x627ffec531716e6e2026-11-08T05:40:49Zgharchive.candidates@4192422312430992004
gharchive.candidates@4192422312430992004gharchive2333load_day2024-04-160xe6cdc4870d3f35352026-11-08T05:39:41Z

DownstreamEvery snapshot a step wrote after reading this one, then what steps wrote after reading those, and so on: what a change to it reaches. forward in the JSON. Docs ↗

No orca run has read it yet.