gharchive.events @ 2497959349972998106
LineageEach box is a snapshot of a dataset, an arrow a step that read the snapshot it starts at and wrote the one it points to, so data flows down: what this snapshot was written from is above it, what was written from it below, up to 20 steps away. A box's second line is the pipeline and partition that wrote it; hover for the run and step, click to open that snapshot's lineage. Docs ↗
this snapshot written by an orca run a source, written by something else another input of a step downstream ↓ read, to write
UpstreamThis snapshot, if an orca run wrote it, and every snapshot it was written from, directly or not: for each, the run and step that wrote it and the snapshots that step read. A source, written by something other than orca, is only in the Read column. back in the JSON. Docs ↗
| SnapshotA snapshot of a table: the table as one commit left it. Click for its lineage. | Written byThe pipeline, and its step, that wrote it. | RunA run: one start of a pipeline over some partitions, with its steps and their attempts. Click for its page. | StepA step of the pipeline: a function that runs once per partition (mapped) or once over all of them (gather). | PartitionThe partition this row is for; empty for a gather step, which runs once over all of them. | CodeThe code hash: what the binary says about itself (its steps, partitions and schedule). It changes when they do, not on every build. | CommittedWhen the attempt that wrote it finished. | ReadThe snapshots the step read when it wrote this one. Click one for its own lineage. |
|---|---|---|---|---|---|---|---|
| gharchive.events@2497959349972998106 | gharchive | 1781 | load_day | 2023-11-26 | 0xe6cdc4870d3f3535 | 2026-11-08T03:14:38Z |
DownstreamEvery snapshot a step wrote after reading this one, then what steps wrote after reading those, and so on: what a change to it reaches. forward in the JSON. Docs ↗
No orca run has read it yet.