Skip to main content

Varicent ELT Assistant

Snapshot

Use the Snapshot tool to save a copy of your data based on the last calculation. You can also use this to save a data set state before transforming the data. The snapshot stays the same when you export a pipe with new data.

To trigger the Snapshot tool to update the output, a pipe build must include it in the set of outdated tools, such as when an upstream tool is updated or when a data source changes. If there are no changes, the build skips the snapshot, and the data remains unchanged.

An export can also auto-trigger a build if the system detects changes, such as a data source refresh, a tool configuration modification, or if you add or delete any tools. If the auto-triggered build marks the Snapshot data as outdated, it will refreeze it.

Here's an example of how the pipe can behave with the Snapshot tool:

  • First initial pipe with original data, the Snapshot tool freezes the data, capturing the current source data.

  • Subsequent pipe build, the data is unchanged, and the Snapshot tool is not outdated. The Snapshot tool data remains the same and frozen.

  • Subsequent pipe build, a new data source is loaded, the Snapshot tool data is now outdated. The Snapshot tool data updates as the tool captures the new data source, refreezing with the new data.

Configuration

Use the following configuration options to configure the Snapshot tool.

Configuring the Snapshot tool
  1. Go to the Pipes module from the side navigation bar.

  2. From the Pipes tab, click an existing pipe to open, or create a new pipe. To create a new pipe, read the Creating a pipe documentation.

  3. Click symon_add_icon.png + Tool.

    The Tools modal opens, where you can add tools, such as the  Aggregate  tool, to your pipe.

  4. In the Tools modal search bar, type Snapshot, and then click + Add tool.

    Tip

    You can also find the Snapshot tool in the Data section.

  5. Click the tool node and drag the line to the next tool to connect the tools. If you need to undo the action, click the line and then click Unlink.

    You've now saved a copy of your data based on the last calculation.