Skip to main content

Varicent ELT Assistant

Union

Use the Union tool when you want to combine data sets, but limit the number of columns to only those relevant to the first data set. When you want to combine data sets without restrictions, use the Join tool instead. Add additional rows to your data by appending rows from another dataset.

Caution

The inputs you put into the Union tool must match identically, or it can yield unexpected results. For example, if you perform a union where the columns don't match by Name and Data type, the tool drops those mismatched columns, and the union performs without them. You may see duplicates in the output, and it can also cause columns to disappear from your results.

Input and output

The Union tool requires two data sets. Using this tool requires at least one matching column shared by both data sets.

When you build this tool, it appends the rows from matching columns from one data set to the other.

Configuration

Use the following configuration options to help create your unions.

Configuring the Union tool

  1. Go to the Pipes module from the side navigation bar.

  2. From the Pipes tab, click an existing pipe to open, or create a new pipe. To create a new pipe, read the Creating a pipe documentation.

  3. In the Pipe builder, add at least two data sources to your pipe. For more information on adding a data source, see the Data Input tool.Data Input

  4. Click symon_add_icon.png + Tool.

    The Tools modal opens, where you can add tools, such as the  Aggregate  tool, to your pipe.

  5. In the Tools modal, search for Union. Click + Add tool.

    Tip

    You can also find the Union tool in the Combine section.

  6. Connect the tool to your data sets.