Skip to main content

Varicent ELT Assistant

Merge columns

Use the Merge columns tool to check for text in the columns specified in sequence, and return the first set of text it finds, replacing the original columns. Use when you have inconsistent text columns and want to combine them into a single column.

Input

The Merge columns tool requires one data input.

Configuration

Use the following configuration options to help create your Merge columns configuration.

Configuring the Merge columns tool

  1. Go to the Pipes module from the side navigation bar.

  2. From the Pipes tab, click an existing pipe to open, or create a new pipe. To create a new pipe, read the Creating a pipe documentation.

  3. In the Pipe builder, add a data source to your pipe. For more information on adding a data source, see the Data Input tool.Data Input

  4. Click symon_add_icon.png + Tool.

    The Tools modal opens, where you can add tools, such as the  Aggregate  tool, to your pipe.

  5. In the search bar, search for Merge columns. Click + Add tool.

    Tip

    You can also find the Merge columns tool in the Calculate section.

  6. Click the tool node and drag the line to the next tool to connect the tools. If you need to undo the action, click the line and then click Unlink.

  7. In the configuration, under Column, select the column or columns that you want to use to merge.

  8. Under New column name, enter the new column name.

  9. Click on the tool name to rename your tool node to a meaningful name. Name your tools in a way that describes the function, not the object or the data action. For example, use “Look up rate” instead of “Join to rate table”.