Skip to main content

Varicent ELT Help Center

Filter

Abstract

Use the Filter tool to explore a subset of your data.

Use the Filter tool to explore a subset of your data.

When to use this tool

Use when you want to explore a subset of your data.

Figure 5. Filter tool example
Filter tool example


Input

The Filter tool requires one data input.

Configuration

Use the following configuration options to help create your Filter configuration.

Configuring the Filter tool

  1. Go to the Pipes module from the side navigation bar.

  2. From the Pipes tab, click an existing pipe to open, or create a new pipe. To create a new pipe, read the Creating a pipe documentation.

  3. In Pipe builder, add your data source.

  4. Click symon_add_icon.png + Tool.

  5. In the search bar, search for Filter. Click + Add tool.

    Tip

    You can also find the Filter tool in the Clean section.

  6. Connect the tool to your data set.

  7. In the configuration pane, enter the following information:

    Table 54. Filter tool configuration

    Field

    Description

    Select a column

    Select a column to filter your data with.

    Filter category

    Select one of the following filters to use:

    • Equal

    • Not Equal

    • Less Than

    • Less Than or Equal

    • Greater Than

    • Greater than or Equal

    • Starts With

    • Ends With

    • Contains

    • Not Contains

    • Is Null

    • Is Not Null

    Value or text

    Select the value to use, or start typing to find a value.

    AND + Statement

    Optionally add an AND statement. Filters data based on the specified conditions. Only rows that meet the conditions in all AND statements will be included.

    OR + Statement

    Optionally add an OR statement. Filters data based on the specified conditions. Rows that meet the conditions in one or more OR statements will be included.

    Switch to advanced

    Click to go to advanced filter rules to add a group or statement.



Usage example

In this example, we have a data set that contains customer IDs and an NPS score.

CustomerID

NPS

2453

2

3243

4

3452

10

4324

6

5324

8

Let's say we want to explore data only for customers considered "detractors" (a score of 6 or less). We can remove the rows we don't need by using the Filter tool:

  1. In the left side literal or column field, select or type "NPS".

  2. Select or type "Less Than or Equal".

  3. In the right side literal or column field, type "6".

As a result, the data set now looks like this:

CustomerID

NPS

2453

2

3243

4

4324

6