Skip to main content

Varicent ELT Help Center

SFTP

Abstract

Use the SFTP connector to connect your data to Varicent ELT.

Use the SFTP connector to connect your data to Varicent ELT.

Note

We auto-detect encoding, but if we can't detect a data set's file encoding, we will automatically use UTF-8 encoding.

You can also import flat files dynamically, such as CSV and Excel, with the filename and a wildcard (*) to import the file. With a timestamp, you can retrieve the last modified file to import.

Importing data

  1. In Varicent ELT, select the Data module from the sidebar navigation pane.

  2. Click Import data.

  3. In the Third party sources section, click SFTP.

  4. Click New connection.

    Note

    If you already have an established SFTP connection, you will skip to the Select data page to import new data.

  5. On the Connect to your Model page, enter the following information to connect:

    Table 18. SFTP connector

    Field

    Description

    Connector name

    The name of the connection.

    Host

    The host name for the connection.

    Port

    The port number.

    Username

    The user name to access the connection.

    Password

    The password to access the connection.



  6. Click Next.

  7. On the Select data page, enter the following information to import your data:

    Field

    Description

    Static file

    Directory

    Select the directory for the file that you want to import.

    File type

    Select the file type that you want to import.

    Delimiter

    Select the delimiter that you want to use from the following delimiters in the drop-down field:

    • Comma (,)

    • Pipe (|)

    • Semi-colon (;)

    • Space ( )

    • Tab ( )

    • Tilde (~)

    Quote

    Select the type of quotes that you want to use, such as double quotes (").

    Exclude excess data

    Enter the number of rows that you want to ignore in the beginning or end of your file.

    Header

    Check to designate the first unignored row as the column header. Leave unchecked to have column headers automatically generated.

    Dynamic file

    File location

    Select the folder in the directory where the file is located.

    Match file name on *

    Type the name of the file, or enter a partial name with an asterisk * wildcard. For example, File* could retrieve all results with file in the name, such as File123, File456, and so on. Select the file that you want to import when it appears in the list.

    Select by

    Choose between Oldest modified data or Newest modified data.

    File type

    Select the file type that you want to import.

    Delimiter

    Select the delimiter that you want to use from the following delimiters in the drop-down field:

    • Comma (,)

    • Pipe (|)

    • Semi-colon (;)

    • Space ( )

    • Tab ( )

    • Tilde (~)

    Quote

    Select the type of quotes that you want to use, such as double quotes (").

    Exclude excess data

    Enter the number of rows that you want to ignore in the beginning or end of your file.

    Header

    Check to designate the first unignored row as the column header. Leave unchecked to have column headers automatically generated.

  8. Click Next.

  9. On the Choose data sets page, select which data sets that you want to include.

  10. On the Import data page, review your data and select the data to obfuscate (if any). Click Next.

  11. On the Filter data page, optionally click Filter data to refine your data, or click Import data to continue.

    1. Filter the rows in your data by selecting the column to filter, the filter category and the value or text.

    2. Click Import data to continue.

    Note

    For more information about how to configure data filters, see: Filter data.

  12. On the Review page, review the data sets that you want to import.

    Note

    You can also change the name of the data sets before you import the data. Click the pencil icon pencil_icon.png to edit the text field.

  13. Click Import data.

    The information is available on the My data page.