Skip to main content

Varicent ELT Help Center

Schedule data

Abstract

Schedule a date and time to build or export a pipe or refresh a third-party data source.

You can schedule a date and time to perform the following actions:

  • Build a pipe.

  • Export a pipe.

  • Refresh a third-party data source.

Set the build, export or refresh for the current date or later, or at different intervals. For example, you can create an hourly, daily, weekly, or monthly schedule.

  • If you choose an hourly schedule, do not schedule exports more frequently than every 15 minutes.

  • If you choose a daily schedule, you can have it export every day, every other day, every third day, and so on.

  • If you choose a weekly schedule, you can pick specific days of the week, and more than one day in that week, such as Monday, Wednesday and Friday.

  • If you choose a monthly schedule, you can pick the frequency and the date, such as every two months on the 10th day.

Important

The Scheduler exports the most recent scheduled time. If you deactivate the schedule close to the time you previously scheduled and reactivate it right after the time, it exports. For example, you deactivate the job at 11:59 am for a noon export, reactivate the job at 12:01 pm, the Scheduler checks when the last job exported and will know that the noon job didn't export. Since you reactivated the schedule, it will export. If you have a daily schedule and the last scheduled export was over 24 hours, the job will not export.

If you have multiple schedules exporting at the same time, the last one to be completed shows in the Scheduler.

Creating a schedule from the Data page

You can use the Scheduler to create a schedule to update the sources on your data page.

Note

You can only create a schedule from data imported from a connector.

  1. On the Data page, find and select the data that you want to create a schedule for.

  2. On the data row that you want to create the schedule for, click the Options menu.png menu.

  3. Click Schedule.

    The New Schedule modal appears.

  4. Update the modal with the scheduling information:

    Table 5. New schedule modal

    Option

    Description

    For

    The name of the pipe you are building the schedule for. This is a read-only field.

    Perform

    There is only one option and it is already selected: Data connector refresh.

    Starting on

    The date to start the schedule. Choose the desired starting date.

    Repeat

    The option to set the schedule as repeating.

    Repeat ON

    If you toggle on Repeat, select the intervals to repeat, such as hourly, daily, weekly or monthly.

    Every

    This option is active if you toggle on Repeat,. Enter the hours and minutes to repeat the schedule.

    Ending

    This option is active if you toggle on Repeat,. Optionally enter the ending date to the schedule. Select either On or After to enter the end information. If you select the After option, you can select how many times to run the schedule for.

    Starting at

    The time and time zone to start the schedule on. For example, 11:30 am in the America/Toronto time zone.

    Summary

    A summary of the scheduled dates and times shown in the local time zone. The Scheduler accounts for any daylight savings times. This is a read-only field.



  5. Click Create Schedule. Once ready, you will see a calendar icon in the row. A success message appears containing a link to the Scheduler tab where you can see that the schedule is active.

Creating a schedule from the Pipe page

You can easily create a schedule.

  1. On the Pipes page, select the pipe that you want to create a schedule for.

  2. On the pipe tile, click the Options menu.png menu.

  3. Click New Schedule.

    The New Schedule modal appears.

  4. Update the modal with the scheduling information:

    Table 6. New schedule modal

    Option

    Description

    For

    The name of the pipe you are building the schedule for. This is a read-only field.

    Perform

    The action you want to be scheduled. Select Build pipe or Export pipe.

    Starting on

    The date to start the schedule. Choose the desired starting date.

    Repeat

    The option to set the schedule as repeating. If you toggle Repeat on, the modal updates with more options to select.

    Repeat ON

    If you toggle on Repeat, select the intervals to repeat, such as hourly, daily, weekly or monthly.

    Every

    This option is active if you toggle on Repeat,. Enter the hours and minutes to repeat the schedule.

    Ending

    This option is active if you toggle on Repeat,. Optionally enter the ending date to the schedule. Select either On or After to enter the end information. If you select the After option, you can select how many times to run the schedule for.

    Starting at

    The time and time zone to start the schedule on. For example, 11:30 am in the America/Toronto time zone.

    Summary

    A summary of the scheduled dates and times shown in the local time zone. The Scheduler accounts for any daylight savings times. This is a read-only field.



  5. Click Create Schedule. Once ready, you will see a calendar icon on the pipe. A success message appears which also contains a link to the Scheduler tab where you can see that the schedule is active.

Editing a schedule

You can update a current schedule with new options or information.

  1. On the Pipes or Data page, select the pipe or data that you want to edit the schedule for.

  2. Click the Options menu.png menu.

  3. Click Schedule.

  4. Click Edit Schedule.

    The schedule(s) appear.

  5. Click the Options menu.png menu on the schedule that you want to edit.

  6. Click Edit Schedule.

    The Edit Schedule modal appears.

  7. Update the schedule details.

  8. Click Edit Schedule to finish.

Updating a scheduled export with revised data

If the pipe has never been built and you try to export the data with the revised data, it will trigger a build first, before you can export.

  1. On the Pipes or Data page, select the pipe or data that you want to edit the schedule for.

  2. Click the Options menu.png menu.

  3. Click Schedule.

  4. Click Edit Schedule.

  5. Click the Options menu.png menu on the schedule that you want to edit.

  6. Click Edit Schedule.

    The Edit Schedule modal appears.

  7. Update the input file to use the revised data.

  8. Click Edit Schedule to finish.

Deactivating a schedule

You can deactivate a current schedule.

  1. On the Pipes or Data page, select the pipe or data that you want to deactivate the schedule for.

  2. Click the Options menu.png menu.

  3. Click Schedule.

  4. Click Edit Schedule. The schedule(s) appear.

  5. Click the Activate toggle off.

    The schedule is deactivated.

Deleting a schedule

You can delete any current schedules.

  1. On the Pipes or Data page, select the pipe or data that you want to delete the schedule for.

  2. Click the Options menu.png menu.

  3. Click Schedule.

  4. Click the Options menu on the schedule that you want to delete.

  5. Click Delete Schedule.

    The schedule is deleted.