Schedule Data Refresh

Re-ViVE presents a powerful feature, ‘Data Schedule’, which is designed to automate data transfers efficiently. This functionality enables users to manage Data seamlessly between source connections and their corresponding destination tables. By utilizing the Data Scheduler, users can automate data transfers tailored to their specific requirements, involving appending data to existing data or executing a complete Refresh.

Launch Scheduler

Click the ‘Schedule Data Refresh’ sub menu of ‘Data & Connections’ option of ‘ViVE Admin’ menu in ViVE’s main Interface, to launch the following screen.

This is the main interface for Scheduling Data Refresh.

Choose the name of the Workspace from the ‘Workspace’ Drop Down list.

Choose the source connection from the ‘Source Connection’ Drop Down list.

Choose the load type as either ‘Full Time’ or ‘Incremental’ from the ‘Load Type’ drop down list.

The Data Scheduler offers two distinct options for Data Management:

Delta (Incremental) Transfer
Full Transfer

Delta (Incremental) Transfer

In the Delta (Incremental) Transfer Mode, the system appends only new data to the existing dataset while preserving the logs for Activity and Attribute.

This feature includes:

Existing Data Preservation: Previous records in the logs (Activity & Attribute) remain unchanged.
New Data Addition: Only new entries are appended to the existing data.
Comprehensive Updates: The entire data structure—including Facts, Dimensions, and Cubes—will be updated to reflect both existing and new data.

This approach is particularly beneficial in scenarios where maintaining Historical Data is essential, allowing users to track changes over time without losing any previously captured information.

Full Transfer

The Full transfer mode adopts a different strategy by entirely replacing the existing dataset.

This feature includes:

Data Replacement: Existing records in the Logs (Activity & Attribute) are deleted.
New Data Insertion: Fresh data is inserted into the Logs, completely replacing the old data.
Complete Refresh: The entire data structure—Facts, Dimensions, and Cubes—will be updated to reflect only the latest data.

This option is advantageous for users seeking to ensure that their datasets are current and devoid of any residual data from previous transfers, providing a clean slate for analysis.

After Choosing the ‘Workspace’, ‘Source Connection' and the ‘Load Type’ Click on the ‘Create’ button to display the following screen.

Scheduling of data transfers can be customized by selecting specific scheduler types and defining desired timings. This flexibility allows users to align data transfers with their operational needs, ensuring that data remains consistently up-to-date and accurately reflects the current state of the source connection.

Enter the following details in the above displayed Interface

Scheduler Name: Provide a unique name to identify your scheduler.
Workspace: Select the Workspace where the source connection exists.
Source Connection: Choose the source connection to pull data from.
Load Type: Select the load type: Full to load all data or Incremental to load only new or changed data.
Process Maps: Define the Process Maps that would guide data flow and where the data process will run
Frequency: Set how often the data job should run: Daily, Weekly, or Monthly.
Recur After Days: Set the number of days between each recurring schedule.
Time Zone: Choose the time zone for the scheduled job.
Start Date: Specify the date when the scheduler should begin.
End Date: Set an end date for the scheduling process, if applicable.
Start Time: Define the exact time the schedule should start.
End Time: Set the time when the scheduled job should stop running.
Summary: Review Scheduling Configuration with the detail given in this field.
Select ‘Enable Email Alerts’ to send Alerts to the selected Users

Selection of Users can be made from a list available in the column provided.

All selected users will be notified during the creation, update, and upon the success or failure of the data refresh process.

Click the ‘Schedule’ button to affect the Data Scheduling with the given parameters.

e-mail will be sent during
creation
update
success/failure

Re-ViVE's Data Scheduler significantly enhances Data Management capabilities by offering flexible, automated solutions for both incremental and full Data Transfers. By selecting the appropriate transfer mode, control can be effectively maintained over the data updates, ensuring efficiency and accuracy in Data Management Processes.

Note:

For users, the Schedule Data Refresh feature is enabled when they have the privilege to create Process Maps. To use this feature, they must also have access to the relevant Process Map and its source connections. Once they have all the required access, they can view the existing list of schedules as well.

For admins, full access is granted by default, allowing them to use this feature without any restrictions.