Dim load

Dim Load is used to manage Slowly Changing Dimension (SCD) data, typically in data warehousing, where dimensions can change over time. This screen allows you to load data into a dimension table using two modes:

• Update Insert: This option is utilized for updating and inserting records into a table. Key fields are specified in the “Key” tab to determine the conditions for the update and insertion of records.

• Delete Insert: This option is employed for deleting and inserting records into a table. Conditions are applied to the values provided in the Dimension and Stream Field columns to determine which records should be deleted, updated, or inserted into the stream.

Steps to Perform Dim Load:

Step 1: Add “Dim Load” to the graph.

Step 2: Choose the appropriate form type for the lookup: “Update_insert” or “Delete_insert.”

Step 3: For Update_Insert

Step 3.1: Choose the “Data source connection” and select the destination dimension table where the data should be loaded

Step 3.2: The “Keys value” tab defines how records are matched between the stream and dimension table.

Step 3.3: Set the conditions in the comparator in the “Keys” tab.

Step 3.4: Lists the fields in the dimension table that will be updated using corresponding values from the stream (incoming data). The user can delete key values and update fields by clicking the “trash” icon under the delete column.

Step 3.5: Click “Save.”

For example:

• Open the “Dim Loader” and select “Update_Insert.”
• We choose “etl_connection” and required table from the drop-down options.
• Click “+” to add key values and checked the update values.
• Click “Save” and “Run.”

Step 4: For Delete_insert

Step 4.1: Choose the “Data source connection” and select the destination dimension table where the data should be loaded

Step 4.2: The “Keys value” tab defines how records are matched between the stream and dimension table.

Step 4.3: Set the conditions in the comparator in the “Keys” tab.

Step 4.4: Click “Save.”

For example:

• Open the “Dim Loader” and select “Delete_Insert.”
• We choose “etl_connection” and the required table from the drop-down options.
• Click “+” to add key values.
• Click “Save” and “Run.”