Table output

The Table Output component saves the result of your data pipeline into a database table. After you’ve finished all the steps, such as cleaning, filtering, or transforming your data, this component helps you store it in a table for later use.

You can choose to:

• Save the data into an existing table if one already exists
• Or create a new table if you’re working with a fresh dataset

This makes it easy to keep your processed data organized and ready for reporting, analysis, or further use.

Steps to use Table Output:

Step 1: Open the Table Output component and connect it to the graph whose output you want to save.

Step 2: The user can save the output by select existing table or create new table.

Step 3: Selecting existing table

Step 3.1: Pick the database connection where the output table exists using “Select connection.”

Step 3.2: After selecting the connection, fetch the available tables and “Select table name” from the drop-down menu.

Step 3.3: Next, select the loading method. Users can choose the appropriate method based on their requirements. Below is a description of each method and its recommended use cases.

Step 3.4: Enable the “Batch Load” option to group multiple records for more efficient bulk insertion.

Step 3.5: “Specify database fields” allows users to manually map stream fields (from your pipeline) to database columns.

Users have the flexibility to conduct column mapping, and the mapping table can be sorted using the “Match by Position” and “Match by Name” buttons. Once completed, click “Save.”

For example:

• Selecting the “SnowPartner” connection, fetch the tables, and choose the “Sales” table from the list.
• Choosing “Append” as the loading method.

Step 4: Create new table

Step 4.1: Pick the database connection where the output table exists using “Select connection.”

Step 4.2: Provide the table name.

Step 4.3: Enable the “Batch Load” option to group multiple records for more efficient bulk insertion. Click “Save.”

For example:

• Select the “SnowPartner” connection and provide the table name “Sales_output.”