Job

A Job is used when you combine multiple graphs to handle data from different sources or workflows. It allows you to run several data pipelines together in a coordinated way.

You can also create new jobs using existing ones, making it easy to reuse and manage complex processes without starting from scratch. Jobs help you organize, automate, and scale your data tasks more efficiently.

How to use a Job?

Step 1: Open the job transformation component and select the previously created job.

Step 2: Utilize any component as per the user’s needs to modify the existing job.

Step 3: Save the job by assigning a name, then proceed to execute it.

For example:

• Initially, we utilized a pre-existing job that included a “Remove Duplicates” step to clean the dataset.
• Next, we added a “Sort” transformation to the selected job to sort the cleaned data. Once configured, click Save to apply the changes.

Preview