Elements of Data Pipeline Studio

Elements of Data Pipeline Studio

The Data Pipeline Studio has multiple features. The table below explains the different elements of Data Pipeline Studio.

Sr. No. Element Description
1 Deployment stages The various deployment stages like Dev, QA, Prod and so on, to which you can promote and deploy your data pipeline. See Promoting Data Pipelines to Different Stages in DPS.
2 Pipeline stages The various stages that you can add to a data pipeline. See Data Pipeline Stages.
3 Expand/ Collapse view Collapse the data pipeline stages for a wider view of the main screen of DPS, where you create the data pipeline. Click the icon again to expand the data pipeline stages.
4 Create Pipeline versions Create versions of the data pipeline that you are creating. See Pipeline Version and Wheel Package Version.
5 Edit Pipeline Make changes to the pipeline. After you edit the pipeline, click Publish to save the changes to the pipeline.
6 View Pipeline Run Details Click View Details for details about pipeline runs.
7 More Options DPS provides multiple options for scheduling pipeline runs, setting notifications, importing templates, exporting templates and so on. See  .
8 Node An element that you add to a new stage in a data pipeline.
9 Technology A data tool or database that you add to a node of a stage in a data pipeline.
10 Connector Element used to connect a node from one stage to a node in another stage.
11

Reset, Undo, and Redo options

When you are creating a data pipeline you may often need to undo some changes that are done, or at times revert to a published version of the data pipeline for certain reasons. The Lazsa Platform offers some simple UI options that you can use from the home page of Data Pipeline Studio or by using keyboard shortcuts. The following options are available while making changes to a pipeline in draft stage and for a published version of the pipeline:

Option Keyboard Shortcut Description
Undo Ctrl +Z This option removes the last change done to the pipeline in the draft state.
Redo Ctrl + Y This option restores the last undone change in a pipeline in the draft state.
Reset Ctrl + R

This option reverts a pipeline to its last saved version that is not published or to its last published version.

  • Previous draft version - The last modified state of the pipeline, which is not published.

  • Last published version - The version of the pipeline which is published.

 

Related Topics Link IconRecommended Topics

What's next? Create a Data Pipeline