Data Pipeline Stages

A data pipeline in the Calibo Accelerate platform may consist of the following stages. Each stage supports a variety of technologies:

Stage	Supported Technologies
Data Source	Salesforce ServiceNow CSV MS Excel Parquet FTP SFTP Amazon S3 Azure Data Lake Calibo Data Ingestion Catalog REST API Microsoft SQL Server (RDBMS) MySQL (RDBMS) Oracle (RDBMS) PostgreSQL (RDBMS) Snowflake (RDBMS) Amazon Kinesis Streams
Data Integration	Amazon Appflow Databricks Snowflake Bulk Ingest Snowflake Stream Ingest Snowpark
Data Lake	Amazon S3 Azure Data Lake Databricks Unity Catalog Snowflake
Data Transformation	Calibo Action Databricks Snowflake Snowpark dbt
Data Quality	Databricks Databricks Unity Catalog Snowflake
Data Analytics	Python with JupyterLab
Data Visualization	Qlik Sense Angular Calibo Action Java Django Fast API NestJS NextJS Node.js Nuxt Python React Vue.js
Analytical Data Store	Amazon RDS for MySQL Amazon RDS for PostgreSQL Microsoft SQL Server MySQL Oracle PostgreSQL Snowflake
Workflow	Workflow (Databricks)