Configuring Snowflake Connection Details

Snowflake is a fully-managed SaaS data platform that provides data warehousing, data lakes, data science, data application development among many other features. Snowflake provides out-of-the--box features like scalable computing, separation of storage and compute, data sharing, data cloning, and support for third-party tools to handle the demanding needs of businesses.

After you save your Snowflake connection details in the Lazsa Platform, you can start using it as a data source in your data pipelines.

The Lazsa Platform offers various options for retrieving your database credentials to establish a secure connection. You can either directly provide the credentials within the connection details, where they are securely stored in the Lazsa-managed secret manager. Alternatively, you can choose to retrieve credentials programmatically from your designated secrets management tool.

Prerequisites

The following permissions are required for configuring Snowflake:

Create schema, table, warehouse
Read and Write Tables
Usage for storage integration

To allow Snowflake to read data from and write data to an Amazon S3 bucket, you must create a storage integration in Snowflake. For detailed information on creating a storage integration, see: Configure Storage Integration.

To trigger automatic load of data from S3 to Snowflake, you must create Amazon SQS event notifications for an S3 bucket. For detailed information on creating SQS event notifications, refer to the following link: Creating a new S3 event notification to automate Snowpipe

To configure the connection details of Snowflake, do the following:

Sign in to the Lazsa Platform and click Configuration in the left navigation pane.
On the Platform Setup screen, on the Cloud Platform, Tools & Technologies tile, click Configure.
On the Cloud Platform, Tools & Technologies screen, in the Databases and Data Warehouses section, click Configure.
(After you save your first connection details in this section, you see the Modify button here.)

Databases and Data Warehouses

In the list of available database and data warehouse options, click Snowflake.

On the Snowflake screen, do the following:

In the Details section, provide the following details:

Field	Description
Name	Give a unique name to your Microsoft SQL Server configuration. This name is used to save and identify your specific Microsoft SQL Server connection details within the Lazsa Platform.
Description	Provide a brief description that helps you identify the purpose or context of this Microsoft SQL Server configuration.

In the Configuration section, provide the Account URL for your Snowflake account.
Select Cloud Provider - select the cloud platform on which your Snowflake account is hosted. Choose from the following options:
1. AWS
2. Azure

Depending on how you want to retrieve the credentials to connect to Snowflake, do one of the following:

Field	Description
Connect using Lazsa Orchestrator Agent	Enable this option to resolve your Snowflake credentials within your private network via Lazsa Orchestrator Agent without sharing them with the Lazsa Platform. Select the Lazsa Orchestrator Agent that you want to use from the list of your configured agents. If you select an agent installed in an Amazon EKS cluster, the secrets management tool AWS Secrets Manager is auto-selected. Provide the name and the key of the secret where you store your Snowflake credentials. If you select an agent installed in an Azure AKS cluster, the secrets management tool Azure Key Vault is auto-selected. Provide the Vault Name and the name of the secret where you store your Microsoft SQL Server credentials.
Select Secret Manager	Select Lazsa and type your Snowflake username and password. In this case, the user credentials are securely stored in the Lazsa-managed secrets store. Select AWS Secrets Manager. In the Secret Management dropdown list, the AWS Secrets Manager configurations that you save and activate in the Secret Management section on the Cloud Platform, Tools & Technologies screen are listed for selection. Select the configuration of your choice. Provide the Secret Name, Username Key, and the Password Key for the Lazsa Platform to retrieve the secrets for your Snowflake account. Select Azure Key Vault. In the Secret Management dropdown list, the Azure Key Vault configurations that you save and activate in the Secret Management section on the Cloud Platform, Tools & Technologies screen are listed for selection. Select the configuration of your choice. Provide the Vault Name, Username Secret, and Password Secret for the Lazsa Platform to retrieve the credential values.

Field

Description

Connect using Lazsa Orchestrator Agent

Enable this option to resolve your Snowflake credentials within your private network via Lazsa Orchestrator Agent without sharing them with the Lazsa Platform.

Select the Lazsa Orchestrator Agent that you want to use from the list of your configured agents.

If you select an agent installed in an Amazon EKS cluster, the secrets management tool AWS Secrets Manager is auto-selected. Provide the name and the key of the secret where you store your Snowflake credentials.
If you select an agent installed in an Azure AKS cluster, the secrets management tool Azure Key Vault is auto-selected. Provide the Vault Name and the name of the secret where you store your Microsoft SQL Server credentials.

Select Secret Manager

Select Lazsa and type your Snowflake username and password.

In this case, the user credentials are securely stored in the Lazsa-managed secrets store.
Select AWS Secrets Manager. In the Secret Management dropdown list, the AWS Secrets Manager configurations that you save and activate in the Secret Management section on the Cloud Platform, Tools & Technologies screen are listed for selection. Select the configuration of your choice. Provide the Secret Name, Username Key, and the Password Key for the Lazsa Platform to retrieve the secrets for your Snowflake account.
Select Azure Key Vault. In the Secret Management dropdown list, the Azure Key Vault configurations that you save and activate in the Secret Management section on the Cloud Platform, Tools & Technologies screen are listed for selection. Select the configuration of your choice. Provide the Vault Name, Username Secret, and Password Secret for the Lazsa Platform to retrieve the credential values.

Send Calibo Partner ID with this Snowflake instance - This setting adds Calibo Partner ID in the queries run in Snowflake. You can disable the option if you do not want Calibo Partner ID to be added in the Snowflake queries.
Click Test Connection to validate whether you have configured the correct connection details and you can connect to Snowflake successfully.
Database - select a database from the dropdown list of configured databases in the Lazsa Platform.
Schema - select a schema from the list of schemas that are part of the database.
Warehouse - select a warehouse for the database. You can either select an existing warehouse or create a new warehouse. See Create Snowflake Warehouse.
View Details - click to view the configuration details of the Snowflake warehouse that you selected from the dropdown list.
(...) - click the ellipsis to edit, resume, or delete a warehouse.
Secure configuration details with a password
To password-protect your Snowflake connection details, turn on this toggle, enter a password, and then retype it to confirm. This is optional but recommended. When you share the connection details with multiple users, password protection helps you ensure authorized access to the connection details.
Click Save Configuration. The configured connection details, you can see the configuration listed on the Databases and Data Warehouses screen.