Configure Snowflake Connection Details (as data source)

Snowflake is a fully-managed SaaS data platform that provides features such as data warehousing, data lake, data science, data application development among many others. Snowflake provides out-of-the-box features like scalable computing, separation of storage and compute, data sharing, data cloning, and support for third-party tools to handle the demanding needs of businesses.

You can use Snowflake in different stages of a data pipeline in the Lazsa Platform:

  • To use Snowflake as a data source in a data ingestion pipeline, configure your Snowflake connection details in the RDBMS section of Databases and Data Warehouses. See Configure Snowflake as a Data Source.

The Lazsa Platform offers various options for retrieving your database credentials to establish a secure connection. You can either directly provide the credentials within the connection details, where they are securely stored in the Lazsa-managed secret manager. Alternately, you can choose to retrieve credentials programmatically from your designated secrets management tool.

Note:

The user that you configure must have the read-only access to your RDBMS.

To configure the connection details of Snowflake as a data source, do the following:

  1. Sign in to the Lazsa Platform and click Configuration in the left navigation pane.
  2. On the Platform Setup screen, on the Cloud Platform, Tools & Technologies tile, click Configure.
  3. On the Cloud Platform, Tools & Technologies screen, in the Databases and Data Warehouses section, click Configure.
    (After you save your first connection details in this section, you see the Modify button here.)
    Databases and Data Warehouses Configuration in Lazsa Platform
  4. In the list of available Databases and Data Warehouses, click RDBMS logo. Snowflake as Data Lake

  5. On the RDBMS screen, do the following:
    1. In the Details section, provide the following information:

      FieldDescription
      NameGive a unique name to your Snowflake configuration. This name is used to save and identify your specific Snowflake connection details within the Lazsa Platform.
      DescriptionProvide a brief description that helps you identify the purpose or context of this Snowflake configuration.
  6. In the Configuration section, do the following:

    1. From the RDBMS Subtype, select Snowflake.
    2. Provide the Account URL for your Snowflake account.
    3. Select Cloud Provider - Select the cloud platform on which your Snowflake account is hosted. Choose from the following options:
      1. AWS
      2. Azure
  7. Depending on how you want to retrieve the credentials to connect to Snowflake, do one of the following:

    Field Description
    Connect using Lazsa Orchestrator Agent

    Enable this option to resolve your Snowflake credentials within your private network via Lazsa Orchestrator Agent without sharing them with the Lazsa Platform.

    Select the Lazsa Orchestrator Agent that you want to use from the list of your configured agents.

    • If you select an agent installed in an Amazon EKS cluster, the secrets management tool AWS Secrets Manager is auto-selected. Provide the Secret Name using which you store your Snowflake credentials. Provide the Username Key and Password Key.


      Snowflake Orchestrator Agent AWS Secret Manager

    • If you select Azure as the cloud provider in the above step, the dropdown list shows a list of Azure agents installed in an AKS cluster. The secrets management tool Azure Key Vault is auto-selected. Provide the Vault Name, Username Secret, and Password Secret of the secret where you store your Snowflake credentials.

      Snowflake AzureKey Vault Configuration

    Select Secret Manager
    • Select Lazsa and type your Snowflake Username and Password.

      Lazsa Secret Manager without Orchestrator

    In this case, the user credentials are securely stored in the Lazsa-managed secrets store.

    • Select AWS Secrets Manager. In the Secret Management dropdown list, the AWS Secrets Manager configurations that you save and activate in the Secret Management section on the Cloud Platform, Tools & Technologies screen are listed for selection. Select the configuration of your choice. Provide the Secret Name, Username Key, and the Password Key for the Lazsa Platform to retrieve the secrets for your Snowflake account.
      Snowflake_NoOrch_AWS Secrets Manager
    • Select Azure Key Vault. In the Vault Configuration dropdown list, the Azure Key Vault configurations that you save and activate in the Secret Management section on the Cloud Platform, Tools & Technologies screen are listed for selection. Select the Vault Configuration of your choice. Provide the Vault Name, Username Secret, and Password Secret for the Lazsa Platform to retrieve the credential values.

      Azure Key Vault without Orchestrator Agent
  1. Click Test Connection to validate whether you have configured the correct connection details and you can connect to Snowflake successfully.
  2. Database - Select a database from the dropdown list of configured databases in your Snowflake account.
  3. Schema - Select a schema from the list of schemas that are part of the selected database.
  4. Warehouse - Select a warehouse for the database. You can either select an existing warehouse or create a new warehouse. See Create Snowflake Warehouse.
  5. View Details - Click to view the configuration details of the Snowflake warehouse that you selected from the dropdown list.
  6. (...) - click the ellipsis to edit, resume, or delete a warehouse.
  7. Secure configuration details with a password
    To password-protect your Snowflake connection details, turn on this toggle, enter a password, and then retype it to confirm. This is optional but recommended. When you share the connection details with multiple users, password protection helps you ensure authorized access to the connection details.
  8. Click Save Configuration. You can see the configuration listed on the Databases and Data Warehouses screen as an RDBMS Snowflake connection.

Related Topics Link IconRecommended Topics

What's next? Data Visualization