dbt (Cloud Version)

Adding dbt to your decube connections helps you monitor your transformations via our Data Quality model and see metadata on your dbt models and jobs directly synced to the Data Catalog.

This documentation is for the cloud version of dbt which is dbt Cloud. To see documentation on how to connect the open source version of dbt, please check out the documentation for dbt core here.

Supported Capabilities

Supported Capabilities

General

• Metadata — metadata extraction and display of asset information (tables, columns, schemas). Types collected: Schema, Virtual Table, Virtual Column, Data Job, Data Run, Data Task

Data Quality Monitors

• Job Failure

Not Supported

General

• Profiling

• Preview

• Data Quality

• Configurable Collection

• External Table

• View Table

• Stored Procedure

Data Quality Monitors

• Freshness

• Volume

• Field Health

• Custom SQL

• Schema Drift

dbt Cloud can map lineage relationships to upstream and downstream objects from the following connectors:

• Upstream Connectors: postgresql, redshift, snowflake, bigquery, mysql

• Downstream Connectors: postgresql, redshift, snowflake, bigquery, mysql

Connection Requirements

Minimum Requirements

This connection requires Service Account Tokens to be generated in dbt Cloud, which is only accessible to dbt accounts on Team and Enterprise plans.

• Service Account API Key

• Account ID

• Tenancy Type

• Access URL (if non DBT multi-tenant)

• Discovery URL (if non DBT multi-tenant)

Adding a dbt connection on decube.

• From the My Account page on decube platform, select on the dbt tile to be brought to the dbt connection form.

DBT

1. Account ID

• To get your Account ID, you can refer to the numbers at the end of the accounts path component of the URL (https://cloud.getdbt.com/settings/accounts/{account_id}).

1. API Key

• To get your API Key, please read on to the next section "Retrieve Service Token from dbt account settings" to generate your service token for your dbt account.

1. DBT Tenancy Type

• Usually this will be US Multi Tenant for most customers. To verify, check the domain you log in to your DBT with

  • US Multi Tenant - cloud.getdbt.com

  • EMEA Multi Tenant - emea.dbt.com

  • APAC Multi Tenant - au.dbt.com

If your DBT domain contains other URLs, you must choose Other as the tenancy type and provide item 4 and 5 mentioned below:

1. Access URL (For Other tenancy type)

• Navigate to your DBT Account Settings and below the Account Information pane, you can find the Access URL. You can follow the guide from DBT here

1. Discovery URL (For Other tenancy type)

• Navigate to your DBT Account Settings and below the Account Information pane, you can find the Discovery API URL. You can follow the guide from DBT here

Retrieve Service Token from dbt account settings

1. Log into your dbt account. From the Dashboard, click on gear icon on the top right corner as shown in image, to navigate to Account Settings.

Click on the Account Settings on the top right of the dbt Dashboard.

1. Within Account Settings, find the setting for Service Tokens on the left sidebar.

Find Service Tokens in the Account Settings.

1. Within the Service Tokens section, click on + New Token.

Add a new token under the Service Tokens section.

1. Within the New Service Token page, you can set any token name, such as "decube". Then, click on the + Add button.

Give a name and add the permissions.

1. Select Job Admin and add all the Projects that you would like to connect decube with. Then, click on Save at the bottom right.

Setting the correct permissions for the Service Token.

1. A token will be generated. Use the Copy button to copy the token into your clipboard.

Copy the Service Token.

1. Insert the Service token that you've copied into the "API Key" of the connection form, then test the connection. If it is successful, you can now add the name and submit the connection.

If there is any issues or questions related with connecting your data sources, please reach out to us via our Live chat for support.