# Azure Data Factory

## Supported Capabilities

{% tabs %}
{% tab title="Supported Capabilities" %}
**General**

* **Metadata** — metadata extraction and display of asset information (tables, columns, schemas). Types collected: Schema, Virtual Table, Virtual Column, Data Job, Data Run, Data Task
  {% endtab %}

{% tab title="Not Supported" %}
**General**

* Profiling
* Preview
* Data Quality
* Configurable Collection
* External Table
* View Table
* Stored Procedure
  {% endtab %}
  {% endtabs %}

Azure Data Factory can map lineage relationships to upstream and downstream objects from the following connectors:

* Upstream Connectors: postgresql, mysql, synapse, azure\_server, databricks, sql\_server, redshift, bigquery, adls
* Downstream Connectors: postgresql, mysql, synapse, azure\_server, databricks, sql\_server, redshift, bigquery, adls

## Connection Requirements

From our Azure account, we will need the following information:

* Tenant ID
* Client ID
* Client Secret
* Subscription ID
* Resource Group Name
* Factory Name
* Data Source Name

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-8124a9689202f44f2e18a385b3cae4095b035b14%2Fimage.png?alt=media" alt=""><figcaption><p>Azure Data Factory</p></figcaption></figure>

### How to connect

1. On the Azure Home Page, go to `Azure Active Directory`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-80b65a5a61a3029b94537b5ba8089152bf35f83c%2FScreenshot%202023-06-16%20at%206.12.58%20PM.png?alt=media" alt=""><figcaption></figcaption></figure>

2. Go to `App registrations`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-3a327665717246b384fd084078e42dbbb1ca312b%2FUntitled%20(2).png?alt=media" alt=""><figcaption></figcaption></figure>

3. Click on `New registration`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-082578ac0d6c3ed19276bd2210de09e8446111e9%2FUntitled%20(3).png?alt=media" alt=""><figcaption></figcaption></figure>

4. Click `Register`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-5378e21ff8fb718961cbe6c832ee2ec8f4b6dba7%2FUntitled%20(4).png?alt=media" alt=""><figcaption></figcaption></figure>

5. Save the `Application (client) ID` and `Directory (tenant) ID`.
6. Click `Add a certificate or secret`.
7. Go to `Client secrets` and click `+ New client secret`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-7e0ac5952f0eb7c7754f122ccd2a3dd58250c9f1%2FUntitled%20(5).png?alt=media" alt=""><figcaption></figcaption></figure>

8. Click `Add`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-504aeb0aab787909b6eaa74527ec4f3bcfa0835e%2FScreenshot%202023-06-16%20at%206.20.16%20PM.png?alt=media" alt=""><figcaption></figcaption></figure>

9. Copy and save the `Value`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-a33dcc31d06836d38c5e51c8147592b7ba94dd7b%2FScreenshot%202023-06-16%20at%206.21.12%20PM.png?alt=media" alt=""><figcaption></figcaption></figure>

10. Go to Data Factories and click the factory you wanna add.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-17633868fc8e5f54405855cd3d16623a5959126e%2FUntitled%20(6).png?alt=media" alt=""><figcaption></figcaption></figure>

11. Go to `Access Control (IAM)`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-0d19b65e72dc578c5a0eac206062fcc460c632dd%2Fimage.png?alt=media" alt=""><figcaption></figcaption></figure>

12. Click on `+ Add` and select `Add role assignment`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-f56b0bff57cde1c55c654a7c66be889cd7376ea0%2FUntitled%20(8).png?alt=media" alt=""><figcaption></figcaption></figure>

13. Select `Data Factory Contributor`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-abfd6c262e30828a87325d993937fe616bcc19dd%2FUntitled%20(9).png?alt=media" alt=""><figcaption></figcaption></figure>

14. Go to `Members` tab and Click on `+ Select members`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-3640985907da91f6a967fe1cc20189155f2c2378%2FUntitled%20(12).png?alt=media" alt=""><figcaption></figcaption></figure>

15. Search and select the service principal that was created in the previous step. Click on `Select`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-579b07ec5accba1066767bfe7574cfa10b18a3ea%2FUntitled%20(11).png?alt=media" alt=""><figcaption></figcaption></figure>

16. Go to `Review + assign` tab and Click `Review + assign`

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-84b65785f9175512f3536ad100a84d18a024f726%2FUntitled%20(13).png?alt=media" alt=""><figcaption></figcaption></figure>

17. Go to Data Factories and select the factory you wanna add, copy the `Name` and `Resource group`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-e64c8ca00e048d0d3a7e059460ba06b019562ebe%2FUntitled%20(14).png?alt=media" alt=""><figcaption></figcaption></figure>

18. Copy the `Subscription ID`.

<figure><img src="https://1779874722-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FTw0qpCVzfrIXqS4FEg4T%2Fuploads%2Fgit-blob-b67e7249c92a3d4cefc7329090bd89c203f14eaa%2FUntitled%20(15).png?alt=media" alt=""><figcaption></figcaption></figure>

19. Fill all the required fields in the connection form, and click on Test this connection once connection is successful, give your database a name and connect the data source.
