Skip to main content

Azure Data Factory

You can run Azure Data Factory Pipelines from JAMS. JAMS has an ADFPipelineRuns Execution Method that lets you configure a Job to run.

To use the ADFPipelineRuns Execution Method, ensure the JAMS Scheduler and JAMS Client are running 7.8.1 or higher.

Before You Begin​

You will need the following information from Azure to set up this connection:

  • The Tenant ID.
  • The Client ID.
  • The Client Secret.
  • The Subscription ID.
  • The Resource Group that stores your Azure Data Factory.
  • The Azure Data Factory Pipeline instance that you will access.
  • The Azure Data Factory Pipeline that will run.
  • Any Parameters to run the Azure Data Factory Pipeline.

Creating Credentials in JAMS​

You need two Credentials in JAMS to run an Azure Data Factory Job:

  • A Credential is used to store the Client Secret value from Azure.
  • A Credential is used to run the Job in JAMS.

Adding a Credential for the Azure Credentials​

  1. Click Execution from the main menu.
  2. Click Credentials.
  3. Click Add.
  4. In the Display Name field, enter a name for the Credential. This may be the name used when logging on with this Credential.
  5. In the Password and Reenter Password fields, enter the Client Secret Value.
  6. Click Save and Return to List.

Adding a Credential for Running the Job​

  1. Click Execution from the main menu.
  2. Click Credentials.
  3. Click Add.
  4. In the Display Name field, enter a name for the Credential.
  5. In the Logon Username field, enter the username for the Credential.
  6. In the Password and Reenter Password fields, enter the password.
  7. Click Save and Return to List.

Creating a Connection Store Item for Azure Data Factory​

To connect to Azure Data Factory, you need a Connection Store item in JAMS. See Connections for Integrations for the steps to configure the Connection.

Creating a Job for running Azure Data Factory Pipelines​

  1. Click Jobs from the main menu.

  2. Click a Folder in the Folder Navigator where the Job will be saved.

  3. Click Add.

  4. In the Job Name field, enter a name for the Job.

  5. In the Execution Method field, select ADFPipelineRuns.

  6. Click Save and Continue to Edit.

  7. Click the Source tab.

  8. In the Azure Connection field, select the Connection Store item that you created for Azure Data Factory.

  9. In the Resource Group Name, enter the resource group that stores your Azure Data Factory.

  10. In the Data Factory Name field, enter the instance that you will access.

  11. In the Pipeline Name field, enter the name of the Pipeline that will run.

  12. In the Pipeline Run Parameters field, any Parameters that you define from the Parameters tab will be displayed. To add a Parameter, do the following:

    1. Click Save.
    2. Click the Parameters tab.
    3. Click ADD in the top right corner of the Parameters table.
    4. In the Parameter Name field, enter the name for the Parameter.
    5. In the Data Type field, select the type of value to be used. For example, you can select Text.
    6. In the Default Value field, enter a default value.
    7. Click Save and Return to List.
    8. Click the Source tab.
    9. Click the checkbox next to the Parameter to have the value passed.
    10. Click Save.

  13. Click the Schedules tab to add schedule items to set when the Job will run.

  14. Click the Properties tab.

  15. In the Agent field, select the Agent if the Job will not run on the Scheduler.

  16. In the Execute As field, select the JAMS Credential to run the Job.

  17. Click Save.