Azure Databricks Job

Azure Databricks is a cloud-based data analytics platform that enables you to process large workloads of data.

The following table describes Azure Databricks job attributes:

Attribute

Description

Connection profile

Defines the connection profile for the job.

Rules:

  • Characters: 1-30

  • Case Sensitive: Yes

  • Invalid Characters: Blanks

  • Variable Name: %%AZURE-ACCOUNT

Databricks Job ID

Determines the ID of the job created in your Databricks workspace.

Parameters

Defines task parameters to override when the job runs, according to the Databricks convention. The list of parameters must begin with the name of the parameter type. For example:

  • "notebook_params":{"param1":"val1", "param2":"val2"}

  • "jar_params": ["param1", "param2"]

For more information about the parameter types, review the properties of RunParameters in the OpenAPI specification provided through the Azure Databricks documentation.

For no parameters, specify the following value:

  • "params": {}

Status Polling Frequency

(Optional) Determines the number of seconds to wait before checking the status of the job between intervals.

Default: 30