Databricks Job

The Databricks job enables you to integrate jobs created in the Databricks environment with your existing Control-M workflows. The following table describes Databricks job parameters:

Parameter

Description

Connection profile

Determines which connection profile to use to connect to the Databricks workspace.
Databricks Job ID Determines the job ID created in your Databricks workspace.
Parameters

Defines task parameters to override when the job runs, according to the Databricks convention. The list of parameters must begin with the name of the parameter type. For example:

  • "notebook_params":{"param1":"val1", "param2":"val2"}

  • "jar_params": ["param1", "param2"]

For more information about the parameter types, review the properties of RunParameters in the OpenAPI specification provided through the Azure Databricks documentation.

For no parameters, specify the following value:

  • "params": {}
Status Polling Frequency

(Optional) Determines the number of seconds to wait before checking the status of the job between intervals.

Default: 30