Azure HDInsight Job

Azure HDInsight enables you to run an Apache Spark batch job for big data analytics.

The following table describes Azure HDInsight job parameters:

Attribute

Description

Connection Profile

Defines the name of a connection profile to use to connect to the Azure HDInsight workspace.

Parameters

Determines which parameters are passed to the Apache Spark Application during job execution, in JSON format (name:value pairs).

This JSON must include the file and className elements.

Polling Intervals

Determines the number of seconds to wait before the Apache Spark batch job is verified.

Default: 10 seconds

Status Polling Interval

Determines whether logs from Apache Spark appear in the job output.