Metrics Configuration Properties

Table 1. Metrics Configuration Properties
Name Default Value Description

spark.metrics.conf

metrics.properties

The metrics configuration file.

spark.metrics.namespace

Spark application’s ID (i.e. spark.app.id configuration property)

Root namespace for metrics reporting.

Since a Spark application’s ID changes with every execution of a Spark application, a custom spark.metrics.namespace can be specified for an easier metrics reporting.

Used when MetricsSystem is requested for a metrics source identifier (aka metrics namespace)

results matching ""

    No results matching ""