RuntimeConfig — Management Interface of Runtime Configuration

Table 1. RuntimeConfig API
Method	Description
get	`get(key: String): String get(key: String, default: String): String`
getAll	`getAll: Map[String, String]`
getOption	`getOption(key: String): Option[String]`
`isModifiable`	`isModifiable(key: String): Boolean` (New in 2.4.0)
set	`set(key: String, value: Boolean): Unit set(key: String, value: Long): Unit set(key: String, value: String): Unit`
unset	`unset(key: String): Unit`

RuntimeConfig is available using the conf attribute of a SparkSession.

scala> :type spark
org.apache.spark.sql.SparkSession

scala> :type spark.conf
org.apache.spark.sql.RuntimeConfig

Figure 1. RuntimeConfig, SparkSession and SQLConf

RuntimeConfig is created exclusively when SparkSession is requested for one.

RuntimeConfig takes a SQLConf when created.

get(key: String): String
get(key: String, default: String): String

get…FIXME

Note	`get` is used when…FIXME

getAll: Map[String, String]

getAll…FIXME

Note	`getAll` is used when…FIXME

getOption(key: String): Option[String]

getOption…FIXME

Note	`getOption` is used when…FIXME

set(key: String, value: Boolean): Unit
set(key: String, value: Long): Unit
set(key: String, value: String): Unit

set…FIXME

Note	`set` is used when…FIXME

unset(key: String): Unit

unset…FIXME

Note	`unset` is used when…FIXME

results matching ""