RuntimeConfig — Management Interface of Runtime Configuration

RuntimeConfig is the management interface of the runtime configuration.

Table 1. RuntimeConfig API
Method Description

get

get(key: String): String
get(key: String, default: String): String

getAll

getAll: Map[String, String]

getOption

getOption(key: String): Option[String]

isModifiable

isModifiable(key: String): Boolean

(New in 2.4.0)

set

set(key: String, value: Boolean): Unit
set(key: String, value: Long): Unit
set(key: String, value: String): Unit

unset

unset(key: String): Unit

RuntimeConfig is available using the conf attribute of a SparkSession.

scala> :type spark
org.apache.spark.sql.SparkSession

scala> :type spark.conf
org.apache.spark.sql.RuntimeConfig
spark sql RuntimeConfig.png
Figure 1. RuntimeConfig, SparkSession and SQLConf

RuntimeConfig is created exclusively when SparkSession is requested for one.

RuntimeConfig takes a SQLConf when created.

get Method

get(key: String): String
get(key: String, default: String): String

get…​FIXME

Note
get is used when…​FIXME

getAll Method

getAll: Map[String, String]

getAll…​FIXME

Note
getAll is used when…​FIXME

getOption Method

getOption(key: String): Option[String]

getOption…​FIXME

Note
getOption is used when…​FIXME

set Method

set(key: String, value: Boolean): Unit
set(key: String, value: Long): Unit
set(key: String, value: String): Unit

set…​FIXME

Note
set is used when…​FIXME

unset Method

unset(key: String): Unit

unset…​FIXME

Note
unset is used when…​FIXME

results matching ""

    No results matching ""