Utils Helper Object

Utils is a Scala object that…​FIXME

getLocalDir Method

getLocalDir(conf: SparkConf): String

getLocalDir…​FIXME

Note

getLocalDir is used when:

fetchFile Method

fetchFile(
  url: String,
  targetDir: File,
  conf: SparkConf,
  securityMgr: SecurityManager,
  hadoopConf: Configuration,
  timestamp: Long,
  useCache: Boolean): File

fetchFile…​FIXME

Note

fetchFile is used when:

  • SparkContext is requested to addFile

  • Executor is requested to updateDependencies

  • Spark Standalone’s DriverRunner is requested to downloadUserJar

getOrCreateLocalRootDirsImpl Internal Method

getOrCreateLocalRootDirsImpl(conf: SparkConf): Array[String]

getOrCreateLocalRootDirsImpl…​FIXME

Note
getOrCreateLocalRootDirsImpl is used exclusively when Utils is requested to getOrCreateLocalRootDirs

getOrCreateLocalRootDirs Internal Method

getOrCreateLocalRootDirs(conf: SparkConf): Array[String]

getOrCreateLocalRootDirs…​FIXME

Note

getOrCreateLocalRootDirs is used when:

results matching ""

    No results matching ""