OrcFileFormat

OrcFileFormat is a FileFormat that…​FIXME

buildReaderWithPartitionValues Method

buildReaderWithPartitionValues(
  sparkSession: SparkSession,
  dataSchema: StructType,
  partitionSchema: StructType,
  requiredSchema: StructType,
  filters: Seq[Filter],
  options: Map[String, String],
  hadoopConf: Configuration): (PartitionedFile) => Iterator[InternalRow]
Note
 buildReaderWithPartitionValues is part of FileFormat Contract to build a data reader with partition column values appended.

buildReaderWithPartitionValues…​FIXME

inferSchema Method

inferSchema(
  sparkSession: SparkSession,
  options: Map[String, String],
  files: Seq[FileStatus]): Option[StructType]
Note
 inferSchema is part of FileFormat Contract to…​FIXME.

inferSchema…​FIXME

Building Partitioned Data Reader — buildReader Method

buildReader(
  sparkSession: SparkSession,
  dataSchema: StructType,
  partitionSchema: StructType,
  requiredSchema: StructType,
  filters: Seq[Filter],
  options: Map[String, String],
  hadoopConf: Configuration): (PartitionedFile) => Iterator[InternalRow]
Note
 buildReader is part of FileFormat Contract to…​FIXME

buildReader…​FIXME

results matching ""

    No results matching ""