createSource(
sqlContext: SQLContext,
metadataPath: String,
schema: Option[StructType],
providerName: String,
parameters: Map[String, String]): Source
StreamSourceProvider Contract — Streaming Source Providers for Micro-Batch Stream Processing (Data Source API V1)
StreamSourceProvider
is the contract of data source providers that can create a streaming source for a format (e.g. text file) or system (e.g. Apache Kafka).
StreamSourceProvider
is part of Data Source API V1 and used in Micro-Batch Stream Processing only.
Method | Description | ||
---|---|---|---|
|
Creates a streaming source
Used exclusively when |
||
|
The name and schema of the streaming source Used exclusively when |
Note
|
KafkaSourceProvider is the only known StreamSourceProvider in Spark Structured Streaming.
|