MicroBatchReader createMicroBatchReader(
Optional<StructType> schema,
String checkpointLocation,
DataSourceOptions options)
MicroBatchReadSupport Contract — Data Sources with MicroBatchReaders
MicroBatchReadSupport
is the extension of the DataSourceV2
for data sources with a MicroBatchReader for Micro-Batch Stream Processing.
MicroBatchReadSupport
defines a single createMicroBatchReader
method to create a MicroBatchReader.
createMicroBatchReader
is used when:
-
MicroBatchExecution
is requested for the analyzed logical plan (and creates a StreamingExecutionRelation for a StreamingRelationV2 with aMicroBatchReadSupport
data source) -
DataStreamReader
is requested to create a streaming query for a MicroBatchReadSupport data source
MicroBatchReadSupport | Description |
---|---|