ContinuousReadSupport Contract — Data Sources with ContinuousReaders

ContinuousReadSupport is the extension of the DataSourceV2 for data sources with a ContinuousReader for Continuous Stream Processing.

ContinuousReadSupport defines a single createContinuousReader method to create a ContinuousReader.

ContinuousReader createContinuousReader(
  Optional<StructType> schema,
  String checkpointLocation,
  DataSourceOptions options)

createContinuousReader is used when:

Table 1. ContinuousReadSupports
ContinuousReadSupport Description

ContinuousMemoryStream

Data source provider for memory format

KafkaSourceProvider

Data source provider for kafka format

RateStreamProvider

Data source provider for rate format

TextSocketSourceProvider

Data source provider for socket format

results matching ""

    No results matching ""