MicroBatchReader Contract — DataSourceReaders For Micro-Batch Stream Processing

MicroBatchReader is the extension of the DataSourceReader (and BaseStreamingSource) contracts for data source readers that can read continually in Micro-Batch Stream Processing mode.

Table 1. MicroBatchReader Contract
Method Description

commit

void commit(Offset end)

Used when…​FIXME

deserializeOffset

Offset deserializeOffset(String json)

Used when…​FIXME

getEndOffset

Offset getEndOffset()

Used when…​FIXME

getStartOffset

Offset getStartOffset()

Used when…​FIXME

setOffsetRange

void setOffsetRange(
  Optional<Offset> start,
  Optional<Offset> end)

Used when…​FIXME

Table 2. MicroBatchReaders
MicroBatchReader Description

KafkaMicroBatchReader

MemoryStream

RateStreamMicroBatchReader

TextSocketMicroBatchReader

results matching ""

    No results matching ""