MemorySinkBase Contract — Base Contract for Memory Sinks

MemorySinkBase is the extension of the BaseStreamingSink contract for memory sinks that manage all data in memory.

Table 1. MemorySinkBase Contract
Method Description

allData

allData: Seq[Row]

dataSinceBatch

dataSinceBatch(
  sinceBatchId: Long): Seq[Row]

latestBatchData

latestBatchData: Seq[Row]

latestBatchId

latestBatchId: Option[Long]
Table 2. MemorySinkBases
MemorySinkBase Description

MemorySink

Streaming sink for Micro-Batch Stream Processing (based on Data Source API V1)

MemorySinkV2

Writable streaming sink for Continuous Stream Processing (based on Data Source API V2)

results matching ""

    No results matching ""