addBatch(
batchId: Long,
data: DataFrame): Unit
Sink Contract — Streaming Sinks for Micro-Batch Stream Processing
Sink
is the extension of the BaseStreamingSink contract for streaming sinks that can add batches to an output.
Sink
is part of Data Source API V1 and used in Micro-Batch Stream Processing only.
Method | Description |
---|---|
|
Adds a batch of data to the sink Used exclusively when MicroBatchExecution stream execution engine (Micro-Batch Stream Processing) is requested to add a streaming batch to a sink (addBatch phase) while running an activated streaming query. |
Sink | Description |
---|---|
Used for DataStreamWriter.foreachBatch streaming operator |
|
Used for kafka output format |
|