MemorySinkV2 — Writable Streaming Sink for Continuous Stream Processing

MemorySinkV2 is a DataSourceV2 with StreamWriteSupport for memory data source format in Continuous Stream Processing.

Tip
 Read up on DataSourceV2 Contract in The Internals of Spark SQL book.

MemorySinkV2 is a custom MemorySinkBase.

When requested for a StreamWriter, MemorySinkV2 simply creates a MemoryStreamWriter.

results matching ""

    No results matching ""