void abort(
long epochId,
WriterCommitMessage[] messages)
StreamWriter Contract
StreamWriter
is the extension of the DataSourceWriter
contract to support epochs, i.e. streaming writers that can abort and commit writing jobs for a specified epoch.
Tip
|
Read up on DataSourceWriter in The Internals of Spark SQL book. |
Method | Description |
---|---|
|
Aborts the writing job for a specified Used exclusively when |
|
Commits the writing job for a specified Used when:
|
StreamWriter | Description |
---|---|
KafkaStreamWriter |
|
MemoryStreamWriter |