StateStoreConf

StateStoreConf is…​FIXME

Table 1. StateStoreConf’s Properties
Name Configuration Property

minDeltasForSnapshot

spark.sql.streaming.stateStore.minDeltasForSnapshot

maxVersionsToRetainInMemory

spark.sql.streaming.maxBatchesToRetainInMemory

minVersionsToRetain

spark.sql.streaming.minBatchesToRetain

Used exclusively when HDFSBackedStateStoreProvider is requested for cleanup.

providerClass

Used exclusively when StateStoreProvider helper object is requested to create and initialize the StateStoreProvider.

results matching ""

    No results matching ""