StatefulOperatorStateInfo identifies the state store for a given stateful physical operator:

  • Checkpoint directory (checkpointLocation)

  • Run ID of a streaming query (queryRunId)

  • Stateful operator ID (operatorId)

  • State version (storeVersion)

  • Number of partitions

StatefulOperatorStateInfo is created exclusively when IncrementalExecution is requested for nextStatefulOperationStateInfo.

When requested for a textual representation (toString), StatefulOperatorStateInfo returns the following:

state info [ checkpoint = [checkpointLocation], runId = [queryRunId], opId = [operatorId], ver = [storeVersion], numPartitions = [numPartitions]]

State Version and Batch ID

When created (when IncrementalExecution is requested for the next StatefulOperatorStateInfo), a StatefulOperatorStateInfo is given a state version.

The state version is exactly the batch ID of the IncrementalExecution.

results matching ""

    No results matching ""