FlatMapGroupsWithStateExecHelper

FlatMapGroupsWithStateExecHelper is a utility with the main purpose of creating a StateManager for FlatMapGroupsWithStateExec physical operator.

Creating StateManager — createStateManager Method

createStateManager(
  stateEncoder: ExpressionEncoder[Any],
  shouldStoreTimestamp: Boolean,
  stateFormatVersion: Int): StateManager

createStateManager simply creates a StateManager (with the stateEncoder and shouldStoreTimestamp flag) based on stateFormatVersion:

createStateManager throws an IllegalArgumentException for stateFormatVersion not 1 or 2:

Version [stateFormatVersion] is invalid
Note
createStateManager is used exclusively for the StateManager for FlatMapGroupsWithStateExec physical operator.

results matching ""

    No results matching ""