GroupStateTimeout — Group State Timeout in Arbitrary Stateful Streaming Aggregation

GroupStateTimeout represents an aggregation state timeout that defines when a GroupState can be considered timed-out (expired) in Arbitrary Stateful Streaming Aggregation.

GroupStateTimeout is used with the following KeyValueGroupedDataset operations:

Table 1. GroupStateTimeouts
GroupStateTimeout Description


Timeout based on event time

Used when…​FIXME


No timeout

Used when…​FIXME


Timeout based on processing time

FlatMapGroupsWithStateExec physical operator requires that batchTimestampMs is specified when ProcessingTimeTimeout is used.

batchTimestampMs is defined when IncrementalExecution is created (with the state). IncrementalExecution is given OffsetSeqMetadata when StreamExecution is requested to run a streaming batch.

results matching ""

    No results matching ""