KafkaOffsetRangeLimit — Desired Offset Range Limits

KafkaOffsetRangeLimit represents the desired offset range limits for starting, ending, and specific offsets in Kafka Data Source.

Table 1. KafkaOffsetRangeLimits
KafkaOffsetRangeLimit Description

EarliestOffsetRangeLimit

Intent to bind to the earliest offset

LatestOffsetRangeLimit

Intent to bind to the latest offset

SpecificOffsetRangeLimit

Intent to bind to specific offsets with the following special offset "magic" numbers:

  • -1 or KafkaOffsetRangeLimit.LATEST - the latest offset

  • -2 or KafkaOffsetRangeLimit.EARLIEST - the earliest offset

Note
KafkaOffsetRangeLimit is a sealed trait in Scala which means that implementations are all in the same compilation unit (a single file).

KafkaOffsetRangeLimit is often used in a text-based representation and is converted to from latest, earliest or a JSON-formatted text using KafkaSourceProvider.getKafkaOffsetRangeLimit object method.

Note
A JSON-formatted text is of the following format {"topicName":{"partition":offset},…​}, e.g. {"topicA":{"0":23,"1":-1},"topicB":{"0":-2}}.

KafkaOffsetRangeLimit is used when:

results matching ""

    No results matching ""