HintInfo

HintInfo takes a single broadcast flag when created.

HintInfo is created when:

  1. Dataset.broadcast function is used

  2. ResolveBroadcastHints logical resolution rule is executed (and resolves UnresolvedHint logical operators)

  3. ResolvedHint and Statistics are created

  4. InMemoryRelation is requested for computeStats (when sizeInBytesStats is 0)

  5. HintInfo is requested to resetForJoin

broadcast is used to…​FIXME

broadcast is off (i.e. false) by default.

import org.apache.spark.sql.catalyst.plans.logical.HintInfo
val broadcastOff = HintInfo()

scala> println(broadcastOff.broadcast)
false

val broadcastOn = broadcastOff.copy(broadcast = true)
scala> println(broadcastOn)
(broadcast)

val broadcastOff = broadcastOn.resetForJoin
scala> println(broadcastOff.broadcast)
false

resetForJoin Method

resetForJoin(): HintInfo

resetForJoin…​FIXME

Note
 resetForJoin is used when SizeInBytesOnlyStatsPlanVisitor is requested to visitIntersect and visitJoin.

results matching ""

    No results matching ""