Packages

object GpuShuffledSizedHashJoinExec extends Serializable

Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. GpuShuffledSizedHashJoinExec
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class BoundJoinExprs(boundBuildKeys: Seq[GpuExpression], buildTypes: Array[DataType], buildOutput: Seq[Attribute], boundStreamKeys: Seq[GpuExpression], streamTypes: Array[DataType], streamOutput: Seq[Attribute], boundCondition: Option[GpuExpression], numFirstConditionTableColumns: Int, compareNullsEqual: Boolean, buildSideNeedsNullFilter: Boolean) extends Product with Serializable

    Utility class to track bound expressions and expression metadata related to a join.

  2. trait HostHostJoinSizer extends JoinSizer[SpillableHostConcatResult]

    Join sizer when both the left and right table are coming directly from a shuffle and the data will be on the host.

    Join sizer when both the left and right table are coming directly from a shuffle and the data will be on the host. Caches shuffle batches in host memory while probing without grabbing the GPU semaphore.

  3. trait HostHostUnspillableJoinSizer extends JoinSizer[ColumnarBatch]

    Very similar to the HostHostJoinSizer except it does not support host spillable data.

    Very similar to the HostHostJoinSizer except it does not support host spillable data. This should only be used when the amount of data being probed is the target batch size or less, which matches the behavior of normal shuffle processing today. Ideally we should be using HostHostJoinSizer, but this saves the overhead of registering and unregistering all of the shuffle buffers with the spill framework. See https://github.com/NVIDIA/spark-rapids/issues/11322.

  4. case class JoinInfo(joinType: JoinType, buildSide: GpuBuildSide, buildIter: Iterator[ColumnarBatch], buildSize: Long, buildStats: Option[JoinBuildSideStats], streamIter: Iterator[ColumnarBatch], exprs: BoundJoinExprs) extends Product with Serializable

    Utility class to track information related to a join.

  5. trait JoinSizer[T <: AutoCloseable] extends AnyRef

    Trait to house common code for determining the ideal build/stream assignments for symmetric joins.

  6. trait SpillableColumnarBatchJoinSizer extends JoinSizer[SpillableColumnarBatch]

    Join sizer to use when at least one side of the join is coming from another GPU exec node such that the GPU semaphore is already held.

    Join sizer to use when at least one side of the join is coming from another GPU exec node such that the GPU semaphore is already held. Caches input batches on the GPU.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. def createJoinIterator(info: JoinInfo, spillableBuiltBatch: LazySpillableColumnarBatch, lazyStream: Iterator[LazySpillableColumnarBatch], gpuBatchSizeBytes: Long, opTime: GpuMetric, joinTime: GpuMetric): Iterator[ColumnarBatch]
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def getConcatMetrics(metrics: Map[String, GpuMetric]): Map[String, GpuMetric]
  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. def useSizedJoin(conf: RapidsConf, joinType: JoinType, leftKeys: Seq[Expression], rightKeys: Seq[Expression]): Boolean
  20. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  23. object BoundJoinExprs extends Serializable

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped