class HostHostAsymmetricJoinSizer extends AsymmetricJoinSizer[ColumnarBatch] with HostHostUnspillableJoinSizer
- Alphabetic
- By Inheritance
- HostHostAsymmetricJoinSizer
- HostHostUnspillableJoinSizer
- AsymmetricJoinSizer
- JoinSizer
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getJoinInfo(joinType: JoinType, leftKeys: Seq[Expression], leftOutput: Seq[Attribute], rawLeftIter: Iterator[ColumnarBatch], rightKeys: Seq[Expression], rightOutput: Seq[Attribute], rawRightIter: Iterator[ColumnarBatch], condition: Option[Expression], gpuBatchSizeBytes: Long, metrics: Map[String, GpuMetric]): JoinInfo
Probe the left and right join inputs to determine which side should be used as the build side and which should be used as the stream side.
Probe the left and right join inputs to determine which side should be used as the build side and which should be used as the stream side.
- joinType
type of join to perform
- leftKeys
join keys for the left table
- leftOutput
schema of the left table
- rawLeftIter
iterator of batches for the left table
- rightKeys
join keys for the right table
- rightOutput
schema of the right table
- rawRightIter
iterator of batches for the right table
- condition
inequality portions of the join condition
- gpuBatchSizeBytes
target GPU batch size
- metrics
map of metrics to update
- returns
join information including build side, bound expressions, etc.
- Definition Classes
- AsymmetricJoinSizer → JoinSizer
-
def
getProbeBatchDataSize(batch: ColumnarBatch): Long
Get the data size in bytes of a batch of data
Get the data size in bytes of a batch of data
- Definition Classes
- HostHostUnspillableJoinSizer → JoinSizer
-
def
getProbeBatchRowCount(batch: ColumnarBatch): Long
Get the row count of a batch of data
Get the row count of a batch of data
- Definition Classes
- HostHostUnspillableJoinSizer → JoinSizer
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
val
magnificationThreshold: Int
- Definition Classes
- HostHostAsymmetricJoinSizer → AsymmetricJoinSizer
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
setupForJoin(queue: Queue[ColumnarBatch], remainingIter: Iterator[ColumnarBatch], batchTypes: Array[DataType], gpuBatchSizeBytes: Long, metrics: Map[String, GpuMetric]): Iterator[ColumnarBatch]
Build an iterator in preparation for using it for sub-joins.
Build an iterator in preparation for using it for sub-joins.
- queue
a possibly empty queue of data that has already been fetched from the underlying iterator as part of probing sizes of the join inputs
- remainingIter
the data remaining to be fetched from the original iterator. Iterating the queue followed by this iterator reconstructs the iteration order of the original input iterator.
- batchTypes
the schema of the data
- gpuBatchSizeBytes
target GPU batch size in bytes
- metrics
metrics to update (e.g.: if coalescing batches)
- returns
iterator of columnar batches to use in sub-joins
- Definition Classes
- HostHostUnspillableJoinSizer → JoinSizer
-
def
setupForProbe(iter: Iterator[ColumnarBatch]): Iterator[ColumnarBatch]
Wrap, if necessary, an iterator in preparation for probing the size before a join.
Wrap, if necessary, an iterator in preparation for probing the size before a join.
- Definition Classes
- HostHostUnspillableJoinSizer → JoinSizer
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()