case class AllowSpillOnlyLazySpillableColumnarBatchImpl(wrapped: LazySpillableColumnarBatch) extends LazySpillableColumnarBatch with Product with Serializable
A version of LazySpillableColumnarBatch where instead of closing the underlying
batch it is only spilled. This is used for cases, like with a streaming hash join
where the data itself needs to out live the JoinGatherer it is handed off to.
- Alphabetic
- By Inheritance
- AllowSpillOnlyLazySpillableColumnarBatchImpl
- Serializable
- Serializable
- Product
- Equals
- LazySpillableColumnarBatch
- LazySpillable
- Retryable
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new AllowSpillOnlyLazySpillableColumnarBatchImpl(wrapped: LazySpillableColumnarBatch)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
allowSpilling(): Unit
Indicate that we are done using the data for now and it can be spilled.
Indicate that we are done using the data for now and it can be spilled.
This method should not have issues with being called multiple times without the data being accessed.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillable
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
checkpoint(): Unit
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → Retryable
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
close(): Unit
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → AutoCloseable
-
def
dataTypes: Array[DataType]
The data types of the underlying batches columns.
The data types of the underlying batches columns. Should not unspill the batch to get this info.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
def
deviceMemorySize: Long
The amount of device memory in bytes that the underlying batch uses.
The amount of device memory in bytes that the underlying batch uses. Should not unspill the batch to get this info.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
getBatch: ColumnarBatch
Get the batch that this wraps and unspill it if needed.
Get the batch that this wraps and unspill it if needed.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
numCols: Int
How many columns are in the underlying batch.
How many columns are in the underlying batch. Should not unspill the batch to get this info.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
def
numRows: Int
How many rows are in the underlying batch.
How many rows are in the underlying batch. Should not unspill the batch to get this into.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
def
releaseBatch(): ColumnarBatch
Release the underlying batch to the caller who is responsible for closing it.
Release the underlying batch to the caller who is responsible for closing it. The resulting batch will NOT be closed when this instance is closed.
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → LazySpillableColumnarBatch
-
def
restore(): Unit
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → Retryable
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AllowSpillOnlyLazySpillableColumnarBatchImpl → AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- val wrapped: LazySpillableColumnarBatch