trait LazySpillableColumnarBatch extends LazySpillable
Holds a Columnar batch that is LazySpillable.
- Alphabetic
- By Inheritance
- LazySpillableColumnarBatch
- LazySpillable
- Retryable
- AutoCloseable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Abstract Value Members
-
abstract
def
allowSpilling(): Unit
Indicate that we are done using the data for now and it can be spilled.
Indicate that we are done using the data for now and it can be spilled.
This method should not have issues with being called multiple times without the data being accessed.
- Definition Classes
- LazySpillable
-
abstract
def
checkpoint(): Unit
- Definition Classes
- Retryable
-
abstract
def
close(): Unit
- Definition Classes
- AutoCloseable
- Annotations
- @throws( classOf[java.lang.Exception] )
-
abstract
def
dataTypes: Array[DataType]
The data types of the underlying batches columns.
The data types of the underlying batches columns. Should not unspill the batch to get this info.
-
abstract
def
deviceMemorySize: Long
The amount of device memory in bytes that the underlying batch uses.
The amount of device memory in bytes that the underlying batch uses. Should not unspill the batch to get this info.
-
abstract
def
getBatch: ColumnarBatch
Get the batch that this wraps and unspill it if needed.
-
abstract
def
numCols: Int
How many columns are in the underlying batch.
How many columns are in the underlying batch. Should not unspill the batch to get this info.
-
abstract
def
numRows: Int
How many rows are in the underlying batch.
How many rows are in the underlying batch. Should not unspill the batch to get this into.
-
abstract
def
releaseBatch(): ColumnarBatch
Release the underlying batch to the caller who is responsible for closing it.
Release the underlying batch to the caller who is responsible for closing it. The resulting batch will NOT be closed when this instance is closed.
-
abstract
def
restore(): Unit
- Definition Classes
- Retryable
Concrete Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()