Packages

package arrow

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Type Members

  1. trait AbstractMessageIterator extends Iterator[ArrowMessage]
  2. class ArrowDeserializingIterator[E] extends CloseableIterator[E]
  3. class ArrowSerializer[T] extends AnyRef

    Helper class for converting user objects into arrow batches.

  4. class ConcatenatingArrowStreamReader extends ArrowReader

    An ArrowReader that concatenates multiple MessageIterators into a single stream.

    An ArrowReader that concatenates multiple MessageIterators into a single stream. Each iterator represents a single IPC stream. The concatenated streams all must have the same schema. If the schema is different an exception is thrown.

    In some cases we want to retain the messages (see SparkResult). Normally a stream reader closes its messages when it consumes them. In order to prevent that from happening in non-destructive mode we clone the messages before passing them to the reading logic.

  5. class EmptyDeserializingIterator[E] extends CloseableIterator[E]
  6. class MessageIterator extends AbstractMessageIterator

    Decode an Arrow IPC stream into individual messages.

    Decode an Arrow IPC stream into individual messages. Please note that this iterator MUST have a valid IPC stream as its input, otherwise construction will fail.

Value Members

  1. object ArrowDeserializers

    Helper class for converting arrow batches into user objects.

  2. object ArrowSerializer
  3. object ArrowVectorReader

Ungrouped