parquet.column.values

Class ValuesWriter

java.lang.Object

parquet.column.values.ValuesWriter

Direct Known Subclasses:

BitPackingValuesWriter, BooleanPlainValuesWriter, ByteBitPackingValuesWriter, DevNullValuesWriter, DictionaryValuesWriter, PlainValuesWriter, RunLengthBitPackingHybridValuesWriter

public abstract class ValuesWriter
extends Object

base class to implement an encoding for a given column

Author:

Julien Le Dem

Constructor Summary

Constructors

Constructor and Description
ValuesWriter()

Method Summary

Methods

Modifier and Type	Method and Description
DictionaryPage	createDictionaryPage()
abstract long	getAllocatedSize()
abstract long	getBufferedSize() used to decide if we want to work to the next page
abstract BytesInput	getBytes()
abstract Encoding	getEncoding() called after getBytes() and before reset()
abstract String	memUsageString(String prefix)
abstract void	reset() called after getBytes() to reset the current buffer and start writing the next page
void	resetDictionary() reset the dictionary when a new block starts
void	writeBoolean(boolean v)
void	writeByte(int value)
void	writeBytes(Binary v)
void	writeDouble(double v)
void	writeFloat(float v)
void	writeInteger(int v)
void	writeLong(long v)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ValuesWriter

public ValuesWriter()

Method Detail

getBufferedSize

public abstract long getBufferedSize()

used to decide if we want to work to the next page

Returns:

the size of the currently buffered data (in bytes)

getBytes

public abstract BytesInput getBytes()

Returns:

the bytes buffered so far to write to the current page

getEncoding

public abstract Encoding getEncoding()

called after getBytes() and before reset()

Returns:

the encoding that was used to encode the bytes

reset

public abstract void reset()

called after getBytes() to reset the current buffer and start writing the next page

createDictionaryPage

public DictionaryPage createDictionaryPage()

Returns:

the dictionary page or null if not dictionary based

resetDictionary

public void resetDictionary()

reset the dictionary when a new block starts

getAllocatedSize

public abstract long getAllocatedSize()

Returns:

the allocated size of the buffer ( > {@link #getBufferedMemorySize()() )

writeByte

public void writeByte(int value)

Parameters:

value - the value to encode

writeBoolean

public void writeBoolean(boolean v)

Parameters:

value - the value to encode

writeBytes

public void writeBytes(Binary v)

Parameters:

value - the value to encode

writeInteger

public void writeInteger(int v)

Parameters:

value - the value to encode

writeLong

public void writeLong(long v)

Parameters:

value - the value to encode

writeDouble

public void writeDouble(double v)

Parameters:

value - the value to encode

writeFloat

public void writeFloat(float v)

Parameters:

value - the value to encode

memUsageString

public abstract String memUsageString(String prefix)