Package parquet.avro

Provides classes to store Avro data in Parquet files.

See: Description

Interface Summary

Interface	Description
Cars
Cars.Callback

Class Summary

Class	Description
AvroParquetInputFormat	A Hadoop InputFormat for Parquet files.
AvroParquetOutputFormat	A Hadoop OutputFormat for Parquet files.
AvroParquetReader<T extends org.apache.avro.generic.IndexedRecord>	Read Avro records from a Parquet file.
AvroParquetWriter<T extends org.apache.avro.generic.IndexedRecord>	Write Avro records to a Parquet file.
AvroReadSupport<T extends org.apache.avro.generic.IndexedRecord>	Avro implementation of ReadSupport for Avro IndexedRecords which cover both Avro Specific and Generic.
AvroSchemaConverter	Converts an Avro schema into a Parquet schema.
AvroWriteSupport	Avro implementation of WriteSupport for IndexedRecords - both Avro Generic and Specific.
Car
Car.Builder	RecordBuilder for Car instances.
Engine
Engine.Builder	RecordBuilder for Engine instances.
LeatherTrim
LeatherTrim.Builder	RecordBuilder for LeatherTrim instances.
Service
Service.Builder	RecordBuilder for Service instances.
Stereo
Stereo.Builder	RecordBuilder for Stereo instances.

Enum Summary

Enum	Description
EngineType

Package parquet.avro Description

Provides classes to store Avro data in Parquet files. Avro schemas are converted to parquet schemas as follows. Only record schemas are converted, other top-level schema types are not converted and attempting to do so will result in an error. Avro types are converted to Parquet types using the mapping shown here:

Avro type	Parquet type
null	no type (the field is not encoded in Parquet), unless a null union
boolean	boolean
int	int32
long	int64
float	float
double	double
bytes	binary
string	binary (with original type UTF8)
record	group containing nested fields
enum	binary (with original type ENUM)
array	group (with original type LIST) containing one repeated group field
map	group (with original type MAP) containing one repeated group field (with original type MAP_KEY_VALUE) of (key, value)
fixed	fixed_len_byte_array
union	an optional type, in the case of a null union, otherwise not supported