Index
All Classes and Interfaces|All Packages|Constant Field Values
A
- AvroColumnReader<D> - Class in org.apache.trevni.avro
-
Read files written with
AvroColumnWriter
. - AvroColumnReader(AvroColumnReader.Params) - Constructor for class org.apache.trevni.avro.AvroColumnReader
-
Construct a reader for a file.
- AvroColumnReader.Params - Class in org.apache.trevni.avro
-
Parameters for reading an Avro column file.
- AvroColumnWriter<D> - Class in org.apache.trevni.avro
-
Write Avro records to a Trevni column file.
- AvroColumnWriter(Schema, ColumnFileMetaData) - Constructor for class org.apache.trevni.avro.AvroColumnWriter
- AvroColumnWriter(Schema, ColumnFileMetaData, GenericData) - Constructor for class org.apache.trevni.avro.AvroColumnWriter
- AvroTrevniInputFormat<T> - Class in org.apache.trevni.avro
-
An
InputFormat
for Trevni files. - AvroTrevniInputFormat() - Constructor for class org.apache.trevni.avro.AvroTrevniInputFormat
- AvroTrevniKeyInputFormat<T> - Class in org.apache.trevni.avro.mapreduce
-
An
InputFormat
for Trevni files. - AvroTrevniKeyInputFormat() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyInputFormat
- AvroTrevniKeyOutputFormat<T> - Class in org.apache.trevni.avro.mapreduce
-
An
OutputFormat
that writes Avro data to Trevni files. - AvroTrevniKeyOutputFormat() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyOutputFormat
- AvroTrevniKeyRecordReader<T> - Class in org.apache.trevni.avro.mapreduce
-
Reads records from an input split representing a chunk of an Trenvi container file.
- AvroTrevniKeyRecordReader() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordReader
- AvroTrevniKeyRecordWriter<T> - Class in org.apache.trevni.avro.mapreduce
-
Writes Trevni records to an Trevni container file output stream.
- AvroTrevniKeyRecordWriter(TaskAttemptContext) - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter
-
Constructor.
- AvroTrevniKeyValueInputFormat<K,
V> - Class in org.apache.trevni.avro.mapreduce -
An
InputFormat
for Trevni files. - AvroTrevniKeyValueInputFormat() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueInputFormat
- AvroTrevniKeyValueOutputFormat<K,
V> - Class in org.apache.trevni.avro.mapreduce -
An
OutputFormat
that writes Avro data to Trevni files. - AvroTrevniKeyValueOutputFormat() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueOutputFormat
- AvroTrevniKeyValueRecordReader<K,
V> - Class in org.apache.trevni.avro.mapreduce -
Reads Trevni generic records from an Trevni container file, where the records contain two fields: 'key' and 'value'.
- AvroTrevniKeyValueRecordReader() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordReader
- AvroTrevniKeyValueRecordWriter<K,
V> - Class in org.apache.trevni.avro.mapreduce -
Writes key/value pairs to an Trevni container file.
- AvroTrevniKeyValueRecordWriter(TaskAttemptContext) - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordWriter
-
Constructor.
- AvroTrevniOutputFormat<T> - Class in org.apache.trevni.avro
-
An
OutputFormat
that writes Avro data to Trevni files. - AvroTrevniOutputFormat() - Constructor for class org.apache.trevni.avro.AvroTrevniOutputFormat
- AvroTrevniRecordReaderBase<K,
V, - Class in org.apache.trevni.avro.mapreduceT> -
Abstract base class for
RecordReader
s that read Trevni container files. - AvroTrevniRecordReaderBase() - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniRecordReaderBase
- AvroTrevniRecordWriterBase<K,
V, - Class in org.apache.trevni.avro.mapreduceT> -
Abstract base class for
RecordWriter
s that writes Trevni container files. - AvroTrevniRecordWriterBase(TaskAttemptContext) - Constructor for class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
Constructor.
C
- close() - Method in class org.apache.trevni.avro.AvroColumnReader
- close() - Method in class org.apache.trevni.avro.HadoopInput
- close() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordReaderBase
- close(TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyInputFormat
- createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueInputFormat
E
- EXT - Static variable in class org.apache.trevni.avro.AvroTrevniOutputFormat
-
The file name extension for trevni files.
- EXT - Static variable in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
trevni file extension
F
- flush() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
A Trevni flush will close the current file and prep a new writer
G
- getCurrentKey() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordReader
- getCurrentKey() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordReader
- getCurrentRecord() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordReaderBase
-
Gets the current record read from the Trevni container file.
- getCurrentValue() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordReader
- getCurrentValue() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordReader
- getFileSchema() - Method in class org.apache.trevni.avro.AvroColumnReader
-
Return the schema for data in this file.
- getProgress() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordReaderBase
- getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.trevni.avro.AvroTrevniInputFormat
- getRecordWriter(FileSystem, JobConf, String, Progressable) - Method in class org.apache.trevni.avro.AvroTrevniOutputFormat
- getRecordWriter(TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyOutputFormat
- getRecordWriter(TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueOutputFormat
- getRowCount() - Method in class org.apache.trevni.avro.AvroColumnReader
-
Return the number of rows in this file.
H
- HadoopInput - Class in org.apache.trevni.avro
-
Adapt a Hadoop
FSDataInputStream
to Trevni'sInput
. - HadoopInput(Path, Configuration) - Constructor for class org.apache.trevni.avro.HadoopInput
-
Construct given a path and a configuration.
- hasNext() - Method in class org.apache.trevni.avro.AvroColumnReader
I
- initialize(InputSplit, TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordReaderBase
- initSchema(TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter
-
Use the task context to construct a schema for writing
- initSchema(TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordWriter
-
Use the task context to construct a schema for writing
- initSchema(TaskAttemptContext) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
Use the task context to construct a schema for writing
- isSplitable(FileSystem, Path) - Method in class org.apache.trevni.avro.AvroTrevniInputFormat
- iterator() - Method in class org.apache.trevni.avro.AvroColumnReader
L
- length() - Method in class org.apache.trevni.avro.HadoopInput
- listStatus(JobConf) - Method in class org.apache.trevni.avro.AvroTrevniInputFormat
M
- meta - Variable in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
meta data to be stored in the output file.
- META_PREFIX - Static variable in class org.apache.trevni.avro.AvroTrevniOutputFormat
- META_PREFIX - Static variable in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
prefix of job configs that we care about
N
- next() - Method in class org.apache.trevni.avro.AvroColumnReader
- nextKeyValue() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordReader
- nextKeyValue() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordReader
- nextKeyValue() - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordReaderBase
O
- org.apache.trevni.avro - package org.apache.trevni.avro
-
Read and write Avro data in Trevni column files.
- org.apache.trevni.avro.mapreduce - package org.apache.trevni.avro.mapreduce
P
- Params(File) - Constructor for class org.apache.trevni.avro.AvroColumnReader.Params
-
Construct reading from a file.
- Params(Input) - Constructor for class org.apache.trevni.avro.AvroColumnReader.Params
-
Construct reading from input.
- part - Variable in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
Counter that increments as new trevni files are create because the current file has exceeded the block size
R
- read(long, byte[], int, int) - Method in class org.apache.trevni.avro.HadoopInput
- remove() - Method in class org.apache.trevni.avro.AvroColumnReader
S
- schema - Variable in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
Provided avro schema from the context
- SCHEMA_KEY - Static variable in class org.apache.trevni.avro.AvroColumnWriter
- setMeta(JobConf, String, String) - Static method in class org.apache.trevni.avro.AvroTrevniOutputFormat
-
Add metadata to job output files.
- setModel(GenericData) - Method in class org.apache.trevni.avro.AvroColumnReader.Params
-
Set data representation.
- setSchema(Schema) - Method in class org.apache.trevni.avro.AvroColumnReader.Params
-
Set subset schema to project data down to.
- sizeEstimate() - Method in class org.apache.trevni.avro.AvroColumnWriter
-
Return the approximate size of the file that will be written.
W
- write(D) - Method in class org.apache.trevni.avro.AvroColumnWriter
-
Add a row to the file.
- write(AvroKey<K>, AvroValue<V>) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyValueRecordWriter
- write(AvroKey<T>, NullWritable) - Method in class org.apache.trevni.avro.mapreduce.AvroTrevniKeyRecordWriter
- writer - Variable in class org.apache.trevni.avro.mapreduce.AvroTrevniRecordWriterBase
-
Trevni file writer
- writeTo(File) - Method in class org.apache.trevni.avro.AvroColumnWriter
-
Write all rows added to the named file.
- writeTo(OutputStream) - Method in class org.apache.trevni.avro.AvroColumnWriter
-
Write all rows added to the named output stream.
All Classes and Interfaces|All Packages|Constant Field Values