K - The type of key the record reader should generate.V - The type of value the record reader should generate.T - The type of the entries within the Avro container file being read.public abstract class AvroRecordReaderBase<K,V,T> extends RecordReader<K,V>
RecordReaders that read Avro container
files.| Modifier | Constructor and Description |
|---|---|
protected |
AvroRecordReaderBase(Schema readerSchema)
Constructor.
|
| Modifier and Type | Method and Description |
|---|---|
void |
close() |
protected DataFileReader<T> |
createAvroFileReader(SeekableInput input,
DatumReader<T> datumReader)
Creates an Avro container file reader from a seekable input stream.
|
protected SeekableInput |
createSeekableInput(Configuration conf,
Path path)
Creates a seekable input stream to an Avro container file.
|
protected T |
getCurrentRecord()
Gets the current record read from the Avro container file.
|
float |
getProgress() |
void |
initialize(InputSplit inputSplit,
TaskAttemptContext context) |
boolean |
nextKeyValue() |
getCurrentKey, getCurrentValueprotected AvroRecordReaderBase(Schema readerSchema)
readerSchema - The reader schema for the records of the Avro container
file.public void initialize(InputSplit inputSplit, TaskAttemptContext context) throws IOException, InterruptedException
initialize in class RecordReader<K,V>IOExceptionInterruptedExceptionpublic boolean nextKeyValue()
throws IOException,
InterruptedException
nextKeyValue in class RecordReader<K,V>IOExceptionInterruptedExceptionpublic float getProgress()
throws IOException,
InterruptedException
getProgress in class RecordReader<K,V>IOExceptionInterruptedExceptionpublic void close()
throws IOException
close in interface Closeableclose in interface AutoCloseableclose in class RecordReader<K,V>IOExceptionprotected T getCurrentRecord()
Calling nextKeyValue() moves this to the next record.
protected SeekableInput createSeekableInput(Configuration conf, Path path) throws IOException
conf - The hadoop configuration.path - The path to the avro container file.IOException - If there is an error reading from the path.protected DataFileReader<T> createAvroFileReader(SeekableInput input, DatumReader<T> datumReader) throws IOException
input - The input containing the Avro container file.datumReader - The reader to use for the individual records in the Avro
container file.IOException - If there is an error reading from the input stream.Copyright © 2009–2023 The Apache Software Foundation. All rights reserved.