Package | Description |
---|---|
org.apache.hadoop.io |
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
|
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | |
org.apache.hadoop.mapreduce.lib.output |
Modifier and Type | Method and Description |
---|---|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata,
EnumSet<CreateFlag> createFlag,
org.apache.hadoop.fs.Options.CreateOpts... opts)
Construct the preferred type of SequenceFile Writer.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated.
|
static org.apache.hadoop.io.SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
org.apache.hadoop.io.SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
org.apache.hadoop.io.SequenceFile.Metadata metadata)
Deprecated.
|
Modifier and Type | Interface and Description |
---|---|
interface |
DirectDecompressionCodec
This class encapsulates a codec which can decompress direct bytebuffers.
|
interface |
SplittableCompressionCodec
This interface is meant to be implemented by those compression codecs
which are capable to compress / de-compress a stream starting at any
arbitrary position.
|
Modifier and Type | Class and Description |
---|---|
class |
BZip2Codec
This class provides output and input streams for bzip2 compression
and decompression.
|
class |
DefaultCodec |
class |
GzipCodec
This class creates gzip compressors/decompressors.
|
class |
PassthroughCodec
This is a special codec which does not transform the output.
|
Modifier and Type | Method and Description |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its
filename suffix.
|
CompressionCodec |
CompressionCodecFactory.getCodecByClassName(String classname)
Find the relevant compression codec for the codec's canonical class name.
|
CompressionCodec |
CompressionCodecFactory.getCodecByName(String codecName)
Find the relevant compression codec for the codec's canonical class name
or by codec alias.
|
Modifier and Type | Method and Description |
---|---|
Class<? extends CompressionCodec> |
CompressionCodecFactory.getCodecClassByName(String codecName)
Find the relevant compression codec for the codec's canonical class name
or by codec alias and returns its implemetation class.
|
static List<Class<? extends CompressionCodec>> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs discovered via a Java ServiceLoader, or
listed in the configuration.
|
Modifier and Type | Method and Description |
---|---|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec) |
static Compressor |
CodecPool.getCompressor(CompressionCodec codec,
Configuration conf)
Get a
Compressor for the given CompressionCodec from the
pool or a new one. |
static Decompressor |
CodecPool.getDecompressor(CompressionCodec codec)
Get a
Decompressor for the given CompressionCodec from the
pool or a new one. |
static int |
CodecPool.getLeasedCompressorsCount(CompressionCodec codec)
Return the number of leased
Compressor s for this
CompressionCodec |
static int |
CodecPool.getLeasedDecompressorsCount(CompressionCodec codec)
Return the number of leased
Decompressor s for this
CompressionCodec |
Modifier and Type | Method and Description |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the
CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the
CompressionCodec for compressing the job outputs. |
Modifier and Type | Method and Description |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the
CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the
CompressionCodec for compressing the job outputs. |
void |
JobConf.setMapOutputCompressorClass(Class<? extends CompressionCodec> codecClass)
Set the given class as the
CompressionCodec for the map outputs. |
static void |
FileOutputFormat.setOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> codecClass)
Set the
CompressionCodec to be used to compress job outputs. |
Modifier and Type | Method and Description |
---|---|
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobContext job,
Class<? extends CompressionCodec> defaultValue)
Get the
CompressionCodec for compressing the job outputs. |
Modifier and Type | Method and Description |
---|---|
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobContext job,
Class<? extends CompressionCodec> defaultValue)
Get the
CompressionCodec for compressing the job outputs. |
static void |
FileOutputFormat.setOutputCompressorClass(Job job,
Class<? extends CompressionCodec> codecClass)
Set the
CompressionCodec to be used to compress job outputs. |
Copyright © 2022 Apache Software Foundation. All rights reserved.