|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use CompressionCodec | |
---|---|
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner. |
org.apache.hadoop.mapreduce.lib.output |
Uses of CompressionCodec in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io that return CompressionCodec | |
---|---|
CompressionCodec |
SequenceFile.Writer.getCompressionCodec()
Returns the compression codec of data in this file. |
CompressionCodec |
SequenceFile.Reader.getCompressionCodec()
Returns the compression codec of data in this file. |
Methods in org.apache.hadoop.io with parameters of type CompressionCodec | |
---|---|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
Uses of CompressionCodec in org.apache.hadoop.io.compress |
---|
Subinterfaces of CompressionCodec in org.apache.hadoop.io.compress | |
---|---|
interface |
SplittableCompressionCodec
This interface is meant to be implemented by those compression codecs which are capable to compress / decompress a stream starting at any arbitrary position. |
Classes in org.apache.hadoop.io.compress that implement CompressionCodec | |
---|---|
class |
BZip2Codec
This class provides CompressionOutputStream and CompressionInputStream for compression and decompression. |
class |
DefaultCodec
|
class |
GzipCodec
This class creates gzip compressors/decompressors. |
class |
SnappyCodec
This class creates snappy compressors/decompressors. |
Methods in org.apache.hadoop.io.compress that return CompressionCodec | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
CompressionCodec |
CompressionCodecFactory.getCodecByClassName(String classname)
Find the relevant compression codec for the codec's canonical class name. |
CompressionCodec |
CompressionCodecFactory.getCodecByName(String codecName)
Find the relevant compression codec for the codec's canonical class name or by codec alias. |
Methods in org.apache.hadoop.io.compress that return types with arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
CompressionCodecFactory.getCodecClassByName(String codecName)
Find the relevant compression codec for the codec's canonical class name or by codec alias and returns its implemetation class. |
static List<Class<? extends CompressionCodec>> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs listed in the configuration |
Methods in org.apache.hadoop.io.compress with parameters of type CompressionCodec | |
---|---|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec)
|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec,
Configuration conf)
Get a Compressor for the given CompressionCodec from the
pool or a new one. |
static Decompressor |
CodecPool.getDecompressor(CompressionCodec codec)
Get a Decompressor for the given CompressionCodec from the
pool or a new one. |
Uses of CompressionCodec in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return types with arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
Method parameters in org.apache.hadoop.mapred with type arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
void |
JobConf.setMapOutputCompressorClass(Class<? extends CompressionCodec> codecClass)
Set the given class as the CompressionCodec for the map outputs. |
static void |
FileOutputFormat.setOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> codecClass)
Set the CompressionCodec to be used to compress job outputs. |
Uses of CompressionCodec in org.apache.hadoop.mapreduce.lib.output |
---|
Methods in org.apache.hadoop.mapreduce.lib.output that return types with arguments of type CompressionCodec | |
---|---|
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobContext job,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
Method parameters in org.apache.hadoop.mapreduce.lib.output with type arguments of type CompressionCodec | |
---|---|
static Class<? extends CompressionCodec> |
FileOutputFormat.getOutputCompressorClass(JobContext job,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
static void |
FileOutputFormat.setOutputCompressorClass(Job job,
Class<? extends CompressionCodec> codecClass)
Set the CompressionCodec to be used to compress job outputs. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |