Uses of Class
org.apache.hadoop.mapreduce.Job
Packages that use Job
Package
Description
Command-line tools for MapReduce.
-
Uses of Job in org.apache.hadoop.mapreduce
Methods in org.apache.hadoop.mapreduce that return JobModifier and TypeMethodDescriptionJob[]Cluster.getAllJobs()Deprecated.static JobJob.getInstance()static JobJob.getInstance(Configuration conf) static JobJob.getInstance(Configuration conf, String jobName) static JobJob.getInstance(Cluster ignored) Deprecated.UsegetInstance()static JobJob.getInstance(Cluster ignored, Configuration conf) Deprecated.static JobJob.getInstance(Cluster cluster, JobStatus status, Configuration conf) static JobJob.getInstance(JobStatus status, Configuration conf) Get job corresponding to jobid. -
Uses of Job in org.apache.hadoop.mapreduce.lib.aggregate
Methods in org.apache.hadoop.mapreduce.lib.aggregate that return JobModifier and TypeMethodDescriptionstatic JobValueAggregatorJob.createValueAggregatorJob(String[] args, Class<? extends ValueAggregatorDescriptor>[] descriptors) static JobValueAggregatorJob.createValueAggregatorJob(Configuration conf, String[] args) Create an Aggregate based map/reduce job. -
Uses of Job in org.apache.hadoop.mapreduce.lib.chain
Methods in org.apache.hadoop.mapreduce.lib.chain with parameters of type JobModifier and TypeMethodDescriptionstatic voidChainMapper.addMapper(Job job, Class<? extends Mapper> klass, Class<?> inputKeyClass, Class<?> inputValueClass, Class<?> outputKeyClass, Class<?> outputValueClass, Configuration mapperConf) Adds aMapperclass to the chain mapper.static voidChainReducer.addMapper(Job job, Class<? extends Mapper> klass, Class<?> inputKeyClass, Class<?> inputValueClass, Class<?> outputKeyClass, Class<?> outputValueClass, Configuration mapperConf) Adds aMapperclass to the chain reducer.static voidChainReducer.setReducer(Job job, Class<? extends Reducer> klass, Class<?> inputKeyClass, Class<?> inputValueClass, Class<?> outputKeyClass, Class<?> outputValueClass, Configuration reducerConf) Sets theReducerclass to the chain job. -
Uses of Job in org.apache.hadoop.mapreduce.lib.db
Methods in org.apache.hadoop.mapreduce.lib.db with parameters of type JobModifier and TypeMethodDescriptionstatic voidDataDrivenDBInputFormat.setInput(Job job, Class<? extends DBWritable> inputClass, String inputQuery, String inputBoundingQuery) setInput() takes a custom query and a separate "bounding query" to use instead of the custom "count query" used by DBInputFormat.static voidDataDrivenDBInputFormat.setInput(Job job, Class<? extends DBWritable> inputClass, String tableName, String conditions, String splitBy, String... fieldNames) Note that the "orderBy" column is called the "splitBy" in this version.static voidDBInputFormat.setInput(Job job, Class<? extends DBWritable> inputClass, String inputQuery, String inputCountQuery) Initializes the map-part of the job with the appropriate input settings.static voidDBInputFormat.setInput(Job job, Class<? extends DBWritable> inputClass, String tableName, String conditions, String orderBy, String... fieldNames) Initializes the map-part of the job with the appropriate input settings.static voidInitializes the reduce-part of the job with the appropriate output settingsstatic voidInitializes the reduce-part of the job with the appropriate output settings -
Uses of Job in org.apache.hadoop.mapreduce.lib.input
Methods in org.apache.hadoop.mapreduce.lib.input with parameters of type JobModifier and TypeMethodDescriptionstatic voidFileInputFormat.addInputPath(Job job, Path path) Add aPathto the list of inputs for the map-reduce job.static voidMultipleInputs.addInputPath(Job job, Path path, Class<? extends InputFormat> inputFormatClass) Add aPathwith a customInputFormatto the list of inputs for the map-reduce job.static voidMultipleInputs.addInputPath(Job job, Path path, Class<? extends InputFormat> inputFormatClass, Class<? extends Mapper> mapperClass) static voidFileInputFormat.addInputPaths(Job job, String commaSeparatedPaths) Add the given comma separated paths to the list of inputs for the map-reduce job.static voidSequenceFileInputFilter.setFilterClass(Job job, Class<?> filterClass) set the filter classstatic voidFileInputFormat.setInputDirRecursive(Job job, boolean inputDirRecursive) static voidFileInputFormat.setInputPathFilter(Job job, Class<? extends PathFilter> filter) Set a PathFilter to be applied to the input paths for the map-reduce job.static voidFileInputFormat.setInputPaths(Job job, String commaSeparatedPaths) Sets the given comma separated paths as the list of inputs for the map-reduce job.static voidFileInputFormat.setInputPaths(Job job, Path... inputPaths) Set the array ofPaths as the list of inputs for the map-reduce job.static voidFileInputFormat.setMaxInputSplitSize(Job job, long size) Set the maximum split sizestatic voidFileInputFormat.setMinInputSplitSize(Job job, long size) Set the minimum input split sizestatic voidNLineInputFormat.setNumLinesPerSplit(Job job, int numLines) Set the number of lines per split -
Uses of Job in org.apache.hadoop.mapreduce.lib.jobcontrol
Methods in org.apache.hadoop.mapreduce.lib.jobcontrol that return JobMethods in org.apache.hadoop.mapreduce.lib.jobcontrol with parameters of type JobConstructors in org.apache.hadoop.mapreduce.lib.jobcontrol with parameters of type JobModifierConstructorDescriptionControlledJob(Job job, List<ControlledJob> dependingJobs) Construct a job. -
Uses of Job in org.apache.hadoop.mapreduce.lib.map
Methods in org.apache.hadoop.mapreduce.lib.map with parameters of type JobModifier and TypeMethodDescriptionstatic <K1,V1, K2, V2>
voidMultithreadedMapper.setMapperClass(Job job, Class<? extends Mapper<K1, V1, K2, V2>> cls) Set the application's mapper class.static voidMultithreadedMapper.setNumberOfThreads(Job job, int threads) Set the number of threads in the pool for running maps. -
Uses of Job in org.apache.hadoop.mapreduce.lib.output
Methods in org.apache.hadoop.mapreduce.lib.output with parameters of type JobModifier and TypeMethodDescriptionstatic voidMultipleOutputs.addNamedOutput(Job job, String namedOutput, Class<? extends OutputFormat> outputFormatClass, Class<?> keyClass, Class<?> valueClass) Adds a named output for the job.static voidFileOutputFormat.setCompressOutput(Job job, boolean compress) Set whether the output of the job is compressed.static voidMultipleOutputs.setCountersEnabled(Job job, boolean enabled) Enables or disables counters for the named outputs.static voidSequenceFileOutputFormat.setOutputCompressionType(Job job, SequenceFile.CompressionType style) Set theSequenceFile.CompressionTypefor the outputSequenceFile.static voidFileOutputFormat.setOutputCompressorClass(Job job, Class<? extends CompressionCodec> codecClass) Set theCompressionCodecto be used to compress job outputs.static voidLazyOutputFormat.setOutputFormatClass(Job job, Class<? extends OutputFormat> theClass) Set the underlying output format for LazyOutputFormat.static voidFileOutputFormat.setOutputPath(Job job, Path outputDir) Set thePathof the output directory for the map-reduce job.static voidSequenceFileAsBinaryOutputFormat.setSequenceFileOutputKeyClass(Job job, Class<?> theClass) Set the key class for theSequenceFilestatic voidSequenceFileAsBinaryOutputFormat.setSequenceFileOutputValueClass(Job job, Class<?> theClass) Set the value class for theSequenceFile -
Uses of Job in org.apache.hadoop.mapreduce.lib.partition
Methods in org.apache.hadoop.mapreduce.lib.partition with parameters of type JobModifier and TypeMethodDescriptionstatic voidKeyFieldBasedComparator.setKeyFieldComparatorOptions(Job job, String keySpec) Set theKeyFieldBasedComparatoroptions used to compare keys.voidKeyFieldBasedPartitioner.setKeyFieldPartitionerOptions(Job job, String keySpec) Set theKeyFieldBasedPartitioneroptions used forPartitionerstatic <K,V> void InputSampler.writePartitionFile(Job job, org.apache.hadoop.mapreduce.lib.partition.InputSampler.Sampler<K, V> sampler) Write a partition file for the given job, using the Sampler provided. -
Uses of Job in org.apache.hadoop.mapreduce.tools
Methods in org.apache.hadoop.mapreduce.tools with parameters of type JobModifier and TypeMethodDescriptionprotected voidCLI.displayTasks(Job job, String type, String state) Display the information about a job's tasks, of a particular type and in a particular state -
Uses of Job in org.apache.hadoop.tools
Methods in org.apache.hadoop.tools that return JobModifier and TypeMethodDescriptionDistCp.createAndSubmitJob()Create and submit the mapreduce job.DistCp.execute()Original entrypoint of a distcp job.DistCp.execute(boolean extraContextChecks) Implements the core-execution.Methods in org.apache.hadoop.tools with parameters of type JobModifier and TypeMethodDescriptionprotected PathDistCp.createInputFileListing(Job job) Create input listing by invoking an appropriate copy listing implementation.voidDistCp.waitForJobCompletion(Job job) Wait for the given job to complete.
Cluster.getAllJobStatuses()instead.