@InterfaceAudience.Public @InterfaceStability.Evolving public class DistCp extends Configured implements Tool
Constructor and Description |
---|
DistCp(Configuration configuration,
org.apache.hadoop.tools.DistCpOptions inputOptions)
Public Constructor.
|
Modifier and Type | Method and Description |
---|---|
Job |
createAndSubmitJob()
Create and submit the mapreduce job.
|
protected Path |
createInputFileListing(Job job)
Create input listing by invoking an appropriate copy listing
implementation.
|
Job |
execute()
Implements the core-execution.
|
protected Path |
getFileListingPath()
Get default name of the copy listing file.
|
static void |
main(String[] argv)
Main function of the DistCp program.
|
int |
run(String[] argv)
Implementation of Tool::run().
|
void |
waitForJobCompletion(Job job)
Wait for the given job to complete.
|
getConf, setConf
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getConf, setConf
public DistCp(Configuration configuration, org.apache.hadoop.tools.DistCpOptions inputOptions) throws Exception
inputOptions
- Options (indicating source-paths, target-location.)configuration
- The Hadoop configuration against which the Copy-mapper must run.Exception
public int run(String[] argv)
public Job execute() throws Exception
Exception
public Job createAndSubmitJob() throws Exception
Exception
public void waitForJobCompletion(Job job) throws Exception
job
- the given mapreduce job that has already been submittedException
protected Path createInputFileListing(Job job) throws IOException
job
- - Handle to jobIOException
- - If anyprotected Path getFileListingPath() throws IOException
IOException
- - Exception if anyCopyright © 2016 Apache Software Foundation. All rights reserved.