org.apache.hadoop.util
Class CopyFiles

java.lang.Object
  org.apache.hadoop.util.CopyFiles

All Implemented Interfaces:

Configurable, Tool

public class CopyFiles
extends Object
implements Tool

A Map-reduce program to recursively copy directories between different file-systems.

Nested Class Summary

static class

CopyFiles.DuplicationException An exception class for duplicated source files.

Constructor Summary

CopyFiles(Configuration conf)

Method Summary

static void	copy(Configuration conf, String srcPath, String destPath, Path logPath, boolean srcAsList, boolean ignoreReadFailures) Deprecated.
Configuration	getConf() Return the configuration used by this object.
static void	main(String[] args)
int	run(String[] args) This is the main driver for recursively copying directories across file systems.
void	setConf(Configuration conf) Set the configuration to be used by this object.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CopyFiles

public CopyFiles(Configuration conf)

Method Detail

setConf

public void setConf(Configuration conf)

Description copied from interface: Configurable

Set the configuration to be used by this object.

Specified by:

setConf in interface Configurable

getConf

public Configuration getConf()

Description copied from interface: Configurable

Return the configuration used by this object.

Specified by:

getConf in interface Configurable

copy

@Deprecated
public static void copy(Configuration conf,
                                   String srcPath,
                                   String destPath,
                                   Path logPath,
                                   boolean srcAsList,
                                   boolean ignoreReadFailures)
                 throws IOException

Deprecated.

Throws:

IOException

run

public int run(String[] args)
        throws Exception

This is the main driver for recursively copying directories across file systems. It takes at least two cmdline parameters. A source URL and a destination URL. It then essentially does an "ls -lR" on the source URL, and writes the output in a round-robin manner to all the map input files. The mapper actually copies the files allotted to it. The reduce is empty.

Specified by:

run in interface Tool

Parameters:

args - command specific arguments.

Returns:

exit code.

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception