|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.hadoop.conf.Configured org.apache.hadoop.mapred.pipes.Submitter
public class Submitter
The main entry point and job submitter. It may either be used as a command line-based or API-based method to launch Pipes jobs.
Field Summary | |
---|---|
protected static org.apache.commons.logging.Log |
LOG
|
Constructor Summary | |
---|---|
Submitter()
|
|
Submitter(Configuration conf)
|
Method Summary | |
---|---|
static String |
getExecutable(JobConf conf)
Get the URI of the application's executable. |
static boolean |
getIsJavaMapper(JobConf conf)
Check whether the job is using a Java Mapper. |
static boolean |
getIsJavaRecordReader(JobConf conf)
Check whether the job is using a Java RecordReader |
static boolean |
getIsJavaRecordWriter(JobConf conf)
Will the reduce use a Java RecordWriter? |
static boolean |
getIsJavaReducer(JobConf conf)
Check whether the job is using a Java Reducer. |
static boolean |
getKeepCommandFile(JobConf conf)
Does the user want to keep the command file for debugging? If this is true, pipes will write a copy of the command data to a file in the task directory named "downlink.data", which may be used to run the C++ program under the debugger. |
static RunningJob |
jobSubmit(JobConf conf)
Submit a job to the Map-Reduce framework. |
static void |
main(String[] args)
Submit a pipes job based on the command line arguments. |
int |
run(String[] args)
Execute the command with the given arguments. |
static RunningJob |
runJob(JobConf conf)
Submit a job to the map/reduce cluster. |
static void |
setExecutable(JobConf conf,
String executable)
Set the URI for the application's executable. |
static void |
setIsJavaMapper(JobConf conf,
boolean value)
Set whether the Mapper is written in Java. |
static void |
setIsJavaRecordReader(JobConf conf,
boolean value)
Set whether the job is using a Java RecordReader. |
static void |
setIsJavaRecordWriter(JobConf conf,
boolean value)
Set whether the job will use a Java RecordWriter. |
static void |
setIsJavaReducer(JobConf conf,
boolean value)
Set whether the Reducer is written in Java. |
static void |
setKeepCommandFile(JobConf conf,
boolean keep)
Set whether to keep the command file for debugging |
static RunningJob |
submitJob(JobConf conf)
Deprecated. Use runJob(JobConf) |
Methods inherited from class org.apache.hadoop.conf.Configured |
---|
getConf, setConf |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface org.apache.hadoop.conf.Configurable |
---|
getConf, setConf |
Field Detail |
---|
protected static final org.apache.commons.logging.Log LOG
Constructor Detail |
---|
public Submitter()
public Submitter(Configuration conf)
Method Detail |
---|
public static String getExecutable(JobConf conf)
conf
-
public static void setExecutable(JobConf conf, String executable)
conf
- executable
- The URI of the application's executable.public static void setIsJavaRecordReader(JobConf conf, boolean value)
conf
- the configuration to modifyvalue
- the new valuepublic static boolean getIsJavaRecordReader(JobConf conf)
conf
- the configuration to check
public static void setIsJavaMapper(JobConf conf, boolean value)
conf
- the configuration to modifyvalue
- the new valuepublic static boolean getIsJavaMapper(JobConf conf)
conf
- the configuration to check
public static void setIsJavaReducer(JobConf conf, boolean value)
conf
- the configuration to modifyvalue
- the new valuepublic static boolean getIsJavaReducer(JobConf conf)
conf
- the configuration to check
public static void setIsJavaRecordWriter(JobConf conf, boolean value)
conf
- the configuration to modifyvalue
- the new value to setpublic static boolean getIsJavaRecordWriter(JobConf conf)
conf
- the configuration to check
public static boolean getKeepCommandFile(JobConf conf)
conf
- the configuration to check
public static void setKeepCommandFile(JobConf conf, boolean keep)
conf
- the configuration to modifykeep
- the new value@Deprecated public static RunningJob submitJob(JobConf conf) throws IOException
runJob(JobConf)
conf
- the job to submit to the cluster (MODIFIED)
IOException
public static RunningJob runJob(JobConf conf) throws IOException
conf
- the job to submit to the cluster (MODIFIED)
IOException
public static RunningJob jobSubmit(JobConf conf) throws IOException
RunningJob
which can be used to track
the running-job.
conf
- the job configuration.
RunningJob
which can be used to track the
running-job.
IOException
public int run(String[] args) throws Exception
Tool
run
in interface Tool
args
- command specific arguments.
Exception
public static void main(String[] args) throws Exception
args
-
Exception
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |