Package org.apache.hadoop.mapred.nativetask.util

Class NativeTaskOutputFiles

java.lang.Object
org.apache.hadoop.mapred.nativetask.util.NativeTaskOutputFiles
All Implemented Interfaces:
NativeTaskOutput
@Private public class NativeTaskOutputFiles extends Object implements NativeTaskOutput
Manipulate the working area for the transient store for maps and reduces. This class is used by map and reduce tasks to identify the directories that they need to write to/read from for intermediate files. The callers of these methods are from child space and see mapreduce.cluster.local.dir as taskTracker/jobCache/jobId/attemptId. This class should not be used from TaskTracker space.

  • Constructor Summary

    Constructors
    Constructor
    Description
    NativeTaskOutputFiles(org.apache.hadoop.conf.Configuration conf, String id)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.hadoop.fs.Path
    getInputFile(int mapId)
    Return a local reduce input file created earlier
    org.apache.hadoop.fs.Path
    getInputFileForWrite(org.apache.hadoop.mapred.TaskID mapId, long size, org.apache.hadoop.conf.Configuration conf)
    Create a local reduce input file name.
    org.apache.hadoop.fs.Path
    getOutputFile()
    Return the path to local map output file created earlier
    org.apache.hadoop.fs.Path
    getOutputFileForWrite(long size)
    Create a local map output file name.
    org.apache.hadoop.fs.Path
    getOutputIndexFile()
    Return the path to a local map output index file created earlier
    org.apache.hadoop.fs.Path
    getOutputIndexFileForWrite(long size)
    Create a local map output index file name.
    String
    getOutputName(int partition)
     
    org.apache.hadoop.fs.Path
    getSpillFile(int spillNumber)
    Return a local map spill file created earlier.
    org.apache.hadoop.fs.Path
    getSpillFileForWrite(int spillNumber, long size)
    Create a local map spill file name.
    org.apache.hadoop.fs.Path
    getSpillIndexFile(int spillNumber)
    Return a local map spill index file created earlier
    org.apache.hadoop.fs.Path
    getSpillIndexFileForWrite(int spillNumber, long size)
    Create a local map spill index file name.
    void
    removeAll()
    Removes all of the files related to a task.

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • NativeTaskOutputFiles

      public NativeTaskOutputFiles(org.apache.hadoop.conf.Configuration conf, String id)

  • Method Details