Package org.apache.hadoop.examples

package org.apache.hadoop.examples
Hadoop example code.
  • Classes
    Class
    Description
    org.apache.hadoop.examples.AggregateWordCount
    This is an example Aggregated Hadoop Map/Reduce application.
    org.apache.hadoop.examples.AggregateWordCount.WordCountPlugInClass
     
    org.apache.hadoop.examples.AggregateWordHistogram
    This is an example Aggregated Hadoop Map/Reduce application.
    org.apache.hadoop.examples.AggregateWordHistogram.AggregateWordHistogramPlugin
     
    org.apache.hadoop.examples.BaileyBorweinPlouffe
    A map/reduce program that uses Bailey-Borwein-Plouffe to compute exact digits of Pi.
    org.apache.hadoop.examples.BaileyBorweinPlouffe.BbpInputFormat
    Input format for the BaileyBorweinPlouffe.BbpMapper.
    org.apache.hadoop.examples.BaileyBorweinPlouffe.BbpMapper
    Mapper class computing digits of Pi.
    org.apache.hadoop.examples.BaileyBorweinPlouffe.BbpReducer
    Reducer for concatenating map outputs.
    org.apache.hadoop.examples.BaileyBorweinPlouffe.BbpSplit
    Input split for the BaileyBorweinPlouffe.BbpInputFormat.
    org.apache.hadoop.examples.DBCountPageView
    This is a demonstrative program, which uses DBInputFormat for reading the input data from a database, and DBOutputFormat for writing the data to the database.
    org.apache.hadoop.examples.ExampleDriver
    A description of an example program based on its class and a human-readable description.
    org.apache.hadoop.examples.Grep
     
    org.apache.hadoop.examples.Join
    Given a set of sorted datasets keyed with the same class and yielding equal partitions, it is possible to effect a join of those datasets prior to the map.
    org.apache.hadoop.examples.MultiFileWordCount
    MultiFileWordCount is an example to demonstrate the usage of MultiFileInputFormat.
    org.apache.hadoop.examples.MultiFileWordCount.CombineFileLineRecordReader
    RecordReader is responsible from extracting records from a chunk of the CombineFileSplit.
    org.apache.hadoop.examples.MultiFileWordCount.MapClass
    This Mapper is similar to the one in WordCount.TokenizerMapper.
    org.apache.hadoop.examples.MultiFileWordCount.MyInputFormat
    To use CombineFileInputFormat, one should extend it, to return a (custom) RecordReader.
    org.apache.hadoop.examples.MultiFileWordCount.WordOffset
    This record keeps <filename,offset> pairs.
    org.apache.hadoop.examples.QuasiMonteCarlo
    A map/reduce program that estimates the value of Pi using a quasi-Monte Carlo (qMC) method.
    org.apache.hadoop.examples.QuasiMonteCarlo.QmcMapper
    Mapper class for Pi estimation.
    org.apache.hadoop.examples.QuasiMonteCarlo.QmcReducer
    Reducer class for Pi estimation.
    org.apache.hadoop.examples.RandomTextWriter
    This program uses map/reduce to just run a distributed job where there is no interaction between the tasks and each task writes a large unsorted random sequence of words.
    org.apache.hadoop.examples.RandomWriter
    This program uses map/reduce to just run a distributed job where there is no interaction between the tasks and each task write a large unsorted random binary sequence file of BytesWritable.
    org.apache.hadoop.examples.SecondarySort
    This is an example Hadoop Map/Reduce application.
    org.apache.hadoop.examples.SecondarySort.FirstGroupingComparator
    Compare only the first part of the pair, so that reduce is called once for each value of the first part.
    org.apache.hadoop.examples.SecondarySort.FirstPartitioner
    Partition based on the first part of the pair.
    org.apache.hadoop.examples.SecondarySort.IntPair
    Define a pair of integers that are writable.
    org.apache.hadoop.examples.SecondarySort.IntPair.Comparator
    A Comparator that compares serialized IntPair.
    org.apache.hadoop.examples.SecondarySort.MapClass
    Read two integers from each line and generate a key, value pair as ((left, right), right).
    org.apache.hadoop.examples.SecondarySort.Reduce
    A reducer class that just emits the sum of the input values.
    org.apache.hadoop.examples.Sort<K,V>
    This is the trivial map/reduce program that does absolutely nothing other than use the framework to fragment and sort the input values.
    org.apache.hadoop.examples.WordCount
     
    org.apache.hadoop.examples.WordCount.IntSumReducer
     
    org.apache.hadoop.examples.WordCount.TokenizerMapper
     
    org.apache.hadoop.examples.WordMean
     
    org.apache.hadoop.examples.WordMean.WordMeanMapper
    Maps words from line of text into 2 key-value pairs; one key-value pair for counting the word, another for counting its length.
    org.apache.hadoop.examples.WordMean.WordMeanReducer
    Performs integer summation of all the values for each key.
    org.apache.hadoop.examples.WordMedian
     
    org.apache.hadoop.examples.WordMedian.WordMedianMapper
    Maps words from line of text into a key-value pair; the length of the word as the key, and 1 as the value.
    org.apache.hadoop.examples.WordMedian.WordMedianReducer
    Performs integer summation of all the values for each key.
    org.apache.hadoop.examples.WordStandardDeviation
     
    org.apache.hadoop.examples.WordStandardDeviation.WordStandardDeviationMapper
    Maps words from line of text into 3 key-value pairs; one key-value pair for counting the word, one for counting its length, and one for counting the square of its length.
    org.apache.hadoop.examples.WordStandardDeviation.WordStandardDeviationReducer
    Performs integer summation of all the values for each key.