#Java - Code Snippets for '#Org.apache.hadoop.mapreduce.Job'

#Java - Code Snippets for '#Org.apache.hadoop.mapreduce.Job' - 3 code snippet(s) found

Sample 1. MapReduce Word Count using Apache Accumlo

https://apache.googlesource.com/accumulo/+/HEAD/examples/simple/src/main/java/org/apache/accumulo/examples/simple/mapreduce/WordCount.java

_{Like Feedback}

Sample 2. Apache Hadoop Multi File Word Count

https://apache.googlesource.com/hadoop-common/+/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java

_{Like Feedback}

Sample 3. Usage of org.apache.hadoop.mapreduce.Job

Job job = new Job(conf);

if (t instanceof PathTarget) {

PathTarget pt = (PathTarget) t;

pt.configureForMapReduce(job, ptype, pt.getPath(), "out0");

CrunchOutputs.OutputConfig outConfig =

CrunchOutputs.getNamedOutputs(job.getConfiguration()).get("out0");

job.setOutputFormatClass(outConfig.bundle.getFormatClass());

job.setOutputKeyClass(outConfig.keyClass);

job.setOutputValueClass(outConfig.valueClass);

outConfig.bundle.configure(job.getConfiguration());

job.getConfiguration().set("crunch.namedoutput", "out0");

Path tmpPath = pipeline.createTempPath();

outRDD.saveAsNewAPIHadoopFile(

tmpPath.toString(),

c.getKeyClass(),

c.getValueClass(),

job.getOutputFormatClass(),

job.getConfiguration());

pt.handleOutputs(job.getConfiguration(), tmpPath, -1);

}

_{Like Feedback}

Search Java Code Snippets