Saturday 2 January 2016

Hadoop: Map Reduce job configuration

configuration. You can get the Job instance by calling
getInstance method.

Ex:
Job job = Job.getInstance(conf, "word count");

Once you got the Job instance, you can specify Mapper, combiner, Partitioner, Reducer, InputFormat, OutputFormat implementations by using setter methods of the Job instance.

For an example, go through the link.

How to submit a job
By using following methods, you can submit a job.

Job.submit(): Submit the job to the cluster and return immediately.

Job.waitForCompletion(boolean): Submit the job to the cluster and wait for it to finish.




Previous                                                 Next                                                 Home

No comments:

Post a Comment