Question
What are combiners? when should i use a combiner in my mapreduce job?
Answers
Combiners are used to increase the efficiency of a MapReduce program. They are used to aggregate intermediate map output locally on individual mapper outputs. Combiners can help you reduce the amount of data that needs to be transferred across to the reducers. You can use your reducer code as a combiner if the operation performed is commutative and associative. The execution of combiner is not guaranteed, Hadoop may or may not execute a combiner. Also, if required it may execute it more then 1 times. Therefore your MapReduce jobs should not depend on the combiners execution.   Your Comment




  • Contributors: *,
More Software Questions..
What is the inputsplit in map reduce software?
What is software configuration management?
What Is Java Api For Xml-based Rpc (jax-rpc)?
How can you implement fine-grained auditing?
What is IBM’s simple explanation for Big Data’s four critical features?
What is static synchronized method in JDBC API? Give an example?
What does the NULLIF function do?
What happens if a start method is not invoked and the run method is directly invoked?
Should we override finalize method
what is the difference between mysql_fetch_array and mysql_fetch_object?
How will XML affect my document links?
Why to use Style Sheets?
What are Filters in MVC?
Can you explain Application layer in OSI model?
How to define new testplan attributes?
What are the minimum system requirements to run Photoshop? Is it possible to run Photoshop over linux?
Which oracle package is used to manage the oracle lock management services?
What is Latch Up? Explain Latch Up with cross section of a CMOS Inverter. How do you avoid Latch Up?
What is marker interface?
What types of partitioning are there for BW?


Search
Can you Answer!!
  • Q Name the famous ballet Russian dancer who changed the face of modern ballet.
  • Q To customize the logoff screen to the portal which file is used to change?
  • Q Methods of democratic socialism are–
  • Q What is widget style editor?
  • Q Is Zakat due on a person owning wheat and barley if it collectively reaches the taxable limit i.e. 847 kilograms (approx.) and does not reach it separately?
  • Q Write a C code to reverse a linked list?
  • Q What is the color code for orange?
  • Q What do I need to know about Response.Redirect?
  • Q The Election Commission of India operates under which article of Indian Constitution?
  • Q What online resources do you use to keep abreast of web security issues? Can you give an example of a recent web security vulnerability or threat
  • Q MMT is useful mostly for