Question
How can you debug Hadoop code?
Answers
First, check the list of MapReduce jobs currently running. Next, we need to see that there are no orphaned jobs running; if yes, you need to determine the location of RM logs.

Run: “ps –ef | grep –I ResourceManager”
and look for log directory in the displayed result. Find out the job-id from the displayed list and check if there is any error message associated with that job.
On the basis of RM logs, identify the worker node that was involved in execution of the task.
Now, login to that node and run – “ps –ef | grep –iNodeManager”
Examine the Node Manager log. The majority of errors come from user level logs for each map-reduce job.   Your Comment




  • Contributors: *,
More Software Questions..
What is the inputsplit in map reduce software?
What is software configuration management?
What Is Java Api For Xml-based Rpc (jax-rpc)?
How can you implement fine-grained auditing?
What is IBM’s simple explanation for Big Data’s four critical features?
What is static synchronized method in JDBC API? Give an example?
What does the NULLIF function do?
What happens if a start method is not invoked and the run method is directly invoked?
Should we override finalize method
what is the difference between mysql_fetch_array and mysql_fetch_object?
How will XML affect my document links?
Why to use Style Sheets?
What are Filters in MVC?
Can you explain Application layer in OSI model?
How to define new testplan attributes?
What are the minimum system requirements to run Photoshop? Is it possible to run Photoshop over linux?
Which oracle package is used to manage the oracle lock management services?
What is Latch Up? Explain Latch Up with cross section of a CMOS Inverter. How do you avoid Latch Up?
What is marker interface?
What types of partitioning are there for BW?


Search
Can you Answer!!
  • Q Name the theories of capital structure?
  • Q Gist
  • Q How do you do Performance tuning of SQR?
  • Q Slogan of Kotak Mahindra Bank is ____________.
  • Q The International commission on Zoological Nomenclature was established in
  • Q What is the chemical name of Washing Soda?
  • Q What’s something we could offer to our customers?
  • Q What is scale a cloud service ?
  • Q What White house event did President Hayes, in 1878, start?
  • Q If one company can maintain one customer number for different sales areas is it possible with out any changes?
  • Q Mention what is sub-query?