Question
You came to know that your model is suffering from low bias and high variance. Which algorithm should you use to tackle it? Why?

Answers

Low bias occurs when the model’s predicted values are near to actual values. In other words, the model becomes flexible enough to mimic the training data distribution. While it sounds like great achievement, but not to forget, a flexible model has no generalization capabilities. It means, when this model is tested on an unseen data, it gives disappointing results.
In such situations, we can use bagging algorithm (like random forest) to tackle high variance problem. Bagging algorithms divides a data set into subsets made with repeated randomized sampling. Then, these samples are used to generate  a set of models using a single learning algorithm. Later, the model predictions are combined using voting (classification) or averaging (regression).
Also, to combat high variance, we can:

Use regularization technique, where higher model coefficients get penalized, hence lowering model complexity.
Use top n features from variable importance chart. May be, with all the variable in the data set, the algorithm is having difficulty in finding the meaningful signal.

    Your Comment






Search
Can you Answer!!
  • Q To display a value in the console, what Python keyword do you use?
  • Q How can you retrieve data from the ResultSet?  
  • Q What is phellogen? What is its function?
  • Q Asian School of Cyber Laws is at :
  • Q How to access vsam file?
  • Q Difference between vector and arraylist?
  • Q Write Notes on Real time PCR
  • Q What do you understand by Header linked List?
  • Q Tell me what educational courses are available for aquaculture?
  • Q When a therapeutic dose of ACE inhibitors have been given in a diabetic after an anterior ST elevation myocardial infarction with an ejection…
  • Q How many mod 3 counters are required to construct mod 9 counter.