Question
Why is there a need for broadcast variables when working with apache spark?
Answers
These are read only variables, present in-memory cache on every machine. When working with Spark, usage of broadcast variables eliminates the necessity to ship copies of a variable for every task, so data can be processed faster. Broadcast variables help in storing a lookup table inside the memory which enhances the retrieval efficiency when compared to an RDD lookup ().   Your Comment




  • Contributors: *,
More Software Questions..
What is the inputsplit in map reduce software?
What is software configuration management?
What Is Java Api For Xml-based Rpc (jax-rpc)?
How can you implement fine-grained auditing?
What is IBM’s simple explanation for Big Data’s four critical features?
What is static synchronized method in JDBC API? Give an example?
What does the NULLIF function do?
What happens if a start method is not invoked and the run method is directly invoked?
Should we override finalize method
what is the difference between mysql_fetch_array and mysql_fetch_object?
How will XML affect my document links?
Why to use Style Sheets?
What are Filters in MVC?
Can you explain Application layer in OSI model?
How to define new testplan attributes?
What are the minimum system requirements to run Photoshop? Is it possible to run Photoshop over linux?
Which oracle package is used to manage the oracle lock management services?
What is Latch Up? Explain Latch Up with cross section of a CMOS Inverter. How do you avoid Latch Up?
What is marker interface?
What types of partitioning are there for BW?


Search
Can you Answer!!
  • Q A+B+C+D=D+E+F+G=G+H+I=17 where each letter represent a number from 1 to 9. Find out what does letter D and G represent if letter A=4.
  • Q Who was the Chinese pilgrim who visited India during the time of Chandragupta II?
  • Q Have you used sampling? What are the various types of sampling have you worked with?
  • Q What is the full form of T9?
  • Q What are the four objectives of the selection of a data type?
  • Q What is descriptive programming
  • Q what is the difference between IList and IEnumerable
  • Q Always ask permission from the judge before stepping down from the witness stand. (A)True (B)False
  • Q what is the abbreviation of DMRC
  • Q What is a weighted graph?
  • Q What is the advantage of afd?