Question
What is robot.txt & why we use it?
Answers
Web Robot are known as crawlers, spiders. And robot.txt use to give instructions to these Web robots. Using this file a website owner can block robots to follow some link in website. Ex: User-agent: * Disallow: / Above code means website owner restricting all (“*”) to visit whole website(“/”).   Your Comment




  • Contributors: *,
More Software Questions..
What is the inputsplit in map reduce software?
What is software configuration management?
What Is Java Api For Xml-based Rpc (jax-rpc)?
How can you implement fine-grained auditing?
What is IBM’s simple explanation for Big Data’s four critical features?
What is static synchronized method in JDBC API? Give an example?
What does the NULLIF function do?
What happens if a start method is not invoked and the run method is directly invoked?
Should we override finalize method
what is the difference between mysql_fetch_array and mysql_fetch_object?
How will XML affect my document links?
Why to use Style Sheets?
What are Filters in MVC?
Can you explain Application layer in OSI model?
How to define new testplan attributes?
What are the minimum system requirements to run Photoshop? Is it possible to run Photoshop over linux?
Which oracle package is used to manage the oracle lock management services?
What is Latch Up? Explain Latch Up with cross section of a CMOS Inverter. How do you avoid Latch Up?
What is marker interface?
What types of partitioning are there for BW?


Search
Can you Answer!!
  • Q Animals which suckle their young ones
  • Q Periyar River is falls in to
  • Q Form books are useful for lawyers. (A)True (B)False
  • Q Does orbix support oracle jrockit java virtual machine?
  • Q Fathers age is 5 times his son's age. 4 years back the father was 9 times older than son.Find the fathers' present age.
  • Q An American in Maine got a divorce cos wife fed him only what
  • Q Describe the political system by which people govern themselves in band societies.
  • Q BMB’s initial capital
  • Q What is 'State of the art' (A)Something that has not been invented yet (B)Something that you have bought (C)Something that is just about to revealed to the public
  • Q What are some examples of the control and informative function of organic molecules?
  • Q Explain what is the use of “Air Abrasion”?