Question:

What is robots.txt?

Answer:

Robots.txt is a text file. It is through this file, it gives instruction to search engine crawlers about indexing and caching of a webpage, file of a website or directory, domain.


Keywords:

© 2017 QuizBucket.org