Googlebot is a web crawler of Google to indexing the websites.
Googlebot is a software which are indexing the websites in Google Search Engine.
If you want to crawl all the pages of your website then simply add Sitemap in your website. The sitemap can easily crawled by Googlebot.
If you want to restrict your website by Googlebot then simply add the following Meta Tag in your HTML page.
No comments:
Post a Comment