Hello friends,
today I am going to write regarding the thanks to add a robots.txt and
sitemap.xml into internet web site
First of all it’s
important to know what is Robots.txt and Sitemap.xml file. I justify a fast
introduction here for extra information regarding those searches Google.
Robots.txt
Each search engine have
its own crawlers like robots, scooters etc. When these crawlers go to any
internet web site first of all they check the robots.txt file and then crawl
the entire internet web site. In line with robots.txt file permission they
crawl an online web site. as an example if I prohibit the Google crawler to
contact us page then my contact us page is not crawled. This could be an idea
regarding Robots and why we have a tendency to tend to use the Robots.txt file.
Here is that the subsequent code that is used for robots.txt file.
user-agent:*
Disallow:
Use * and leave blank
field in front of disallow if you want to allow all robots to crawl your
internet web site. You will be able to prohibit a page by using following code.
user-agent: *
disallow: /cgi/
This code offer the instruction to crawlers to not crawl a page with cgi name.
How to upload it in website
After finishing the coding
of Robots.txt in Notepad, place it aside with robots.txt name. currently Use
FTP server to upload it and upload it inside the basis directory of your
internet web site.
What is Sitemap.xml
Sitemap.xml and
sitemap.html are two sorts of sitemaps. Sitemap.Xml can be a kind of sitemap
that is used only for crawlers. Sitemap can be a file that makes an internet
web site straightforward to travel to. When crawlers come to website then in
line with sitemaps they crawl the overall site. Sitemap.xml is formed by using
varied on-line tools like http://www.xml-sitemaps.com/. Enter your internet web
site url here and download the coding file. Save the same file in notepad with
sitemap.xml file and upload it in Root directory of your internet web site.
I hope this
temporary description offer you with set up regarding Robots.txt and
Sitemap.xml. If this post assists you then Like my facebook fan page and follow
my blog.
Partner site : online news
.jpg)
