A blogger who has SEO knowledge knows about custom robots.txt and header tag.But it is unfamiliar to new blogger.This feature found in blogger search preferences option.Which help search engines to crawl your site properly and also helps to index your blog posts to them.Custom robots.txt and header tag is basic tool for SEO.But you have to edit this setting carefully.Because Incorrect use of these features can result in your blog being ignored by search engines.So I am writing about how to add custom robots.txt and header tag in blogger.
How to Enable Custom robots.txt for Blogger:-
Go to your blogger dashboard>Setting>Search preferences>custom robots .txt:edit>Enable custom robots.txt content?:Yes Now add the codes given below>Save changes
User-agent: Mediapartners-Google
Disallow:
# Blogger Sitemap generated on 2013.11.04
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://alltricks24.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500
Here you just replace my blog URL(alltricks24)with yours.Now click save changes button.You can edit the date as when you are editing robots.txt
How To Set Custom Robots Header Tag:-
Go to your blogger dashboard>Setting>Search preferences>Custom robots header tags:edit>
Simply tick on the option as shown in the image below:
Now press save changes button.You are almost done.You have added custom robots.txt and header tag successfully.