What is Robots.txt | How to Create Robots.txt File ? | Seo Tutorial For Beginners in Tamil | #18

In this video, you will learn what is a robots.txt file, why do you need it, how to SEO optimize it and how to test that search engines can access it without any problems.
#seotutorial #seotutorialforbeginners #seo

Advanced Seo Tutorial in Tamil
Technical SEO Checklist #18


1.What is robots.txt?
The robots.txt is a text file that tells to search engines which pages on your site to crawl and which pages not to crawl.

The contents of a robots.txt are publicly available in the Internet. anyone can view your robots.txt file

2.How does robots.txt work?
The robots file has a very simple structure. There are some predefined keyword combinations you can use.

The most common are:
User-agent
Disallow
Allow
Crawl-delay
Sitemap

Check out my previous videos

Technical SEO Checklist in Tamil [2020] | Seo Tutorial for Beginners in Tamil | Part-17
   • Technical SEO Checklist in Tamil [202...  

What is Twitter Card Meta Tags? | How to use Twitter Card Tags for website | SEO in Tamil | #16
   • What is Twitter Card Meta Tags? | How...  

What is Open Graph Meta Tags? | How to use OG meta tags for website | On Page SEO in Tamil | #15
   • What is Open Graph Meta Tags? | How t...  

What is Meta Robots Tag? | How to use Index, Noindex, Follow, Nofollow | On Page SEO in Tamil | #14
   • What is Meta Robots Tag? | How to use...  

What is URL Optimization? | How to do URL Optimization for SEO | On Page SEO in Tamil | Part-13
   • What is URL Optimization? | How to do...  

What is Image Optimization ? | How to write Alt Tags for SEO | On Page SEO in Tamil | Part-12
   • What is Image Optimization ? | How to...  

What's a Canonical URL Tag? | Why its important for SEO? | On Page SEO Tutorial in Tamil | Part-11
   • What's a Canonical URL Tag? | Why its...  

What is header Tag? | Why is the H1 H2 tag so important to improve your SEO | On Page SEO Tamil |#10
   • What is header Tag? | Why is the H1 H...  

What is Meta Description Tag? | How to Write Perfect Description Tag | On Page SEO in Tamil | #09
   • What is Meta Description Tag? | How t...  

What is Title Tag? | How to Write the Perfect Title Tag for SEO | On Page SEO in Tamil | Part-08
   • What is Title Tag? | How to Write the...  

What is On page SEO? | How to do on page SEO in Tamil | Guide For Beginners [2020] | Part-07
   • What is On page SEO? | How to do on p...  

What is SEO Audit? | How to do SEO Audit ( REPORT ) for website in Tamil | SEO Tutorial in Tamil #06
   • What is SEO Audit? | How to do SEO Au...  

What is Competitor Analysis in Tamil | How to do Competitor Analysis | SEO Tutorial in TAMIL | #05
   • What is Competitor Analysis in Tamil ...  

What is keyword research? | How to do Keyword Research for SEO in Tamil [2020] | Part-04
   • What is keyword research? | How to do...  

What is On-Page SEO & Off-Page SEO in Tamil | Advanced SEO Tutorial in TAMIL 2020 | Part-03
   • What is On-Page SEO & Off-Page SEO in...  

Types of SEO Techniques in Tamil | Advanced SEO Tutorial in TAMIL | Part-02
   • Types of SEO Techniques in Tamil |  A...  

What is SEO (Search Engine Optimization)? | Advanced SEO Tutorial in TAMIL 2020 | Part-01
   • What is SEO (Search Engine Optimizati...  

Instagram Ads in Tamil | How To Create Instagram Ads (Step-By-Step) in 2020 | Part-01
   • How To Create Instagram Ads in Tamil ...  

Facebook Ads Tamil | How to Create a Facebook Ads Campaign in 2020 | Simplified E-learning | Part-01
   • Facebook Ads Tamil | How to Create a ...  

Google Search Console in Tamil | How to Set Up Google Search Console to improve your SEO | Part-01
   • Google Search Console in Tamil | How ...  

Google Ads Tutorial For Beginners in Tamil 2020 Basic Campaign Creation Part-01
   • Google Ads Tutorial For Beginners in ...  

How To Setup Google My Business Step by step for Beginners
   • How to Create & Verify Your Google My...  

Google Analytics in Tamil | What is Google Analytics | How does Google Analytics work? | Part-01
   • What is Google Analytics in Tamil | H...