How to Optimize Your WordPress Robots txt for SEO

By | August 21, 2019


Welcome to WPBeginner and thank you for watching.
In today’s video, you’ll learn how to optimize your WordPress robots.txt for SEO. If you are working on your site’s seo, then
knowing how to tweak the robots.txt file will play a role. Search engines look for your xml sitemap in
the robots.txt file so it’s important to have one for them. It’s usually in the root folder for your site
and you can get to it either by using an ftp client or just accessing it through your cpanel
file manager. Here is a sample robots.txt file. Here we’re saying that all bots can index our upload folder, but not our plugins folder nor the readme file. Below this area, we’ll add links to the sitemap
so the bots know where to what all to index which should help with seo. If you like this video click on the like button and go ahead and leave us a comment there, we’d love to hear from you. And subscribe to our Youtube channel to get the latest videos.

2 thoughts on “How to Optimize Your WordPress Robots txt for SEO

  1. Zenaide Key Post author

    What is SEO please?
    I would like a video on how to reference your website to have more view.
    Thanks!

    Reply
  2. Piano Daddy Post author

    Hi, i have a new domain and when i enter it in webmaster's sitemap i am getting error "URL restricted by robots.txt". Firstly i don't have robots file in root folder, but as webmaster asked i created 1 for this. but still getting same error.. Can you please tell me why?? i am using Google XML Sitemaps v3 for qTranslate plugin for generating sitemap.

    I figure out a issue.. when i install seo plugin it cause error and when i remove seo plugin its working fine.. Confused ๐Ÿ™

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *