WP Robots Txt

Description

WordPress, by default, includes a simple robots.txt file that’s dynamically generated from within the WP application. This is great! but maybe you want to change the content.

Enter WP Robots Txt, a plugin that adds an additional field to the “Reading” admin page where you can do just that.

Simply visit https://your-site.com/wp-admin/options-reading.php and you can control the contents of your https://your-site.com/robots.txt

Changelog

WP Robots Txt was originally developed by chrisguitarguy. The plugin has been adopted and updated by George Pattihis who will continue development.

Screenshots

  • A view of the admin option

Installation

  1. Download the plugin
  2. Unzip it
  3. Upload the unzipped folder to wp-content/plugins directory
  4. Activate and enjoy!

Or you can simply install it through the admin area plugin installer.

FAQ

I totally screwed up my `robots.txt` file. How can I restore the default version?

Delete all the content from the Robots.txt Content field and save the privacy options.

Could I accidently block all search bots with this?

Yes. Be careful! That said, robots.txt files are suggestions. They don’t really block bots as much as they suggest that bots don’t crawl portions of a site. That’s why the options on the Privacy Settings page say “Ask search engines not to index this site.”

Where can I learn more about `robots.txt` files?

Here is a general guide by Google and here is the WordPress SEO documentation.

Reviews

অক্টোবর 21, 2022
Ottimo ti basta attivar il plugin
January 15, 2018
Good code, nice interface. It doesn't have builtin dynamic replacement functionality (like, {siteurl}/sitemap_index.xml), but it can be added with a simple filter. Thanks for the great plugin!
সেপ্টেম্বর 3, 2016
Simple plugin that helped me to fix a js. problem in Google search
ফেব্রুয়ারী 7, 2017
I am using this plugin to overcome my robots.txt problem. This is very useful plugin. http://www.gemstonesprices.in Amethyst Stone
Read all 17 reviews

Contributors & Developers

“WP Robots Txt” is open source software. The following people have contributed to this plugin.

Contributors

“WP Robots Txt” has been translated into 4 locales. Thank you to the translators for their contributions.

Translate “WP Robots Txt” into your language.

Interested in development?

Browse the code, check out the SVN repository, or subscribe to the development log by RSS.

Changelog

1.2

  • Update the default robots.txt content
  • Include sitemap reference
  • Resolve code warnings/errors
  • WP Coding Standards compliant
  • Ensure Compatibility with WP v6

1.1

  • Moved the settings field “officially” to the reading page
  • General code clean up

1.0

  • Initial version