=== Multipart robots.txt editor === Contributors: szepe.viktor Donate link: https://szepe.net/wp-donate/ Tags: google, robot, robots, robots.txt, search, seo, crawlers, spiders, editor Requires at least: 4.7 Tested up to: 4.9.2 Stable tag: 0.4.0 License: GPLv2 Customize your site's robots.txt and include remote content to it == Description == = This plugin needs more documentation! = You can edit your robots.txt and add remote content to it. E.g. you have several sites and want to use a centralized robots.txt. = Features = - Include or exclude WordPress' own robots.txt (core function) - Include or exclude plugins - e.g. sitemap plugins - output to robots.txt (filter output) - Include or exclude a remote text file (the common part) - Include or exclude custom records from the settings page (the site specific part) = Where is robot.txt? = WordPress handles robots.txt as a virtual URL - just the same way as posts and pages. So when you browse to `https://example.com/robots.txt` WordPress generates robots.txt on the fly. = TODO = - add more description here - add a video too - add an admin notice for subdir installs (robots.txt is useless in a subdir) - 'At least one "Disallow" field must be present in the robots.txt file.' - check for that = Links = Development of this plugin goes on on [GitHub](https://github.com/szepeviktor/multipart-robotstxt-editor). == Installation == This section describes how to install the plugin and get it working. 1. Upload the content of the ZIP feil to the `/wp-content/plugins/` directory 1. Activate the plugin through the 'Plugins' menu in WordPress == Frequently Asked Questions == = Where is robot.txt? Why isn't it generated at WordPress root directory? = WordPress handles robots.txt as a virtual URL - just the same way as posts and pages. So when you browse to `https://example.com/robots.txt` WordPress generates robots.txt on the fly. = How often will be the remote text file downloaded? = Every 24 hours and when you press the Sava Changes button on the setting page. == Changelog == = 0.4.0 = * After Shiny Updates (AJAX plugin actions) it was not possible to uninstall = 0.3.0 = * Prettify and sort output (thus the final robots.txt) by [Robots.txt-Parser-Class by @t1gor](https://github.com/t1gor/Robots.txt-Parser-Class) * Update core's default robots.txt content = 0.2.2 = * Added explanation about robots.txt file - NO code change = 0.2.1 = * Googlebot needs CSS and JS files * Introducing semver = 0.2 = * Fixed some serious PHP Notices, sorry = 0.1 = * Initial release