|
At first, the question arises as to how one should start his activity and what steps should be taken . However, before you start developing your website, there is one small but important thing you should do: prevent your site from being indexed by Google and other search engines. If you are still developing your site and you don't want search engines to index your website content, you can use the methods presented in this tutorial. At the time of site design or when you plan to make many changes to your site, pages that are being designed and incomplete may be indexed by Google robots. It is natural that at this stage, mistakes may be made or the content that you have included as a demo on the site may be indexed by Google robots. This is why it is recommended to temporarily prevent search engines from crawling and indexing your site until you get past the initial development phase.
Why should you prevent search engines from indexing your site? Sometimes people want to discourage phone numbers list search engines from indexing their site, some of their reasons are listed below : Unfinished Websites - At this stage when you are debugging and testing the site, it is better not to make your website available to the public. Restricted Websites - If you plan to have an invitation-only website and you don't want this site to be listed in the SERPs (Search Engine Result Page). Demo accounts - site owners who run a copy of their site for trial and testing purposes. Since these sites are not designed for the general public, do not allow them to be indexed by search engines. So how can you prevent search engines from indexing your site? Below are some solutions to do this. Block Google and other search engines using the Robots.txt file The easiest way to prevent search engines from indexing your site content is to prevent them from crawling. To do this, you need to edit your website's robots.txt file. Here are some ways to do this: Enter the WordPress admin area, click on read from the settings section. picture(1) Scroll down to see the " Show to Search Engines " option. Check the option that says " Ask search engines not to check site content " and then click " Save Changes ".

WordPress will automatically edit the robots.txt file for you and put the following code in the robots.txt file: User-agent: * Disallow: / picture (2) Manually edit the robots.txt file If you prefer to manually edit the robots.txt file, you can use File Manager or FTP to edit the robots.txt file. Log in to CPanel and then click on " File Manager " in the " Files " section. picture(3) Go to the root folder of your WordPress site (in most cases it's public_html) and find the robots.txt file. If you can't find it, create a new empty file called robots.txt. Right click on the file and select " Edit ". picture (4) Enter the following command (number 1) and then click on " Save Changes " (number 2) to apply the changes: User-agent: * Disallow: / picture (5) The code above prevents search engines from indexing your entire site. If you want to limit the access of search engines to a certain page, put the sub-category of the desired page in the above code.
|
|