23 Comments

  1. Nina Westerback
    January 13, 2016 @ 7:47 pm

    Hi, I installed the Robots.txt File plugin to edit my robots file. But when I go to Settings > Reading, it does not show my currect Robots file, but the default. My current one, which I want to edit because it prevents some crawling I need to allow, is much longer. If I edit this one in Settings > Reading and save it, nothing seems to happen, it’s like the existing one stays there anyway. Or is there a delay?

    Reply

    • Editorial Staff
      January 13, 2016 @ 8:57 pm

      If you use one more way to add the robots.txt then it will be problem. You can add the text in Settings > Reading Robots.txt box. Then remove that content from all others way. And there is no delay for it. If you still having this issue let me know. Thanks!

      Reply

  2. Nina Westerback
    January 13, 2016 @ 9:34 pm

    There came a robots.txt file included in the theme I installed. It’s very long, disallowing a whole list of things. I haven’t added anything, it just was there when I changed the theme. I want to allow crawling now. This plugin says it can edit an existing robots.txt file, but is this then not true?

    Reply

    • Editorial Staff
      January 13, 2016 @ 10:41 pm

      It’s editing existing robots.txt file but i said to use single way. But no worry the new robots.txt is using from this plugin. If the old one is keep there that’s inactive. Okay

      Reply

  3. Muhammad Tariq
    January 14, 2016 @ 4:45 pm

    well, that is working for my site, but if i need to configure my robot.txt file for Google webmaster tools, this plugin do not offer me an option to put a url suppose http://www.mysite.com/robot.txt . can you plz update that how to make it viable for google, so it access it and find my site robots.txt information. thanks
    Regards,

    Tariq

    Reply

    • Editorial Staff
      January 15, 2016 @ 2:00 am

      why you need to visible this? It’s an security issue if you make it visible. And normally all others using it as non-visible content. But only google can read this.

      Reply

  4. Morgan
    January 29, 2016 @ 11:25 pm

    Hey!

    I used your plugin to make some changes but the changes aren’t being reflected on the live robots.txt file. I cleared the cache on my browser and in the WP caching plugin, many times – but it doesn’t help. Any suggestions? Thanks!

    morgan

    Reply

    • Editorial Staff
      February 2, 2016 @ 10:28 pm

      If you use double way to run robot txt on blog then it will be sometime problem. So please try with this one and deactivate another one. Hope it will work fine there. Thanks!

      Reply

  5. Jill S
    February 3, 2016 @ 10:04 am

    Hi, I am trying to deactivate the robots.txt file so I can run Screaming Frog Application. It keeps telling me my website is blocked. I have tried changing the code in your plug-in to without success.

    User-agent: *
    Disallow:

    I have tried deactivating the plugin – no success

    I have gone to my hosting file manager and cannot seem to find the robots.txt file there.

    Could you please advise how I can short term disable the plugin? Greatly appreciated

    Reply

    • Editorial Staff
      February 3, 2016 @ 10:41 am

      Do you want to deactivate this plugin? Or want to remove any other? If you want to remove this one then just go to active plugins from dashboard then deactivate it. Thanks!

      Reply

  6. Anne Wilson
    September 13, 2016 @ 5:40 am

    Hi,
    I was told by google to edit the robots.txt file so that they can crawl it but I don’t know what to edit. This is what I see.
    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php

    That’s all I see. What should I delete or add? Thanks for your advice.

    Anne.

    Reply

    • Joe
      October 13, 2016 @ 7:34 pm

      same thing for me
      i want Google to search my entire site

      Reply

    • Ataul Ghani
      October 13, 2016 @ 10:24 pm

      Anne & Joe, Please see the sample how you can do this:

      User-Agent: *
      Disallow: /wp-admin/
      Allow: /wp-admin/admin-ajax.php
      Allow: /wp-content/uploads/
      Disallow: /wp-content/plugins/
      Sitemap: http://www.example.com/sitemap.xml

      Thank You!

      Reply

  7. vino
    November 15, 2016 @ 9:36 pm

    hi

    used robots.txt in wordpress http:// its working fine, but robots.txt in wordpress https:// not workings show error
    404 not found can you help on this.

    Reply

    • Ataul Ghani
      November 19, 2016 @ 12:28 pm

      Sorry to hear about that issue! Please can you email me details about it. It will be better to assist you. Thanks!

      Reply

  8. pranita deshpande
    January 1, 2017 @ 3:25 pm

    Why did my comment is not shown . I have completed all this applicationclearly but failed to fit robottxt file.

    Reply

    • Ataul Ghani
      January 2, 2017 @ 12:47 am

      What’s the issue? Can you explain me details please?

      Reply

  9. Mike
    February 16, 2017 @ 10:55 pm

    My web site was recently hacked. The robots.txt file was added during this hack. Robots does not show in my plug ins How do I get rid of it? It seems as if many malware attempts are being made to access this page

    Reply

    • Ataul Ghani
      February 17, 2017 @ 11:58 pm

      Are you using my plugin? If so you should configure it to rejects malware and boots. Please can you buy pro support and send me a private email using contact. Thanks!

      Reply

  10. divamivijayVijay
    March 13, 2017 @ 11:45 am

    I changed the content of robots,txt file and acces http:/url/robots.txt.It is showing old text.Not new.

    Reply

    • Ataul Ghani
      March 14, 2017 @ 12:06 am

      Please send me the link then i can help you. Thanks!

      Reply

  11. Prem
    September 10, 2017 @ 10:25 pm

    Hi there,

    My site “sportskanazee.com” is not indexed by google and whenever i’m searching for my website on google, it throws a message i.e.

    A description for this result is not available because of this site’s robots.txt

    Though i have unchecked the box on “reading” i.e. Discourage search engines from indexing this site on wordpress, still after one week, the message i get on google is “A description for this result is not available because of this site’s robots.txt”

    Kindly help solving this issue so that my website is indexed on google and my site will get ranking.

    Thanks n Regards
    Prem

    Reply

    • Ataul Ghani
      September 11, 2017 @ 2:22 am

      Hey,
      I understand your issue. Please kindly contact with me via live chat on bottom right tab. I will give you best solution on it.
      Thanks!

      Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to Top