Want to work your way up in SERPs? Get and share ideas on link building, on/off page optimizing, social SEO and more.

robot.txt help
affiliatee
Posts: 14
Joined: 28 May 14
Trust:
19 Sep 14 6:59 pm

robot.txt help

I have a free wordpress blog, can i upload a robot.txt file to it?
if so how?
  • 0
Make your first $100 online (#1 best-selling author shows you how with his free training software) -> http://www.operationquickmoney.com/noww

make between $100 to $1000... in 2 weeks? http://download.oqmhandbook.com/noww
 
fvaffiliates
Posts: 10
Joined: 02 Sep 14
Trust:
21 Sep 14 11:09 am

 free means.. you are using wordpress.com ... if yes, you can not upload robot.txt because it is hosted on wordpress server and you dont have access to that... instead, you can goto settings->Reading- to update the settings ...
  • 1
Shaishav Sood
(An Affiliate Marketer)
 
affiliatee
Posts: 14
Joined: 28 May 14
Trust:
21 Sep 14 12:46 pm
admin252 wrote: instead, you can goto settings->Reading- to update the settings ...


could you be a bit more specific on that please.

Thanks
  • 0
Make your first $100 online (#1 best-selling author shows you how with his free training software) -> http://www.operationquickmoney.com/noww

make between $100 to $1000... in 2 weeks? http://download.oqmhandbook.com/noww
 
fvaffiliates
Posts: 10
Joined: 02 Sep 14
Trust:
21 Sep 14 1:55 pm

 basically, you cannot change or upload any text file to free wordpress blog .. but you can change the setting so that Google can crawl your blog... the settings can be changed here...

After login, Goto Settings->Reading and make sure the option "Allow search engines to index this site" is enabled .. (settings option can be found in the left menu)
  • 0
Shaishav Sood
(An Affiliate Marketer)
 
affiliatee
Posts: 14
Joined: 28 May 14
Trust:
21 Sep 14 7:46 pm

 Can you edit the robot.txt from Google Webmaster -> crawl -> Robot.txt tester?
  • 0
Make your first $100 online (#1 best-selling author shows you how with his free training software) -> http://www.operationquickmoney.com/noww

make between $100 to $1000... in 2 weeks? http://download.oqmhandbook.com/noww
 
Site Admin
aletta
Posts: 3392
Joined: 09 Jul 06
Trust:
21 Sep 14 10:20 pm

 You can't edit your actual robots.txt file from inside webmaster tools. There is an "edit" feature inside the tester, but this is just to allow you to test what would happen if you changed your robots.txt file. (eg, edit it a bit and see if the Googlebot behaved differently.)

To save any edits you make, you'd need to be able to copy and paste that into your actual robots.txt file, which lives on your own web server.

More info here: https://support.google.com/webmasters/a ... ic=6061961

Can you tell us what you're trying to do with your robots.txt? Are you trying to block something, or allow something? As admin252 mentioned, if you want to *allow* robots there will be that setting inside your blog settings.

Keep in mind that using a hosted blog like Wordpress.com (not to be confused with Wordpress.org) does severely restrict your ability to do a lot of things with your website. This is why we don't really recommend using a hosted blog for your main money-making website.
  • 0
Are your changes not showing up on your website? Try doing a hard refresh! http://www.refreshyourcache.com/en/cache/
 
publifish
Posts: 10
Joined: 03 Oct 14
Trust:
01 Nov 14 1:39 am

 Hi Aletta,

I have a follow-up question about this as well. One of the "issues" on my affilotools health check is that I don't have the robot.txt file. If I purchased my site through affilojetpack, then how can I access my site through FTP so as to upload the robot.txt file? I don't think it's a free wordpress site, right? I'm pretty sure it's a paid and therefore I should have FTP access..... correct?

Thanks!
  • 0
Site Admin
aletta
Posts: 3392
Joined: 09 Jul 06
Trust:
03 Nov 14 8:59 pm

 AffiloTools is a little bit paranoid about robots.txt files. It is not essential that you have a robots.txt -- you only need it if you are trying to block search engines from particular pages. None of my sites have a robots.txt. You can just ignore this.
  • 1
Are your changes not showing up on your website? Try doing a hard refresh! http://www.refreshyourcache.com/en/cache/
 
publifish
Posts: 10
Joined: 03 Oct 14
Trust:
03 Nov 14 9:02 pm

 Got it - thanks! I'll scratch "fix robots.txt" off my to-do list now. :)
  • 0
Site Admin
aletta
Posts: 3392
Joined: 09 Jul 06
Trust:
03 Nov 14 10:49 pm

 I've also asked the AffiloTools boffins to look into reducing the paranoia over robots.txt files. It really isn't necessary, and shouldn't be flagged with that big scary red thing.

So hopefully it'll be able to take a chill pill soon :)
  • 0
Are your changes not showing up on your website? Try doing a hard refresh! http://www.refreshyourcache.com/en/cache/
 
dmellojesse
Posts: 11
Joined: 20 Oct 14
Trust:
04 Nov 14 6:38 am

 It is very easy. You just have to create one robots.txt file and upload it in root folder.
  • 0
chimborazo
Posts: 100
Joined: 21 Nov 08
Trust:
18 Nov 14 4:30 pm

 Just FYI guys,

You can use a plugin called "WP-FileManager" by Anant Shrivastava, Johannes Ries to upload files (or download files) to the Wordpress server.

And you might want to use a robot.txt file or a meta tag no follow code I just learned of (in your header) on certain pages you don't want coming up in organic searches, like your free ebook's download page for instance.

John
  • 0
cliftoraf
Posts: 11
Joined: 20 Oct 14
Trust:
17 Dec 14 9:51 am

 Upload WP Robots Txt Plugin and change the setting according to your requirement.
  • 0
alpa
Posts: 16
Joined: 02 Feb 15
Trust:
10 Feb 15 10:16 am

 robots.txt is text file use easily your website that allow *.
  • 0

This topic was started on Sep 19, 2014 and has been closed due to inactivity. If you want to discuss this topic further, please create a new forum topic.

Topic locked