Warning: realpath() [function.realpath]: open_basedir restriction in effect. File(/wp-content/uploads) is not within the allowed path(s): (/var/www/vhosts/davestopherseo.co.uk/httpdocs:/tmp) in /var/www/vhosts/davestopherseo.co.uk/httpdocs/wp-includes/functions.php on line 2058

Warning: is_dir() [function.is-dir]: open_basedir restriction in effect. File(/wp-content/uploads/wpcf7_uploads) is not within the allowed path(s): (/var/www/vhosts/davestopherseo.co.uk/httpdocs:/tmp) in /var/www/vhosts/davestopherseo.co.uk/httpdocs/wp-content/plugins/contact-form-7/modules/file.php on line 325

Warning: Cannot modify header information - headers already sent by (output started at /var/www/vhosts/davestopherseo.co.uk/httpdocs/wp-includes/functions.php:2058) in /var/www/vhosts/davestopherseo.co.uk/httpdocs/wp-includes/feed-rss2.php on line 8
Dave Stopher SEO » robots http://www.davestopherseo.co.uk Fri, 20 Aug 2010 09:18:40 +0000 en hourly 1 http://wordpress.org/?v=3.0.1 Stopping Google From Seeing Your Secure Pages http://www.davestopherseo.co.uk/stopping-google-from-seeing-your-secure-pages-54/ http://www.davestopherseo.co.uk/stopping-google-from-seeing-your-secure-pages-54/#comments Wed, 03 Jun 2009 20:43:31 +0000 dave stopher seo http://www.dave-s.net/?p=54 Stopping Google From Seeing Your Secure Pages is a post from: Dave Stopher SEO

]]>
I have come up against this small probelm lately. I wanted to rewrite one of my sites so that my https pages would not get cached by google.

There is one easy wsay to do this that work for me. What you need to do is first make a second robots file and call it whatever you want for this example I will call it Robots_ssl.txt

With this robots file place the below bit of script.

user-agent: *

Disallow: /

This will prevent any spiders from going on your site.

Now the bit that tell the spiders if they follow this rule or not. This bit of script needs to be placed in the .htacces file on the server. (be warned that this only works on an apache server).

RewriteEngine on
Options +FollowSymlinks
RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots_ssl.txt

This should tell the spiders that if the pages is a https(server 443) then follow the robots file shich is called robots_ssl.txt.

So this therefore will stop any pages from being cached. If you have already got pages cached however you just need to register your https site with google webmaster tools and then you need to remove the site from the listing.

Stopping Google From Seeing Your Secure Pages is a post from: Dave Stopher SEO

]]>
http://www.davestopherseo.co.uk/stopping-google-from-seeing-your-secure-pages-54/feed/ 3