The Blog That Is No More
This Blog has moved to http://www.success.grownupgeek.com
Friday, April 27, 2007
  Drupal: Make an SEO Friendly ROBOTS.TXT

Google is very picky about duplicate pages and may penalize your site if it finds too much (or any?) duplicate content. To help squeeze a little-bit more SEO friendliness out of Drupal you can add a few entries to your ROBOTS.TXT to avoid duplicate pages from being indexed and keep the search-bots away from pages that they don't really need to be in.

If you are using Drupal 5 or older, try adding these entries to your ROBOTS.TXT

User-agent: *
Disallow: /admin
Disallow: /aggregator
Disallow: /tracker
Disallow: /node/add
Disallow: /user
Disallow: /files
Disallow: /search
Disallow: /book/print
Disallow: /filter
Disallow: /filter/tips
Disallow: /comment
Disallow: /comment/reply
Disallow: /spam
Disallow: /spam/report
Disallow: /spam/report/comment

Labels: ,

 
Comments:
Hey Randy,

Good to meet you this afternoon -- here is the article I mentioned about cutting down on duplicate content on a Drupal website; there are a few additional things you can do. Please take a look and please let me know what you think:

http://blamcast.net/articles/drupal-seo
 
Hey Pitumbo;
that is an excellent article.. That is the first I have heard of the trailing-slash issue with Drupal. I'm going to implement that .HTACCESS change myself.
 
Post a Comment

Subscribe to Post Comments [Atom]



Links to this post:

Create a Link



<< Home

__________________________