Aug 21 2007
Yahoo Site Explorer Deals with Dynamic URLs Print
Tuesday, 21 August 2007

Recently we've talked about how Google's Webmaster Console has been getting better, although it still needs a lot of work.


Today it got a stiff kick in the backside from Yahoo who keep rolling out neat new features for on their rival to Webmaster Console: Site Explorer. What is Yahoo's cool new tool?

A Solution for Dynamic URLs

Let imagine that you've set up a tracking URL for a banner ad such as alledia.com/?ad_id=1234, which is basically a duplicate URL for alledia.com. You can tell Yahoo that anything that conforms to the "ad_id" parameter following the ? will by a duplicate URL to the primary and Yahoo will rewrite the URL to default to the primary.

When Will This Be Useful?

It can be used to remove all of these from Yahoo's index:


You can use a tool such as WebCEO to create a list of all the pages indexed on your site and make a list of those you want to remove.

Remind Me Again Why I Want to Remove Pages from Google and Yahoo...

Back in the days when websites were hard to build, large websites would generally outrank small websites. However, now that scrapers can create 1000 page websites in the time it takes to read this sentence, things aren't so simple. Sometimes less is more. If a page doesn't have any useful information or if its a duplicate of another, better-established page, then you should remove it from search engines. Yahoo's blog sums it up well.


"Utilizing the 'Dynamic URL Rewriting' feature enables:

  • A more efficient crawl of your site, with fewer duplicate URLs being crawled.
  • Better and deeper site coverage, as we'll be able to use our crawler capacity to find and index more new content on your site."


Comments (1)Add Comment
robots.txt
written by trichosis, August 26, 2007
i'm having the same problem but i have solved it with adding

disallow:/*?*


to my robots.txt

Write comment
quote
bold
italicize
underline
strike
url
image
quote
quote
smile
wink
laugh
grin
angry
sad
shocked
cool
tongue
kiss
cry
smaller | bigger

busy
 
Joomla SEO Club and Book Logo
Search
Login
Blog Details

Subscribe by RSS

Creative Commons License All blog articles are licensed under a Creative Commons Attribution 3.0 United States License.
Top Comment Posters
Good Web Practices
(114 comments)
Klaus Nitsche
(78 comments)
Brian Teeman
(67 comments)
Hummerbie
(35 comments)
guido
(34 comments)
Ansiklopedi
(30 comments)
Amy Stephen
(29 comments)
Yannick Gaultier
(28 comments)
Cory
(27 comments)
Anthony Olsen
(18 comments)
Blog Categories
Accessibility
Affiliates
Alledia News
Analytics
Book Reviews
Business
Design
Domain Names
Domain Tips & Tricks
Drupal
E-Commerce
Extensions of the Month
General CMS Issues
Interviews
Joomla Affiliates
Joomla 1.5
Joomla Blogs
Joomla Hacks
Joomla Hosting
Joomla News
Joomla People
Joomla SEO eBook
Joomla SEO Rankings
Joomla Sites
Joomla South East
Joomla Templates
Joomla Tips & Tricks
Joomla URLs
Open Questions
PHP
Pay Per Click
Product Reviews
Rants
Scams
Recommended Sites
Search Engine Optimization
Security
SEO
SEO Club
SEO Competition
Site Reviews
Template Clubs
Yellow Pages
Virtuemart
Vlogs
Wordpress
Translate
right