How Search engines find Duplicate pages

 

Although there is no such thing as a general duplicate content penalty it is difficult to get high rankings for a web page which contents can also be found on other web pages.

If you want to avoid problems with duplicate content, the following tips and illustrations will help you.

What is duplicate content and what do search engines do about it?

• Duplicate content is if two or more different web pages contain the same or nearly the same content.
• Duplicate content can occur within a single website and across many different websites.
• Web pages can be considered duplicate even if they are not 100% identical.
• Search engines want to list only one version of duplicate content on their search result pages.

Search engines want to return as many different options as possible in their result lists. That’s why they filter all duplicates in the search results and display only one version.

How do search engines determine which web page will be used for the search results?

1. When search engines find a web page, they compare it to previously found web pages to determine whether it is a duplicate or not:                                                                                                          
   

    

    

2. Web pages that are hosted by known spam sites will be removed from the list:        

3. The remaining web pages will be sorted based on the number and the quality of their inbound links:                                                                                                                                                                        

4. The web page with the best inbound links will be chosen for the search results:        

    

    How to avoid duplicate content on your on websites

1. Hide duplicate content from search enginesIf you offer different versions of your website content (regular view, mobile view, print view, etc.) then search engines might pick the wrong variation for the search results.Add a noindex meta tag to your duplicate content versions so that search engines don’t index the duplicate content.      

2. Require backlinks if you syndicate your web page contentIf you syndicate your content to third parties, search engines might favor the version published by one of your partners.Require a back link from your partners to the original document on your own website so that search engines can find out from which web page the content comes.      

    

    

    

    

    

     

   Duplicate content can cause problems with your search engine rankings. If you follow the tips above, search engine spiders should index your web pages correctly.

    

   Note: Even I had copied this article from  IBP newsletter.