Duplicate content sounds scary, and many business owners worry about a "duplicate content penalty". The reality is less dramatic but still important: duplicates waste crawling, split ranking signals and can make Google show the wrong version of a page.
Is there a duplicate content penalty?
Not for normal duplication within your own site. Google doesn't punish you because your product appears at two URLs. It simply picks one version to show and may ignore the others.
The real problems are:
- Google might choose the wrong version
- Links and signals get split between versions
- Google wastes crawling on duplicates instead of new pages
Copying other websites' content wholesale is different. That can make your pages worthless in search.
Common causes of duplicates
- HTTP and HTTPS versions both loading
- www and non-www both loading
- Trailing slashes:
/servicesand/services/ - URL parameters:
?sort=price,?utm_source=facebook,?sessionid=123 - Product in several categories:
/shoes/itemand/sale/item - Printer-friendly or AMP versions
- Similar location or service pages with only one word changed
What a canonical tag is
A canonical tag tells Google which URL is the preferred version of a page:
<link rel="canonical" href="https://yourbusiness.lk/services/local-seo">
Put it in the <head> of every version, pointing to the main one. The main page should point to itself, a "self-referencing canonical".
Canonical tags are a strong hint, not a command. Google usually follows them, but may not if other signals disagree.
Canonical best practices
- Every indexable page has a self-referencing canonical
- Use absolute URLs including https://
- One canonical per page
- Don't canonicalise to a page that redirects, 404s or has noindex
- Keep signals consistent: internal links, sitemaps and canonicals should all point to the same version
- Paginated pages (page 2, 3) should canonicalise to themselves, not to page 1
Canonical vs redirect vs noindex
| Tool | Use when |
|---|---|
| 301 redirect | Users don't need the duplicate version at all, such as HTTP to HTTPS |
| Canonical tag | Users need both versions, such as sorted product listings |
| noindex | The page should stay accessible but never appear in search |
Fix the basics with redirects
These should always be handled with 301 redirects, not just canonicals:
- HTTP to HTTPS
- www to non-www (or the reverse; pick one)
- Trailing slash or no trailing slash; pick one
This website, for example, redirects trailing-slash URLs to the version without.
Near-duplicate pages
Fifteen location pages that say "We offer plumbing in [town]" with nothing else different are near-duplicates. Canonicals won't save them. Either make each page genuinely useful with local details, or merge them into one strong page. See local landing pages that rank.
How to find duplicates
- Search Console's Pages report: look for "Duplicate" statuses
- Crawl your site with a tool like Screaming Frog and compare titles and content
- Search Google for a sentence from your page in quotes
Our SEO audit includes a full duplicate content review. For more on indexing statuses, read fixing page indexing issues in Search Console.