Netconcepts

Specialists in SEO, web dev, online marketing

Book A Free Strategy Call
  • About
    • About Netconcepts
    • Problems We Solve
    • Who We’re Not a fit for
  • Services
  • Results
  • Learn
    • Learning Center
    • Courses
    • Blog
    • Podcasts
  • Press
  • Contact

Spiders like Googlebot choke on Session IDs

Many ecommerce sites have session IDs or user IDs in the URL of their pages. This tends to cause either the pages to not get indexed by search engines like Google, or to cause the pages to get included many times over and over, clogging up the index with duplicates (this phenonemon is called a “spider trap”). Furthermore, having all these duplicates in the index causes the site’s importance score, known as PageRank, to be spread out across all these duplicates (this phenonemon is called “PageRank dilution”).

Ironically, Googlebot regularly gets caught in a spider trap while spidering one of its own sites – the Google Store (where they sell branded caps, shirts, umbrellas, etc.). The URLs of the store are not very search engine friendly: they and are overly complex, and include session IDs. This has resulted in 3,440 duplicate copies of the Accessories page and 3,420 copies of the Office page, for example.

If you have a dynamic, database-driven website and you want to avoid your own site becoming a spider trap, you’ll need to keep your URLs simple. Try to avoid having any ?, &, or = characters in the URLs. And try to keep the number of “parameters” to a minimum. With URLs and search engine friendliness, less is more.

The Art of SEO

Chapter 6:
Keyword Research

From the fundamentals of link building to the nuances of natural linking patterns, virality, and authority.

Get Free Chapter

Related Posts

Blog Images

Embrace Journaling, Tackle Tardiness, and Explore Our Energetic Echo

Here’s what I found inspirational, challenging, or just downright hilarious this week. What caught your eye? And, remember to check out this week’s great podcast episodes: Scaling a SaaS Company with Jason Morehouse “A crucial factor to business success is to find and take the personal path that works best for you.” — Jason Morehouse […]

Read More
Blog Images

Harrison’s harmony, conquering a blank canvas, & gut health hacks

Here’s what I found inspirational, challenging, or just downright hilarious this week. What caught your eye? And, remember to check out this week’s great podcast episodes: Be a Sales Game Changer with Fred Diamond “True elite sales professionals develop a dedicated mindset, proactive client interaction, and continuous self-preparation. They understand their client’s needs and enable […]

Read More
Blog Images

Rebirth of sleeper trains, 4,000 weeks is a long/short time, and golden age for medicine

Here’s what I found inspirational, challenging, or just downright hilarious this week. What caught your eye? And, remember to check out this week’s great podcast episodes: A Story Worth Retelling with Luke Storey “Aligned values are the cornerstone of successful partnerships, whether in business or life, as they shape our moral code, define our priorities, […]

Read More
As seen on
NBC ABC CBS Fox CW Haryard adweek foundr cnet
Capsule Bar Img
How to find words and phrases that connect your customers or clients to your business?

Download chapter 6 of The Art of SEO, Keyword Research

Download Now
netconcepts
  • submenu
    • About
    • Services
    • Problems We Solve
  • submenu
    • FAQ
    • Results
    • Who We’re Not a fit for
  • submenu
    • Learning Center
    • Courses
    • Blog
  • submenu
    • Podcasts
    • Press
    • Contact
netconcepts
© 2025 Netconcepts. All Rights Reserved. Terms of Use Earnings Disclaimer Privacy Policy Trademark Policy Website Accessibility
Book

The Art of SEO

Chapter 7: Content Marketing

Yes, this is the book that Seth Godin referred to as “Hype-free, data-rich, and loaded with insight that’s essential reading for anyone who needs a deep understanding of SEO.”

Want to sharpen your SEO chops?...
start out with an appetizer before you dig into the main course!

Get Free Chapter
  • Facebook
  • LinkedIn
  • Pinterest
  • Twitter
  • YouTube