Spiders like Googlebot choke on Session IDs
Many ecommerce sites have session IDs or user IDs in the URL of their pages. This tends to cause either the pages to not get indexed by search engines like Google, or to cause the pages to get included many times over and over, clogging up the index with duplicates (this phenonemon is called a “spider trap”). Furthermore, having all these duplicates in the index causes the site’s importance score, known as PageRank, to be spread out across all these duplicates (this phenonemon is called “PageRank dilution”).
Ironically, Googlebot regularly gets caught in a spider trap while spidering one of its own sites – the Google Store (where they sell branded caps, shirts, umbrellas, etc.). The URLs of the store are not very search engine friendly: they and are overly complex, and include session IDs. This has resulted in 3,440 duplicate copies of the Accessories page and 3,420 copies of the Office page, for example.
If you have a dynamic, database-driven website and you want to avoid your own site becoming a spider trap, you’ll need to keep your URLs simple. Try to avoid having any ?, &, or = characters in the URLs. And try to keep the number of “parameters” to a minimum. With URLs and search engine friendliness, less is more.
Chapter 6:
Keyword Research
From the fundamentals of link building to the nuances of natural linking patterns, virality, and authority.
Related Posts
How to Have a Conversation with ChatGPT And Actually Get Results Worth Using
Ever felt like you’re only scratching the surface of what ChatGPT can do? You’re not alone. While most people settle for basic responses, power users have discovered how to unlock its hidden potential and transform their workflows in the process. On the surface, GPT-5 might seem like just another AI upgrade — a slightly smarter […]
Read More
Is Google’s AI Telling the Truth? Here’s How to Fact-Check It
In 2024, Google fundamentally changed how we search. Their AI Overviews now sit at the top of search results, essentially taking the old featured snippets concept and supercharging it with AI – or as Google puts it, providing “helpful summaries” of web content. But here’s the thing: these aren’t just summaries. They’re AI-generated interpretations that […]
Read More
Embrace Journaling, Tackle Tardiness, and Explore Our Energetic Echo
Here’s what I found inspirational, challenging, or just downright hilarious this week. What caught your eye? And, remember to check out this week’s great podcast episodes: Scaling a SaaS Company with Jason Morehouse “A crucial factor to business success is to find and take the personal path that works best for you.” — Jason Morehouse […]
Read More
