January 11, 2024

A Deep Dive Into Algorithms

How to Deconstruct a Search Engine

1. Crawl millions of search result pages.
2. Catalog them based on thousands of ranking factors.
3. See behind the curtain.

 

The Common Problem

The common problem with SEO comes from a common way of doing things – when people blindly accept what “authorities” say because they have no other way to generate the data themselves.

Even the most seasoned pros can fall victim to a messy game of SEO telephone…

  • Finding tips in blog posts
  • Trading trends in a Slack channel
  • Attending talks at industry conferences
  • Speaking to your “friend who used to work at Google” 

For many, this results in a surface-level understanding of algorithms and fingers-crossed SEO strategy. Not to mention that much of the commonly-toted advice is ineffective. Or flat-out wrong.

It’s a good thing you aren’t like most people in SEO.

We promise, there’s a better way. And it starts with actually understanding an algorithm.

 

Client Experience

“Best in the business. Their expertise & industry-leading way of thinking was evident from our first point of contact & was maintained the whole way through the process. Couldn’t recommend enough.”

DARIS B. | Recruitment Consultant

 

Our Uncommon Solution

At SearchTides, we go directly to the source, breaking down search algorithms in a quantifiable, scientific way. We then apply that knowledge to our strategies because a cutting-edge approach and relentless pursuit of staying ahead of the trends is the only way to stay on top.

Step One: Collect and Measure Data

Let’s take the most popular search algorithm: Google. What comprises the Google algorithm?
Here it is. Take it in – in all its glory.

ORDINALFACTOR IDNAME#1 MAXPAGE 1 AVG.CORRELATION
1CPZZZ50Number of Top 50 Shared Factors Used4519-0.36
2CPZZZ100Number of Top 100 Shared Factors Used8844-0.35
3CPZZZNumber of Factors Used216128-0.32
4CPZZZ200Number of Top 200 Shared Factors Used14982-0.3
5ENT000aNumber of Entities Used7226-0.29
6CP005Ahrefs Domain Rating8245-0.26
7DD015DomDetailer Moz PA6844-0.25
8CP470Keywords in the HTML Tag115,315400-0.25
9CP134Kaywords in Body Tag114,121348-0.25
10DD013DomDetailer Moz DA8341-0.24
11DD010DomDetailer Majestic Referring Subnets68,89611,590-0.24
12DD006DomDetailer Majestic Ips275,46642,716-0.24
13DD008DomDetailer Majestic Referring Domains1,650,859260,803-0.24
14ENT009Entities in Title Tag73-0.23
15CPX010Keywords in Div Tags32,037194-0.23
16DD005DomDetailer Majestic CF6435-0.23
17DD016DomDetailer Moz Rank84-0.23
18CP059Ahrefs Rank4718-0.23
19DD007DomDetailer Majestic Links74,330,8544,246,287-0.23
20CP061Ahrefs Referring Class C Addresses67952-0.22
21CP063Ahrefs Referring AP Addressses97168-0.22
22CP062Ahrefs Referring Domains1,30684-0.22
23DD012DomDetailer Majestic TF5625-0.22

Search algorithms are simply thousands of “ranking factors.” We break them down into three categories:

  1. On-page factors – the things happening on the page (like words).
  2. Off-site factors – the things happening off the website (like links). 
  3. Technical factors – the things happening on a website that are performance (or crawl) related. 

And how do we collect and measure these factors? Well, we’ve built sophisticated technology:

  1. We crawl millions (and millions) of search results in perpetuity.
  2. We catalog them based on thousands of ranking factors.
  3. We do that enough times to get a real understanding of what’s important across all search results. 
  4. We do that for specific search queries which gets us query-specific data. 

But there’s another key component of understanding the algorithm – results are relative. As opposed to an absolute single strategy existing across all search results, getting to number one is quite literally about beating whoever happens to be at the top in your industry. 

Since their page is ultimately a summation of ranking factors (that happen to be important for a given search query), we can help you beat them.

 

Step Two: Stay On Top Of Algorithm Updates

Most people rely on Google’s word on what’s included in algorithm updates. But remember, we’re no longer making decisions based on what everyone else says – and that includes Google.

They don’t lie, they just don’t tell us the whole truth. 

But data does.

What’s really happening with an algorithm update is a re-ordering of which ranking factors are most important. A factor that once carried significant weight can become less significant post-update.

Our ability to stay on top of the algorithm means we instantly know which factors became more or less important. Plus, it allows us to spot future trends in what Google deems important before they’re rolled out publicly. This is where our unrelenting pursuit of having the freshest, most significant data pays off, giving you a potent competitive advantage.

 

Step Three: Implement Informed Solutions

So what do we do with all of this data? Two things. 

First, we identify and implement any immediate solutions to your SEO strategy. If there’s low-hanging fruit, we identify exactly what it is. We don’t send our clients on a 162-point goose hunt to update tags and descriptions – if the data doesn’t show it’ll make a measurable impact, we don’t waste the time.

Second, we also use the data as a map to carve out larger strategies. The factors we see gaining importance over time lead to hypotheses, which we test within our R&D department. Once confirmed, we roll out those larger recommendations to our clients. That means you’ll have a comprehensive strategy for what works at the website level: technical SEO, website architecture, recommendations on technology stacks, and so on. 

We also create an iterative process for optimization at the page level. This provides a blueprint for what to optimize and helps us to inform your optimization strategy for years into the future. 

 

STEP ONE: COLLECT AND MEASURE THE DATA

Let’s take the most popular search algorithm: Google. What comprises the Google algorithm? Here it is. Take it in – in all its glory.

Search algorithms are simply thousands of “ranking factors.” We break them down into three categories:

  1. On-page factors – the things happening on the page (like words).
  2. Off-site factors – the things happening off the website (like links). 
  3. Technical factors – the things happening on a website that are performance (or crawl) related. 

And how do we collect and measure these factors? Well, we’ve built sophisticated technology:

  1. We crawl millions (and millions) of search results in perpetuity.
  2. We catalog them based on thousands of ranking factors.
  3. We do that enough times to get a real understanding of what’s important across all search results. 
  4. We do that for specific search queries which gets us query-specific data. 

But there’s another key component of understanding the algorithm – results are relative. As opposed to an absolute single strategy existing across all search results, getting to number one is quite literally about beating whoever happens to be at the top in your industry. 

Since their page is ultimately a summation of ranking factors (that happen to be important for a given search query), we can help you beat them.

STEP TWO: STAY ON TOP OF ALGORITHM UPDATES

Most people rely on Google’s word on what’s included in algorithm updates. But remember, we’re no longer making decisions based on what everyone else says – and that includes Google.

They don’t lie, they just don’t tell us the whole truth. 

But data does.

What’s really happening with an algorithm update is a re-ordering of which ranking factors are most important. A factor that once carried significant weight can become less significant post-update.

Our ability to stay on top of the algorithm means we instantly know which factors became more or less important. Plus, it allows us to spot future trends in what Google deems important before they’re rolled out publicly. This is where our unrelenting pursuit of having the freshest, most significant data pays off, giving you a potent competitive advantage.

STEP THREE: IMPLEMENT INFORMED SOLUTIONS

So what do we do with all of this data? Two things. 

First, we identify and implement any immediate solutions to your SEO strategy. If there’s low-hanging fruit, we identify exactly what it is. We don’t send our clients on a 162-point goose hunt to update tags and descriptions – if the data doesn’t show it’ll make a measurable impact, we don’t waste the time.

Second, we also use the data as a map to carve out larger strategies. The factors we see gaining importance over time lead to hypotheses, which we test within our R&D department. Once confirmed, we roll out those larger recommendations to our clients. That means you’ll have a comprehensive strategy for what works at the website level: technical SEO, website architecture, recommendations on technology stacks, and so on. 

We also create an iterative process for optimization at the page level. This provides a blueprint for what to optimize and helps us to inform your optimization strategy for years into the future. 

Our Solution In Action

 

We identify powerful correlations that don’t show up in existing tools.

Average SEO Joe tends to think about SEO as happening in one of two ways: on-page or off-page. But by measuring thousands of ranking factors across all page components, we can see correlations that exist beyond those constructs – ones that don’t appear in any set of tools. 

For example, everyone thinks about using keywords on a page, or topics like keyword density, but not where and how those keywords are used across a number of the page’s different sections – or what we call “content zones.” Optimizing content zones – and maintaining a balance between them – is the key to winning ranking diversity factors.

In other words, if you’re using loads of keywords in your paragraphs and H1s/H2s, but never in your sidebar, or nav, or never using entities, it’s entirely possible on-site tools will show that you have a perfect density score when you actually have a page that’s both over and under-optimized. You need a way to measure that.

We let the data (not Google PR) tell the whole story.

In December 2022, Google released a statement about their latest algorithm update. Publicly, the update was said to be about links. Privately, the data told a radically different story.

What went unmentioned was a complete reconstruction of how Google measures entities – a change so significant that it will fundamentally impact how rankings are constructed over the next three years. 

Entities are officially recognized sub-topics of a given topic on the internet. For example, in the topic of “finance,” “mortgage” would be considered an entity. So would “loan.”

In previous algorithm updates, one real measurement we saw in the data was a correlation between the number of related entities used on a page and the ranking of the page – the same way you’d use a keyword a number of times on a page. 

But with the update, entities are now treated as topic groupings within a website itself. If this seems like a massive change from “how many times a keyword appears on a page,” that’s because it is.

How big of a change? Before this update, we could view entities as an apple – or even a few types of apples. But now, the significance of entities is like every type of fruit (in every form) that has ever been consumed.  

And no one is talking about it. 

We see into the future.

Over two years ago, we spotted a new ranking factor starting to appear in our data. It showed that there was a material difference in rankings between websites with keywords in the first 30 KB of their web page, and those without. 

Here’s what that means: 

  • Google is looking at your source code. 
  • If you have a bloated codebase with no human-readable text, it’s entirely possible that the first 30KB of your source code has zero words, let alone keywords. 

So, how do we gain this insight from the data?

It shows up in the form of a ranking factor – one that previously held little to no weight – that begins to move its way up the priority list.

But here’s the thing, these shifts don’t happen overnight. They happen slowly. Our ability to monitor these small changes means we can make assertions about the direction Google wants to move in.

And because we know when changes are coming, we’re able to do two major things: 

  1. According to the trend we’re seeing, we can make immediate adjustments to your website. 
  2. We can form greater hypotheses as to why something is happening before you’ll need it so you can start having informed conversations years in advance. 

And, this is just one example of the trends we’re seeing in the data.

SEO is a zero-sum game

The moment you get a leg up on the competition, someone else will try to return the favor.

And so the cycle repeats.

At SearchTides, these are the two things we care about most:

  • Getting you the best information possible as it applies to your unique situation.
  • Applying it correctly so we can roll it out for you quickly and at scale.

With Google continuing to forge down a “winner takes all” pathway, the threshold to be competitive gets higher and higher.

Data, and the knowledge of how to use it, is the only way to establish a significant competitive advantage.

Let’s future-proof your SEO strategy for long-term growth.

Related Posts

3 Key Points Your Content Needs to Address

3 Key Points Your Content Needs to Address

High-Ranking Content starts with a plan That's right, an actual plan. Not just the superficial stuff.  You need a plan for more than just your super heavy bottom-of-funnel commercial intent keywords. You need a plan for more than just those two or five blog posts that...

read more
Troubleshooting SEO Rankings Drop

Troubleshooting SEO Rankings Drop

Did your SEO ranking tank? Try this: Determine if the theme (or type) of your search result just changed.   Let us explain: Over time, there have been a lot of different queries that used to have one type of answer as a response. For example, comparison pages....

read more

Compete and win
in the AI-first world of search.

CONTENT

LINKS

ON-SITE

TECHNICAL SEO

Get Weekly SEO Insights

Our best ideas, straight to your inbox.

Follow Us