Saturday, August 12, 2017

How Keyword Difficulty Is Calculated on Any Major Keyword Tool

By Admin Baby Drivers  |  August 12, 2017

Any keyword difficulty score is going to take a hodgepodge of metrics from each of the the top 10 results, apply them to a formula, get a “difficulty score” for each result, then average them together and spit out a number between 1 and 100.

How Keyword Difficulty Is Calculated on Any Major Keyword Tool

 Metrics like these will be consulted:
  • InTitle / InURL / InDescription - Does the keyword appear in the title, URL, or meta description of the result?
  • Moz / Majestic ranks - How do Moz and/or Majestic, two large SEO firms, calculate the difficulty of this result? (Moz uses page authority and domain authority, and Majestic uses Trust Flow and Citation Flow).
  • Backlink count - How many backlinks does this result have?
  • Social count - How many social shares does this result have?

The formula will assign an arbitrary value to each of these determinants and give a difficulty score for each top 10 result. Then, they are averaged together, and that is your “keyword difficulty score”. Each major keyword tool uses a slightly different formula to calculate difficulty but they all operate by considering the same metrics such as InTitle / backlink count / etc.

Why This Method of “Calculation” Is Terribly Inaccurate
For each and every metric that is consulted in the makeup of the “keyword difficulty score”, there are a variety of ways that the automated formula can misread the SERP result and display something inaccurate.

InTitle / InURL / InDescription

Google will recognize similar words and phrases as being the exact same - it’s a semantic search engine. A result may have slightly different wording from the keyword you are checking, which will result in a NO for the keyword difficulty calculator, but a YES in the eyes of Google.

Moz / Majestic ranks

While these scores are usually somewhat accurate, they are not perfect, nor are they a reflection of what Google believes to be the strength of the page. For example, it’s very easy to manipulate DA and PA with low-quality links. Google will still consider the backlink profile to be WEAK, but because of the sheer number of links, Moz will consider the backlink profile to be STRONG.

Backlink count

This is the big one. There is not a single keyword tool that is able to delve into the quality of the backlinks that a result has - it’s an enormous task and probably close to impossible. So instead, they put weight on the number of backlinks, and not the quality of the backlinks. A page with 10 strong editorial links will be shown as WEAK to a keyword difficulty calculator, but a page with 5,000 forum profile links will be shown as STRONG to a keyword difficulty calculator, and WEAK to Google. (Link count in general tells you very little about backlink profile strength.)

Social count

Sometimes, platforms will factor in metrics such as number of social signals. No one really knows how powerful metrics like social signals are. So if a result has 1,000 Facebook likes, a keyword difficulty calculator might see that as STRONG, whereas Google might NOT CARE. At the same time, a result with no social activity might be seen as WEAK by a keyword difficulty calculator, and Google might NOT CARE.

When you combine all of these possible missteps, there is a LOT of room for error, and in general, keyword scores are riddled with errors. In general, the keyword difficulty calculator will misread at least one of the determinants above, which will lead to a higher or lower keyword difficulty score than the true difficulty. Add in a few misreads and it’s totally out of whack.

This means you will sometimes perceive the keyword as too difficult and not pursue it (even if it is easy). And you will sometimes perceive it as easy when it is difficult, which means you will waste time and money trying to rank something impossible. Keyword calculations cannot be blindly trusted because they can lead you down a path which wastes your time and money.

When Keyword Difficulty Scores Can Be Useful

Keyword difficulty scores can tell you when a keyword is completely impossible or unbelievably easy. That is the only real way you should be using keyword difficulty scores: to know at a glance if a keyword is super hard or super easy or in the middle. But there are still ways that a tough result can read as low competition and an easy result can read as high competition… so don’t trust it completely, ever! There is too much on the line - your time and money - to be lazy and pick a bad keyword.

Keyword difficulty scores are in general useless for judging anywhere from low- to medium-competition keywords - aside from telling you that they are in that range. Two keywords with the exact same competition can easily return 20 or 40. 20 will be seen as “very easy” by the tool, and 40 will be seen as “medium” by the tool. In fact two different variations of the same keyword might spit out vastly different numbers because of the missteps in the keyword calculation algorithm.

There is too much room for error to get any accurate gauge on in-the-middle keywords - which is what most of us on BHW are after. All it can tell you is that the keyword is probably in the middle somewhere, or that it’s extremely weak or extremely difficult.

How To Create Your Own “Keyword Difficulty Calculator”

Intuition and knowing how to judge SERP results is the key. It’s a skill and a VERY USEFUL one at that. I can’t install the skill in your brain, but I can tell you how to get started analyzing SERP results and getting better at it yourself.

Common sense

Did you just search “dog food” and see a bunch of static category pages for e-commerce sites like Petco and Amazon with thousands of “dog food” products within each category? If it’s something like that, it’s probably not worth looking at. All blatantly obvious keywords are probably not rankable.

Search volume

Are you looking at a 70,000 USA p/m search term with $1+ CPC? It’s probably not easy. The more profitable a keyword, the more competition it will have. In general, it is not feasible for the average BHW member to target high-volume, very-profitable keywords. While high-volume and low-competition keywords do exist, you probably won’t find them as a beginner. Use search volume as a guide - do not look at any base keyword above 10,000 if you are a beginner is my advice.

Looking at top 10 keyword inclusion

Is the keyword genuinely missing from the top 10 results, or is it there in a different variation or a different way of saying it? Chances are, in 2017, Google is not returning results that are completely irrelevant, so make sure that you aren’t leading yourself on. But, it is worth looking at something like this: if you are looking at “blackhat SEO”, but all of the top 10 results just talk about “SEO” and do not mention “blackhat” or any variation or different way of phrasing it, you may be onto something.

Looking at DA/PA

Are any of these numbers close to 100 or 0? If so the score may not be entirely accurate. For example, a Weebly page will return a very high DA, but Weebly results aren’t particularly powerful because anyone can make a page on Weebly. All parasites will have high DA but that doesn’t matter as much because it’s a parasite. At the same time, if a result has 1 PA, or 3 PA, Moz might just not have enough data on that result to calculate a PA - it’s probably not actually 1.

Looking at backlinks

All of the above is important but backlink profile is by far THE most important. THIS IS THE BIG ONE THAT ALMOST ALL KEYWORD DIFFICULTY CALCULATORS PERCEIVE INCORRECTLY.

Backlink count doesn’t really mean sh*t. You have to look at the actual backlinks and see what their value is. Pop a result into a backlink checker (Moz, Ahrefs, Monitor Backlinks, Backlink Watc, etc.) and take note of what you see.

Are they spam links? PBN links? Honest-to-God editorial links? A lot of spam links won’t mean much. Just a few strong PBNs or editorial links can mean a lot. You need to understand what types of links have power. Once you understand that, you can analyze backlink profiles of potential keywords to see if you can match or exceed the power of the profile. If you can, you might have a winning keyword.

But it’s not ALL about backlinks - for example, a static category page on an authority site might not have a ton of backlinks, but each of the posts or pages within that category might, which will feed the category page in power. So even if the category page has no backlinks, it still might have a lot of link juice powering it.

As another example, a highly-relevant page on HuffPo will still have a lot of power, even if it genuinely has 0 links. Part of making a decision on competitiveness is balancing backlink power with internal power.

At the end of the day you never know for sure if a keyword is easy - you don’t have access to Google’s exact algorithm - but with enough trial and error you will be able to immediately spot a good one.

Everything else

Take it into account, but don’t put too much weight on it. If a result has thousands of social shares… those might be purchased, or worthless to Google - again, no one knows. That’s just one example but there are others.

Steps to Analyzing a Keyword

This is how I do it, rather than trusting inaccurate keyword tools.
  • Determine if the keyword is remotely feasible. Use common sense, general keyword scores, and the factors discussed in this guide to make that determination.
  • Delve into backlink profile strength. If you determine the backlinks of the results are nothing special, continue on.
  • Weigh backlink strength against internal link strength. If there are authoritative but low-link results at the top, could you beat the results with a new low-authority site, but a very strong link profile?
  • If you think you can… go for it! One of two things will happen. You will either have found a good keyword and rank and make money, or you won’t, and you will learn a valuable lesson on keyword analysis.
  • Be careful and check for mistakes. Don’t get absorbed in the excitement of potentially finding a keyword and make a decision based on incomplete information. Really look at the keyword’s top results to check for anything out of place. Did you overlook anything? It’s best to continue doing keyword research within a niche for a few days before you decide on anything if you are new. Rushing into a bad keyword will only waste your time and money.
Overall, keyword research is a wide-ranging skill that takes determination to get good at. You can’t get specific keyword advice, because most people will just steal your keyword if it’s any good. You have to do it yourself. Always keep your findings secret and only discuss general things.

Go now and start trying to find a keyword. Use this guide as a starting point. Once you do some research, you will outgrow this guide, and all of your new ideas and tactics will be yours to own and find lucrative keywords with. All it takes is brute force until you find one good keyword, then building off patterns you recognize in the viable keyword.

» Thanks for reading: How Keyword Difficulty Is Calculated on Any Major Keyword Tool
Author: Baby Drivers

Never fear before trying it and never stop before it works.