Keyword Research: Find the Terms Your Customers Actually Search

Most keyword research is backwards. People start by opening a keyword tool, typing in their product category, sorting by search volume, and picking the biggest numbers. Then they wonder why their content ranks on page 7 for terms their competitors have owned for years.

The keyword research process that actually works starts with understanding your customer, maps their journey to specific search behaviors, identifies the gaps your competitors have missed, and builds a prioritized plan based on what you can realistically rank for given your current authority. Volume is the last thing you look at, not the first.

I have built keyword strategies for content sites, ecommerce businesses, and B2B SaaS products. The methodology below is what consistently produces results. It takes more upfront work than "open Ahrefs, pick keywords," but the output is a strategy that drives traffic you can actually convert.

Why Most Keyword Research Fails

Before getting into the method, you need to understand why the common approach produces poor results.

The Volume Trap

High search volume looks attractive on a spreadsheet. "Project management software" gets 40,000 searches per month. Your eyes light up. But that keyword has a difficulty score of 85, the top 10 results are dominated by sites with domain authority above 80, and the intent is commercial comparison -- meaning users want a listicle of options, not your product page.

You write a 3,000-word guide, publish it, wait three months, and find it sitting on page 6 with 12 impressions per month. The keyword research was technically correct. The strategy was wrong.

Ignoring Intent Mismatch

"CRM" means different things to different searchers. Some want to know what CRM stands for. Some want to compare CRM platforms. Some want to log into their existing CRM. Google knows this, which is why the search results for broad terms show a mix of content types.

When you target a keyword without understanding the dominant intent, you are gambling on whether your content format matches what Google wants to show. That is a bet you will lose more often than not.

Not Accounting for Authority

A six-month-old blog with a domain authority of 15 cannot rank for the same keywords as HubSpot (DA 93) or Neil Patel (DA 91). This is not defeatism -- it is physics. Domain authority is one of the strongest ranking signals, and no amount of content optimization overcomes a 70-point authority gap on competitive terms.

Smart keyword research factors in your current authority and targets keywords where you can compete today while building toward harder targets over time.

Step 1: Define Your Customer's Search Journey

Before opening any tool, map how your customer searches at each stage of their buying process.

Awareness Stage

The customer has a problem but does not know the solution category yet. They search in problem language, not product language.

Examples:

• "Why is my email open rate so low" (not "email marketing software")
• "How to get more website visitors" (not "SEO tools")
• "Team keeps missing deadlines" (not "project management software")

These keywords have lower search volume individually but convert well because you are reaching people at the moment they discover they have a problem you solve.

Consideration Stage

The customer knows the solution category and is evaluating options. They search using category and comparison language.

Examples:

• "Best email marketing platforms for small business"
• "Mailchimp vs ConvertKit vs ActiveCampaign"
• "Email marketing tools pricing comparison"

These keywords have higher commercial value and moderate competition. This is where most keyword strategies should focus the majority of effort.

Decision Stage

The customer has narrowed their choices and is looking for specific information to make a final decision. They search using brand names, pricing, reviews, and implementation terms.

Examples:

• "ConvertKit pricing 2026"
• "Mailchimp reviews from real users"
• "How to migrate from Mailchimp to ConvertKit"

These keywords have the highest conversion rate but the lowest volume. They are essential for capturing ready-to-buy traffic.

Map the Journey for Your Business

Create a simple spreadsheet with three columns: Awareness, Consideration, Decision. Under each column, write 10-15 search queries your ideal customer might use at that stage. Do this from memory first, based on actual conversations you have had with customers. This is your seed list. Every search query you add later from tools gets validated against this map.

Step 2: Build Your Seed Keyword List

Now open your tools. But instead of browsing, search strategically using the seed queries from Step 1.

Start with Google Search Console

If you have an existing site with any traffic, Search Console is your best starting point. Go to Performance > Search Results. Set the date range to the last 6 months. Sort by impressions descending.

This report shows you every query where Google has already shown your site. Many of these will be queries you never intentionally targeted. Look for:

• High impressions, low clicks: Keywords where you rank positions 8-20. These are quick-win candidates -- content improvements or new dedicated pages can push them to page 1.
• Surprise queries: Keywords you never expected. These reveal how Google interprets your content and often suggest new content opportunities.
• Question queries: Filter for queries containing "how," "what," "why," "can." These are excellent targets for FAQ content and featured snippets.

Use Keyword Research Tools

Open Ahrefs Keywords Explorer, Semrush Keyword Magic Tool, or a free alternative like Ubersuggest. Enter your seed keywords from Step 1 one at a time.

For each seed keyword, collect:

• The keyword itself
• Monthly search volume
• Keyword difficulty score
• Current top-ranking content type (article, product page, video)
• Related keyword suggestions

Filter settings that produce actionable results:

• Volume: 50-5,000 monthly searches (ignore anything over 10,000 for now unless your DA is 50+)
• Keyword Difficulty: under 40 (under 25 if your DA is below 30)
• Word count: 3+ words (longer queries have clearer intent and lower competition)

Mine Competitor Keywords

Identify 3-5 direct competitors and 3-5 content competitors (sites that rank for your target topics but are not product competitors).

In Ahrefs or Semrush, run a "Content Gap" or "Keyword Gap" analysis. This shows keywords your competitors rank for that you do not. Filter for keywords where at least 2 competitors rank in positions 1-10 but you rank nowhere. These are validated opportunities -- the keyword drives traffic and your competitors have proven it is worth targeting.

Leverage AI for Keyword Expansion

AI tools have genuinely improved keyword discovery. Use ChatGPT, Claude, or specialized tools like Keyword Insights for:

• Semantic expansion: Give the AI a keyword and ask for related terms a customer might search. AI generates variations that keyword tools miss because they pull from search query databases while AI understands language relationships.
• Question generation: Ask the AI to generate 20 questions a [your target customer] would ask about [your topic]. These questions map directly to content opportunities.
• Intent classification: Paste a list of keywords and ask the AI to classify each by search intent (informational, commercial, transactional, navigational). This is faster than manual classification and surprisingly accurate.
• Clustering: Give the AI 100 keywords and ask it to group them into topical clusters where each cluster should be addressed by a single page. This replaces hours of manual spreadsheet work.

Important caveat: AI does not have access to real search volume data. Use AI for ideation and classification. Use traditional keyword tools for volume and difficulty data. The combination is more powerful than either alone.

Step 3: Map Search Intent for Every Keyword

For every keyword on your list, determine the dominant search intent. This is not optional. Skip this step and you waste time creating content that will never rank.

How to Determine Intent

Search the keyword in Google in an incognito window. Look at the top 10 results.

• All informational articles (how-tos, guides, definitions): Informational intent. Create educational content.
• Mostly comparison/review articles: Commercial investigation intent. Create comparison or review content.
• Product pages and pricing pages dominate: Transactional intent. Your product or service page should target this.
• Mix of brand homepages and login pages: Navigational intent. Usually not worth targeting unless it is your brand name.

Intent Determines Content Format

This is the critical insight most people miss. Intent does not just tell you the topic -- it tells you the format.

If Google shows listicles for a keyword and you create a single-product landing page, you will not rank. If Google shows product pages and you write a 3,000-word educational guide, you will not rank. Match the format Google already rewards.

Step 4: Build Your Keyword Map

A keyword map assigns specific keywords to specific pages on your site. Every page targets one primary keyword and 3-5 related secondary keywords. No two pages target the same primary keyword.

The Mapping Process

Create a spreadsheet with these columns:

• URL (existing or planned)
• Primary Keyword
• Secondary Keywords (3-5)
• Search Volume
• Keyword Difficulty
• Intent
• Content Type
• Status (Existing/To Create/To Update)
• Priority (1-3)

Start with your existing pages. Assign the best-fit primary keyword to each existing page based on current rankings, content relevance, and intent match. Then identify gaps -- keywords from your research that have no matching page. These become your content creation queue.

Avoiding Keyword Cannibalization

Keyword cannibalization happens when multiple pages on your site compete for the same keyword. Google gets confused about which page to rank and often ranks neither well.

How to detect it: In Google Search Console, filter by query for a specific keyword. If multiple URLs appear in the results for that query, you have cannibalization.

How to fix it:

• If both pages serve different intents, differentiate their primary keywords more clearly.
• If one page is clearly better, redirect the weaker page to the stronger one or add a canonical tag.
• If both pages have unique value, consolidate them into a single comprehensive page.

Step 5: Prioritize Your Keyword Targets

You cannot target everything at once. Prioritize based on three factors.

The Prioritization Framework

Score each keyword opportunity on three dimensions (1-5 scale):

Business Value (weight: 40%): How directly does this keyword connect to revenue? A keyword that targets people ready to buy your product scores 5. A keyword that targets people in early awareness scores 2. An off-topic keyword that might drive traffic but no conversions scores 1.

Ranking Feasibility (weight: 35%): Can you realistically rank for this keyword in the next 6 months? Compare the keyword difficulty to your domain authority. Look at the strength of current top-ranking pages. If you would need to outrank Wikipedia and HubSpot, feasibility is low.

Traffic Potential (weight: 25%): What is the combined search volume of the primary keyword plus its secondary keyword cluster? A keyword with 300 monthly searches that has 15 related keywords totaling 2,000 additional searches is more valuable than a single keyword with 500 searches and no related terms.

Composite score = (Business Value x 0.4) + (Ranking Feasibility x 0.35) + (Traffic Potential x 0.25)

Sort by composite score. Work from the top.

The Quick-Win Filter

Before working through the prioritized list, pull out quick wins. These are keywords where you already rank positions 5-20 with existing content. Improving existing content is faster and more predictable than creating new content. A page ranking position 12 can often reach position 5-7 with content updates, better internal linking, and on-page optimization -- no new pages needed.

In Search Console, filter for queries where your average position is 5-20 and impressions are above 100 per month. These are your quick wins. Address them first because they produce results fastest.

Step 6: Long-Tail Strategy

Long-tail keywords are longer, more specific search queries with lower individual search volume but higher collective volume and conversion rates. They are the foundation of any keyword strategy for sites that are not yet authority leaders.

Why Long-Tail Keywords Win

The math favors long-tail keywords for newer sites:

• Lower competition: Fewer sites target specific queries, so you can rank with lower domain authority.
• Clearer intent: "Email marketing tools" is vague. "Email marketing tools for Shopify stores under $50/month" tells you exactly what the searcher wants and how to serve them.
• Higher conversion: Specific queries indicate specific needs. Someone searching for a specific solution is closer to buying than someone searching a broad category.
• Compound traffic: 100 long-tail pages each getting 30 visits per month produce 3,000 monthly visits. That is more than most sites get from chasing a single high-volume keyword.

Finding Long-Tail Opportunities

• Google Autocomplete: Type your seed keyword and note every suggestion. Add each letter of the alphabet after your keyword to trigger more suggestions.
• People Also Ask: Click through PAA boxes on search results pages. Each click generates more questions, creating a cascading list of long-tail opportunities.
• Related Searches: Scroll to the bottom of Google results. These are semantically related queries that represent content opportunities.
• Reddit and forum mining: Search your topic on Reddit. The specific language people use in their posts and comments maps directly to long-tail keywords. "How do I get my Shopify store to show up on Google" is a real long-tail keyword born from real customer language.
• Customer support logs: If you have a product, your support tickets contain the exact language customers use. Mine these for keyword ideas.

Step 7: Build Topic Clusters

Individual keyword pages are less effective than interconnected topic clusters. A topic cluster consists of a pillar page (comprehensive overview targeting a broad keyword) supported by cluster pages (focused articles targeting specific subtopics) that all interlink.

Cluster Structure

Pillar page: "Email Marketing Guide" -- targets the broad term, provides comprehensive coverage, links to every cluster page.

Cluster pages:

• "Email Marketing for Small Business" -- links back to pillar
• "Email Marketing Automation Workflows" -- links back to pillar
• "Best Time to Send Marketing Emails" -- links back to pillar
• "Email Marketing vs Social Media Marketing" -- links back to pillar

Each cluster page targets a specific long-tail keyword while the pillar page targets the head term. The internal linking structure signals topical authority to Google, helping the pillar page rank for the competitive broad keyword while cluster pages capture specific long-tail traffic.

How to Define Your Clusters

Group your keyword map by topic. Each group becomes a cluster. A typical cluster has:

• 1 pillar page targeting a keyword with 1,000+ monthly searches
• 5-15 cluster pages targeting keywords with 50-1,000 monthly searches each
• Consistent internal linking between all pages in the cluster

Plan 3-5 clusters to start. Fully build one cluster before starting the next. A half-built cluster provides less topical authority signal than a complete one.

Putting It All Together

Keyword research is not a one-time task. It is the foundation of your content strategy and should inform every page you create and every piece of content you update. The process I have outlined here takes 2-3 days to complete for an initial strategy and a few hours quarterly to maintain.

Start with your customer journey mapping. Build your seed list from real customer language. Use tools for data, not for strategy. Map intent before creating anything. Prioritize ruthlessly based on business value, feasibility, and traffic potential. Build in clusters, not isolated pages. Review and update quarterly.

The sites that win at organic search are not the ones targeting the most keywords. They are the ones targeting the right keywords with content that matches intent, organized in a structure that builds topical authority. Get that right, and the traffic follows.