How to Verify SEO Case Studies Before Hiring an Agency

Most SEO case studies omit the variables that actually explain the result — here is how to separate genuine proof from polished marketing.

Indexed Research

Research team · 8 min read

Published

Key Takeaways

  • Organic traffic spikes in case studies are frequently caused by seasonality, algorithm recoveries, or paid spend — not by the agency's strategy.
  • A credible case study names the client, the baseline, the timeframe, and the specific tactics deployed — vague studies cannot be verified.
  • Asking an agency for a Google Search Console screenshot dated to the campaign period is the fastest single filter between real results and fabricated ones.
  • Reference checks matter more than testimonial quotes; a real client conversation reveals timeline, budget, and whether results held after the contract ended.
  • Red flags such as anonymised clients, percentage-only gains, and missing competitor context appear in the majority of low-quality agency portfolios.

Agencies publish case studies because procurement teams ask for proof of results. The problem is that almost every agency has at least one result worth photographing — a lucky technical fix, a client in a thin-competition niche, or a traffic spike that coincided with a Google core update rewarding the broader industry. A single data point, presented without context, proves very little about what you should expect when you become a client.

When you are evaluating SEO proposals, the case study section is not a formality. It is your best opportunity to verify seo case studies against independently checkable evidence — and to disqualify agencies whose portfolios cannot survive scrutiny. This article gives you the framework to do that systematically.

If you're looking for expert help in this area, explore how our SEO agency services can drive measurable results for your business.

What a Credible Case Study Actually Contains

Most SEO case studies follow the same template: a before-and-after traffic chart, a percentage increase, and a short client quote. That structure is nearly impossible to verify, because the numbers are self-reported and the context has been stripped out. A case study that can survive due diligence contains a different set of components.

The non-negotiable elements

  • Named client or verifiable domain. Anonymous case studies — "a leading e-commerce brand in the MENA region" — cannot be cross-checked. If an agency cannot name the client, ask why. NDA clauses are legitimate, but they should allow a reference call even if the public post is anonymised.
  • Baseline metrics, not just end-state metrics. "Organic sessions grew 300%" is meaningless without knowing the starting point. Three hundred percent from 100 sessions per month is a different story from 300 percent from 50,000.
  • Date range covering at least twelve months. SEO results that are measured over three to six months often capture algorithm volatility or seasonal uplift rather than sustainable improvement.
  • Specific tactics listed. What pages were created? Which technical issues were fixed? Were backlinks acquired, and from which sources? Vague references to "comprehensive SEO strategy" tell you nothing about replicability.
  • Revenue or conversion data, not just traffic. Traffic that does not convert is a vanity metric. The best case studies show what happened to leads, revenue, or pipeline alongside rankings and sessions.

What most published studies omit

Competitors in this space typically include a list of traffic wins with nice charts. What they almost never include is competitor context — whether the entire industry keyword category was rising during the same period — or the cost basis. Knowing that an agency delivered 200 percent traffic growth is far less useful if you do not know whether the result required a $3,000/month retainer or a $15,000/month one. Cost-adjusted ROI is the metric that actually maps to your decision, and it is almost never published.

How to Verify SEO Case Studies: A Step-by-Step Checklist

Once you have the case study document in front of you, work through the following process before the first agency call. It takes under an hour and will eliminate the majority of weak candidates.

Step 1 — Cross-check domain-level data with third-party tools

Paste the client's domain into Ahrefs Site Explorer or Semrush's Domain Overview. Both tools provide historical organic traffic estimates. Compare the shape of the curve against the campaign dates the agency claims. If the agency says traffic doubled between January and June 2023, the Ahrefs or Semrush trend should show the same inflection point. A mismatch — traffic already rising before the agency started, or no visible change at all — is a serious red flag.

Neither tool provides exact session counts (only Google Search Console does), but directional alignment is a reasonable proxy for truth. A credible agency will not object to you checking this; a defensive reaction to third-party verification is itself diagnostic.

Step 2 — Request a Search Console screenshot

Ask the agency for a Google Search Console Performance report screenshot covering the campaign period, filtered to organic search. This is the most important single verification step. GSC data is tied to the property owner's account and cannot be fabricated without obvious tells (inconsistent date labels, missing impression data, suspicious click-through rates). If the agency claims client confidentiality prevents sharing, ask whether the client would join a brief reference call to screen-share the data instead.

Step 3 — Check for algorithm timing

Visit Moz's Google Algorithm Change History and overlay the case study dates with major core updates. A traffic gain that lands precisely on a broad core update date is more likely to reflect Google's rewarding (or penalising competitors of) the client's sector than it is to reflect the agency's specific work. This is not a disqualifier — recovering from a penalty or capitalising on an update can be genuinely skilled work — but it should change how you interpret the attribution.

Step 4 — Run a reference check with the actual client

Request contact details for the case study client, not a pre-written testimonial. Testimonials are curated; a five-minute phone call is not. Ask the former client three specific questions: Did the results hold for at least six months after the campaign ended? What was the monthly retainer? Were there any significant changes to their paid spend or website during the period? The answers to all three will tell you more than any published document.

Comparing Agency Case Studies: A Decision Framework

When you are evaluating multiple agencies simultaneously, a structured comparison prevents you from defaulting to whoever presented last or has the most polished PDF. The table below applies to any two agencies you are shortlisting.

Evaluation CriterionWhat a Strong Case Study ShowsWhat a Weak Case Study Shows
Client identityNamed domain or client with reference availableAnonymous or described only by sector
Baseline dataStarting traffic, rankings, and conversion rates statedPercentage gain only, no absolute numbers
Campaign duration12+ months with monthly data pointsUnder 6 months, or only start and end snapshots
Tactics specifiedNamed pages, technical fixes, link acquisition sourcesGeneric references to "content strategy" and "on-page SEO"
Third-party verifiabilityAligns with Ahrefs/Semrush historical dataAgency declines third-party cross-check
Business outcome includedRevenue, leads, or conversion rate movement shownTraffic and rankings only
Cost contextRetainer or project cost disclosed or available on requestNo cost information; ROI cannot be calculated

Who This Framework Is For — and Who It Is Not

This is for you if:

  • You are evaluating two or more SEO agencies and need a consistent scoring method.
  • You have been pitched by an agency whose case studies all feature anonymous clients and percentage-only results.
  • You are a marketing director or procurement lead who will need to justify the agency selection to a CFO or board.
  • You are in a competitive sector (legal, finance, e-commerce, real estate) where an agency's sector experience is directly material to whether their results are repeatable for your business.

This is not the right framework if:

  • You are hiring a freelance SEO consultant for a one-off technical audit — the case study burden of proof is different at that scale.
  • You are in a brand-new niche where no agency will have directly comparable case studies, and you are better served evaluating methodology and team credentials instead.
  • You have already signed a contract — at that point, the evaluation framework shifts from due diligence to performance benchmarking.

Red Flags That Should Disqualify an Agency Immediately

Across agency pitches, certain patterns appear repeatedly in portfolios that cannot survive verification. If you encounter any of the following, treat it as a disqualifier unless the agency can produce a satisfactory explanation with evidence.

  • All case studies are from the same narrow period. If every result clusters around one twelve-month window two or three years ago, ask what has happened to client results since. Agencies that cannot show recent performance may have changed their approach, lost key team members, or pivoted away from the channel that drove those historical results.
  • Percentage gains without absolute numbers. An agency that grew organic traffic by 1,200 percent may have taken a site from 50 to 650 sessions per month. That is not a meaningful reference point for a site already receiving 20,000 monthly sessions.
  • No mention of any setback or plateau. Real SEO work includes Google updates that temporarily erode gains, content programmes that underperform, and link-building approaches that require adjustment. A portfolio in which every client experienced linear, uninterrupted growth is a curated fiction.
  • Case studies that predate the agency's current team. The senior strategist who drove a landmark result in 2020 may have left in 2022. Verify that the people credited with historical results are still with the agency and will be on your account.
  • Traffic gains that do not correspond to any GSC-visible keyword movement. If an agency claims traffic grew significantly but cannot show which keyword clusters drove that growth, the result may have come from paid or referral traffic that was misattributed to organic.

FAQ

Can I trust an SEO agency that only has anonymised case studies?

Anonymised case studies are not automatically dishonest — some industries require NDAs, and regulated sectors such as finance and healthcare frequently prevent public disclosure. The key question is whether the agency can arrange a reference call with the unnamed client, even if they cannot publish the company name. If they cannot facilitate that, you have no verifiable evidence of the result at all, and you should weight their portfolio accordingly.

How many case studies should an agency have before I consider them credible?

Volume is less important than relevance and verifiability. Two deeply evidenced case studies in your sector — with named clients, GSC data, and available references — carry more weight than fifteen glossy PDFs featuring anonymous brands. If an agency has been operating for more than three years and cannot produce three verifiable results, that is itself a data point.

What if the client in the case study is a direct competitor of mine?

This is worth raising explicitly in the pitch conversation. An agency that has worked with your direct competitors may have valuable sector knowledge, or they may have a conflict of interest. Ask how they handle competing clients — specifically whether they use shared keyword strategies, whether team members switch between accounts, and what their policy is on confidential competitive data. A mature agency will have a clear answer.

Should I use Ahrefs or Semrush to verify case studies?

Both tools are suitable for directional verification of historical organic traffic. Ahrefs is generally considered stronger for backlink data and keyword accuracy; Semrush offers broader traffic estimation models and is often more familiar to in-house marketing teams. For case study verification purposes, use whichever tool you already have access to — the historical organic traffic trend is available in both, and that is what you are checking.

Indexed Research

Written by

Indexed Research

Research team, Indexed · Reviewed by Anjan Luthra

The Indexed research team tracks how search and AI answer engines behave, tests what actually moves visibility, and publishes the reference material behind our client work.

Share

One email a week

How to turn search into revenue.

One idea a week from live client work — what we changed, what it was worth, and what you can take from it.

One email a week. Unsubscribe in one click.