How to Evaluate an SEO Agency: 10 Criteria

The Problem

Why do 67% of brand-agency SEO relationships fail in the first year?

Because the selection process measures the wrong things.

Hiring an SEO agency is a six-figure decision for most brands doing Rs 10 crore or more in annual revenue. Yet the typical evaluation process boils down to: who had the best pitch deck, who name-dropped the biggest client, and who quoted the lowest retainer. That’s how you end up firing your agency 9 months later. According to the 2025 HubSpot State of Marketing Report, only 33% of marketing leaders described their agency relationships as “highly effective.” The other two-thirds are stuck in cycles of misaligned expectations, unclear reporting, and work that doesn’t connect to revenue. This guide gives you a structured evaluation framework. Ten criteria, each weighted by importance, with a scoring rubric you can use across every agency in your shortlist. We built it because our clients kept telling us the same story: “We wasted a year with the wrong agency before finding you.”

“The best predictor of agency performance isn’t their client list or their case studies. It’s whether they can explain their methodology in language a CEO would understand, not in jargon designed to make you dependent on them.”
Hardik Shah, Founder of ScaleGrowth.Digital

In This Guide

What does this evaluation framework cover?

Transparency and Reporting
Methodology and Process
Case Studies and Proof of Work
Team Structure and Talent
Communication and Responsiveness
Contract Terms and Flexibility
Pricing Model and Value Alignment
Industry Specialization
Strategic Thinking vs. Task Execution
Client References and Retention
The Scoring Rubric
Red Flags vs. Green Flags
25 Questions to Ask in the Pitch

Criterion 1

Does the agency give you full transparency into what they’re doing and why?

Transparency is the single most weighted criterion in this framework, and for good reason. An agency that won’t show you exactly what they’re doing with your budget is an agency you can’t hold accountable. According to Seer Interactive’s 2025 Agency Trust Survey, 78% of brands that terminated an agency relationship cited “lack of visibility into work being done” as a primary factor.

What to look for: Access to all your own data (Google Analytics, Search Console, Ahrefs/SEMrush accounts). Real-time or weekly dashboards you can check without asking. Monthly reports that explain the “so what,” not just the “what.”

Score a 5 if: You own every account. Reports include raw data links. There’s a live dashboard you can access anytime. Deliverables are documented in a shared project management tool. Score a 1 if: The agency controls your analytics accounts. Reports are PDF-only with no raw data access. You have to request updates instead of seeing them proactively. This criterion gets a weight of 15 out of 100 in our scoring rubric because it’s foundational. Without transparency, you can’t evaluate any of the other nine criteria accurately.

Criterion 2

Can they explain their SEO methodology in plain language?

Every credible SEO firm has a process. The question is whether they can walk you through it without hiding behind jargon. A 2025 Gartner study on agency selection found that agencies with documented, repeatable methodologies delivered 2.4x higher client satisfaction scores than those operating on ad-hoc approaches. Ask the agency to describe their process from onboarding to Month 6. You should hear clearly defined phases: audit, strategy, implementation, measurement, optimization. Each phase should have defined deliverables and timelines, not vague promises about “improving your rankings.” Score a 5 if: They present a documented methodology with named phases, timelines, deliverables, and clear success metrics per phase. They explain how SEO connects to your revenue, not just your traffic. Score a 1 if: They talk about “doing SEO” without a structured process. Their pitch is heavy on tools they use but light on strategic rationale. They can’t articulate what happens in Month 1 vs. Month 4. Weight: 12 out of 100.

Criterion 3

Do their case studies prove they’ve solved problems like yours?

Case studies are the proof layer. But not all case studies are equal. A screenshot showing “300% traffic increase” means nothing without context: what was the starting baseline, what was the timeline, what specifically did the agency do, and did that traffic convert into revenue? Push for three things in every case study: the before state (with numbers), the specific actions taken, and the business outcome (revenue, leads, pipeline). According to Clutch’s 2025 B2B Buying Survey, 92% of B2B decision-makers review case studies before shortlisting a vendor, but only 23% say they found the case studies “detailed enough to be useful.” Score a 5 if: They share 3+ case studies in your industry or a related vertical. Each includes specific metrics (before/after), timelines, methodology used, and business impact beyond traffic. They’re willing to connect you with the client. Score a 1 if: Case studies are generic (“increased traffic by X%”). No industry relevance. Metrics are vague or cherry-picked. No reference clients offered. Weight: 12 out of 100.

Criterion 4

Who will actually work on your account?

The senior strategist in the pitch meeting is rarely the person doing the daily work. This is the agency industry’s open secret, and it’s the source of enormous frustration for marketing leaders. A 2024 Digiday survey found that 61% of brand-side marketers felt “bait-and-switched” by the team presented in a pitch vs. the team assigned post-contract. Ask to meet the actual team members who will handle your account. Get their names, experience levels, and how many other accounts they manage. If your account strategist is juggling 15 clients, you’re getting 3 hours of strategic thinking per week at best. Score a 5 if: They introduce you to the actual team (not just the sales lead). Each team member handles 4-6 accounts max. The senior strategist has 5+ years of experience and stays involved post-sale. Score a 1 if: “We’ll assign a team after you sign.” No clarity on who works on what. High team-to-client ratios. Juniors doing strategy work without oversight. Weight: 10 out of 100.

Criterion 5

How do they communicate, and how quickly do they respond?

Communication quality predicts relationship longevity better than any other factor. The agency might produce excellent work, but if you can’t reach them when you need them, trust erodes fast. A study by Setup (2024) found that “communication and responsiveness” ranked as the #1 factor in client satisfaction, ahead of campaign performance. During the evaluation phase, pay attention to how they communicate before they have your money. Response times during the sales process are typically the fastest they’ll ever be. If emails take 3 days during the pitch, expect 5 days once you’ve signed. Score a 5 if: Dedicated point of contact. Defined communication cadence (weekly updates, monthly strategy calls). Response time SLA (e.g., 24-hour response guarantee). Proactive communication about issues or opportunities. Score a 1 if: No dedicated contact. You have to chase for updates. No defined meeting cadence. Important questions get answered days later via email chains. Weight: 10 out of 100.

Criterion 6

What do the contract terms actually say?

Contract terms reveal how confident an agency is in their own work. Long lock-in periods (12-24 months with no exit clause) are a sign that the agency knows clients leave once they see the results. According to a 2025 Agency Spotter analysis, 42% of agency contracts include auto-renewal clauses that kick in if the client doesn’t send written notice 60-90 days before expiry. Read the contract for: termination clauses, data ownership provisions, IP ownership (who owns the content they produce?), performance benchmarks tied to contract renewal, and scope-of-work specificity. Score a 5 if: 90-day out clauses. You own all content and data. Clear scope of work with defined deliverables per month. Performance milestones tied to contract terms. No auto-renewal traps. Score a 1 if: 12-month minimum with no exit clause. Agency retains ownership of content. Vague scope (“SEO services”). Auto-renewal buried in fine print. Penalties for early termination. Weight: 10 out of 100.

Criterion 7

Does their pricing model align with how value is created?

SEO pricing models vary widely: monthly retainers, project-based fees, performance-based pricing, and hourly rates. None of these is inherently better. What matters is whether the pricing model creates the right incentives. Monthly retainers (the most common model, used by roughly 74% of agencies per Credo’s 2025 Pricing Survey) work well when scoped clearly. Performance-based pricing sounds appealing but often incentivizes the agency to chase easy wins rather than build long-term organic authority. The Indian market sees SEO retainers ranging from Rs 50,000 to Rs 5,00,000+ per month depending on scope and company size. Score a 5 if: Pricing is clearly tied to scope. They can explain what you get for every rupee. There’s a clear escalation path as your needs grow. No hidden costs for tools, reporting, or “account management fees.” Score a 1 if: Pricing is vague (“starting at Rs 25,000/month”). Lots of add-ons that weren’t in the original quote. Performance-based pricing with metrics you can’t verify independently. Significant price jumps between tiers with unclear value difference. Weight: 8 out of 100.

Criterion 8

Do they specialize in your industry or business model?

A generalist agency can do competent SEO. A specialist agency can do transformative SEO. The difference lies in understanding your customer’s search behavior, your competitive set, your regulatory environment, and your sales cycle. An agency that’s worked with 20 BFSI brands already knows that “home loan” and “housing loan” have different search intent in India. A generalist would need 3 months to learn that. Specialization doesn’t mean the agency only works in your industry. It means they’ve built enough domain knowledge to skip the learning curve and start creating value from Month 1. Score a 5 if: 3+ clients in your vertical. They can speak your industry language. Their audit or pitch includes industry-specific observations, not generic SEO recommendations. They understand your regulatory constraints. Score a 1 if: Zero experience in your vertical. Their pitch could apply to any company in any industry. They don’t know your competitors. They’ve never dealt with your compliance requirements. Weight: 8 out of 100.

Criterion 9

Are they a strategic partner or a task executor?

The agencies worth their retainer don’t just execute a list of SEO tasks. They connect SEO to your business strategy. They tell you when your product positioning is hurting your search visibility. They push back on keyword targets that drive traffic but not revenue. They bring competitive insights you haven’t seen. Exceed SEO’s 2026 analysis of B2B agency relationships found that agencies scoring high on “strategic contribution” had 3.2x longer average client retention than those scoring high only on “execution quality.” Execution is table stakes. Strategy is what separates a partner from a vendor. Score a 5 if: During the pitch, they challenge your assumptions. They bring insights about your market you didn’t already know. They talk about business outcomes, not just SEO metrics. They have a clear POV on where your industry is heading. Score a 1 if: They agree with everything you say. Their pitch is about what they’ll do (tasks), not what you’ll achieve (outcomes). They don’t ask about your business model, revenue targets, or customer acquisition costs. Weight: 8 out of 100.

Criterion 10

What do their current and former clients say?

References are the acid test. Testimonials on an agency’s website are curated. Clutch reviews are useful but incomplete. The real signal comes from having a 15-minute conversation with a current or recently departed client. According to Clutch’s 2025 data, agencies with an average client tenure above 2 years deliver 40% higher satisfaction scores than those with sub-12-month average tenures. Ask for 3 references: one current long-term client (2+ years), one current client in your industry, and one client who left. If an agency won’t provide a departed client reference, ask why. Score a 5 if: They proactively offer 3+ references. Average client tenure is 2+ years. References confirm that the agency delivers on promises, communicates well, and drives real business results. Score a 1 if: They can’t provide references. All references are from the past 6 months (no long-term clients). References describe execution but not strategic value. Former clients describe misalignment between pitch promises and actual delivery. Weight: 7 out of 100.

The Framework

How do you score agencies using this rubric?

Rate each agency 1-5 on every criterion. Multiply by weight. Compare total scores.

Criterion	Weight	Agency A (1-5)	Agency B (1-5)	Agency C (1-5)
1. Transparency & Reporting	15
2. Methodology & Process	12
3. Case Studies & Proof	12
4. Team Structure & Talent	10
5. Communication	10
6. Contract Terms	10
7. Pricing Model	8
8. Industry Specialization	8
9. Strategic Thinking	8
10. References & Retention	7
Total (max 500)	100

How to calculate: For each criterion, multiply the agency’s score (1-5) by the weight. Sum all 10 weighted scores. Maximum possible: 500 points. Interpretation:

400-500: Strong candidate. Move to reference checks and contract negotiation.
300-399: Decent candidate with gaps. Identify specific weaknesses and discuss them directly.
200-299: Below standard. Material concerns that likely won’t improve post-contract.
Below 200: Walk away. Too many red flags.

Red Flags vs. Green Flags

What are the instant deal-breakers and trust signals?

Red Flag	Green Flag
Guarantees #1 rankings or specific positions	Explains ranking factors and sets realistic timelines (4-12 months)
Won’t share their link building sources	Walks you through their link acquisition process with examples
Uses proprietary metrics you can’t verify	Reports on standard metrics (Search Console, GA4) you can confirm
Requires you to use their analytics accounts	Works inside your existing accounts and grants you full ownership
Promises results in 30-60 days	Sets 90-day milestones with specific deliverables per phase
12-month lock-in with no exit clause	90-day out clause or month-to-month after initial term
Can’t name the people working on your account	Introduces your actual team before you sign
Uses words like “secret sauce” or “proprietary algorithm”	Explains their methodology in plain business language
No references provided, or only very recent clients	Offers references including long-term clients and former clients
Says “trust us” instead of showing data	Leads with data, shows the raw numbers, explains the interpretation

Due Diligence

What are the 25 questions every CMO should ask an SEO agency?

Organized by evaluation criterion. Print this list and bring it to the pitch meeting.

Transparency & Reporting

Will we own all analytics accounts (GA4, Search Console, Ahrefs)?
Can we access a live dashboard at any time, or do we wait for monthly reports?
What does your standard monthly report include, and can we see a sample?

Methodology

Walk us through your process from onboarding to Month 6.
How do you decide which keywords to target for our business?
How do you approach link building, and can you share specific examples of links you’ve built for other clients?

Case Studies

Can you share a case study from a company in our industry with before/after metrics?
What was the timeline from engagement start to measurable results in that case?
Did organic traffic gains translate into revenue, and how did you measure that?

Team

Who specifically will work on our account? Can we meet them before signing?
How many other accounts does our primary strategist manage?
What happens if our account lead leaves your company?

Communication

What’s your guaranteed response time for emails and urgent requests?
How often will we have strategy calls, and who attends from your side?
How do you handle disagreements on strategy or priorities?

Contracts & Pricing

What’s the minimum contract term, and what are the early exit terms?
Who owns the content and assets you create for us?
What’s included in the retainer, and what costs extra?

Specialization

How many clients do you currently serve in our industry?
What do you know about our competitive set that we might not know?
What industry-specific SEO challenges have you solved before?

Strategy

Based on a quick look at our site, what are the top 3 things you’d fix first?
How do you connect SEO metrics to revenue and business outcomes?
How are you preparing clients for AI-driven search (Google AI Overviews, ChatGPT Search)?

References

Can you connect us with 3 references, including one long-term client and one who left?

Pro Tips

What do experienced marketing leaders do differently?

Run a Paid Audit First

Before signing a 6-month retainer, commission a paid diagnostic audit (Rs 25,000-75,000 is typical). This is the best $300-900 you’ll spend. You’ll see their analytical depth, communication style, and strategic thinking before committing to a long-term relationship.

Check Their Own SEO

Run the agency’s own website through Ahrefs or SEMrush. If an SEO firm can’t rank for their own target keywords, that tells you something. Look at their domain rating, organic traffic trend, and content quality.

Evaluate the Sales Process

How they sell is how they’ll serve. If the pitch is high-pressure, the relationship will be high-pressure. If they take time to understand your business before proposing a scope, they’ll take that same care in execution.

Don’t Anchor on Price

The cheapest SEO retainer is rarely the best value. A Rs 50,000/month agency delivering no results is infinitely more expensive than a Rs 2,00,000/month firm that generates Rs 20,00,000 in pipeline. Evaluate cost per outcome, not absolute cost.

Pitfalls

What mistakes do brands make when hiring an SEO agency?

1. Choosing based on the pitch deck alone. The agency with the best presentation isn’t necessarily the best executor. Pitch quality and delivery quality are different skills. Always validate the pitch claims with references and a trial project. 2. Not defining success before signing. If you don’t agree on what “good” looks like in Month 3, Month 6, and Month 12, you’ll both claim different versions of reality when the contract renewal conversation comes. Set specific KPIs upfront: organic traffic, keyword positions, leads from organic, revenue from organic. 3. Ignoring the AI visibility question. By 2026, an estimated 30% of search traffic is influenced by AI-generated answers (Google AI Overviews, ChatGPT Search, Perplexity). If your agency isn’t thinking about AI citability, they’re optimizing for yesterday’s search. 4. Treating SEO as a siloed channel. SEO interacts with content marketing, PR, product, and engineering. An agency that only talks about “SEO” without understanding how it connects to your broader growth strategy will underperform. The best agencies ask about your entire marketing mix during the pitch. 5. Falling for the “big agency” name. Large agencies have brand credibility, but your account might be staffed by the B-team. Mid-size firms often assign senior people to every account because they can’t afford not to. Size is not a proxy for quality.

Related Resources

What else should you use alongside this evaluation guide?

Marketing RFP Template

Send a structured RFP to your shortlisted agencies. Our template includes scope definition, evaluation criteria, and submission requirements. Get Template →

Agency Performance Scorecard

Once you’ve hired an agency, use this monthly scorecard to track performance across KPIs, deliverables, communication, and strategic value. Get Scorecard →

SEO Report Template

Know what a proper SEO report should look like. Use this template to evaluate whether your agency’s reporting meets professional standards. View Template →

FAQ

Frequently Asked Questions

How much should an SEO agency cost in India?

SEO retainers in India range from Rs 50,000 to Rs 5,00,000+ per month depending on company size, scope, and the agency’s experience level. For brands doing Rs 10 crore or more in annual revenue, expect to invest Rs 1,50,000-3,00,000 per month for a competent full-scope SEO engagement. Anything below Rs 75,000/month typically means junior talent or a cookie-cutter approach.

How long does it take to see results from a new SEO agency?

Expect 3-6 months for initial ranking improvements and 6-12 months for meaningful organic traffic growth. Technical fixes often show impact within 4-8 weeks. Content-driven strategies take longer because Google needs time to crawl, index, and build trust for new pages. Any agency promising significant results in under 90 days is either targeting very low-competition keywords or being dishonest.

Should I hire an SEO agency or build an in-house team?

For most brands under Rs 100 crore in revenue, an agency is more cost-effective. A single senior SEO hire costs Rs 15-30 lakh per year (salary plus benefits), and you’d need at least 3 people (strategist, content writer, technical SEO) for a capable team. That’s Rs 40-80 lakh annually before tools (Rs 5-10 lakh/year for Ahrefs, SEMrush, Screaming Frog). An agency provides that entire team for Rs 18-36 lakh per year. The trade-off is control and institutional knowledge.

What’s the most important thing to check before hiring an SEO agency?

Transparency. An agency that gives you full access to your own data, reports with raw numbers (not just summaries), and a clear methodology is an agency you can hold accountable. Everything else is secondary. If you can’t see what they’re doing and verify the results independently, you’re operating on faith.

How many agencies should I evaluate before deciding?

Shortlist 3-5 agencies. Fewer than 3 and you don’t have enough comparison data. More than 5 and the evaluation process becomes unwieldy, and agencies start looking similar. Send an RFP to all of them, hold 60-minute pitch meetings with each, then score them using the rubric in this guide.

How to Evaluate an SEO Agency: 10 Criteria That Separate Partners From Vendors