Because informal evaluation leads to expensive mistakes. A 2025 Gartner CMO survey found that 58% of marketing leaders had replaced at least one external partner in the previous 18 months. The top reason was not poor performance but misaligned expectations set during the sales process. SEO is particularly hard to evaluate before you buy. The deliverables are intangible. The timeline to results is 4-9 months. The terminology is dense enough that a polished pitch can mask shallow thinking. And most contract structures are designed to protect the vendor through a long lock-in period rather than create accountability for outcomes. The 15 questions below cover five categories that matter in every SEO engagement:

1. Methodology (questions 1-3): How do they actually work?
2. Team and execution (questions 4-6): Who does the work?
3. Reporting and measurement (questions 7-9): How will you know it is working?
4. Contract and commercial terms (questions 10-12): What are you signing?
5. AI visibility and future-readiness (questions 13-15): Are they building for 2026 search, or 2019 search?

Ask all 15 in your next vendor evaluation. The answers will tell you more than any case study or proposal deck.

This question tests whether the firm has a repeatable system or improvises with each client. A firm with a defined methodology will walk you through phases, milestones, and decision points. A firm without one will give you a vague timeline padded with buzzwords. Here is what a strong 90-day methodology looks like:

• Weeks 1-2: Technical audit, keyword research, competitive analysis, baseline measurement
• Weeks 3-4: Strategy presentation with prioritized opportunities and projected timelines
• Weeks 5-8: First wave of technical fixes and content production against highest-priority targets
• Weeks 9-12: Measurement against 90-day KPIs, course correction, second-wave planning

The critical detail is what happens between phases. Strong firms have decision gates: specific criteria that must be met before moving to the next phase. If the technical audit reveals a site migration is needed, the content plan changes. If keyword research reveals the original target list is unrealistic, the strategy adapts. These decision gates show that the firm thinks in systems, not templates. At ScaleGrowth.Digital, a growth engineering firm that builds organic acquisition systems, our first 90 days produce a diagnostic report that runs 30+ sections before any optimization work begins. That diagnostic becomes the decision gate. No work starts until the data says where to start. Keyword prioritization is the single highest-impact decision in any SEO engagement. Target the wrong keywords and you will get traffic that does not convert. Target the right ones and the same budget produces 3-5x more pipeline. Most firms prioritize by search volume and keyword difficulty. Those are inputs, not a prioritization framework. A strong firm layers in:

• Conversion intent: Does this keyword signal buying intent or informational browsing?
• Current position: Are you on page 2 (striking distance) or page 10 (long road)?
• Competitive density: Who ranks now and how hard will they be to displace?
• Content gap: Do you have a page for this keyword, or does one need to be created?
• Business value: What is a converted visitor on this keyword worth to your revenue?

When a firm tells you “we’ll target 50 keywords in month one,” ask which 50 and why those 50. The answer will reveal whether their prioritization is driven by data or by the need to fill a deliverables spreadsheet. A 2024 Ahrefs study of 14,000 SEO campaigns found that campaigns targeting fewer, higher-intent keywords outperformed broad campaigns by 2.7x on conversion rate. If the firm has not looked at your site before the pitch meeting, they are selling, not solving. This question is a filter. Any firm that says “we’ll do a full audit after you sign” is asking you to pay for the diagnosis before they know what’s wrong. A credible firm will have spent 30-60 minutes on your site before the first call. They should be able to name:

1. At least 2 technical issues visible in a quick crawl (page speed, indexation gaps, mobile usability)
2. At least 1 content gap compared to your top competitors
3. A rough sense of your current organic visibility and where the upside is

They do not need a complete audit. They need evidence that they did homework. A firm that walks in with a preliminary analysis is telling you something about how they operate. A firm that walks in with a generic pitch deck is telling you something different.

The fastest way to evaluate a firm’s reporting quality is to see a real report. Not a sample. Not a template. An actual report they sent to an actual client, with the client name redacted. The difference between a sample and a real report is the difference between a model home and a lived-in house. What to look for in a strong report:

• Business metrics first: Revenue from organic, leads from organic, conversion rate. Not just traffic.
• Trend lines: Month-over-month and year-over-year comparisons, not just snapshots.
• Attribution: How they connect specific SEO work to specific outcomes.
• Narrative: Written analysis of what happened, why it happened, and what is planned next.
• Action items: Specific next steps with owners and deadlines, not vague recommendations.

If the report is a PDF of ranking screenshots from Ahrefs with a logo slapped on top, that tells you the firm measures activity, not outcomes. In our experience reviewing 100+ reports from across the industry, fewer than 20% connect organic traffic to revenue in a meaningful way. Revenue attribution is where most SEO engagements break down. Without a clear attribution model, the firm cannot prove ROI and you cannot justify the spend to your CFO. It is that direct. There are three common attribution approaches for organic:

1. Last-click attribution: Counts revenue only when organic search was the last touch before conversion. Undervalues organic significantly.
2. First-click attribution: Counts revenue when organic was the first touch in the customer journey. Overvalues organic.
3. Multi-touch attribution: Distributes credit across all touchpoints. Most accurate but requires analytics infrastructure.

The right answer is not any single model. The right answer is: “Here is the attribution model we recommend for your business, here is why, and here are its limitations.” A firm that admits limitations is a firm that understands measurement. A firm that claims organic “generated $2M in revenue” without explaining the attribution method is a firm that is comfortable with imprecision. For context, a 2024 Forrester study found that companies using multi-touch attribution models reported 23% higher confidence in their channel-level ROI calculations compared to single-touch models. This question reveals more about a firm’s character than any case study. Every engagement hits a rough patch. What matters is the response protocol. A strong firm will describe a structured process:

1. Root-cause analysis: What changed? Algorithm update, competitive shift, technical regression, content underperformance?
2. Data review: Pull 90-day trend data across all key metrics to isolate the problem.
3. Revised plan: Present a specific course correction with new timelines and updated projections.
4. Transparent communication: Proactive outreach, not waiting for the client to notice.

A weak firm will say “SEO takes time” and point to vanity metrics that look positive while the business metrics stall. If the firm’s answer to this question is a version of “trust the process,” that is not accountability. That is a request for patience without evidence that patience will pay off.

This is the question that separates 2026-ready firms from firms running a 2019 playbook. Google’s AI Overviews now appear in approximately 40% of informational search queries. ChatGPT processes over 1 billion searches per week. Perplexity, Claude, and Gemini are growing as information sources. An SEO firm that does not have an explicit strategy for AI visibility is ignoring the fastest-growing segment of search. A firm with a real AI visibility practice will discuss:

• AI Overview optimization: How they structure content to be cited in Google’s AI-generated answers
• Entity authority: Building your brand’s entity signals so AI models recognize and reference you
• Citation tracking: Monitoring when and where your brand appears in AI-generated responses
• Structured data: Schema markup that helps AI systems understand your content and expertise
• Multi-platform monitoring: Tracking visibility across ChatGPT, Perplexity, Gemini, and Google AI Overviews

If the firm’s answer is “we’re keeping an eye on AI developments” or “we’ll adapt as things change,” they have not built the capability. AI visibility is not a future consideration. It is a current requirement. Our SEO service includes AI visibility as a core component, not an add-on, because it accounts for a growing share of how your buyers find information. A firm’s relationship with AI tools tells you about their operational maturity. There are three levels:

Level 1: No AI adoption

The firm does everything manually. This is increasingly rare but still exists. It means slower execution, higher costs, and no ability to analyze data at scale. A firm at this level is likely to miss patterns that AI-assisted analysis catches.

Level 2: AI as a crutch

The firm uses ChatGPT or similar tools to generate content, write meta descriptions, and produce reports with minimal human review. This creates volume but not quality. Content reads as generic. Recommendations lack nuance. The human layer is a thin veneer over machine output.

Level 3: AI as infrastructure

The firm uses AI for data analysis, pattern recognition, and initial research. Humans make strategy decisions, review all output, add proprietary insight, and ensure quality. AI makes the team faster and more thorough without replacing judgment. You want a firm at Level 3. Ask for specific examples. “We use AI to analyze 10,000+ keywords and identify patterns a human would miss, but every strategic recommendation is reviewed by the account strategist” is a strong answer. “We use AI to write blog posts” without mentioning quality review is a concerning answer. A firm that cannot name risks has not thought deeply about your business. Every SEO engagement has risks. The honest ones include:

• Algorithm volatility: A core update during the engagement could shift rankings regardless of work quality.
• Competitive response: Your competitors are also investing in SEO, and some will outspend you.
• Technical constraints: Your CMS, dev team bandwidth, or release cycle may limit implementation speed.
• Content velocity: If content production depends on internal SMEs who are overloaded, timelines slip.
• Market shifts: Changes in buyer behavior, new regulations, or industry disruptions.

“When a firm tells me there are no risks, I know they are selling, not strategizing. Every engagement has constraints. The firms that name them upfront are the ones that plan for them. The ones that hide them are the ones that blame you when things go sideways.” — Hardik Shah, ScaleGrowth.Digital

The risk question also tests problem-solving capability. A firm that names a risk and immediately describes the mitigation plan is demonstrating the kind of thinking you need on your account. A firm that deflects the question is demonstrating the opposite.

Five patterns appear repeatedly in engagements that end badly. Recognizing them before you sign saves both money and time.

Mistake 1: Evaluating the pitch, not the process

A polished presentation does not predict execution quality. The firm that spends 40 hours on a pitch deck might spend 4 hours on your monthly strategy. Ask to see process documentation, not presentation materials. Internal playbooks, onboarding checklists, and QA workflows reveal more than any slide deck.

Mistake 2: Choosing on price alone

A $5,000/month engagement that produces no measurable results costs more than a $15,000/month engagement that generates $150,000 in organic pipeline. The relevant metric is not monthly cost. It is cost per acquired customer through organic and the payback period on total investment. At $5,000/month over 12 months, a failed engagement costs $60,000 in fees plus 12 months of lost compound growth.

Mistake 3: Not defining success criteria before signing

If you do not agree on what “success” means at month 6 and month 12 before the contract starts, you will argue about it later. Get specific targets in writing: organic traffic growth percentage, keyword positions for priority terms, organic lead volume, and revenue attribution. Both sides should agree on the measurement methodology and the data sources.

Mistake 4: Ignoring the transition plan

Ask upfront: “If this engagement ends, what does the handoff look like?” The answer should include documentation of all work completed, access to all accounts and data, and a 30-day transition period. A firm that does not have a transition plan assumes you will never leave. That assumption should concern you.

Mistake 5: Not checking references from similar engagements

Request 3 references from companies in your industry or of similar size. Not testimonials on the website. Phone calls with actual marketing directors who managed the relationship. Ask: “What went wrong, and how did the firm handle it?” That question reveals more than “Would you recommend them?” The answers from reference checks and verified results form the final layer of your evaluation.