How to Measure Whether Your Agency Is Actually Working
Most marketing directors evaluate their external partners using the wrong metrics at the wrong cadence. The result: they keep underperformers for 9-12 months too long, or fire good partners 3 months before the compound effects would have shown up. This framework gives you the specific leading and lagging indicators, healthy ranges, and monthly review structure to make evidence-based stay-or-switch decisions.
Why Do Most Companies Struggle to Evaluate Their Marketing Partners?
- Keeping bad partners too long. The average tenure of an underperforming marketing relationship is 14 months, according to a 2024 Forrester study. That is 14 months of retainer fees, internal coordination time, and opportunity cost. Most marketing directors report “gut feeling that things aren’t working” by month 4, but they lack the data framework to make a defensible case for change.
- Firing good partners too early. Organic search, content systems, and brand-building compound over 6-18 months. A partner executing the right strategy will often show modest results in months 2-4 before acceleration kicks in around months 5-8. Without leading indicators to track, the only visible measure is “did revenue go up last month?” and the answer in early months is usually “not yet.”
What Is the Difference Between Leading and Lagging Indicators for Partner Performance?
Leading Indicators (Months 1-3)
These are the signals that predict future performance. If leading indicators are strong but revenue has not moved yet, that is expected. If leading indicators are weak, revenue will not move later either.- Velocity of execution. How many deliverables shipped per month versus what was promised? A partner that commits to 12 content pieces per quarter and delivers 5 has a velocity problem that no amount of “quality over quantity” can explain away.
- Technical debt resolved. In SEO specifically, the number of crawl errors fixed, pages indexed, and Core Web Vitals improved in the first 90 days. These are preconditions for ranking, not rankings themselves.
- Keyword movement direction. Not “are we ranking #1?” but “are positions moving in the right direction?” A keyword moving from position 47 to position 19 in 60 days is a strong leading signal, even though position 19 generates almost no traffic.
- Communication quality. Are you getting proactive updates, or are you always the one asking? A partner that surfaces problems before you notice them is running ahead of the account. A partner that responds to your questions with “let me check” every time is running behind it.
- Strategic recommendations. How many ideas is the partner bringing to the table that you did not ask for? Measure this literally. Count the recommendations per month. Below 2 per month means the partner is executing tasks, not thinking about your business.
Lagging Indicators (Months 4-12)
These are the outcome metrics. They require time to materialise, which is why evaluating a partner on lagging indicators alone in months 1-3 is structurally unfair and leads to bad decisions.- Organic traffic growth. Month-over-month and year-over-year. Both matter because seasonality distorts MoM numbers. A 15% YoY increase in organic sessions is a meaningful signal.
- Conversion rate from organic/paid channels. Traffic without conversions is a content problem, a UX problem, or a targeting problem. Your partner should be able to diagnose which one.
- Cost per acquisition by channel. Is the CPA trending down over 6 months? Flat CPA with rising volume is acceptable. Rising CPA with flat volume is a red flag.
- Revenue attributable to partner-managed channels. The ultimate lagging indicator. Most companies cannot measure this cleanly, which is itself a problem your partner should be helping you solve.
- Share of voice in target keyword set. What percentage of your priority keywords are you ranking for in positions 1-10? Track this quarterly. A move from 12% to 28% share of voice over 6 months is a partner delivering compounding value.
“The number one mistake I see marketing directors make is evaluating month-3 results with month-12 expectations. Organic growth compounds. If the leading indicators are strong at month 3, give the system time. If the leading indicators are weak at month 3, no amount of time will fix it.”
Hardik Shah, Founder of ScaleGrowth.Digital
What Metrics Should You Track, and What Do Healthy Ranges Look Like?
| Metric | What It Tells You | Healthy Range | When to Worry |
|---|---|---|---|
| Deliverable Completion Rate | Is the partner doing what they promised? | 85-100% of committed deliverables shipped on time | Below 70% for 2 consecutive months |
| Organic Traffic Growth (YoY) | Is the SEO strategy producing compounding returns? | 10-25% YoY growth by month 6 | Flat or declining traffic after month 6 with no explained cause |
| Keyword Position Movement | Are target keywords trending toward page 1? | 60%+ of tracked keywords moving up within 90 days | Less than 40% moving up after 90 days of active work |
| Cost Per Acquisition (CPA) | Is the partner getting more efficient with your budget? | CPA trending down 5-15% per quarter | CPA rising for 2+ quarters with no strategic explanation |
| Conversion Rate (Organic) | Is the traffic the partner drives actually relevant? | 1.5-4% for B2B, 2-6% for B2C (industry dependent) | Traffic growing but conversions flat or declining |
| Proactive Recommendations | Is the partner thinking about your business or just executing tasks? | 3-5 strategic recommendations per month | Zero unsolicited recommendations for 60+ days |
| Response Time | Is communication friction slowing down execution? | Same-day response on routine items, 2-hour on urgent | Consistently 48+ hours to respond to routine questions |
| Revenue Attribution | Can the partner connect their work to business outcomes? | Clear attribution model in place by month 3 | Partner cannot explain how their work connects to revenue after 6 months |
| Share of Voice (Target Keywords) | Are you gaining ground against competitors in search? | Measurable increase each quarter (e.g., 15% to 25% in 6 months) | Share of voice declining while competitors gain |
| Technical Health Score | Is the technical foundation improving or degrading? | Crawl errors below 2%, Core Web Vitals passing on 80%+ pages | Technical issues increasing quarter over quarter |
How Should You Structure a Monthly Performance Review With Your Partner?
The 45-Minute Monthly Review Agenda
- Deliverable scorecard (10 minutes). Partner presents: what was committed last month, what was delivered, what was delayed and why. You are looking at the completion rate from the table above. Score it: green (85%+), yellow (70-84%), red (below 70%).
- Leading indicators review (10 minutes). In months 1-6, this is where you spend the most attention. Review keyword movement, technical health changes, content published vs. planned, and proactive recommendations count. Each gets a green/yellow/red score.
- Lagging indicators review (10 minutes). Starting month 4, add this block. Review traffic trends (YoY), conversion rates, CPA movement, and revenue attribution. Score each one. Before month 4, skip this section entirely.
- Blockers and dependencies (5 minutes). Partner flags anything they need from your team that they are not getting. This is critical. If your partner consistently identifies blockers and you consistently fail to clear them, the performance gap is on your side.
- Next month commitments (5 minutes). Partner states exactly what they will deliver next month. Write it down. This becomes the scorecard for the next review.
- Overall score and trend (5 minutes). Assign an overall green/yellow/red for the month. Plot it against previous months. You are looking for trend, not absolute score. Three greens in a row followed by a yellow is fine. Three yellows in a row is a conversation. Two reds in a row is an escalation.
The Scoring System
Keep it simple. Complex scoring systems get abandoned by month 2.- Green: On track. No action needed beyond continuing current plan.
- Yellow: Concerns noted. Partner has 30 days to address. Document the specific concerns in writing.
- Red: Significant underperformance. Triggers a formal improvement conversation with specific milestones for the next 60 days.
What Should You Expect at 30, 90, 180, and 365 Days?
Day 30: Foundation Set
- Complete audit of current state (analytics, search console, ad accounts, technical health)
- Documented strategy with 90-day priorities and measurable targets
- Tracking and attribution infrastructure confirmed or improved
- First deliverables shipped (even if small)
- Communication cadence established and followed
Day 90: Execution Rhythm Proven
- 3 months of deliverables shipped at 85%+ completion rate
- Leading indicators showing positive direction (keyword movement, technical improvements, content velocity)
- At least 8-10 strategic recommendations made beyond the initial plan
- Monthly reviews completed with documented scores
- Any “quick win” opportunities (striking distance keywords, broken pages, ad account waste) captured
Day 180: Results Emerging
- Organic traffic showing measurable YoY improvement (10%+ for most industries)
- At least 30% of target keywords in positions 1-20
- CPA from paid channels trending down or stable with increasing volume
- Attribution model producing actionable data
- Content library growing with measurable engagement metrics
Day 365: Compounding or Not
- 20-40% YoY organic traffic growth (industry dependent)
- Positive ROI on the total partner investment (retainer + ad spend)
- Share of voice in target keywords significantly higher than month 1
- Partner has become a strategic contributor, not just an executor
- Systems and processes built that would survive a team change
What Are the 7 Warning Signs That Your Partner Is Underperforming?
- Reports without insights. The monthly report is 20 pages of charts but contains zero sentences that start with “We recommend…” or “Based on this data, we should…” Reports that describe what happened without explaining why or what to do next are a billing justification, not a strategic document.
- The “we’re working on it” response. When you ask about a missed deliverable and the answer is consistently “we’re working on it” without a specific date, root cause, or plan to catch up, the partner has lost control of the account. Specific answers sound like: “The technical audit is delayed because we found 3x more crawl issues than expected. Revised delivery date is March 15. Here is the interim summary.”
- Team turnover you learn about late. Your account manager changed and nobody told you until you noticed a new name on the email thread. In a well-run engagement, you get 2-4 weeks of transition overlap. In a troubled one, you get an apologetic email after the fact.
- Scope creep without accountability. The partner keeps expanding what they say they need to do (and often what they charge) but the original commitments remain unfulfilled. New initiatives should not start until existing commitments are met.
- Vanity metrics in the foreground. If monthly reports lead with impressions, “total keywords ranking,” or social media follower counts rather than conversions, revenue, and CPA, the partner is either hiding poor performance or does not understand what matters.
- No competitive context. Your traffic grew 8% but your competitor grew 22% in the same period. Without competitive benchmarking, you cannot tell whether your partner is winning slowly or losing relative ground. A good partner brings competitor data into every quarterly review.
- Your internal team is doing their work. If your marketing coordinator is spending 10+ hours per week managing, briefing, chasing, or fixing deliverables from your external partner, you are paying twice for the same output. The whole point of an external partner is to reduce your internal coordination cost, not increase it.
When Should You Stay With Your Current Partner, and When Should You Switch?
Stay When:
- Leading indicators are positive but lagging indicators have not caught up. This is the most common scenario in months 3-6. Keyword positions are improving, content is publishing on schedule, technical health is better than it was. Revenue has not moved. This is normal. Organic growth has a 4-8 month lag between execution and measurable business impact.
- The partner identifies and communicates problems proactively. A partner that tells you “our content strategy for this keyword cluster is not working, here is what we are changing” is a partner that is learning. A partner that waits for you to notice is a partner that is hoping.
- Monthly reviews are trending green. 3+ consecutive green months means the execution engine is working. Trust the process even if the revenue line has not inflected yet.
- The root cause of underperformance is on your side. Approvals taking 3 weeks. Development queue blocking technical fixes. Content briefs requiring 4 rounds of revision because stakeholder alignment is missing. If your partner is consistently blocked by your internal processes, fixing those processes will produce more improvement than switching partners.
Switch When:
- Leading indicators have been flat for 90+ days. No keyword movement, no technical improvement, no proactive recommendations. This means the partner is either not executing or executing the wrong strategy. Either way, 90 days of flat leading indicators is sufficient evidence.
- Communication has broken down structurally. You cannot get timely responses. Monthly reviews get cancelled or rescheduled repeatedly. You feel like you know less about what is happening with your own marketing each month instead of more.
- The partner cannot explain their own results. You ask “why did organic traffic drop 18% last month?” and the answer is vague or takes a week. A partner that cannot diagnose their own performance data does not have the analytical depth to drive your growth.
- 12 months without measurable ROI. If the partner has been working for a full year and you cannot point to a specific business metric (revenue, pipeline, qualified leads, CPA improvement) that improved as a result of their work, the experiment has run its course.
- Trust is gone. You find yourself auditing their work, fact-checking their reports, or suspecting that deliverables are lower quality than what was agreed. Once trust is broken, the relationship consumes more management energy than it saves. No amount of process can fix a trust deficit.
“The best client-partner relationships I have seen share one trait: both sides measure the same things and review them on the same schedule. When measurement is shared, accountability becomes collaborative instead of adversarial. That is when the real compounding starts.”
Hardik Shah, Founder of ScaleGrowth.Digital
How Do You Have the Performance Conversation Without Destroying the Relationship?
The Escalation Framework
- First yellow month: Note it in the review. No escalation needed. Ask the partner what happened and what they are adjusting.
- Second consecutive yellow month: Formal email summarising the pattern. Request a written improvement plan with specific milestones for the next 60 days. Copy your internal stakeholders.
- First red month: Schedule a dedicated 60-minute call (separate from the monthly review). Review the improvement plan. Set 30-day milestones. Be explicit: “If these milestones are not met, we will begin evaluating alternative partners.”
- Second red month or third consecutive yellow: Begin your search for an alternative partner. Give your current partner 30-60 days notice per your contract terms. Start transition planning.
What Does Your Partner Need From You to Perform?
- Approval turnaround under 5 business days. Every week a content piece or campaign sits in your approval queue is a week of lost compound growth. If your approval process takes 15+ days, that alone can explain 30-40% of the delivery gap in most engagements.
- Access to data and systems. Your partner needs Google Analytics, Search Console, ad accounts, CRM data, and sometimes CMS access. Partial access produces partial results. Give full access on day 1, with appropriate permissions.
- A single point of contact. Partners that have to navigate 3-4 internal stakeholders for every decision burn 20-30% of their retainer hours on internal politics instead of execution. Name one decision-maker. Empower that person.
- Honest feedback. If a deliverable is not what you expected, say so within 48 hours. Partners cannot course-correct on feedback delivered 3 weeks later during the monthly review. Real-time feedback produces better work than periodic reviews alone.
- A documented brief. What are your business goals for the next 12 months? What does success look like? Which markets, products, or segments matter most? A partner working without a clear brief is optimising in a vacuum. The brief does not need to be 50 pages. A 2-page document with goals, constraints, and priorities is sufficient.
If You Decide to Switch, How Do You Manage the Transition Without Losing Momentum?
The 4-Step Transition Process
- Secure all assets before notice (Week 1-2). Confirm you own all ad accounts, analytics properties, domain registrations, content, and creative files. This sounds obvious, but 1 in 5 companies discovers during termination that their partner controls a critical account. Check this before the conversation, not during it.
- Begin new partner evaluation while current partner is active (Week 2-6). Overlap is essential. Your new partner should start their audit and strategy development while the current partner is still executing. This prevents the “dead zone” where nobody is working on your marketing for 4-8 weeks.
- Knowledge transfer documentation (Week 4-8). Request from your outgoing partner: current strategy documents, keyword tracking setup, content calendar, historical performance data, technical audit history, and any automations or rules built in ad accounts. Budget 4-6 hours of their time for a formal handover call with your new partner.
- New partner onboarding with clear 90-day contract (Week 6-12). Start the new partner on a 90-day trial engagement with the measurement framework from this article. Set day-30, day-60, and day-90 milestones in writing. This protects you from repeating a bad selection and gives the new partner clear expectations from the start.
How Do You Build a Partner Performance Dashboard That Takes 5 Minutes to Read?
Dashboard Components
- Row 1: Traffic light summary. Green/yellow/red for each of the 10 metrics from the table above. This is the 30-second view. If everything is green, you do not need to read further.
- Row 2: Trend arrows. For each metric, show whether it improved, declined, or stayed flat versus last month. A green metric with a downward trend arrow is an early warning signal.
- Row 3: Partner commentary. 2-3 sentences per metric explaining the why. This is the part that cannot be automated. “Organic traffic grew 12% MoM because the 8 new product pages we published in February started ranking for 23 new keywords” is useful. “Traffic is up” is not.
- Row 4: Action items. What changes based on this data? List the top 3-5 actions for next month, directly connected to the metrics.
What Is the Single Most Important Thing to Get Right?
- Define 5-8 metrics that matter. Use the table in this article as a starting point. Agree on which metrics are leading (months 1-3 focus) and which are lagging (months 4+ focus).
- Set specific targets for each metric at 90-day, 180-day, and 365-day marks. “Increase traffic” is not a target. “15% YoY organic traffic growth by month 6” is a target.
- Establish the monthly review cadence. Date, time, agenda, scoring system. Put it in the calendar for 12 months. Non-negotiable.
- Document the escalation process. What happens at yellow? What happens at red? How many months of underperformance triggers a formal review? Write it into the contract.
- Confirm data access and attribution setup. Both sides agree on what data is available, how attribution will work, and what gaps exist. This prevents the “we cannot measure that” excuse 6 months later.
- Align on client-side commitments. Approval timelines, access requirements, decision-making authority. Hold yourself accountable too.
Ready to Measure What Actually Matters?
Get a free diagnostic of your current marketing partner performance with our structured evaluation framework. Get Your Free Diagnostic →