How to Evaluate a Marketing Agency: 9 Must-Check Criteria

46% of companies that come to MarketerHire have tried a marketing agency before. The pattern is consistent: initial promise, then junior staff on your account, opaque reporting, and 6-12 month lock-in contracts. To evaluate a marketing agency properly, check 9 criteria: team structure and seniority, vetting standards, pricing transparency, contract flexibility, accountability metrics, industry experience, communication quality, scope clarity, and trial options. Each criterion exposes whether you'll get the senior expertise you're paying for or become one of many accounts staffed by juniors.

The stakes are high. The wrong agency burns $50-100K and wastes a quarter before you realize the match isn't working.

Why Most Companies Fail at Agency Evaluation

Most companies evaluate agencies the same way they'd evaluate a full-time hire — credentials, portfolio, references. That's not enough.

Agencies have a different incentive structure than employees, and the mismatch creates predictable problems. Three common mistakes:

1. Trusting credentials without checking team structure. The senior strategist who pitches you won't be the person executing your campaigns. Ask who actually works on your account — names, experience levels, how many other accounts they manage. "Agencies often assign more junior people to small accounts," a medical services company told us after their third agency disappointment.

2. Ignoring contract terms. Most agencies require 6-12 month commitments with 30-60 day cancellation notice on top. You're locked in before you know if it works. Trial periods are rare. When they exist, they're usually 30 days — barely enough time to see results.

3. Not defining accountability metrics upfront. Without clear KPIs and reporting cadence agreed to in writing, you get monthly decks full of impressions and engagement but no pipeline impact. "I have seen some results, but again, it's not that visible," a UK supplier told us. Vague reporting is a feature, not a bug — it extends the relationship past the point where you'd fire them if you had clear data.

The solution is a structured evaluation framework that accounts for how agencies actually operate.

9 Criteria for Evaluating a Marketing Agency

Evaluate agencies across these 9 dimensions before you sign. Each criterion has clear questions to ask and red flags to watch for. Good agencies will answer directly. Evasive answers are disqualifying.

1. Team Structure & Seniority — who works on your account and how experienced are they?
2. Vetting & Quality Standards — how do they screen their talent? What's their acceptance rate?
3. Pricing Transparency — clear pricing or hidden fees? What's included vs what costs extra?
4. Contract Terms & Flexibility — lock-in period? Trial options? Cancellation policy?
5. Accountability & Reporting — what metrics? How often? Direct dashboard access?
6. Industry Experience & Portfolio — relevant case studies? Vertical expertise?
7. Communication & Responsiveness — response times? Direct access to the person doing the work?
8. Scope Clarity & Deliverables — what's in the base retainer vs add-ons? How do scope changes work?
9. Trial Period or Proof of Concept — can you test before committing long-term?

Each section below breaks down what to ask, what good answers look like, and what red flags to avoid.

1. Team Structure & Seniority

Ask who will actually work on your account. Get names, LinkedIn profiles, and their current client load.

The senior person who pitches you is rarely the person executing your campaigns. Most agencies operate on a leverage model: senior staff sell and strategize, junior staff execute across 10-15 accounts each. This works for the agency's economics but not for your results. Junior marketers cost less, so the agency's margin improves when they staff your account with less experienced people.

What to ask:

• "Who will be my day-to-day contact, and what's their experience level?"
• "How many accounts does that person currently manage?"
• "Will the strategist who pitches me be involved in execution, or just oversight?"
• "What's your ratio of senior to junior staff?"

Good answers: Dedicated senior marketer (5-10+ years experience) managing 3-5 accounts maximum. Direct access to that person, not filtered through an account manager. The person pitching is the person executing, or they introduce you to your actual team during the pitch.

Red flags: "You'll have an account team" without names. "Senior oversight with junior execution." "We'll assign someone after you sign." Ratios heavily skewed toward junior staff. The pitch deck shows senior credentials but your contract doesn't name who you'll work with.

2. Vetting & Quality Standards

How selective is the agency when hiring? A 50% acceptance rate means they're staffing up to meet demand. A <10% acceptance rate means they're actually screening for expertise.

Ask about their vetting process: what's the interview process? Do they test actual skills or just check credentials? What percentage of applicants make it through? If they can't answer or the number is high (>25%), their quality bar is low.

What to ask:

• "What's your acceptance rate for new hires or contractors?"
• "Walk me through your vetting process — how do you test skills?"
• "What disqualifies someone from working with you?"

Good answers: Multi-stage vetting (portfolio review, skills test, client interview). Acceptance rate under 10%. Specific examples of what they screen for (strategy, execution, vertical expertise, communication). They can name what disqualifies candidates.

Red flags: No clear vetting process. "We work with a wide network of partners" (translation: unvetted). Can't or won't share acceptance rate. Vetting is just resume review and reference checks.

For context, MarketerHire accepts <5% of marketer applicants after portfolio review, skills assessment, and client matching interviews. That's the standard for vetted talent.

3. Pricing Transparency

Ask for a detailed pricing breakdown before the first call ends. Good agencies will send a rate card or scoping doc within 24 hours.

Evasive pricing is a red flag. Most agencies charge monthly retainers ranging from $5K to $50K+ depending on scope and seniority. The retainer should specify hours, deliverables, and what costs extra. Watch for setup fees, platform fees, ad spend markups, and "strategy sessions" billed separately.

What to ask:

• "What's your monthly retainer for a scope like mine?"
• "What's included in that retainer vs what costs extra?"
• "Do you mark up ad spend or software costs?"
• "Are there setup fees or minimum commitments?"

Good answers: Clear monthly rate tied to specific deliverables and hours. Flat fee or transparent markup on ad spend (10-15% is standard). No hidden platform fees. Scope changes require written approval with pricing impact stated upfront.

Red flags: "It depends" without follow-up clarity. Refusing to share pricing until after a discovery call. Vague retainers ("full-service support") without deliverable commitments. High setup fees that lock you in. Unbundled pricing where every request costs extra.

4. Contract Terms & Flexibility

Standard agency contracts lock you in for 6-12 months with 30-60 day cancellation notice on top. You're committed for 7-13 months before you can walk away.

That's the industry norm, but it's not the only option. Ask about contract length, trial periods, and cancellation terms. The best agencies offer trials (2-4 weeks) or month-to-month agreements because they're confident in their work.

What to ask:

• "What's the minimum contract length?"
• "Do you offer a trial period? How long?"
• "What's the cancellation policy?"
• "Can I pause or scale down mid-contract?"

Good answers: Trial period (2-4 weeks) to validate fit. Month-to-month after trial or 3-month minimum. 30-day cancellation notice, no penalties. Ability to pause or scale down without breaking the contract.

Red flags: 12-month minimum with no trial. 60-90 day cancellation notice (meaning 13-15 months total lock-in). Auto-renewal clauses. Penalties for early termination. No flexibility to adjust scope without renegotiating the entire contract.

Here's how common contract models compare:

5. Accountability & Reporting

Define success metrics and reporting cadence before you sign. Weekly dashboards or monthly decks? Do you get direct access to analytics platforms or just PDF summaries?

The best agencies set KPIs tied to business outcomes (pipeline, revenue, qualified leads) not vanity metrics (impressions, followers, traffic). They report weekly or biweekly, and you get login credentials to see live data.

What to ask:

• "What metrics will we track, and how often will you report?"
• "Do I get direct access to analytics dashboards or just summary reports?"
• "How do you define success for an engagement like mine?"
• "What happens if we're not hitting targets?"

Good answers: Weekly or biweekly reporting on business metrics (pipeline, MQLs, conversion rates, ROAS). Direct access to Google Analytics, ad platforms, CRM reports. Clear success definition agreed to upfront (e.g., "30 qualified leads per month" or "$3 CPA target"). Proactive adjustment plan if targets aren't met.

Red flags: Monthly reporting only. PDF decks without raw data access. Success defined as "increased brand awareness" or other unmeasurable goals. No discussion of what happens if results miss targets. "Trust the process" language without data transparency.

6. Industry Experience & Portfolio

Ask for case studies from companies similar to yours — same industry, same size, same growth stage.

A B2B SaaS portfolio doesn't translate to DTC e-commerce. A $50M company's playbook won't work for a $2M startup. Look for proof: before/after metrics, attribution methodology, how long it took to see results. Vague case studies ("increased engagement 40%") without context are marketing, not proof.

What to ask:

• "Show me 2-3 case studies from [your industry] at [your stage]."
• "What were the metrics before and after your work?"
• "How long did it take to see results?"
• "Can I speak to a current client in a similar situation?"

Good answers: Specific case studies with your vertical and company size. Metrics tied to revenue or pipeline (not just traffic or impressions). Realistic timelines (3-6 months to see meaningful impact). References from current clients who will speak candidly.

Red flags: Only showing large enterprise clients when you're a startup. Case studies without metrics. "We can't share details due to NDAs" across the board. No vertical expertise in your industry. References are all 6+ months old (meaning recent clients didn't go well).

7. Communication & Responsiveness

How fast do they respond? Do you get direct access to the person doing the work, or is everything filtered through an account manager?

The account manager model insulates the agency's team from client demands, but it adds a telephone-game layer that slows decisions and dilutes context. "We're one of many clients," a healthcare company told us after their agency went quiet between monthly check-ins.

What to ask:

• "What's your typical response time for emails and Slack messages?"
• "Do I communicate directly with the person executing, or through an account manager?"
• "How do I escalate if something's urgent?"
• "What's your policy on after-hours or weekend requests?"

Good answers: Response within 4-24 hours for non-urgent requests, same-day for urgent. Direct access to your marketer (email, Slack, scheduled check-ins). Clear escalation path if your main contact is unavailable. Reasonable boundaries for after-hours (they'll respond Monday, not midnight Sunday).

Red flags: All communication goes through an account manager. 3-5 day response times. No escalation path. Vague answers about availability. They're "always available" (burnout risk) or "check in monthly" (too slow for most marketing needs).

8. Scope Clarity & Deliverables

Get the scope in writing: what's included in the base retainer vs what costs extra.

Agencies often lowball the retainer and then bill separately for creative, landing pages, email sequences, or ad account setup. Ask what happens when scope changes — and it will. Do you get a change order with pricing? Can you reallocate hours within the retainer? Scope creep is the fastest way to blow your budget.

What to ask:

• "What deliverables are included in the monthly retainer?"
• "What typically costs extra?"
• "How do we handle scope changes or new requests?"
• "Can I reallocate hours if priorities shift?"

Good answers: Detailed deliverables list (e.g., "4 blog posts, 8 social posts, 2 email campaigns, monthly analytics report"). Clear addons priced separately. Scope change process: you request, they estimate hours/cost, you approve before work starts. Some flexibility to reallocate hours within the retainer.

Red flags: Vague deliverables ("comprehensive social strategy"). Everything beyond the retainer costs extra, even small requests. No process for scope changes (just surprise invoices). Zero flexibility — every request is billed separately.

9. Trial Period or Proof of Concept

Can you test before committing to a 12-month contract? The best agencies offer trial periods (2-4 weeks) or pilot projects (1-3 months) to prove fit before you're locked in.

Trials reduce your risk. If the match isn't working — communication is slow, strategy misses the mark, results lag — you can walk away. Agencies that refuse trials are either confident you'll churn (and want the contract lock-in) or not confident in their ability to deliver fast wins.

What to ask:

• "Do you offer a trial period before the full contract?"
• "What does the trial include, and how long is it?"
• "What happens if either of us wants to end the trial early?"
• "What's the conversion rate from trial to full engagement?"

Good answers: 2-4 week trial with clear scope and deliverables. Either party can end the trial early without penalty. High conversion rate (>80%) from trial to ongoing engagement. The trial is a real test, not just a Discovery Phase billed at full rate.

Red flags: No trial option ("we only work with committed partners"). Trial is actually just a month of the 12-month contract, not a true opt-out period. Trial deliverables are vague. Can't or won't share trial-to-full conversion rate (suggests most trials fail).

MarketerHire offers a 2-week trial on every engagement. 95% of trials convert to ongoing work because the matching process gets it right upfront.

Red Flags to Watch For

Walk away if you see these warning signs during evaluation:

• Evasive answers about who works on your account. If they won't name the person executing during the sales process, you're getting junior staff.
• No clear metrics or reporting cadence. "We'll report monthly" without defining what's in the report means you'll get vanity metrics.
• Pressure to sign quickly. "This pricing is only available this week" is a sales tactic, not a sign of high demand.
• Long lock-in with no trial. 12-month commitment before you've worked together? They're optimizing for their revenue, not your results.
• Portfolio doesn't match your context. Enterprise case studies when you're a Series A startup. B2C when you're B2B. Different industries entirely.
• Can't explain their vetting process. If they can't articulate how they screen talent, they're not screening.
• References are all outdated. Current clients who are happy will talk to you. If all their references are 6+ months old, recent clients churned.
• "We do everything" positioning. Specialists beat generalists. An agency claiming equal expertise in SEO, paid social, content, email, and PR is lying about at least 3 of those.

One of our customers said it perfectly after agency number three: "One thing I've found in the marketing stuff is it seems everybody says they can do everything."

Questions to Ask Before You Sign

Use this checklist to vet any agency before committing. Good agencies will answer every question directly. Evasive or vague responses are disqualifying.

Team & Vetting:

1. Who will work on my account day-to-day? Can I meet them before signing?
2. What's their experience level and how many other accounts do they manage?
3. What's your acceptance rate when hiring marketers?
4. Walk me through your vetting process.

Pricing & Contracts:

5. What's the monthly retainer, and what's included vs what costs extra?
6. What's the minimum contract length?
7. Do you offer a trial period? What's the cancellation policy?
8. Are there setup fees or other upfront costs?

Accountability & Results:

9. What metrics will we track, and how do you define success?
10. How often will you report, and do I get direct dashboard access?
11. Show me case studies from companies like mine. What were the before/after metrics?
12. Can I speak to a current client?

Execution & Communication:

13. Do I communicate directly with the person doing the work, or through an account manager?
14. What's your typical response time?
15. How do scope changes work, and how are they priced?

If an agency refuses to answer any of these, that's your answer.

Agency vs Freelancer vs In-House: When Each Makes Sense

Agencies aren't the only option. Depending on your needs, budget, and timeline, comparing agencies, freelancers, and full-time hires might lead you to a different model entirely.

Here's when each model works:

Choose an agency if: You need multi-channel execution (SEO + paid + content + social), have budget for $15K+/month, and value having one vendor manage everything. Just vet them carefully using the 9 criteria above.

Choose a freelancer if: You have a specific project (redesign landing pages, set up email automation), know exactly what you need, and have time to manage them. Check out our guide on managing freelancers effectively.

Choose in-house if: You have consistent 40-hour/week workload, budget for $100K+ total comp, and time for a 3-6 month hiring process. See our marketing team cost breakdown for budget planning.

Choose a fractional expert if: You need senior-level strategy and execution without the overhead of full-time or the risk of long agency lock-ins. Fractional CMOs bring leadership expertise on a part-time basis.

Most companies end up with a hybrid model: in-house for brand and product marketing, fractional experts for specialized channels, agencies for large-scale campaign execution.