AI vs. Senior Copywriter: Ad Copy Showdown
The question everyone's afraid to ask: Is AI actually better at writing ads than experienced humans?
We tested it. With real ads, real budget, and real conversion data.
The Setup
The Brief: Write Facebook ad copy for a productivity SaaS tool targeting remote managers.
The Contestants:
- Claude 3.5 Sonnet — with a detailed prompt + brand guidelines
- GPT-4o — same prompt and guidelines
- Sarah — 12 years as a senior copywriter at top agencies
The Rules:
- Same brief, same brand assets, same targeting
- Each wrote 5 ad variations
- Top 2 from each went live with equal budget ($500 each)
- Ran for 14 days
- Measured: CTR, CPC, conversion rate, ROAS
The Results
| Metric | Claude | GPT-4o | Sarah (Human) |
|---|---|---|---|
| Click-through rate | 2.1% | 1.8% | 2.4% |
| Cost per click | $1.42 | $1.67 | $1.31 |
| Conversion rate | 3.2% | 2.8% | 4.1% |
| Return on ad spend | 2.8x | 2.2x | 3.5x |
| Time to produce | 12 min | 15 min | 3 hours |
Winner: Sarah. But not by as much as you'd think.
The Nuance
Where AI Won
- Speed: 12 minutes vs. 3 hours. If you need 50 ad variations for testing, AI is the only realistic option.
- Volume: AI generated 5 solid variations in the time it took Sarah to warm up.
- Hook diversity: Claude produced hooks that tested well even though they weren't "agency style."
Where the Human Won
- Emotional precision. Sarah's best ad had a line that made people feel seen: "You're managing a team across 3 time zones and your to-do list just had a to-do list." Neither AI wrote anything that specific.
- Strategic positioning. Sarah instinctively positioned the product against the feeling of chaos, not just the problem of disorganization.
- Conversion rate. The people who clicked Sarah's ads were more likely to sign up. Her copy attracted higher-intent clicks.
The Real Insight
This isn't AI vs. human. It's about the workflow.
Sarah's take:
"I wouldn't want to go back to writing all first drafts from scratch. Give me AI drafts and I'll turn them into something that converts. That's the future — AI for volume, humans for precision."
The optimal workflow we found:
- AI generates 10-20 ad variations (15 minutes)
- Human selects top 3, edits for emotional precision (30 minutes)
- Run A/B tests with the hybrid versions
- Use AI to iterate on winners
Time: 45 minutes for better results than either alone.
Cost Comparison
| Approach | Time | Quality | Cost |
|---|---|---|---|
| AI only | 15 min | Good (7/10) | ~$0.50 in API costs |
| Human only | 3 hours | Excellent (9/10) | ~$450 (senior rate) |
| Hybrid | 45 min | Very good (8.5/10) | ~$70 |
The hybrid approach gets you 94% of expert quality at 16% of the cost.
Takeaway
AI won't replace your best copywriter. But it will replace the process of staring at a blank page for 45 minutes.
The real competition isn't AI vs. humans. It's people using AI vs. people not using it.
All experiments at FOMA use real budgets and real data. We don't simulate results.