How to A/B Test Email Subject Lines Online
If you want to A/B test email subject lines online without stitching together scripts and spreadsheets, marginal gives you a hosted email MCP server your AI agent can call directly. Generate variants, launch the test, and pull results — all from the tools you already use.
Why run a subject line A/B test online?
Subject lines are the single biggest lever on open rates, but most teams guess instead of measuring. An online subject line A/B test splits your audience, sends competing versions, and tells you which one actually earns opens and clicks.
marginal handles the part that's usually tedious: managed sends, open and click tracking, and within-test lift metrics so you can see the real difference between variants — not just raw counts.
- Compare two or more subject lines on a live segment
- Track opens and clicks per variant automatically
- Read lift metrics to quantify the winner
- Stay inside your editor instead of a separate dashboard
The MCP tools that power the test
marginal exposes four MCP tools your AI agent calls in sequence. Together they cover the full loop of an experiment, from drafting candidates to deciding what to send next.
- generate_variants — produce subject line candidates to test
- launch_test — start the managed send and split your audience
- get_results — pull open/click tracking and within-test lift
- recommend_next — get a suggested follow-up based on the data
Let an AI agent drive the experiment
AI agent email marketing works best when the agent can act, not just advise. Because marginal is an email MCP server, agents in Cursor, Claude Desktop, Claude Code, Windsurf, Cline, Continue, Zed, and OpenAI Codex can run a full subject line A/B test conversationally.
Ask your agent to draft five subject lines, launch the test, and report which one wins. It calls the marginal tools, waits for results, and summarizes the lift — no manual export step in between.
- Hosted at https://marginal.sh/mcp — nothing to self-host
- Bearer API key auth (marg_live_...) keeps access scoped
- Free tier covers 100 experiments per month
- Registry id: sh.marginal/mcp
Reading the results that matter
Once a test finishes, get_results returns open and click tracking alongside within-test lift, so you know how much one subject line outperformed another rather than eyeballing percentages.
Use recommend_next to turn that data into the following experiment — iterating subject lines is far more valuable than a single one-off test. See the full tool reference in the docs at https://marginal.sh/docs/.
Get started with marginal
marginal is a hosted email marketing MCP server at marginal.sh. Sign up free, create an API key, and connect https://marginal.sh/mcp from Cursor, Codex, or Claude Desktop.
- 100 experiments/month on the free tier
- Four MCP tools: generate_variants, launch_test, get_results, recommend_next
- Listed in the MCP Registry as sh.marginal/mcp