Stop Chasing Open Rates: The Lifecycle Marketing Scorecard That Actually Moves the Needle
Stop Chasing Open Rates: The Lifecycle Marketing Scorecard That Actually Moves the Needle
The General Who Measured the Wrong Thing
In the early 1960s, U.S. Secretary of Defense Robert McNamara was convinced he could win the Vietnam War with data. A former Ford executive famous for turning chaos into spreadsheets, McNamara built an entire war-measurement apparatus called the Measurement of Progress System — 71 unique metrics designed to quantify military success.
His favourite? The body count. Kill enough enemy soldiers, and the war was won. Simple. Auditable. Satisfying on a dashboard.
The problem: it measured what was easy to count, not what actually mattered. Field commanders inflated numbers to look good. North Vietnam replenished soldiers faster than they were killed. The metric optimised for a reality that didn't exist. The result was one of the most catastrophic strategic failures in modern history.
This phenomenon — making decisions based solely on metrics that are easy to measure while ignoring everything that isn't — now has a name: the McNamara Fallacy.
Sound familiar?
Because right now, thousands of email marketers are doing exactly the same thing. They're watching open rates climb on their dashboards, celebrating click-through rates in their weekly reports, and completely missing the question that actually matters: is any of this making us money?
It's time to retire the body count. Here's what to measure instead.
Why Open Rates Are No Longer a Reliable Metric
Let's start with the most uncomfortable truth in email marketing: your open rate is almost certainly wrong.
On September 20, 2021, Apple released iOS 15 with a feature called Mail Privacy Protection (MPP). When users opted in — and the majority did — Apple began automatically pre-fetching emails and loading all images, including tracking pixels, before the user ever opened the message.
The result? An "open" gets recorded whether someone reads your email for three minutes or never touches it at all.
Apple Mail commands somewhere between 40–60% of the email client market share. That's not a rounding error. That's the majority of your list potentially generating phantom opens every single send.
The DMA's Email Benchmarking Report 2024 explicitly called out the need to move away from open rates as a primary KPI. HubSpot's research found that 62% of email marketers who were impacted by iOS 15 responded by prioritising different KPIs entirely.
The industry has known this for years. So why are we still leading every campaign report with open rate?
Because it feels good. And because we haven't agreed on what to replace it with.
Until now.
What Is the McNamara Fallacy in Email Marketing?
The McNamara Fallacy, applied to email marketing, works in four steps:
- Measure what's easy to measure (sends, opens, clicks).
- Ignore what's hard to measure (revenue attribution, LTV impact, behavioural signals).
- Treat the easy metrics as if they represent the full picture.
- Make campaign decisions based on a distorted reality.
The result is a marketing team optimising subject lines to boost a metric that's been broken since 2021, while churn quietly climbs and customer lifetime value stagnates.
A 25% open rate on a campaign that converted zero customers isn't a success. It's a very pretty-looking failure.
The Email Metrics Hierarchy: From Vanity to Value
Not all metrics are created equal. Think of them as a hierarchy — the higher you climb, the closer you get to metrics that actually move the business.
Level 1 — Vanity Metrics (Stop Leading With These)
These metrics feel good and they're easy to report. They also tell you almost nothing about business health.
| Metric | Why It's Broken |
|---|---|
| Open Rate | Inflated by Apple MPP pre-fetching since iOS 15 |
| Total Sends | Measures output, not outcomes |
| List Size | A huge disengaged list harms deliverability |
| Click Rate (alone) | Clicks without conversions are just traffic |
"A rising number of email subscribers can mask a plummeting open rate and a disengaged list." — Improvado
These aren't completely useless. Watch them for anomalies and trend direction. Just don't build your strategy around them.
Level 2 — Engagement Quality Metrics (Better, But Not Enough)
These sit above vanity metrics. They measure real human behaviour — things automated systems don't inflate.
- Click-to-Open Rate (CTOR) — Of people who genuinely opened, how many clicked? Filters out MPP noise.
- Reply Rate — One of the strongest engagement signals in existence. A reply means someone read, processed, and responded.
- Unsubscribe Rate — Often overlooked as a negative. It's actually a healthy hygiene signal.
- Spam Complaint Rate — Anything above 0.08% is a deliverability red flag.
- Human Opens — Customer.io now surfaces Human Metrics that filter out automated opens from privacy tools and bots, giving you a cleaner picture of genuine engagement.
Customer.io's human metrics are specifically designed to solve the MPP problem — tracking interactions most likely to reflect real people, not automated systems.
Level 3 — Behavioural Milestone Metrics (Where It Gets Interesting)
This is where you start measuring what people do after they read your email, not just whether they opened it.
- Email-to-site conversion rate — Did the click lead to a meaningful action on your website?
- Activation events triggered — Did a campaign push a user from free to engaged (e.g., completed a key onboarding step)?
- Segment progression — Did someone move from "prospect" to "active user" following a campaign sequence?
- Goal completions — Customer.io's Campaign Goals & Conversion Criteria lets you define exactly what counts as success — a purchase, a signup, a plan upgrade — and track it within a 90-day conversion window. This is the bridge between email activity and real-world outcomes.
With Customer.io, you set the goal once. The platform tracks who achieves it after receiving, opening, or clicking a message — and tells you precisely how many journeys converted.
Level 4 — Revenue Attribution Metrics (This Is What the CFO Cares About)
This is where email marketing earns its seat at the boardroom table.
- Revenue per email (RPE) — Total campaign revenue ÷ emails delivered. According to Kissmetrics, triggered behavioural emails can generate $2.50 RPE versus $0.15 for a standard newsletter. That's a 16x difference.
- Revenue per subscriber — Total email-attributed revenue ÷ list size. Reveals your most valuable segments.
- Campaign-attributed revenue — Using Customer.io's revenue reporting, you can tie specific campaigns directly to transactions. Not "email probably helped" — actual attributable revenue.
- Cost per acquisition via email — What does it cost you to acquire one paying customer through email? This grounds email spend in commercial reality.
- Email's contribution to marketing pipeline — For B2B teams, email drives 30–60% of marketing-sourced pipeline. Are you actually measuring that?
Level 5 — Lifetime Value Impact Metrics (The Long Game)
The most sophisticated email teams operate here. These metrics connect your email programme to the long-term financial health of the business.
- Subscriber Lifetime Value (SLTV) — Total revenue generated per subscriber from signup to churn. Subscribers who engage with your first three emails have dramatically higher LTV than those who don't.
- Cohort LTV by email segment — Track cumulative revenue at 30, 90, 180, and 365 days for different subscriber cohorts. You might discover that a specific acquisition source or campaign sequence produces 3x the LTV of others.
- Churn rate influenced by email — Does email reduce churn in cohorts that receive retention sequences vs. those that don't?
- LTV:CAC ratio — The gold standard. For every £1 spent acquiring a customer, how much lifetime revenue do you generate? A healthy ratio is 3:1 or better.
Email generates an average ROI of $36–$42 for every $1 spent, according to Litmus's 2025 State of Email Report. But that number means nothing if you're not measuring which campaigns, sequences, and segments are driving it.
The Lifecycle Marketing Scorecard
Here's the template. Copy it, adapt it, and kill your vanity-metric dashboard for good.
Replace your weekly "opens and clicks" report with this. Review it monthly at the campaign level and quarterly at the programme level.
🧾 Lifecycle Marketing Scorecard Template
Review Period: _________ | Prepared By: _________ | Platform: Customer.io
SECTION 1 — Deliverability Health
The foundation everything else sits on.
| KPI | Target | Actual | Status |
|---|---|---|---|
| Delivery Rate | >98% | ||
| Bounce Rate (Hard) | <0.5% | ||
| Spam Complaint Rate | <0.08% | ||
| Unsubscribe Rate | <0.3% per send | ||
| List Growth Rate (net) | Positive |
Verdict: 🟢 Healthy / 🟡 Watch / 🔴 Action Required
SECTION 2 — Engagement Quality
Measure real human behaviour, not machine noise.
| KPI | Target | Actual | Status |
|---|---|---|---|
| Click-to-Open Rate (CTOR) | >12% | ||
| Human Open Rate (CIO metric) | Track trend | ||
| Reply Rate (where applicable) | >1% | ||
| Click Rate | >2.5% | ||
| Forwarded / Shared Rate | Track trend |
Note: Do not use raw open rate as a performance signal. Use CTOR and human opens instead.
SECTION 3 — Behavioural Milestones
Did email change what people do?
| KPI | Target | Actual | Status |
|---|---|---|---|
| Email-to-Site Conversion Rate | >3% | ||
| Key Activation Events Triggered | Set per campaign | ||
| Campaign Goal Completions (CIO) | Set per campaign | ||
| Segment Progression Rate | Track trend | ||
| Trial-to-Paid Conversion (lifecycle) | Industry benchmark |
Tool: Use Customer.io's conversion criteria to define and track each goal. Set conversion window up to 90 days.
SECTION 4 — Revenue Attribution
Connect campaigns to commercial outcomes.
| KPI | Target | Actual | Status |
|---|---|---|---|
| Revenue per Email (RPE) | >$0.10 B2C / >$0.18 B2B | ||
| Revenue per Subscriber (monthly) | Track cohort trend | ||
| Campaign-Attributed Revenue (CIO) | Set per campaign | ||
| Email-Sourced Revenue (% of total) | >20% | ||
| Cost per Email-Acquired Customer | Below LTV threshold |
SECTION 5 — Lifetime Value Impact
The long game.
| KPI | Target | Actual | Status |
|---|---|---|---|
| Subscriber LTV (12-month cohort) | Track & improve | ||
| LTV:CAC Ratio | >3:1 | ||
| Churn Rate — Email-Engaged vs. Not | Email cohort lower | ||
| Revenue at 30/90/180 Days (cohort) | Improve quarter-on-quarter | ||
| Email's % of Marketing Pipeline | Track trend |
SCORECARD SUMMARY
| Section | Score (1–5) | Priority Action |
|---|---|---|
| Deliverability Health | ||
| Engagement Quality | ||
| Behavioural Milestones | ||
| Revenue Attribution | ||
| LTV Impact | ||
| Overall Programme Health |
How to score each section:
- 5 — Hitting all targets, trending positively
- 4 — Hitting most targets, one area to watch
- 3 — Mixed results, clear action needed
- 2 — Underperforming on majority of KPIs
- 1 — Significant issues, escalate immediately
How Customer.io Makes This Scorecard Possible
Measuring at Levels 3–5 requires tooling that connects email events to downstream outcomes. This is exactly where Customer.io earns its keep.
Campaign Goals & Conversion Criteria — Set event-based or segment-based goals for any campaign. Customer.io tracks who meets the goal within your defined conversion window (up to 90 days) after receiving, opening, or clicking a message. You can see, right inside the campaign, how many journeys converted. This turns every campaign from an engagement exercise into a business experiment.
Human Metrics — Customer.io now distinguishes between machine-generated opens (Apple MPP, security scanners) and genuine human interactions. This directly addresses the iOS 15 problem and gives you clean engagement data to work with.
Analysis Page & Reports — The Analysis page lets you compare campaign and journey performance across common tags or naming conventions. Want to compare all your onboarding sequences vs. re-engagement sequences? Done. You can surface conversion counts, revenue-linked events, and performance trends — across channels, not just email.
Workspace Dashboard — Leaderboard — The Leaderboard shows your highest and lowest performing campaigns by conversion count, not just sends and opens. The default view already nudges teams toward outcome thinking.
Conversion-Linked Events — Because Customer.io is built around events (things people do), you can tie conversion goals to any action in your product or website: a purchase, a subscription upgrade, a feature adoption event, a form completion. Revenue lives in your data. Customer.io surfaces it inside your marketing workflow.
For teams running lifecycle marketing — onboarding sequences, retention flows, win-back campaigns — this infrastructure is what separates teams that feel effective from teams that know they are.
If you want help connecting your Customer.io conversion goals to actual revenue data, NerveCentral's team of certified Customer.io experts can build that for you.
Is Open Rate Dead? Here's the Honest Answer
No. But it needs a demotion.
Open rate isn't worthless. It's a directional signal. If your open rate drops 40% overnight, something's wrong — deliverability, subject line quality, list fatigue. That's worth knowing.
What open rate cannot tell you:
- Whether anyone read the email
- Whether anyone bought anything
- Whether your campaign made or lost money
- Whether your programme is growing or shrinking the business
Use open rate as a health check, not a success metric. A campaign with a 15% open rate and a 6% goal completion rate is crushing a campaign with a 40% open rate and 0% conversions. Every time.
Frequently Asked Questions
What's wrong with measuring email open rates?
Open rates became unreliable after Apple released iOS 15 in September 2021. The update's Mail Privacy Protection feature automatically pre-fetches emails and loads tracking pixels before a user opens the message. Since Apple Mail accounts for 40–60% of the email client market, a significant portion of recorded opens are phantom opens — recorded by Apple's servers, not real human eyeballs. The DMA's 2024 Email Benchmarking Report explicitly recommends moving away from open rates as a defining KPI.
What should I use instead of open rate?
Replace open rate with a combination of: Click-to-Open Rate (CTOR), which measures clicks among people who genuinely opened; Human Open Rate (available in Customer.io's metrics dashboard), which filters out automated opens; reply rate for high-touch sequences; and campaign goal completions tied to real business events like purchases or signups. For programme-level health, track revenue per subscriber and subscriber LTV.
What is a lifecycle marketing scorecard?
A lifecycle marketing scorecard is a structured measurement framework that replaces vanity metrics (opens, sends, list size) with a hierarchy of KPIs spanning deliverability, engagement quality, behavioural milestones, revenue attribution, and LTV impact. Instead of asking "did people open this email?", it asks "did this campaign contribute to business growth?" — and gives you a reproducible way to answer that question every month.
How does Customer.io help with revenue attribution?
Customer.io's Campaign Goals & Conversion Criteria feature lets you define exactly what constitutes a conversion for any campaign — an event (like a purchase or signup), entering a segment, or leaving a segment. The platform tracks goal completions for up to 90 days after a message is delivered, opened, or clicked, then reports how many journeys achieved the goal. This ties email activity directly to downstream business actions, turning campaign reporting from engagement metrics into outcome metrics.
What is Revenue per Email (RPE) and how do I calculate it?
Revenue per Email (RPE) is the total revenue attributed to a campaign divided by the number of emails delivered. For example, if a campaign sent to 10,000 subscribers generated $1,500 in attributed revenue, the RPE is $0.15. According to Kissmetrics, triggered behavioural emails typically generate $2.50 RPE versus $0.15 for standard newsletters — a 16x difference that rarely shows up in open rate comparisons.
What is Subscriber Lifetime Value (SLTV) and why does it matter for email marketing?
Subscriber Lifetime Value measures the total revenue a subscriber generates from the time they join your list to when they churn or become inactive. It's the most strategic email metric because it connects your email programme to long-term business value. SLTV analysis often reveals that subscribers acquired through specific campaigns, channels, or sequences generate dramatically different long-term revenue — information that's invisible when you're only tracking open rates. Track it by cohort (grouped by signup month) at 30, 90, 180, and 365 days.
What is the McNamara Fallacy and how does it apply to email marketing?
The McNamara Fallacy — named for U.S. Secretary of Defense Robert McNamara, who famously used enemy body counts as the primary success metric in the Vietnam War — describes the error of measuring only what's easy to quantify while ignoring what actually matters. In email marketing, the fallacy manifests as over-reliance on open rates and send volumes while ignoring revenue attribution, LTV, and behavioural outcomes. The body count looked good on paper; the war was still lost. A high open rate feels great; a campaign that converts nobody is still a failure.
How do I measure email's contribution to customer lifetime value?
Start by cohort analysis: group subscribers by their signup month, then track cumulative revenue generated at 30, 90, 180, and 365 days. Compare cohorts across acquisition sources, campaign sequences, and segments. Then look at churn rate differences between email-engaged customers and those who aren't engaged. If email-engaged cohorts churn at a lower rate, email is contributing to LTV even when conversions aren't directly attributable to a specific campaign. Customer.io's event tracking and segment tools make this analysis accessible without a data science team.
Should I completely ignore open rates now?
No — but demote them. Use open rate as a directional health signal, not a success metric. A sudden drop in open rates might signal a deliverability problem worth investigating. A consistent open rate tells you your subject lines are working. But a campaign's success should never be defined by open rate alone. Use Click-to-Open Rate and Human Opens (from Customer.io) as your primary engagement signals, and campaign goal completions as your primary success metric.
What is Click-to-Open Rate (CTOR) and why is it better than open rate?
CTOR measures the percentage of people who clicked a link among those who genuinely opened the email. The formula is: (Unique Clicks ÷ Unique Opens) × 100. It's more reliable than raw click rate because it strips out MPP-inflated denominator distortion. A high CTOR (>12% is a reasonable benchmark) tells you that the people who actually engaged with your email found the content compelling enough to click. Raw click rate doesn't tell you that.
How do I set up conversion goals in Customer.io?
In Customer.io, open any campaign and click the upper-left menu, then select "Manage" under Goal. Choose your conversion criteria type: an event (something a person did, like purchased or upgraded_plan), or a segment (entered or left). Set your conversion window — up to 90 days — and decide whether to count conversions from sends, opens, or tracked link clicks. You can also filter event-based goals by specific event properties, which ensures attribution stays accurate across campaigns. Once set, Customer.io tracks and reports goal completions for every journey.
What's a healthy LTV:CAC ratio for email-acquired customers?
The industry benchmark for a healthy LTV:CAC ratio is 3:1 — for every £1 or $1 spent acquiring a customer, you generate $3 in lifetime gross profit. Below 1:1, you're destroying value. Between 1:1 and 3:1, you're sustaining but not scaling efficiently. Above 3:1, you're in a strong growth position. For email specifically, where the channel ROI averages $36–$42 per $1 spent (Litmus, 2025), a well-run programme should be well above the 3:1 baseline — which makes tracking it essential.
What email metrics should I report to the C-suite?
The C-suite doesn't care about open rates. Report: email-attributed revenue (this quarter vs. last), revenue per subscriber (trend over 6 months), email's percentage contribution to total marketing pipeline, subscriber LTV by acquisition cohort, and LTV:CAC ratio for email-acquired customers. These are the metrics that connect email marketing to business performance — and they're the metrics that protect your budget when cuts come.
How do automated emails compare to manual campaigns in revenue generation?
Significantly better. According to multiple industry benchmarks, automated emails generate approximately 320% more revenue than non-automated campaigns, despite making up only a small fraction of total email volume. This is because triggered behavioural emails (welcome sequences, activation nudges, re-engagement flows, purchase follow-ups) are sent at the exact moment of maximum relevance. Customer.io is built specifically for this kind of event-driven automation, and setting conversion goals on each automated journey gives you full visibility into which sequences are generating that revenue.
What's the first step to implementing this scorecard in my business?
Start with deliverability (Section 1 of the scorecard). If your emails don't land in the inbox, nothing else matters. Then set up conversion goals in Customer.io for your top three campaigns — choose specific, measurable events that map to real business outcomes. Run for 90 days. Review your first scorecard. You'll immediately see which campaigns are driving conversions and which are generating impressive open rates while delivering nothing. Then work upward through the hierarchy, adding revenue attribution and LTV tracking as your data infrastructure matures.
The Bottom Line
McNamara had 71 metrics and still lost the war. You might have a perfectly formatted weekly email report, with beautiful open rate trends and click graphs, and still be losing the battle for revenue.
The metrics hierarchy isn't complicated. Deliverability first. Real engagement second. Behavioural milestones third. Revenue attribution fourth. LTV impact fifth.
Every email you send has a job. The scorecard tells you whether it did it.
NerveCentral helps businesses turn Customer.io into a revenue-generating machine. If you want to implement this metrics framework and connect your campaigns directly to business outcomes, get in touch — we'll build it with you.
Sources & Citations
- McNamara Fallacy — Wikipedia — https://en.wikipedia.org/wiki/McNamara_fallacy
- Data Disasters: Learning From History — Contingencies Magazine — https://contingencies.org/data-disasters-learning-from-history-case-studies-in-analytic-decision-making/
- The Impact of iOS 15 on Email Marketing — One Year Later — Greg Zakowicz — https://www.gregzakowicz.com/blog/ios-15-impact-on-email-marketing
- Apple iOS Impact on Email Open Rates — DailyStory — https://www.dailystory.com/blog/applie-ios-email-open-rate/
- How Apple iOS 15 is Impacting Email Marketers — HubSpot — https://blog.hubspot.com/marketing/apple-ios-15-email-marketing-impact-data
- Email Benchmarking Report 2024 — DMA & Marigold — https://www.dma.org.uk/resources/report/email-benchmarking-report-2024
- The ROI of Email Marketing — Litmus (2025 State of Email) — https://www.litmus.com/blog/the-roi-of-email-marketing/
- Email Marketing ROI Statistics 2024–2026 — Verified Email — https://verified.email/blog/email-marketing/roi-statistics
- Email Marketing Analytics: Metrics That Go Beyond Open Rates — Kissmetrics — https://www.kissmetrics.io/blog/email-marketing-analytics
- Vanity Metrics: How to Stop Using Them — Improvado — https://improvado.io/blog/what-is-a-vanity-metric
- Campaign Goals & Conversion Criteria — Customer.io Docs — https://customer.io/docs/journeys/campaign-conversions
- Metrics Overview — Customer.io Docs — https://customer.io/docs/journeys/analytics
- Apple Privacy Impact on Email Open Rate Reporting — Schaefer Advertising — https://schaeferadvertising.com/apple-privacy-impact-on-email-open-rate-reporting/
