Your Newsletter Metrics Are Probably Measuring the Wrong Things

Most newsrooms I work with can tell me their open rate within seconds. Very few can tell me what percentage of their list has opened at least three of the last five issues. Those are completely different numbers, and only one of them tells you whether your newsletter is working.

INN's Audience Studio has been running experiments with member newsrooms on exactly this problem. The short version: open rate and click rate are outcome metrics. They capture a moment. What local newsrooms actually need are habit metrics, numbers that tell you whether readers are coming back, building a relationship with your publication, and moving toward the kind of trust that eventually turns into a membership or a donation.

The problem with optimizing for open rate

Open rate became the default newsletter metric because it was easy to track and easy to compare. It also became meaningless the moment Apple Mail Privacy Protection rolled out in 2021 and started pre-loading email pixels at scale. Even before that, it was a shallow measure. A 40% open rate sounds impressive until you realize you have no idea if those openers read anything, skimmed the subject line and closed it, or have been passively opening your emails for two years without ever clicking through to your site.

Click rate has the same limitation. It tells you a reader clicked something once. It does not tell you whether that reader has ever clicked anything before, or whether they are the kind of reader who shows up every week versus the kind who opened one issue eight months ago because a friend forwarded it.

These metrics are not useless. But when they become the primary lens, you end up optimizing for the wrong behavior. You write subject lines designed to generate opens rather than subject lines that train your readers to expect something worth their time. You A/B test button colors instead of asking whether your newsletter is actually creating a reading habit.

What habit metrics actually look like

INN members experimenting with total reach metrics are trying to answer a harder question: who is my consistent audience, and is that group growing? That reframe matters.

A few metrics worth tracking alongside open and click rate:

Consistent openers over a rolling window. How many subscribers have opened at least three of your last five issues? This is your active core. If it is shrinking while your list is growing, that is a signal worth paying attention to.

Reactivation rate. When you send a re-engagement campaign to lapsed subscribers, what percentage actually come back? A low reactivation rate usually points to an onboarding problem. You got the signup but never built the habit.

List growth versus list churn together. A lot of newsrooms celebrate subscriber growth without tracking how many people are quietly unsubscribing or going dormant at the same time. Net active subscribers is a more honest number than total list size.

Site visits from email over time. Not just clicks on a given issue, but whether email is consistently driving traffic to your site month over month. Your newsletter should be a pipeline to deeper engagement, not a standalone product that competes with your website for attention.

This is also an infrastructure question

Here is where I will be direct about something I see constantly with clients. The reason most small newsrooms are not tracking these things is not because they do not care. It is because their newsletter setup does not make it easy.

If your email platform does not segment by engagement level, you cannot see your consistent openers. If your newsletter and your website are not connected through proper UTM tracking, you cannot measure downstream site behavior. If your onboarding sequence is just one welcome email and then a weekly issue, you have not actually done anything to build a habit. You have just added someone to a list.

Getting this right does not require a big budget. It requires intentional setup. A three-email onboarding sequence that tells new subscribers what to expect and why it matters. Engagement-based segmentation so you can treat your active core differently from your lapsed subscribers. A consistent send schedule that trains readers to expect you at a specific time.

The question worth asking

Your open rate from last week is already history. The more useful question is: how many people have made your newsletter part of their week, and is that number growing?

That is the question INN members are starting to ask. It is the right one. And the newsrooms that figure out how to answer it are going to have a much clearer picture of whether their email program is actually building an audience or just maintaining a list.