Fargoinvestor Calm, evidence-based investing for private investors
ETFs & Stocks

Tracking Error or Tracking Difference: Which One Really Matters Before Buying an ETF?

Two ETFs replicating the same index with identical expense ratios listed on their fact sheets can perform very differently over the years. The figures highlighted on a fact sheet—5-year returns, ongoing charges—rarely reveal the true quality of index replication.

To assess this, you need to look at two measures that are often confused: tracking difference and tracking error. Vanguard, in its explanation of indexing fundamentals, points out that tracking difference is typically negative for an ETF, since the fund's performance includes its fees while the benchmark index bears none. Understanding this distinction changes how you read a fact sheet, and the resulting decision depends heavily on your investment time horizon.

Key Points

Tracking Difference and Tracking Error: Clearing Up the Confusion

Tracking difference is calculated simply: it's the total return of the ETF over a given period minus the total return of the index it is supposed to replicate. A negative figure means the ETF underperformed its index—which is the norm, since the fund bears fees that the theoretical index does not.

Tracking error is a different measure. According to Vanguard's formal definition, it is the annualized standard deviation of that tracking difference. VettaFi describes it similarly: the standard deviation between the ETF's returns and the index's returns over a given period. In other words, tracking error doesn't tell you whether the ETF has done better or worse than its index on average, but rather how consistent or, conversely, erratic that gap has been from one period to the next.

One Term, Two Different Realities

Vanguard highlights a useful point to watch for: some providers call "tracking error" what is actually just a simple return difference—in other words, tracking difference. Before comparing figures published by different fund providers, you should verify the calculation method actually used in their documentation rather than relying on the stated label.

This distinction has a practical consequence: a fund may show low tracking difference over a given period while having high tracking error if its returns vary significantly from the index from one period to the next, as VettaFi notes. The two figures measure different things, and neither replaces the other.

Why Can Two ETFs with the Same Expense Ratio Track Their Index So Differently?

The ongoing charges ratio displayed on a fact sheet doesn't capture everything. Vanguard is clear about this: fees remain the most frequent contributor to negative tracking difference, but you need to evaluate all costs, including transaction costs not captured in the expense ratio. Several other mechanisms, rarely visible on a consumer-facing fact sheet, influence replication quality.

Replication Method

An index manager must choose between full replication (buying all securities in the index), sampling or optimization (buying a basket of more liquid proxy securities), and synthetic replication (using swaps with a counterparty)—this last method being particularly common among UCITS ETFs in Europe. VettaFi notes that sampling tends to produce higher tracking error, while full replication can reduce it—but with tradeoffs, such as impact on illiquid securities pricing or execution delays generating cash drag, a mechanism detailed below.

Uninvested Cash

An index has, by definition, no cash reserves. A fund typically holds some, at least temporarily: this uninvested cash, called cash drag, reduces the fund's return and distances its net asset value from the index's, according to VettaFi. Dividends paid by portfolio securities themselves create cash, a source of short-term cash drag until they are reinvested.

Rebalancing and Market Volatility

Periodic portfolio rebalancing keeps alignment with the index and thus reduces tracking error, but it generates commissions and transaction fees—a tradeoff between precision and cost, VettaFi notes. Furthermore, tracking error tends to increase when markets are more volatile, notably due to wider bid-ask spreads and increased risk that the ETF price diverges from its net asset value; it decreases during calmer market periods.

Which Measure Should You Focus On Based on Your Investment Horizon?

Facing these two figures, a practical question arises: which should you prioritize? Vanguard offers clear decision criteria: for a long-term total return objective, tracking difference matters more than tracking error; in the short term, it's the opposite—tracking error takes priority.

Vanguard illustrates this idea with a hypothetical example that can be restated as follows: imagine two funds, A and B, replicating the same index. Fund A shows high tracking error—its returns diverge significantly from the index from one period to the next—but accumulates, over several years, better total returns. Fund B, meanwhile, tracks the index far more consistently, with low tracking error, but its cumulative average return remains below Fund A's. An investor primarily seeking high total returns over the long term might prefer Fund A despite its irregularity. Another, more sensitive to period-to-period predictability, would prefer Fund B even with lower average returns.

These two perspectives aren't really opposed: aiming for tracking error close to zero remains the manager's objective, while cumulative tracking difference remains the relevant reading for the long-term investor. Vanguard actually offers a benchmark for interpreting a published tracking error figure: with 50 basis points of tracking error, tracking difference should fall, roughly two-thirds of the time, within 50 basis points of its average. However, there is no universal standard for "good" tracking error—passive products simply aim to get as close as possible.

What Does (and Doesn't) an ETF Fact Sheet Available in Belgium Show?

To concretely see what a Belgian saver finds—and doesn't find—when consulting a consumer-facing fact sheet, take the example of the Xtrackers Portfolio Income UCITS ETF (Distribution), listed on Xetra. On its Test-Achats fact sheet, undated at the time of review, the 5-year annual return shown is 2.30% and the ongoing charges (expense ratio) are 0.65%.

These two figures say nothing about the quality of replication itself. Yet Test-Achats's rating methodology for funds and ETFs rests on five criteria: 5-year return (accounting for 25% of the average rating), consistency, risk, fees, and proximity to the targeted market (15% of the rating). Neither tracking difference nor tracking error appears among these criteria.

This doesn't mean these fact sheets are useless—they answer other questions, particularly about fees and the fund's positioning. But to judge an ETF's fidelity to its index, you need to seek that information elsewhere, typically in the periodic information sheet published by the fund provider (its monthly "factsheet"), which generally details tracking difference over multiple periods.

Checklist: 5 Questions to Ask Yourself Before Assessing an ETF's Tracking

Before comparing two ETFs solely on the basis of their displayed expense ratio, here are five questions that help you form a more complete picture of their actual tracking:

  1. Total costs beyond the expense ratio: fees remain, according to Vanguard, the most frequent contributor to negative tracking difference, and some transaction costs are not reflected in the ongoing charges ratio.
  2. Replication method: a fund using sampling rather than full replication tends, per VettaFi, to have higher tracking error.
  3. Cash management: uninvested cash, particularly from dividends received, can generate the cash drag mentioned above, which distances the fund from its index.
  4. Securities lending: this practice can offset some fees and improve performance, to an extent depending on the share of lending revenue retained by the fund manager.
  5. Rebalancing frequency: more frequent rebalancing reduces tracking error but generates additional commissions and transaction fees.

Frequently Asked Questions

Can a zero-fee ETF still track its index poorly?

Yes. Even a fund showing expense ratio close to zero remains subject to mechanisms independent of fees themselves: the cash drag mentioned above, linked to dividends awaiting reinvestment, continues to weigh on performance, as does the replication method chosen, which influences the consistency of tracking rather than its cost.

Can Tracking Difference Be Positive?

It's rare, but possible. Securities lending—a practice whereby the fund temporarily lends portfolio securities in exchange for compensation—can offset some fees or even exceed them. The magnitude of this effect depends, however, on what share of lending revenue the fund manager retains for itself rather than returning to the fund.

Does an Index ETF Always Have Lower Tracking Error Than an Active Fund?

According to VettaFi, index funds generally tend to show lower tracking error than actively managed funds, insofar as their explicit objective is to stick to an index rather than deviate from it.

Should I Worry If an ETF's Tracking Error Suddenly Spikes?

Rising tracking error introduces unpredictability and may signal hidden costs. For risk managers, VettaFi notes, rising tracking error can be an early signal of fund liquidity or structure problems—a reason to monitor its evolution over time rather than relying on a single snapshot.

Conclusion

On the Test-Achats fact sheet examined, neither tracking difference nor tracking error appears among the selected criteria. As long as this type of consumer-facing fact sheet doesn't systematically incorporate these two measures, vigilance remains individual: it is in the fund provider's documentation—its periodic information sheet, or factsheet—rather than on a comparative fact sheet that the real assessment of an ETF's replication quality takes place.

--- This article is published for informational purposes only and does not constitute investment advice. Consult a qualified financial advisor before making any investment decision.

Read next

This site only uses functional cookies. By continuing to browse you accept their use. Learn more