P/E Compression in Japan: The Signal That Finds Stocks But Not Alpha

Growth of $10,000 invested in P/E Compression Screen on JPX vs S&P 500 from 2000 to 2025

We ran the P/E compression screen on JPX (Tokyo Stock Exchange) from 2000 to 2025. The strategy found an average of 28 qualifying stocks per year, the signal fired reliably, and the portfolio still returned 5.35% annually vs 7.64% for the S&P 500. That's -2.29% per year, compounding into a 268.1% total return against SPY's 530.7% over 25 years. Japan is the clearest example in this series of a signal that works mechanically but fails structurally.

Contents

  1. Method
  2. The Strategy
  3. Screen
  4. Results
  5. When It Works
  6. When It Fails
  7. The Japan Discount
  8. Full Annual Returns
  9. Limitations
  10. Run It Yourself
  11. Part of a Series

Method

  • Data source: Ceta Research (FMP financial data warehouse)
  • Universe: JPX (Tokyo Stock Exchange), market cap > exchange-specific threshold
  • Period: 2000-2025 (25 annual rebalance periods)
  • Rebalancing: Annual (January), equal weight top 30 by compression score
  • Benchmark: S&P 500 Total Return (SPY)
  • Currency note: Returns in Japanese Yen (JPY). Benchmark is USD. Direct comparison has currency effects.
  • Cash rule: Hold cash if fewer than 10 stocks qualify

Historical financial data with 45-day lag to prevent look-ahead bias. Full methodology: backtests/METHODOLOGY.md


The Strategy

P/E compression is the inverse of multiple expansion. A stock whose P/E has contracted 15%+ below its own historical average looks cheap relative to itself. Not cheap in absolute terms, but cheap relative to what the market was willing to pay for this company's earnings across multiple business cycles.

The filters:

Criterion Metric Threshold Why
Valuation compression Current P/E / 5yr avg P/E < 0.85 15%+ below own history
Real earnings P/E > 5 Positive earnings, not distressed
Not speculative P/E < 40 Excludes story stocks
Profitability Return on equity > 10% Business still earns decent returns
Leverage Debt-to-equity < 2.0 Not over-leveraged
Liquidity Market cap > exchange threshold Investable
History Prior P/E data 3+ years Enough to compute meaningful average

Ranking: Top 30 by most compressed (lowest current/average ratio), equal weight.

The ROE and D/E filters are the key differentiator from simple low-P/E screens. A stock with a compressed P/E but deteriorating fundamentals is a value trap. The quality filters select for companies where the compression looks like sentiment or cycle-driven repricing, not earnings deterioration.

Screen

WITH fy_pe AS (
 SELECT r.symbol, r.priceToEarningsRatio AS pe, r.dateEpoch,
 ROW_NUMBER() OVER (PARTITION BY r.symbol ORDER BY r.dateEpoch DESC) AS rn,
 AVG(r.priceToEarningsRatio) OVER (
 PARTITION BY r.symbol ORDER BY r.dateEpoch
 ROWS BETWEEN 5 PRECEDING AND 1 PRECEDING
 ) AS avg_pe_5yr,
 COUNT(r.priceToEarningsRatio) OVER (
 PARTITION BY r.symbol ORDER BY r.dateEpoch
 ROWS BETWEEN 5 PRECEDING AND 1 PRECEDING
 ) AS n_prior
 FROM financial_ratios r
 JOIN profile p ON r.symbol = p.symbol
 WHERE r.period = 'FY' AND r.priceToEarningsRatio > 0 AND r.priceToEarningsRatio < 100
 AND p.exchange IN ('JPX')
)
SELECT f.symbol, p.companyName, p.sector,
 ROUND(f.pe, 2) AS current_fy_pe,
 ROUND(f.avg_pe_5yr, 2) AS pe_5yr_avg,
 ROUND(f.pe / f.avg_pe_5yr, 3) AS pe_ratio_to_avg,
 ROUND((1 - f.pe / f.avg_pe_5yr) * 100, 1) AS compression_pct,
 ROUND(k.returnOnEquityTTM * 100, 1) AS roe_pct,
 ROUND(f2.debtToEquityRatioTTM, 2) AS debt_to_equity,
 ROUND(k.marketCap / 1e9, 2) AS mktcap_b
FROM fy_pe f
JOIN key_metrics_ttm k ON f.symbol = k.symbol
JOIN financial_ratios_ttm f2 ON f.symbol = f2.symbol
JOIN profile p ON f.symbol = p.symbol
WHERE f.rn = 1
 AND f.avg_pe_5yr IS NOT NULL
 AND f.n_prior >= 3
 AND f.pe > 5
 AND f.pe < 40
 AND f.pe / f.avg_pe_5yr < 0.85
 AND k.returnOnEquityTTM > 0.10
 AND (f2.debtToEquityRatioTTM IS NULL OR (f2.debtToEquityRatioTTM >= 0 AND f2.debtToEquityRatioTTM < 2.0))
ORDER BY f.pe / f.avg_pe_5yr ASC
LIMIT 30

Results

Metric Portfolio S&P 500
CAGR 5.35% 7.64%
Total Return 268.1% 530.7%
Max Drawdown -50.89% -34.90%
Volatility (ann.) 20.10% 17.51%
Sharpe Ratio 0.261 0.322
Sortino Ratio 0.457
Beta 0.829 1.00
Alpha -1.00%
Up Capture 82.8%
Down Capture 86.6%
Win Rate (vs SPY) 40.0%
Cash Periods 4/25
Avg Stocks 28.0

The strategy underperforms on every dimension: lower CAGR, deeper max drawdown, worse win rate. The one positive framing is the Sharpe ratio of 0.261, positive means the portfolio did earn more than the risk-free rate on a risk-adjusted basis. It wasn't a complete failure. It just consistently trailed the benchmark.


When It Works

Japan had genuine standout years. These four clustered around macro regime shifts.

Year Portfolio S&P 500 Excess
2005 +37.5% +7.2% +30.3%
2009 +38.8% +24.7% +14.1%
2013 +43.6% +27.8% +15.8%
2017 +31.8% +21.6% +10.2%

2005 was part of a broad Japanese market recovery after the deflationary 1990s. Value stocks caught a bid as the economy found footing.

2009 followed the global financial crisis. Companies whose P/Es compressed in the panic recovered as earnings stabilized, consistent with what the screen found in other markets that year.

2013 coincided with Abenomics. Prime Minister Abe's policy package (aggressive monetary easing, fiscal stimulus, structural reforms) drove a broad Japanese equity rally. Compressed-multiple stocks with decent ROE benefited disproportionately as the yen weakened and corporate earnings expanded.

2017 was a quieter version of the same: a steady global growth environment where quality value names participated without the macro headwinds that hurt other years.


When It Fails

The failure years are more numerous and more consistent.

Year Portfolio S&P 500 Excess
2000 0.0% -10.5% +10.5% (cash)
2001 0.0% -9.2% +9.2% (cash)
2002 0.0% -19.9% +19.9% (cash)
2003 0.0% +24.1% -24.1% (cash)
2008 -47.9% -34.3% -13.6%
2018 -28.2% -5.2% -23.1%
2021 +8.6% +31.3% -22.7%
2024 +6.5% +25.3% -18.8%

2000-2003: JPX data in the FMP warehouse was thin for the early period. Not enough stocks met the full quality filter set (P/E history, ROE, D/E). The portfolio held cash all four years. This produced accidental defense in 2000-2002 (SPY fell), but missed the 2003 recovery entirely.

2008: The worst active loss year. -47.9% against SPY's -34.3%. Japanese equities got hammered in the global crisis. Companies with compressed P/Es that also had leverage and cyclical exposure fell harder than the broader index.

2018: A sharp global equity selloff hit Japan's export-heavy market particularly hard. -28.2% with -23.1% excess is the worst spread of any active year.

2021 and 2024: The mirror image of the Abenomics years. Global capital rotated aggressively into high-growth, high-multiple names. Compressed-P/E screens hold the opposite of that.


The Japan Discount

The deeper issue isn't one bad year or a data gap. It's structural.

Japanese companies have historically traded at lower multiples than their Western counterparts. The reasons are well-documented: low ROE targets, chronic over-retention of cash and cross-shareholdings (keiretsu), weak shareholder return culture, and a deflationary macro backdrop that depressed nominal earnings growth for nearly two decades. When a Japanese company's P/E compresses below its 5-year average, you're not always looking at a temporarily cheap business. You're often looking at a market that has correctly priced in low capital efficiency.

The P/E compression signal assumes the compressed multiple is anomalous. That there's a "normal" multiple the company should revert to. In the US, that assumption holds reasonably well because US companies operate in an environment where earnings growth and shareholder returns are actively managed. In Japan, the "normal" multiple has itself been structurally low. The market wasn't wrong. It was just reflecting reality.

This explains the signal finding 28 stocks per year. The screen fires because plenty of Japanese companies see P/E fluctuations around their historical averages. But the re-rating that drives the US alpha doesn't follow consistently in Japan, because the underlying ROE expansion and multiple expansion that fuel re-ratings depend on corporate behavior that was, for much of this period, absent.

The landscape may be changing. The Tokyo Stock Exchange launched a governance reform campaign in 2023, pressuring companies trading below book value to improve capital efficiency, increase buybacks, and articulate ROE targets. Early evidence shows some effect. Several major Japanese conglomerates have announced shareholder return programs and cross-holding disposals. If this reforms corporate Japan's capital allocation culture, P/E compression may become a stronger signal going forward. The 2023 and 2024 results (+22.2% and +6.5%) don't yet reflect it clearly, but the 2023 absolute return was solid.

Despite underperforming the benchmark, the strategy's positive Sharpe (0.261) means it wasn't pointless. It earned above the Japanese risk-free rate on a risk-adjusted basis across the full period. That's a floor, not a ceiling.


Full Annual Returns

Years 2000-2003 held cash (fewer than 10 qualifying stocks in JPX data)

Year Portfolio S&P 500 Excess
2000 0.0% -10.5% +10.5%
2001 0.0% -9.2% +9.2%
2002 0.0% -19.9% +19.9%
2003 0.0% +24.1% -24.1%
2004 +9.1% +10.2% -1.1%
2005 +37.5% +7.2% +30.3%
2006 +18.6% +13.7% +5.0%
2007 -5.7% +4.4% -10.1%
2008 -47.9% -34.3% -13.6%
2009 +38.8% +24.7% +14.1%
2010 +8.2% +14.3% -6.1%
2011 -8.3% +2.5% -10.8%
2012 +11.8% +17.1% -5.3%
2013 +43.6% +27.8% +15.8%
2014 +14.3% +14.5% -0.2%
2015 +0.6% -0.1% +0.7%
2016 +6.5% +14.4% -7.9%
2017 +31.8% +21.6% +10.2%
2018 -28.2% -5.2% -23.1%
2019 +20.7% +32.3% -11.6%
2020 +6.3% +15.6% -9.4%
2021 +8.6% +31.3% -22.7%
2022 -9.4% -19.0% +9.6%
2023 +22.2% +26.0% -3.8%
2024 +6.5% +25.3% -18.8%

Limitations

Currency effects. Portfolio returns are in JPY. The benchmark is SPY in USD. The JPY/USD rate moved materially over this period, which affects any direct comparison. A USD-denominated investor in Japanese equities would have seen different numbers depending on FX moves.

Early cash years. JPX coverage in the FMP data warehouse was thinner for 2000-2003, meaning fewer companies had the 3+ years of P/E history needed to qualify. This produced four cash years at the start of the test, which distorts both the early drawdown stats and the compounding base.

The 2008 drawdown. At -50.89%, the max drawdown is worse than SPY's -34.90% and worse than the US version of this strategy at -42.82%. Japanese equities in general fell harder in 2008 due to yen appreciation and export sector exposure.

Annual rebalancing lag. Rebalancing once per year in January means the portfolio can't respond to mid-year deterioration. The FY P/E history calculation is most reliable with annual filings, so quarterly rebalancing would introduce noise.


Run It Yourself

git clone https://github.com/ceta-research/backtests.git
cd backtests

# Japan backtest
python3 pe-compression/backtest.py --preset japan --output results.json --verbose

# Current screen
python3 pe-compression/screen.py --preset japan

Part of a Series

This is the Japan analysis. We tested the same screen across 19 exchanges globally:


Run It Yourself

Explore the data behind this analysis on Ceta Research. Query our financial data warehouse with SQL, build custom screens, and run your own backtests across 70,000+ stocks on 20 exchanges.

Data: Ceta Research (FMP financial data warehouse), 2000-2025. Returns in JPY. Benchmark: SPY (USD). Full methodology: METHODOLOGY.md. Past performance doesn't guarantee future results.

Read more