Honest out-of-sample validation · information only

Is your strategy real — or self-deception?

A beautiful backtest is easy. Surviving reality is not. Upload your strategy's returns and our honest gauntlet returns a verdict — REAL, SELF-DECEPTION, or DEAD — with the exact reason. A free AI will flatter your overfit. We'll tell you the truth before the market charges you for it.

Validate free See how it works
No card for your first check We never hold funds or trade Same engine that retired 24 strategies
The problem

Your backtest lies.

Not on purpose. A curve that climbs cleanly is the single most convincing thing in trading — and the easiest to fake by accident. Three quiet killers do most of the damage.

Survivorship

You test on the assets and periods that made it to today. The blow-ups that quietly delisted never entered your data — so your edge looks safer than the world ever was.

Overfitting

Tune enough parameters and you stop modelling the market and start memorising the noise. The result is gorgeous in-sample and helpless the moment new data arrives.

Multiple testing

Try 200 ideas and one will look brilliant by pure luck. Without a penalty for how many you tried, the winner you fell in love with is often just the loudest coin flip.

The chart feels like proof. It isn't. Real money is where the illusion gets billed to you.

How it works

One paste. One honest gauntlet. One verdict.

No setup, no integration, no access to your account. Just your return series and an honest answer in seconds.

01

Paste your returns

Drop in your strategy's per-period returns and how many variants you tested to find it. Nothing connected, nothing custodial. It's just numbers in.

Returns seriesTrials count
02

Run the honest gauntlet

We re-test it the way reality will — net of costs, across purged splits, and against a bar raised for every variant you tried. No re-tuning until it passes.

Purged-CVDeflated-SharpeCosts & slippageTail / CVaR
03

Get verdict + certificate

A clear REAL · SELF-DECEPTION · DEAD verdict with the precise reason, the numbers behind it, and a clean report you can keep or share.

Plain-language reasonShareable report
24
strategies we retired — that looked great.

We didn't build this to sell hope. We built it to kill our own bad ideas before they cost us. The same engine now runs on yours, held to exactly the same standard.

  • Gross Sharpe 2.1 that collapsed to 0.4 once fees, funding and slippage were counted.
  • A smooth equity curve hiding a brutal left tail the average quietly buried.
  • A "winner" picked from dozens of trials that never cleared the deflated-Sharpe bar.
  • A backtest that broke on a single shifted fold — fragile, not robust.
Sample verdict

Two strategies. One honest answer each.

This is what comes back — a verdict you can act on, not a wall of numbers you have to interpret.

SELF-DECEPTIONLooks real, isn't

Gross numbers look outstanding — but the edge does not survive once costs and multiple-testing are honestly accounted for.

Net Sharpe0.4
Worst CV fold-1.2
Deflated bar2.81
REALSurvives honest OOS

The edge holds net of costs, stays positive across every purged fold, and clears the deflated-Sharpe bar for the trials you ran.

Net Sharpe1.6
Worst CV fold0.7
Deflated bar1.42

Illustrative examples. Every verdict is probabilistic and carries the same honest caveats described below.

Pricing

Start free. Pay only when it's worth it.

One check is on us. The day an honest verdict saves you a single bad deployment, the rest pays for itself many times over.

Free
$0
One honest check, no card.
  • 1 full validation
  • Verdict + plain-language reason
  • Core metrics on screen
  • No saved report
Validate free
Most popular
Pro
$29/mo
Unlimited checks + full reports.
  • Unlimited validations
  • Full report + shareable certificate
  • Every metric: purged-CV, deflated-Sharpe, CVaR
  • PDF export & version history
Start with Pro
Pay-per-check
$9/check
For the occasional verdict.
  • 1 full validation
  • Full report + certificate
  • PDF export
  • No subscription
Buy a check

Cancel anytime. No funds held, no trades executed, no lock-in. This is information — you keep every decision.

Informational analysis only

isitalpha provides informational analysis only. It is not investment advice, not a recommendation, not an offer or solicitation, and not asset management. Nothing here is a suggestion to adopt, deploy, fund, continue, or abandon any strategy. We make no promise of profit of any kind.

Past performance does not guarantee future results. Every verdict is probabilistic and rests on the return series you supply and on assumptions about costs, funding and execution that may not match your real conditions. A "REAL" verdict is not a certification of future profitability; a "DEAD" or "SELF-DECEPTION" verdict does not prove a strategy cannot work. Survivorship, data-quality, look-ahead and regime-change caveats apply.

You are solely responsible for your own decisions. Trading involves the risk of loss, including loss of capital. We never hold client funds and never execute trades on your behalf. Consider seeking advice from a licensed professional in your jurisdiction before acting.

Find out before the market does.

The market will tell you the truth eventually — and charge you for the lesson. Get the honest verdict first. Your first check is free.