Someone asked under one of my Reddit posts a few weeks back how I actually calculate the robustness score shown on each strategy. Fair question. I went to grab the methodology link and realized I'd never written the answer down anywhere public. I shipped the Robustness column months ago and never documented it. That's fixed, the methodology page now has a full section on it. But I think this number does the most honest job on the whole site, so it gets its own post.
Start with the uncomfortable part. I've backtested 202 strategy variants that are still alive in my database. 150 of them sit on the public leaderboard; the other 52 belong to research strategies I never released. Imagine all 202 had zero real edge, just random monthly returns dressed up as strategies. Rank them by Sharpe and look at the winner. It won't look random at all. Given the actual spread of Sharpe ratios across everything I've tested, the luckiest of 202 no-edge strategies should still show an annualized Sharpe around 0.56. From pure noise.
That number bothers me. It means a positive Sharpe is close to meaningless when it comes out of a large menu of backtests. And every strategy platform, mine included, is a large menu of backtests.
What the score actually is
The Robustness score is the Deflated Sharpe Ratio, from a 2014 paper by David Bailey and Marcos López de Prado. It's a probability from 0 to 1: how likely is it that this strategy's Sharpe reflects a real edge rather than being the luckiest pick among everything I tested?
Three corrections do the work.
Catalog size. I count N as every variant I've backtested and still track, 202 today, whether or not it ever made it to the site. The unreleased research pile counts, the reference rows like the single-asset 200-day trends count, because every one of them was a chance to get lucky. From the Sharpe spread across those 202 I compute that best-of-N-by-luck benchmark, and each strategy's Sharpe has to clear it, which sits well above zero.
Track length. A 0.8 Sharpe over 50 years of monthly data is a much stronger claim than 0.8 over 8 years. Fewer months, lower score.
Return shape. I plug in each backtest's actual monthly skewness and kurtosis instead of assuming a bell curve. Negative skew and fat tails make a raw Sharpe look more dependable than it is, so they pull the score down.
Scores above 0.90 print as a quiet gray number. Anything below 0.90 I flag amber as fragile, right on the leaderboard.
What it says about my own catalog
The median score on the leaderboard today is 0.99, and about 3 in 10 variants round to 1.0. That's what a real edge compounding over 40 or 50 years of monthly data looks like: the HAA and VAA families live up there, Century Momentum prints 0.9996 on almost a century of data, GEM sits at 0.99.
And 25 of the 150 public variants sit below the 0.90 line (8 more fragile ones hide in the unreleased pile, you just never see those). The lowest visible is the plain 200-day trend on TLT, at 0.48. Worse than a coin flip. The GLD version reads 0.51, and White Knuckle, the 3x risk-parity rotation, is at 0.58. All flagged amber, by me, on my own product.
A fragile flag means the track record can't yet separate the strategy's edge from the luck of the draw, given how many things I tested. Single-asset trend rules carry modest Sharpes by construction, so they sit close to the noise benchmark. My honest reading is "this might work, the data can't prove it yet". I'd rather print that than hide it.
The property that sold me on it
Every variant I test raises N, which raises the luck benchmark, which drags every score down a little. Published or not. I widened N from the 150 public variants to all 202 tested ones while writing this post, and watched every single score drop and 5 borderline strategies pick up the fragile flag. My own research output works against my own headline numbers, which is exactly the direction the incentives usually don't run.
As far as I know, nobody else in the retail strategy space deflates their published numbers as a function of their own catalog size. I'd honestly like to be wrong about that, it would be good for everyone.
The caveats, because there are always caveats
I compute the score on monthly Sharpe over the full track record, so flipping the leaderboard to a 5-year or 10-year window leaves it untouched. I built it that way on purpose. It answers one question: is this Sharpe likely real? How the strategy did last year is a different question, and the period columns already answer it.
Even this N is a floor. The parameter variations I tried and threw away before publishing aren't logged as separate trials, and the industry at large has run millions of backtests, so the true luck benchmark out there is higher than anything I can compute. A high Robustness score gets a strategy a hearing. It can't win the case alone. A 1.0 doesn't guarantee the next decade behaves, and a 0.48 mostly tells me to size the position like the evidence is thin, because it is.
If you want to poke at it, sort the leaderboard by the Robustness column and hover the header for the short version. The full math, the 0.90 cutoff, and the paper reference are in the methodology, section 11. And if you're wondering how I handle the cousin problem, overfitting inside a single strategy's parameters, that's the walk-forward deep dive.