The Deflated Sharpe Ratio: Correcting for Selection Bias, Backtest Overfitting and Non-normality
نویسندگان
چکیده
With the advent in recent years of large financial data sets, machine learning and highperformance computing, analysts can backtest millions (if not billions) of alternative investment strategies. Backtest optimizers search for combinations of parameters that maximize the simulated historical performance of a strategy, leading to backtest overfitting. The problem of performance inflation extends beyond backtesting. More generally, researchers and investment managers tend to report only positive outcomes, a phenomenon known as selection bias. Not controlling for the number of trials involved in a particular discovery leads to over-optimistic performance expectations. The Deflated Sharpe Ratio (DSR) corrects for two leading sources of performance inflation: Selection bias under multiple testing and non-Normally distributed returns. In doing so, DSR helps separate legitimate empirical findings from statistical flukes.
منابع مشابه
Pseudo-Mathematics and Financial Charlatanism: The Effects of Backtest Overfitting on Out-of-Sample Performance
Introduction A backtest is a historical simulation of an algorithmic investment strategy. Among other things, it computes the series of profits and losses that such strategy would have generated had that algorithm been run over that time period. Popular performance statistics, such as the Sharpe ratio or the Information ratio, are used to quantify the backtested strategy’s return on risk. Inves...
متن کاملOnline tools for demonstration of backtest overfitting
In mathematical finance, backtest overfitting means the usage of historical market data (a backtest) to develop an investment strategy, where too many variations of the strategy are tried, relative to the amount of data available. Backtest overfitting is now thought to be a primary reason why quantitative investment models and strategies that look good on paper often disappoint in practice. In ...
متن کاملOutperformance Testing of a Dynamic Assets Portfolio Selection Supplemented with a Continuous Paths Levy Process
This study aims at getting a better performance for optimal stock portfolios by modeling stocks prices dynamics through a continuous paths Levy process. To this end, the share prices are simulated using a multi-dimensional geometric Brownian motion model. Then, we use the results to form the optimal portfolio by maximizing the Sharpe ratio and comparing the findings with the outputs of the conv...
متن کاملPseudo Mathematics and Financial Charlatanism: Backtest Overfitting and Out-of-sample Performance
Recent computational advances allow investment managers to search for profitable investment strategies. In many instances, that search involves a pseudo-mathematical argument, which is spuriously validated through a simulation of its historical performance (also called backtest). We prove that high performance is easily achievable after backtesting a relatively small number of alternative strat...
متن کاملStock portfolio design and backtest overfitting
In mathematical finance, backtest overfitting connotes the usage of historical market data to develop an investment strategy, where too many variations of the strategy are tried, relative to the amount of data available. Backtest overfitting is now thought to be a primary reason why investment models and strategies that look good on paper often disappoint in practice. Models and strategies suff...
متن کامل