Plumbline
Service
Sample report
Notes
About & contact
中文
Plumbline · Notes
Backtest pitfall notes
Backtest problems we have run into in our own research and check for in every audit, one per note.
2026-11-21
“Beat the market” needs taking apart: five questions before you subscribe to a stock-pick service
A made-up book that picks no stocks at all and simply moves 1.5 times the market each day “beat” the S&P 500 by more than 70 percentage points over four years. A stock-pick service's track record needs taking apart.
2026-11-20
Rebalance start-date luck: one strategy, a Sharpe anywhere from 0.01 to 0.73
A book that rebalances every 63 trading days gives 63 different Sharpe ratios when only its start date changes. The one originally reported ranks 8th of 63.