Zach Anderson
Mar 13, 2026 17:07
New analysis reveals backtests utilizing revised on-chain knowledge produce deceptive outcomes. Level-in-time metrics reveal considerably worse real-world efficiency.
That worthwhile buying and selling technique you backtested? It most likely would not have labored in actual time. Glassnode’s newest analysis demonstrates how retroactively revised on-chain knowledge creates a harmful phantasm of profitability that evaporates when examined towards info merchants really had entry to.
The analytics agency ran an identical backtests on a easy BTC alternate steadiness technique—one utilizing normal historic knowledge, one other utilizing immutable point-in-time (PiT) metrics. Similar sign logic, similar parameters, similar 0.1% buying and selling charges. The outcomes diverged dramatically.
The Hidden Downside with On-Chain Information
Metrics like alternate balances aren’t static. They get revised as deal with clustering improves and entity labeling updates. That Binance BTC steadiness determine you are for January 15, 2024 might not match what was really revealed on that date.
Whenever you backtest towards revised knowledge, you are buying and selling on info that did not exist when choices would have been made. This look-ahead bias is especially extreme for metrics depending on entity identification—precisely the type of knowledge many merchants depend on for alternate circulate evaluation.
Glassnode’s check technique was easy: go lengthy when the 5-day shifting common of Binance’s BTC steadiness drops under the 14-day common (sustained outflows), exit when it crosses again above (outflows reversing). Operating from January 2024 by March 2026 with $1,000 preliminary capital, the usual backtest confirmed efficiency roughly matching buy-and-hold.
The PiT model instructed a distinct story. Whereas each methods tracked equally by a lot of 2024, the immutable knowledge model missed the robust November 2024 and March 2025 rallies that the revised-data backtest captured. Cumulative efficiency ended up “significantly decrease,” in line with Glassnode.
Why This Issues for Quant Merchants
The implications prolong past this single technique. Any backtest counting on knowledge topic to revision—alternate balances, entity-tagged flows, even buying and selling volumes from exchanges that report with delays—faces the identical contamination danger.
This aligns with broader issues in quantitative finance about knowledge high quality. Analysis from various knowledge suppliers reveals PiT methodology prevents a number of bias varieties: look-ahead bias from utilizing future revisions, survivorship bias from datasets that exclude failed entities, and hindsight bias from restated figures.
For crypto particularly, the place on-chain analytics corporations repeatedly refine their entity labeling and clustering algorithms, the revision downside compounds. A pockets recognized as belonging to Binance in the present day may not have been tagged accurately two years in the past when your backtest assumes you traded on that sign.
The Sensible Repair
Glassnode now provides PiT variants for all metrics by their Skilled tier. These append-only datasets lock in every knowledge level because it was initially computed—no retroactive adjustments.
The tradeoff is actual: your backtests will seemingly look worse. However they will mirror what would have really occurred. For merchants allocating actual capital based mostly on quantitative alerts, that accuracy hole between a flattering backtest and disappointing dwell efficiency may be costly.
Earlier than deploying any technique constructed on on-chain metrics, the query is not whether or not the backtest seems worthwhile—it is whether or not you examined towards the info you’ll have really seen.
Picture supply: Shutterstock
