loader from loading.io

86 - The Tyranny of Backtesting: Why Backtests are harmful and counter-productive

The DIY Investing Podcast

Release Date: 08/02/2020

108 - Coffee Can Portfolio Investing show art 108 - Coffee Can Portfolio Investing

The DIY Investing Podcast

In this episode, I discuss the coffee can portfolio approach to investing. This investing strategy involves never selling a stock once it is bought. Therefore, you must seek high-quality companies with long runways for growth and high returns on capital.

107 - Investing Goals for 2021 show art 107 - Investing Goals for 2021

The DIY Investing Podcast

In this episode, I outline my top investing goals for the new year. I aim to identify 2 new companies worth buying and my goal is to attain a 20%+ annual return for 2021. I also cover process-based goals relating to how to go about investing research. Finally, I would like to pass the Series 65 exam so that I can begin managing money for outside clients. 

106 - When to Sell Stocks show art 106 - When to Sell Stocks

The DIY Investing Podcast

Many value investors lack a clear strategy on when to sell stocks in their portfolio. This decision ought to be based on opportunity cost, potential investment mistakes, intrinsic value, and return differential between old and new companies.

105 - Investing vs Speculation vs Gambling show art 105 - Investing vs Speculation vs Gambling

The DIY Investing Podcast

An investment is any investment operation that utilizes a margin of safety, provides an adequate return of 10% or more, earns that return from fundamental cash flows, is a positive-sum game, and bounded by a range of prices and terms.

104 - Terminal Value and Why Intrinsic Value grows over time show art 104 - Terminal Value and Why Intrinsic Value grows over time

The DIY Investing Podcast

Terminal Value is the net present value of all future cash flows discounted back to a specific year in the future. Intrinsic value is fixed, but your estimate of intrinsic value will change over time.

103 - The Deflation Myth show art 103 - The Deflation Myth

The DIY Investing Podcast

The Deflation Myth has been accepted primarily because economists have used false assumptions in their analysis and because debtors, namely world governments, tend to hold massive political and cultural power. It is in their best interest to convince you that deflation is bad so that they can inflate away their debts. Yet, most investors are harmed more by inflation than they would be by deflation. 

102 - Don't use Enterprise Value - Here's Why show art 102 - Don't use Enterprise Value - Here's Why

The DIY Investing Podcast

Be conservative when valuing companies. Don't give managers credit where they don't deserve it. Enterprise value should only be used when companies hold debt. Yet, you should only buy companies with net cash.

101 - How to find good stock ideas (FAQ) show art 101 - How to find good stock ideas (FAQ)

The DIY Investing Podcast

The best way to identify good stock ideas is to copy a watchlist of investors you trust and respect. Their best ideas can form a strong foundation for your watchlist.

100 - Special Edition: Reflecting after 100 episodes show art 100 - Special Edition: Reflecting after 100 episodes

The DIY Investing Podcast

As I reflect on my first 100 episodes of The DIY Investing Podcast, I want to hear from you my audience. Share your thoughts and feedback so the next 100 episodes are even better.

99 - OTC Manual Database with Jan Svenda and David Flood show art 99 - OTC Manual Database with Jan Svenda and David Flood

The DIY Investing Podcast

I interview two guests in today's show: Jan Svenda of SvendaManual.com and David Flood of ElementaryValue.com. We discuss their new product, an OTC Manual database for finding stock ideas.

More Episodes

Books Referenced:

Fooled by Randomness by Nassim Taleb

*If you purchase through this affiliate link, I will receive a small commission, at no additional cost to you. Your purchase will be supporting the show's continued production of free content. 

Thank you for your support!

Mental Models discussed in this podcast:

  • A priori knowledge
  • Deductive vs Inductive Reasoning
  • Empirical Evidence
  • The Scientific Method
  • Curve Fitting and Extrapolation Problem
  • Boundary Conditions
  • Hindsight Bias
  • Ergodicity

Please review and rate the podcast

If you enjoyed this podcast and found it helpful, please consider leaving me a rating and review. Your feedback helps me to improve the podcast and grow the show's audience. 

Follow me on Twitter and YouTube

Twitter Handle: @TreyHenninger

YouTube Channel: DIY Investing

Support the Podcast on Patreon

This is a podcast supported by listeners like you. If you’d like to support this podcast and help me to continue creating great investing content, please consider becoming a Patron at DIYInvesting.org/Patron.

You can find out more information by listening to episode 11 of this podcast.

Show Outline

The full show notes for this episode are available at https://www.diyinvesting.org/Episode86

Why Backtests are harmful and counterproductive 

  • Empirical Evidence - backtesting is a form of empirical evidence. I.e. observation of the past
  • A priori knowledge - knowledge, justifications, or arguments that exist independently from experience. (Ex: Mathematics) (Wikipedia)
    • a form of knowledge that can be derived by reason alone.
  • Deductive reasoning - the process of reasoning from one or more statements to reach a logically certain conclusion. (Wikipedia)
  • Inductive reasoning:
    • “inductive reasoning as the derivation of general principles from specific observations (arguing from specific to general)” - Wikipedia (same link as below)
    • “While the conclusion of a deductive argument is certain, the truth of the conclusion of an inductive argument is probable, based upon the evidence given.” -Wikipedia
  • Scientific Method:
    • Form a hypothesis
    • Propose an experiment to test that hypothesis.
    • Results of the experiment either support or disprove the hypothesis. No experiment can prove a hypothesis.
  • The problem with the theory:
    • A theory only follows the scientific method if it can be disproven. If a theory is unable to be disproven, then it is not a true scientific theory but something else.
  • Curve Fitting and Extrapolation problem (using a curve or model beyond the range of observed data is subject to uncertainty)
  • Boundary conditions.
  • G Merani (Twitter) (Website) - Covers net-net study backtests in depth


Investors use backtests in order to test whether a portfolio's asset allocation would have performed well in the past. The use of backtesting is harmful to a portfolio because it ignores uncertainty and overstates the value of empirical evidence.

It is much better to reason from first principles using deductive reasoning. This deductive reasoning is better than inductive reasoning for investors because it eliminates hindsight bias.