86 - The Tyranny of Backtesting: Why Backtests are harmful and counter-productive
Release Date: 08/02/2020
The DIY Investing Podcast
In this episode, I discuss the coffee can portfolio approach to investing. This investing strategy involves never selling a stock once it is bought. Therefore, you must seek high-quality companies with long runways for growth and high returns on capital.
info_outlineThe DIY Investing Podcast
In this episode, I outline my top investing goals for the new year. I aim to identify 2 new companies worth buying and my goal is to attain a 20%+ annual return for 2021. I also cover process-based goals relating to how to go about investing research. Finally, I would like to pass the Series 65 exam so that I can begin managing money for outside clients.
info_outlineThe DIY Investing Podcast
Many value investors lack a clear strategy on when to sell stocks in their portfolio. This decision ought to be based on opportunity cost, potential investment mistakes, intrinsic value, and return differential between old and new companies.
info_outlineThe DIY Investing Podcast
An investment is any investment operation that utilizes a margin of safety, provides an adequate return of 10% or more, earns that return from fundamental cash flows, is a positive-sum game, and bounded by a range of prices and terms.
info_outlineThe DIY Investing Podcast
Terminal Value is the net present value of all future cash flows discounted back to a specific year in the future. Intrinsic value is fixed, but your estimate of intrinsic value will change over time.
info_outlineThe DIY Investing Podcast
The Deflation Myth has been accepted primarily because economists have used false assumptions in their analysis and because debtors, namely world governments, tend to hold massive political and cultural power. It is in their best interest to convince you that deflation is bad so that they can inflate away their debts. Yet, most investors are harmed more by inflation than they would be by deflation.
info_outlineThe DIY Investing Podcast
Be conservative when valuing companies. Don't give managers credit where they don't deserve it. Enterprise value should only be used when companies hold debt. Yet, you should only buy companies with net cash.
info_outlineThe DIY Investing Podcast
The best way to identify good stock ideas is to copy a watchlist of investors you trust and respect. Their best ideas can form a strong foundation for your watchlist.
info_outlineThe DIY Investing Podcast
As I reflect on my first 100 episodes of The DIY Investing Podcast, I want to hear from you my audience. Share your thoughts and feedback so the next 100 episodes are even better.
info_outlineThe DIY Investing Podcast
I interview two guests in today's show: Jan Svenda of SvendaManual.com and David Flood of ElementaryValue.com. We discuss their new product, an OTC Manual database for finding stock ideas.
info_outlineBooks Referenced:
Fooled by Randomness by Nassim Taleb
*If you purchase through this affiliate link, I will receive a small commission, at no additional cost to you. Your purchase will be supporting the show's continued production of free content.
Thank you for your support!
Mental Models discussed in this podcast:
- A priori knowledge
- Deductive vs Inductive Reasoning
- Empirical Evidence
- The Scientific Method
- Curve Fitting and Extrapolation Problem
- Boundary Conditions
- Hindsight Bias
- Ergodicity
Please review and rate the podcast
If you enjoyed this podcast and found it helpful, please consider leaving me a rating and review. Your feedback helps me to improve the podcast and grow the show's audience.
Follow me on Twitter and YouTube
Twitter Handle: @TreyHenninger
YouTube Channel: DIY Investing
Support the Podcast on Patreon
This is a podcast supported by listeners like you. If you’d like to support this podcast and help me to continue creating great investing content, please consider becoming a Patron at DIYInvesting.org/Patron.
You can find out more information by listening to episode 11 of this podcast.
Show Outline
The full show notes for this episode are available at https://www.diyinvesting.org/Episode86
Why Backtests are harmful and counterproductive
- Empirical Evidence - backtesting is a form of empirical evidence. I.e. observation of the past
- A priori knowledge - knowledge, justifications, or arguments that exist independently from experience. (Ex: Mathematics) (Wikipedia)
- a form of knowledge that can be derived by reason alone.
- Deductive reasoning - the process of reasoning from one or more statements to reach a logically certain conclusion. (Wikipedia)
- Inductive reasoning:
- “inductive reasoning as the derivation of general principles from specific observations (arguing from specific to general)” - Wikipedia (same link as below)
- “While the conclusion of a deductive argument is certain, the truth of the conclusion of an inductive argument is probable, based upon the evidence given.” -Wikipedia
- Scientific Method:
- Form a hypothesis
- Propose an experiment to test that hypothesis.
- Results of the experiment either support or disprove the hypothesis. No experiment can prove a hypothesis.
- The problem with the theory:
- A theory only follows the scientific method if it can be disproven. If a theory is unable to be disproven, then it is not a true scientific theory but something else.
- Curve Fitting and Extrapolation problem (using a curve or model beyond the range of observed data is subject to uncertainty)
- Boundary conditions.
- G Merani (Twitter) (Website) - Covers net-net study backtests in depth
Summary:
Investors use backtests in order to test whether a portfolio's asset allocation would have performed well in the past. The use of backtesting is harmful to a portfolio because it ignores uncertainty and overstates the value of empirical evidence.
It is much better to reason from first principles using deductive reasoning. This deductive reasoning is better than inductive reasoning for investors because it eliminates hindsight bias.