loader from loading.io

86 - The Tyranny of Backtesting: Why Backtests are harmful and counter-productive

The DIY Investing Podcast

Release Date: 08/02/2020

118 - NACCO Stock Post-Mortem $NC show art 118 - NACCO Stock Post-Mortem $NC

The DIY Investing Podcast

Mental Models discussed in this podcast: Durability Post-Mortem Resulting Capital Allocation Please review and rate the podcast If you enjoyed this podcast and found it helpful, please consider leaving me a rating and review. Your feedback helps me to improve the podcast and grow the show's audience.  Follow me on Twitter and YouTube Twitter Handle:  YouTube Channel:  Support the Podcast on Patreon This is a podcast supported by listeners like you. If you’d like to support this podcast and help me to continue creating great investing content, please consider becoming a...

info_outline
117 - What risks are you willing to underwrite? show art 117 - What risks are you willing to underwrite?

The DIY Investing Podcast

Mental Models discussed in this podcast: Operational Leverage Risk Management Please review and rate the podcast If you enjoyed this podcast and found it helpful, please consider leaving me a rating and review. Your feedback helps me to improve the podcast and grow the show's audience.  Follow me on Twitter and YouTube Twitter Handle:  YouTube Channel:  Support the Podcast on Patreon This is a podcast supported by listeners like you. If you’d like to support this podcast and help me to continue creating great investing content, please consider becoming a Patron at ....

info_outline
116 - Learning from mistakes you narrowly avoid $MCLDF show art 116 - Learning from mistakes you narrowly avoid $MCLDF

The DIY Investing Podcast

Mental Models discussed in this podcast: Confirmation Bias Skin in the Game Please review and rate the podcast If you enjoyed this podcast and found it helpful, please consider leaving me a rating and review. Your feedback helps me to improve the podcast and grow the show's audience.  Follow me on Twitter and YouTube Twitter Handle:  YouTube Channel:  Support the Podcast on Patreon This is a podcast supported by listeners like you. If you’d like to support this podcast and help me to continue creating great investing content, please consider becoming a Patron at . Show...

info_outline
115 - How to rebalance a concentrated portfolio show art 115 - How to rebalance a concentrated portfolio

The DIY Investing Podcast

Rebalancing a portfolio should be based on four key principles: Occam's Razor, rank every position in your portfolio, price matters, and default to inactivity. Too often rebalancing makes a portfolio worse by taking action.

info_outline
114 - Solitron Devices Stock Thesis (SODI) show art 114 - Solitron Devices Stock Thesis (SODI)

The DIY Investing Podcast

Solitron Devices is a high-quality niche manufacturing company in the defense industry. This Solitron Stock Thesis focuses on SODI stock which I believe will become a ten-bagger in ten years or less.

info_outline
113 - Never Buy or Sell Options! (Investing Rules) show art 113 - Never Buy or Sell Options! (Investing Rules)

The DIY Investing Podcast

You should never buy or sell options because options can cause you to be stupid and lose money.  You don't need to be smart to make money investing. You just need to be consistently not stupid. Investing rules improve your future performance and returns by limiting your mistakes. 

info_outline
112 - Never Short Stocks! (Investing Rules) show art 112 - Never Short Stocks! (Investing Rules)

The DIY Investing Podcast

Investing rules improve your future performance and returns by limiting your mistakes. You don't need to be smart to make money investing. You just need to be consistently not stupid. Shorting stocks is stupid.

info_outline
111 - Eliminate your investing mistakes show art 111 - Eliminate your investing mistakes

The DIY Investing Podcast

A focus on eliminating your investment mistakes is the easiest way to improve your investment returns. Don't repeat the same mistake twice by making sure you learn the right lessons. Signal vs Noise. Process vs Outcomes.

info_outline
110 - How I am incorporating Momentum into my Investing Process show art 110 - How I am incorporating Momentum into my Investing Process

The DIY Investing Podcast

Both momentum investing and value investing provide excess returns. This episode outlines how I plan to profit from both forms in my investing process. Specifically, price and business momentum will be added to value investing. The use of price momentum should limit my losses when mistakes are made. Meanwhile, by analyzing business momentum I am likely to reduce the probability of making mistakes.

info_outline
109 - How much time should you research a stock before buying? show art 109 - How much time should you research a stock before buying?

The DIY Investing Podcast

The process of researching stocks requires a significant amount of time investment. You should optimize the time you spend researching by focusing on three questions: Cheap? Good? Safe? You should be able to answer in ten hours or less.

info_outline
 
More Episodes

Books Referenced:

Fooled by Randomness by Nassim Taleb

*If you purchase through this affiliate link, I will receive a small commission, at no additional cost to you. Your purchase will be supporting the show's continued production of free content. 

Thank you for your support!

Mental Models discussed in this podcast:

  • A priori knowledge
  • Deductive vs Inductive Reasoning
  • Empirical Evidence
  • The Scientific Method
  • Curve Fitting and Extrapolation Problem
  • Boundary Conditions
  • Hindsight Bias
  • Ergodicity

Please review and rate the podcast

If you enjoyed this podcast and found it helpful, please consider leaving me a rating and review. Your feedback helps me to improve the podcast and grow the show's audience. 

Follow me on Twitter and YouTube

Twitter Handle: @TreyHenninger

YouTube Channel: DIY Investing

Support the Podcast on Patreon

This is a podcast supported by listeners like you. If you’d like to support this podcast and help me to continue creating great investing content, please consider becoming a Patron at DIYInvesting.org/Patron.

You can find out more information by listening to episode 11 of this podcast.

Show Outline

The full show notes for this episode are available at https://www.diyinvesting.org/Episode86

Why Backtests are harmful and counterproductive 

  • Empirical Evidence - backtesting is a form of empirical evidence. I.e. observation of the past
  • A priori knowledge - knowledge, justifications, or arguments that exist independently from experience. (Ex: Mathematics) (Wikipedia)
    • a form of knowledge that can be derived by reason alone.
  • Deductive reasoning - the process of reasoning from one or more statements to reach a logically certain conclusion. (Wikipedia)
  • Inductive reasoning:
    • “inductive reasoning as the derivation of general principles from specific observations (arguing from specific to general)” - Wikipedia (same link as below)
    • “While the conclusion of a deductive argument is certain, the truth of the conclusion of an inductive argument is probable, based upon the evidence given.” -Wikipedia
  • Scientific Method:
    • Form a hypothesis
    • Propose an experiment to test that hypothesis.
    • Results of the experiment either support or disprove the hypothesis. No experiment can prove a hypothesis.
  • The problem with the theory:
    • A theory only follows the scientific method if it can be disproven. If a theory is unable to be disproven, then it is not a true scientific theory but something else.
  • Curve Fitting and Extrapolation problem (using a curve or model beyond the range of observed data is subject to uncertainty)
  • Boundary conditions.
  • G Merani (Twitter) (Website) - Covers net-net study backtests in depth

Summary:

Investors use backtests in order to test whether a portfolio's asset allocation would have performed well in the past. The use of backtesting is harmful to a portfolio because it ignores uncertainty and overstates the value of empirical evidence.

It is much better to reason from first principles using deductive reasoning. This deductive reasoning is better than inductive reasoning for investors because it eliminates hindsight bias.