Your out-of-sample test is single-use. Peek at it, tweak once, and it’s just more in-sample data – with a better story attached.
Why it might be wrong
One-shot holdouts waste scarce data, and markets keep producing new data anyway. Walk-forward testing and correcting for the number of trials let you reuse data honestly – rigor beats purity.
Your take?
