The Bitter Lesson — Reflections on Sutton’s Talk

In this blog, richard encode what he thinks about two different paradigms - Human Heuristic or Large scale learning and searching

He also notes the Large and Small difference is not just computing, but heuristic info vs meta-learning info

in the podcast talking about “The Bitter Lesson”. Sutton talked about how human learn. Things like Supervised Learning isn’t what happens in the human brain, “prediction learning” is.

Overall, his point would be - let our methods search, not ourselves