“All models are wrong, some are useful” ≠ Modeling is a futile exercise

Venkat Raman
2 min readJul 21, 2021
Source : Author

The phrase “All models are wrong, some are useful” is quite loosely used. Some take it in a very literal sense to imply that “Modeling is a futile exercise”.

This is a terrible misunderstanding and we shall see why shortly.

“All models are wrong, some are useful” is an aphorism (meaning it is a concise expression of general truth). But the aphorism in this case leads to misinterpretation.

Firstly, it is important to understand what modeling is.

The purpose of modeling is to provide an abstraction of real process. Basically, a good approximation of reality.

Anybody who mistakes the abstraction for the real, commits the Fallacy of Reification (yup, one more fallacy to add to the list of all fallacies which we data scientists/statisticians commit).

Anybody who mistakes the abstraction for the real, commits the Fallacy of Reification

Coming to why the phrase should not be taken literally, a good analogy would be that of an example of a Map.

In an exact sense, a map is also wrong because it does not provide 1:1 mapping of the real world.

So, George Box’s phrase should be construed the same way as a map is considered wrong because it does not represent the real world.

Does a map provide 1:1 mapping to the real world?
No.
But is it mighty useful?
Hell yeah.

Also, talking about utility of the models, John Tukey’s words conveys the essence clearly.

Far better an approximate answer to the right question, which is often vague, than an exact answer to the wrong question”.

So, to summarize
“All models are wrong, some are useful” ≠ “Modeling is a futile exercise”.

Reference (map analogy) : On Exactitude in science — Jorge Luis Borges

Your comments and opinions are welcome.

You can reach out to me on

Linkedin

Twitter

--

--

Venkat Raman

Co-Founder of Aryma Labs. Data scientist/Statistician with business acumen. Hoping to amass knowledge and share it throughout my life. Rafa Nadal Fan.