Skip to main content

Why Test a Theory?

 More precisely, what are the potential consequences of applying old  theories to new situations without testing them first? The easiest answer is that most of the time, we don’t know it’s a new situation and/or an old theory until it fails. Putting that aside, the consequences are many. Keep in mind, though, sometimes testing is impossible as in some economic or cosmological theories. Testing Einstein’s general theory of relativity had to await instrumentality development that could do so.  Here are some other consequences of failure to test or inappropriate use.



1.      It is a sometimes expensive way to find the old theory needs repair. (Aeronautics, encryption, numerical analysis)

2.      Overgeneralization. (Maslow's Hierarchy of Needs)

3.      It can sometimes cause lives or great damage. (Bridge design, large machinery)

4.      It can make inaccurate predictions and consequent decisions. (Ineffective vaccines, medical procedures, legal or military strategies, climate, AI)

5.      It can lead to a lack of or missing knowledge for decades or more. (Astronomy, Newtonian mechanics)

6.      Selectively interpreting evidence to support a particular viewpoint. (Evolution)

7.      Ignoring counter-evidence. (Economics, Modern Monetary Theory)

8.      Misapplication of context. (Freud psychoanalytic theory)

You could think of it as knowledge growing up and learning by mistakes. You could think of it as parenting and the mistakes made because it didn’t work like the handbook said. You could think of it as normal research and the discovery of new knowledge. Testing or using ideas and theories beyond their scope, for good or bad, is our way of life, and the pathway to new knowledge.

Concomitant with non testing a theory prior to use is using a theory incorrectly. This implies those responsible must fully understand the theory and its limitations. One common such error is that of violating the assumptions underlying the theory.

Comments

Popular posts from this blog

Behavioral Science and Problem-Solving

I.                                       I.                 Introduction.                Concerning our general behavior, it’s high about time we all had some understanding of how we operate on ourselves, and it is just as important how we are operated on by others. This is the wheelhouse of behavioral sciences. It is a vast subject. It touches our lives constantly. It’s influence is pervasive and can be so subtle we never notice it. Behavioral sciences profoundly affect our ability and success at problem-solving, from the elementary level to highly complex wicked problems. This is discussed in Section IV. We begin with the basics of behavioral sciences, Section II, and then through the lens of multiple categories and examples, Section III. II.     ...

Where is AI (Artificial Intelligence) Going?

  How to view Artificial Intelligence (AI).  Imagine you go to the store to buy a TV, but all they have are 1950s models, black and white, circular screens, picture rolls, and picture imperfect, no remote. You’d say no thanks. Back in the day, they sold wildly. The TV was a must-have for everyone with $250 to spend* (about $3000 today). Compared to where AI is today, this is more or less where TVs were 70 years ago. In only a few decades AI will be advanced beyond comprehension, just like TVs today are from the 50s viewpoint. Just like we could not imagine where the video concept was going back then, we cannot really imagine where AI is going. Buckle up. But it will be spectacular.    *Back then minimum wage was $0.75/hr. Thus, a TV cost more than eight weeks' wages. ------------------------- 

Fake News

If you've been following the news the last couple of days, you will note the flurry of copy devoted to fake news.  Both sides are blaming whatever has befallen them the consequence of fake news.  Let's look at this phenomenon a bit.    When I was a student years ago, a friend climbed some mountain in Peru.   A article was written in the local newspaper about the event.   In only three column inches, the newspaper made about six errors.   An easy article to write you say?   Just interview and reproduce.   Yet so many errors?   The question is this: was this fake news or bad reporting?   The idea here is that fake news comes in various flavors. Bad reporting – errors made by the author or editor Opinion presented as news     Deliberate creation of falsehoods to favor a point of view       The reporting of selected truths to favor a particular point of view Now we have the big social media ...