11.1 Pathological Science

How to catch bad science.

The Lesson in Context

[Introduction to the lesson.]

[[[Lesson Name]]][[Image:Topic Icon - [Lesson Name].png|32px|frameless|link=[Lesson Name]]]

• [Relation to current lesson.]

[[[Lesson Name]]][[Image:Topic Icon - [Lesson Name].png|32px|frameless|link=[Lesson Name]]]

• [Relation to current lesson.]

[[[Lesson Name]]][[Image:Topic Icon - [Lesson Name].png|32px|frameless|link=[Lesson Name]]]

• [Relation to current lesson.]

[[[Lesson Name]]][[Image:Topic Icon - [Lesson Name].png|32px|frameless|link=[Lesson Name]]]

• [Relation to current lesson.]

Takeaways

Learning GoalsDefinitionsExamplesCommon Misconceptions

After this lesson, students should

1. Be able to distinguish roughly among the following:
   1. Good science that gets the wrong answer.
   2. Fraudulent science.
   3. Pathological science.
   4. Poorly-done science.
   5. Pseudo-science.
2. Feel comfortable using Langmuir's Pathological Science Indicators to assess scientific articles.
3. Be able to identify what is wrong in cases of fraudulent, pathological, poorly-done, and pseudo-science.

Spectrum of Poor Research

There are many gradations to poor research and poor results. Several approximate categories are listed below.

• Good Science

This includes good well-done science that gets the wrong result. Even with a confidence interval of 95%, 5% of the time the results will be wrong. This is normal.

• Poorly-done Science

Science done honestly, but not done well.

• Pathological Science

This is what happens when a researcher falls a little too "in love" with their ideas. It is indicated by Langmuir's criteria.

• Pseudo-science

Pseudo-science is characterized by using scientific vocabulary without aligning with the corresponding concepts or engaging in real scientific practices (i.e., science being "skin deep," not scientific below the surface).

• Fraudulent Science

Research that involves intentional deception, such as deliberately fabricating data or deliberately deceiving the reader about the strength of evidence.

Langmuir's Pathological Science Indicators

A set of seven indicators that can be used to flag when something might be pathological science.

1. The effect is produced by a barely detectable cause, and the magnitude of the effect is substantially independent of the intensity of the cause.
2. The effect is barely detectable, or has very low statistical significance. Claims of great accuracy.
3. Claims of great accuracy.
4. Involving fantastic theories contrary to experience.
5. Criticisms are met with ad hoc excuses.
6. Ratio of supporters to critics rises to near 50%, then drops back to near zero.
7. Conclusion-motivated design & analysis.

There is no set number of Langmuir's criteria that determines whether something is pathological science or not. The criteria serve as a useful guide, but detecting pathological science is ultimately something of an art.

[Example Name]

[Example Description]

---

[Example Name]

[Example Description]

[Description of misconception.]

[Resolution.]

[Description of misconception.]

[Resolution.]

Useful Resources

Lecture VideoDiscussion SlidesHandouts and ActivitiesReadings and Assignments

[[address] Discussion Slides Template]

[[address] The discussion slides for this lesson.]

[[address] [Title]]

[[address] [Description.]]

[[address] [Title]]

[[address] [Description.]]

[[address] [Title]]

[[address] [Description.]]

[[address] [Title]]

[[address] [Description.]]

Recommended Outline

Before Class

[Any steps that need to be taken before class.]

During Class

[n] Minutes	[Activity.]
[n] Minutes	[Activity.]

Lesson Content

Activity 1

[Brief description of and motivation for the activity]

[Common misconception or thing to look out for.]

[Thing you really need to look out for!]

[Title]

[Useful tip, guideline, or other background.]

Instructions

[n] Minutes	[Activity.]
[n] Minutes	[Activity.]

Discussion Questions

[Question 1]

[Possible misconception that may need to be corrected and clarified.]

[Intended answer to the above question.]

---

[Question 2]

[Possible misconception that may need to be corrected and clarified.]

[Intended answer to the above question.]

---

[[[Previous Lesson]|⟨]]

[[[Previous Lesson]|Previous]]

[[[Previous Lesson]]]

[[[Next Lesson]|⟩]]

[[[Next Lesson]|Next]]

[[[Next Lesson]]]