11.1 Pathological Science

Learning Goals

[Link to PlayPosit]

[Link to instructional video]

More details: [link to topic on SSS website]

After this lesson, students should

1. Be able to identify the following:
   1. Good science that gets the wrong answer.
   2. Fraudulent science.
   3. Pathological science.
   4. Poorly-done science.
   5. Pseudo-science.
2. Feel comfortable using Langmuir's Pathological Science Indicators to assess scientific articles.
3. Be able to identify what is wrong in cases of fraudulent, pathological, poorly-done, and pseudo-science.

Definitions

• Spectrum of poor research:
  • Good science that gets the wrong answer

    Even with a confidence level of 95%, 5% of the time the results will be wrong. This is normal.

  • Poorly-done Science

    Science done honestly, but not done well.

  • Pathological Science

    Indicated by Langmuir's criteria.

  • Pseudo-science

    Pseudo-science is characterized by using scientific vocabulary without aligning with the corresponding concepts or engaging in real scientific practices (i.e., science being “skin deep,” not scientific below the surface).

  • Fraudulent Science

    Research that involves intentional deception, such as deliberately fabricating data or deliberately deceiving the reader about the strength of evidence.

• Langmuir's Pathological Science Indicators
  • The effect is produced by a barely detectable cause, and the magnitude of the effect is substantially independent of the intensity of the cause.
  • The effect is barely detectable, or has very low statistical significance. Claims of great accuracy.
  • Claims of great accuracy.
  • Involving fantastic theories contrary to experience.
  • Criticisms are met with ad hoc excuses.
  • Ratio of supporters to critics rises to near 50%, then drops back to near zero.
  • Conclusion-motivated design & analysis.

Examples

• [item 1]

Common Misconceptions

• Mistaken quote

  Explanation.

Context

[Explanation of how the current topic into the larger context of the course by explaining how the previous topic(s) relate to the current topic and leaving cliffhangers for future topics where relevant throughout the lesson]

Before

X.X Lesson Name

Explanation.

• Itemized explanation.

After

X.X Lesson Name

Explanation.

• Itemized explanation.

Recommended Outline

Before Class

• Each student will have read one of the three articles that we discuss in this section.
• Prepare a seating chart.
• Review PlayPosit and discussion questions and ask faculty, Gabriel, or Emlen any questions you have.
• (Optional) Prepare a presentation.

During Class

• (5 min) Come up with some fun way to assign the roles of spokesperson and notetaker (e.g. earliest birthday in the year, lives furthest from campus). Remind them of the responsibilities of these roles.
• ([#] min) [Description of some module from #Lesson Content]
• (5 min) Collect questions for plenary.

After Class

• [Any essential logistical things that need to be done as followup for this class]
• Collect answers from notetakers for the forum / plenary.

Lesson Content

Clicker Question

Question

1. First option
2. Second option
3. Third option
4. Fourth option

Activity 1: Name

[Brief description of and motivation for the activity]

Discussion Questions

1. Question 1
   1. Subquestion a

   2. Subquestion b

Collect Questions for Plenary

(5 min) Collect remaining questions from the students for faculty in plenary (can be questions for clarification, extension, discussion, etc.), and add [ here].