8.1 Orders of Understanding: Difference between revisions

Revision as of 16:12, 4 August 2023

Because each event and/or phenomenon has many causal factors, it is often important to distinguish which factors affect it the most and which factors play a smaller role.

The Lesson in Context

This lesson introduces a practical framework for discussing cause and effect in this complex world. Specifically, the students should learn that there are usually multiple causes contributing to a certain effect, and it is possible to compare the magnitude of the effects from different causes. We wish to encourage students to develop the habit of considering multiple possible causes, rather than just claiming that "X is the cause of Y".

1.2 Shared Reality and Modeling

Simplification is necessary when modeling a phenomenon. A first step is to extract and describe the most important feature of the phenomenon (first-order effect) and then add refinements to the model to describe finer details (higher-order effects).

6.1 Correlation and Causation

Causation is defined as correlation under intervention, or in other words, a clear effect is observed when the intervention is done as contrasted to when the intervention is not done (the control condition). Orders of explanation can be argued by considering the magnitude of the effect when each causal factor is turned on or off.
RCTs are an idealized way to study the size of the effect due to a certain cause, enabling researchers to hold all else constant (in the ideal case). It is possible to compare the magnitude of the effects due to two different causes by conducting an RCT with more than two conditions.

6.2 Hill's Criteria

When RCTs are impractical or impossible to conduct, Hill's criteria may be used to argue about the existence and magnitude of the effect due to a certain cause.

8.2 Fermi Problems

The next lesson will introduce a practical method that can help us quickly estimate the magnitude of numerical quantities when there is little available information. We will use the Fermi estimation method to compare different sources of US government spending.

Takeaways

After this lesson, students should

[Something.]

Order of Magnitude

Factors of ten. A is one magnitude higher than B if it is approximately 10 times larger than B. (Orders of magnitude are typically used for very rough approximations of quantities, "to the nearest order of magnitude.")

This is an intuitive, rather than exact, concept. For example, we may say 2,340 is one order of magnitude higher than 488 but on the same order of magnitude as 977. Fermi estimates only have to be accurate up to a couple of orders of magnitude, so numbers can be replaced by other more convenient numbers on the same order of magnitude.

Order of Understanding/Description

Orders of understanding are a framework of modeling in which we separate all the details relevant to a system or phenomenon into different levels or "orders." Some details are more important than others, in that they have a greater impact on the model's predictions if included.

Orders of Causes

The orders (of importance) of causes are based on the magnitude of the effect if each cause were removed or altered. The one(s) that produce(s) the overwhelmingly largest effect are called first-order cause(s), and subsequently second-order, and so on. There may be multiple causes at each order.

Shape of the Earth

At zeroth order (even more basic than first order), we can model the earth as flat; this works for many purposes (e.g. navigating a city or country) but is incomplete. At first order, a sphere. At second order, an oblate spheroid (pear shape). At third order, one can include the terrain features such as mountains and valleys in the model. Further refinements can still be made. (See The Relativity of Wrong by Isaac Asimov.)

To put this more numerically, the curvature of a flat earth is 0 feet per mile, while that of a perfectly spherical earth would be 0.667 feet per mile, a refinement from 0. On the earth's oblate spheroidal surface, the curvature varies from 0.6644 feet per mile to 0.6689 feet per mile, which is a tiny refinement from a sphere.

Commute to Work

When describing the route from home to work, the zeroth order description may just be a straight line. The first order may include the actual roads and turns along the way, and the second order may include the lanes and traffic lights. At higher orders, one may include the traffic condition and pedestrians.

Maslow's Hierarchy of Needs

Since the hierarchy is constructed such that each previous level must be satisfied before the higher ones become relevant, you can consider the lowest level as first order and each level up as one order higher.

In every century people have thought they understood the universe at last, and in every century they were proved to be wrong. It follows that the one thing we can say about our modern "knowledge" is that it is wrong.

There are different levels of "wrong," and each correction to the previous wrong idea is typically a refinement (by including a higher order effect), rarely a total re-evaluation. Even if the new idea turns out to be wrong or incomplete also, it is still less wrong than the one before.

You know what the real cause of unemployment is? It's the stimulus cheques that the government is distributing discouraging people from finding a job.

While the distribution of stimulus cheques may have an effect on employment, the more important question is to ask whether it is a leading cause of unemployment, or if there is another lower-order (more important) cause. Such a way of reasoning makes it possible in a debate to concede that X is a cause of unemployment, without fully conceding that it is the cause or even a primary one.

Useful Resources

Discussion Slides Template

The discussion slides for this lesson.

Identifying Orders of Understanding Worksheet

Worksheet used for the activities in this lesson.

The Relativity of Wrong

Isaac Asimov on using orders of understanding in our descriptions of reality.

Recommended Outline

Before Class

Any steps that need to be taken before class.

During Class

[n] Minutes	[Activity.]
[n] Minutes	[Activity.]

Lesson Content

Activity 1

[Brief description of and motivation for the activity]

[Common misconception or thing to look out for.]

[Thing you really need to look out for!]

[Title]

[Useful tip, guideline, or other background.]

Instructions

[n] Minutes	[Activity.]
[n] Minutes	[Activity.]

Discussion Questions

[Question 1]

[Possible misconception that may need to be corrected and clarified.]

[Intended answer to the above question.]

[Question 2]

[Possible misconception that may need to be corrected and clarified.]

[Intended answer to the above question.]

[[[Previous Lesson]|⟨]]

[[[Previous Lesson]|Previous]]

[[[Previous Lesson]]]

[[[Next Lesson]|⟩]]

[[[Next Lesson]|Next]]

[[[Next Lesson]]]

@@ Line 5: / Line 5: @@
 {{Navbox}}
-== Useful Links ==
+== The Lesson in Context ==
-* [[:File:Orders of Understanding Worksheet.pdf|Worksheet]]
+<!-- Always begin section with a description of this lesson in relation to the course as a whole. -->
-* [https://docs.google.com/document/d/1IEtaXgOjb4Tu_lMtpELMfnwsIBoY1o3XQn0mrWQJBIs/edit?usp=sharing Three Column Overview of the Week]
+This lesson introduces a practical framework for discussing cause and effect in this complex world. Specifically, the students should learn that there are usually multiple causes contributing to a certain effect, and it is possible to compare the magnitude of the effects from different causes. We wish to encourage students to develop the habit of considering multiple possible causes, rather than just claiming that "''X'' is ''the'' cause of ''Y''".
-* [https://docs.google.com/presentation/d/1hSuj_vTMXYEF-HxeGE_pNr85jvkMnuuiE-siUzHG8QY/edit?usp=drivesdk Lesson Slides (2023 Master)]
-* [https://sensesensibilityscience.berkeley.edu/topic/14 Website Page]
-=== Readings and Assignments ===
+<!-- Expandable section relating this lesson to earlier lessons. -->
+{{Expand|Relation to Earlier Lessons|
+{{ContextLesson|1.2 Shared Reality and Modeling}}
+{{ContextRelation|Simplification is necessary when modeling a phenomenon. A first step is to extract and describe the most important feature of the phenomenon (first-order effect) and then add refinements to the model to describe finer details (higher-order effects).}}
+{{ContextLesson|6.1 Correlation and Causation}}
+{{ContextRelation|Causation is defined as correlation under intervention, or in other words, a clear effect is observed when the intervention is done as contrasted to when the intervention is not done (the control condition). Orders of explanation can be argued by considering the magnitude of the effect when each causal factor is turned on or off.}}
+{{ContextRelation|RCTs are an idealized way to study the size of the effect due to a certain cause, enabling researchers to hold all else constant (in the ideal case). It is possible to compare the magnitude of the effects due to two different causes by conducting an RCT with more than two conditions.}}
+{{ContextLesson|6.2 Hill's Criteria}}
+{{ContextRelation|When RCTs are impractical or impossible to conduct, Hill's criteria may be used to argue about the existence and magnitude of the effect due to a certain cause.}}
+}}
+<!-- Expandable section relating this lesson to later lessons. -->
+{{Expand|Relation to Later Lessons|
+{{ContextLesson|8.2 Fermi Problems}}
+{{ContextRelation|The next lesson will introduce a practical method that can help us quickly estimate the magnitude of numerical quantities when there is little available information. We will use the Fermi estimation method to compare different sources of US government spending.}}
+}}
-* [[:File:The Relativity of Wrong - Asimov.pdf|The Relativity of Wrong]]
+== Takeaways ==
-==== Lecture Video ====
+<tabber>
-<youtube>https://youtu.be/7Mm2J45inA0</youtube>
+|-|Learning Goals=
-== Learning Goals ==
 After this lesson, students should
-# Recognize that there are usually multiple causes that contribute to an effect to varying degrees, ranked first-, second-, third-order, and so on.
+<!-- Learning goals are written as a numbered list. -->
-# Recognize that there are often multiple causes of the same order of importance.
+# [Something.]
-# Understand that a model is inevitably a simplification of the real world. As one includes finer and finer details, one is taking into account higher and higher order causes.
-## The order of a cause is determined by the magnitude of its effect, relative to other causes.
-## When creating a model, there are some factors (causes) for which we don't consider the order, because we assume them to be constant (e.g. they are the underlying environment or circumstance). Whether or not we assume something to be constant may be partly a question of values. (E.g. when considering a model of traffic accidents, we typically don't include oxygen content in the air, even though if the oxygen suddenly went out, everyone would crash.)
-=== Definitions ===
+|-|Definitions=
-* '''Order of Magnitude'''
+<!-- Definitions must be written with the Definition and Subdefinition templates. The first Definition should have the "first=yes" flag at the end. -->
-*: Factors of ten. ''A'' is one magnitude higher than ''B'' if it is approximately 10 times larger than ''B''. (Orders of magnitude are typically used for very rough approximations of quantities, "to the nearest order of magnitude.") {{Caution|This is an intuitive, rather than exact, concept. For example, we may say 2,340 is one order of magnitude higher than 488 but on the same order of magnitude as 977. Fermi estimates only have to be accurate up to a couple of orders of magnitude, so numbers can be replaced by other more convenient numbers on the same order of magnitude.}}
+{{Definition|Order of Magnitude|Factors of ten. ''A'' is one magnitude higher than ''B'' if it is approximately 10 times larger than ''B''. (Orders of magnitude are typically used for very rough approximations of quantities, "to the nearest order of magnitude.")|first=yes}}
-* '''Order of Understanding/Description'''
+{{BoxCaution|This is an intuitive, rather than exact, concept. For example, we may say 2,340 is one order of magnitude higher than 488 but on the same order of magnitude as 977. [[8.2 Fermi Problems|Fermi estimates]] only have to be accurate up to a couple of orders of magnitude, so numbers can be replaced by other more convenient numbers on the same order of magnitude.}}
-*: (Shorter) When modeling/describing a system/phenomenon, the act of including higher orders is the act of including finer details in the model.
+{{Definition|Order of Understanding/Description|Orders of understanding are a framework of modeling in which we separate all the details relevant to a system or phenomenon into different levels or "orders." Some details are more important than others, in that they have a greater impact on the model's predictions if included. }}
-*: (Longer) Orders of understanding are a framework of modeling in which we separate all the details relevant to a system or phenomenon into different levels or "orders." Some details are more important than others, in that they have a greater impact on the model's predictions if included.
+{{Definition|Orders of Causes|The orders (of importance) of causes are based on the magnitude of the effect if each cause were removed or altered. The one(s) that produce(s) the overwhelmingly largest effect are called first-order cause(s), and subsequently second-order, and so on. There may be multiple causes at each order.}}
-* '''Orders of Causes'''
+<br />
-*: The orders (of importance) of causes are based on the magnitude of the effect if each cause were removed or altered. The one(s) that produce(s) the overwhelmingly largest effect are called first-order cause(s), and subsequently second-order, and so on. There may be multiple causes at each order.
-=== Examples ===
+|-|Examples=
-* '''Shape of the Earth''': At zeroth order (even more basic than first order), we can model the earth as flat; this works for many purposes (e.g. navigating a city or country) but is incomplete. At first order, a sphere. At second order, an oblate spheroid (pear shape). At third order, one can include the terrain features such as mountains and valleys in the model. Further refinements can still be made. (See ''The Relativity of Wrong'' by Isaac Asimov.)
+<!-- Example formatting is still experimental. -->
-*: To put this more numerically, the curvature of a flat earth is 0 feet per mile, while that of a perfectly spherical earth would be 0.667 feet per mile, a refinement from 0. On the earth's oblate spheroidal surface, the curvature varies from 0.6644 feet per mile to 0.6689 feet per mile, which is a tiny refinement from a sphere.
+'''Shape of the Earth'''
-* '''Commute to work''': When describing the route from home to work, the zeroth order description may just be a straight line. The first order may include the actual roads and turns along the way, and the second order may include the lanes and traffic lights. At higher orders, one may include the traffic condition and pedestrians.
+: At zeroth order (even more basic than first order), we can model the earth as flat; this works for many purposes (e.g. navigating a city or country) but is incomplete. At first order, a sphere. At second order, an oblate spheroid (pear shape). At third order, one can include the terrain features such as mountains and valleys in the model. Further refinements can still be made. (See ''The Relativity of Wrong'' by Isaac Asimov.)
-* '''Maslow's Hierarchy of Needs''': Since the hierarchy is constructed such that each previous level must be satisfied before the higher ones become relevant, you can consider the lowest level as first order and each level up as one order higher.
+: To put this more numerically, the curvature of a flat earth is 0 feet per mile, while that of a perfectly spherical earth would be 0.667 feet per mile, a refinement from 0. On the earth's oblate spheroidal surface, the curvature varies from 0.6644 feet per mile to 0.6689 feet per mile, which is a tiny refinement from a sphere.
+{{Line}}
+'''Commute to Work'''
+: When describing the route from home to work, the zeroth order description may just be a straight line. The first order may include the actual roads and turns along the way, and the second order may include the lanes and traffic lights. At higher orders, one may include the traffic condition and pedestrians.
+{{Line}}
+'''Maslow's Hierarchy of Needs'''
+: Since the hierarchy is constructed such that each previous level must be satisfied before the higher ones become relevant, you can consider the lowest level as first order and each level up as one order higher.
-=== Common Misconceptions ===
+|-|Common Misconceptions=
-* ''In every century people have thought they understood the universe at last, and in every century they were proved to be wrong. It follows that the one thing we can say about our modern "knowledge" is that it is wrong.''
+<!-- Misconceptions must be written with the Misconception template. The first Misconception should have the "first=yes" flag at the end. -->
-*: There are different levels of "wrong," and each correction to the previous wrong idea is typically a refinement (by including a higher order effect), rarely a total re-evaluation. Even if the new idea turns out to be wrong or incomplete also, it is still less wrong than the one before.
+{{Misconception|In every century people have thought they understood the universe at last, and in every century they were proved to be wrong. It follows that the one thing we can say about our modern "knowledge" is that it is wrong.|There are different levels of "wrong," and each correction to the previous wrong idea is typically a refinement (by including a higher order effect), rarely a total re-evaluation. Even if the new idea turns out to be wrong or incomplete also, it is still less wrong than the one before.}}
-* ''You know what the real cause of unemployment is? It's the stimulus cheques that the government is distributing discouraging people from finding a job.''
+{{Misconception|You know what the real cause of unemployment is? It's the stimulus cheques that the government is distributing discouraging people from finding a job.|While the distribution of stimulus cheques may have an effect on employment, the more important question is to ask whether it is a leading cause of unemployment, or if there is another lower-order (more important) cause. Such a way of reasoning makes it possible in a debate to concede that X is ''a'' cause of unemployment, without fully conceding that it is ''the'' cause or even a primary one.|first=yes}}
-*: While the distribution of stimulus cheques may have an effect on employment, the more important question is to ask whether it is a leading cause of unemployment, or if there is another lower-order (more important) cause. Such a way of reasoning makes it possible in a debate to concede that X is ''a'' cause of unemployment, without fully conceding that it is ''the'' cause or even a primary one.
-== Context ==
+</tabber>
-This lesson introduces a practical framework for discussing cause and effect in this complex world. Specifically, the students should learn that there are usually multiple causes contributing to a certain effect, and it is possible to compare the magnitude of the effects from different causes. We wish to encourage students to develop the habit of considering multiple possible causes, rather than just claiming that "X is ''the'' cause of Y".
+== Useful Resources ==
-=== Before ===
+<tabber>
-: '''[[1.2 Shared Reality and Modeling]]'''
+|-|Lecture Video=
-:: Simplification is necessary when modeling a phenomenon. A first step is to extract and describe the most important feature of the phenomenon (first-order effect) and then add refinements to the model to describe finer details (higher-order effects).
-: '''[[6.1 Correlation and Causation]]'''
-:* Causation is defined as correlation under intervention, or in other words, a clear effect is observed when the intervention is done as contrasted to when the intervention is not done (the control condition). Orders of explanation can be argued by considering the magnitude of the effect when each causal factor is turned on or off.
-:* RCTs are an idealized way to study the size of the effect due to a certain cause, enabling researchers to hold all else constant (in the ideal case). It is possible to compare the magnitude of the effects due to two different causes by conducting an RCT with more than two conditions.
-: '''[[6.2 Hill's Criteria]]'''
-:: When RCTs are impractical or impossible to conduct, Hill's criteria may be used to argue about the existence and magnitude of the effect due to a certain cause.
-=== After ===
+<br /><center><youtube>7Mm2J45inA0</youtube></center><br />
-: '''[[8.2 Fermi Problems]]'''
+|-|Discussion Slides=
-:: The next lesson will introduce a practical method that can help us quickly estimate the magnitude of numerical quantities when there is little available information. We will use the Fermi estimation method to compare different sources of US government spending.
-== Recommended Outline ==
+{{LinkCard
+|url=https://docs.google.com/presentation/d/1hSuj_vTMXYEF-HxeGE_pNr85jvkMnuuiE-siUzHG8QY/
+|title=Discussion Slides Template
+|description=The discussion slides for this lesson.
+}}
+<br />
-=== Before Class ===
+|-|Handouts and Activities=
-* Review PlayPosit and discussion questions and ask faculty, Gabriel, or Emlen any questions you have.
+{{LinkCardInternal
-* Familiarize yourself with the [[:File:Orders of Understanding Worksheet.pdf|worksheet]] and print it.
+|url=:File:Orders of Understanding Worksheet.pdf
+|title=Identifying Orders of Understanding Worksheet
+|description=Worksheet used for the activities in this lesson.}}
+<br />
-=== During Class ===
+|-|Readings and Assignments=
-* (5 min) Come up with some fun way to assign the roles of spokesperson and notetaker (e.g. earliest birthday in the year, lives furthest from campus). Remind them of the responsibilities of these roles.
+{{LinkCardInternal
-* (6 min) [[#Concept Review|Concept review]].
+|url=:File:The Relativity of Wrong - Asimov.pdf
-* (25 min) [[#Traffic Accidents|Traffic accident activity]] (skip parts 3 & 4 if running low on time).
+|title=The Relativity of Wrong
-* (15 min) [[#Happiness|Happiness activity]].
+|description=Isaac Asimov on using orders of understanding in our descriptions of reality.}}
-* (24 min) [[#Government Spending|Government spending activity]]. (This is the most important activity. Make sure you leave sufficient time for it.)
+<br />
-== Lesson Content ==
+</tabber>
-=== Concept Review ===
+== Recommended Outline ==
-==== Discussion Question ====
+=== Before Class ===
-# (3 min) Refer to the image on the right. We're modelling natural scenery with computer graphics. [[File:Minecraft Graphics Comparison.png|thumb|right|Normal Minecraft and Minecraft with shaders.]]
+Any steps that need to be taken before class.
-## What first order details of the scene did the graphic designers include on the left?
-## What second order details were included on the right?
-## What further higher order refinements could we make?
-==== Introductory ExSAMple ====
+=== During Class ===
-Open with the following class poll and give students a minute to discuss before answering. [[File:The Great Pyramid of Sam.png|thumb|right|The higher the block on the pyramid, the higher order the cause.]]
+{| class="wikitable" style="margin-left: 0px; margin-right: auto;"
-# Claim: "Sam makes a lot of money because she works hard." Do you think Sam's hard work is:
+|[n] Minutes
-## A first order cause of her high income.
+|[Activity.]
-## A second order cause of her high income.
+|-
-## A third or higher order cause of her high income.
+|[n] Minutes
-## Not a cause of her high income.
+|[Activity.]
-After the poll results are revealed, tell the students that you forgot to find out whether Sam was born in a Bangladeshi slum or to a family of lawyers in the Upper East Side of Manhattan. What if Sam attended college? Open the poll again and give students another minute to discuss before answering.
+|}
-{{Answer|The extent to which "hard work" plays a role in how much money Sam makes is a second (or higher) order cause in all of these cases. The first order cause would be what her circumstances are. If she was born in the Upper East Side then there's a much higher floor and ceiling to what Sam could conceivably earn than if she were born in Bangladesh.}}
-{{Caution|Orders of understanding are a part of the modeling process, which in turn requires first defining the scope of the problem. This question is tricky because it does not specify the scope, i.e. the success of a random world citizen or a New Yorker/Bangladeshi. This is why, once the scope is clarified, the orders of understanding in modeling the causes of success change.}}
-=== Traffic Accidents ===
+== Lesson Content ==
-This activity lets students practice assigning orders to various causes. In particular, it frames the orders of causes in terms of intervention (c.f. [[6.1 Correlation and Causation]]). It also highlights the importance of first considering the set of relevant or realistic interventions, before studying the magnitude of the effect of each intervention.
+=== Activity 1 ===
-==== Instructions ====
+[Brief description of and motivation for the activity]
+{{BoxCaution|[Common misconception or thing to look out for.]}}
-# (20 min) Have students follow instructions on the [[:File:Orders of Understanding Worksheet.pdf|worksheet]] and answer any questions they may have.
+{{BoxWarning|[Thing you really need to look out for!]}}
-#: {{Caution|'''If they only finish Parts I & II, that's fine; be sure to save time for [[#Happiness|Happiness]] and [[#Government Spending|Government Spending]].'''}}
+{{BoxTip|title=[Title]|[Useful tip, guideline, or other background.]}}
-# (5 min) Whole class discussion sharing their results.
-#: {{Caution|The orders are somewhat based on one's intuition, and there are no correct or recommended answers for this activity. The purpose is to let students reflect on and discuss the relative impact of various causes of traffic accidents, as well as the relevance of interventions as a way of studying the effect size.}}
-==== Discussion Questions ====
-As a whole class, discuss the following questions.
-# Were there any factors whose effect size was particularly hard to determine?
-# Did anyone come up with specific methods or criteria for determining the orders of explanation?
-# Were there any factors that your group could not agree upon?
-=== Happiness ===
-This activity gives students another opportunity to reflect on possible ''interventions'' on their life and the order of importance to their happiness of each intervention.
 ==== Instructions ====
-# (10 min) Have students follow instructions on the worksheet and answer any questions they may have.
+{| class="wikitable" style="margin-left: 0px; margin-right: auto;"
-# (5 min) Whole class discussion sharing their results.
+|[n] Minutes
+|[Activity.]
+|-
+|[n] Minutes
+|[Activity.]
+|}
 ==== Discussion Questions ====
-As a whole class, discuss the following questions.
+[Question 1]
-# What did you learn about your happiness from this exercise?
+{{BoxCaution|[Possible misconception that may need to be corrected and clarified.]|small=right}}
-# Is there anything that you might want to do differently in your life?
+{{BoxAnswer|[Intended answer to the above question.]}}
+{{Line}}
-=== Government Spending ===
+[Question 2]
+{{BoxCaution|[Possible misconception that may need to be corrected and clarified.]|small=right}}
-{{Caution|small=right|Prioritize this activity, as it will be continued in the [[8.2 Fermi Problems|next lesson]].}}
+{{BoxAnswer|[Intended answer to the above question.]}}
-# (20 min) Have students follow instructions on the worksheet and answer any questions they may have.
-# (4 min) Whole class discussion sharing their results.
-#: {{Caution|Tell students to keep this worksheet for the next lesson, so they can compare their rankings of government spending before and after they use Fermi estimation.}}
-{{NavCard|prev=7.2 Emergent Phenomena|next=8.2 Fermi Problems}}
+{{NavCard|prev=[Previous Lesson]|next=[Next Lesson]}}
-[[Category:Lesson plans]]
+<includeonly>[[Category:Lesson plans]]</includeonly>