class: center middle main-title section-title-3 # In-person<br>session 11 .class-info[ **March 28, 2024** .light[PMAP 8521: Program evaluation<br> Andrew Young School of Policy Studies ] ] --- name: outline class: title title-inv-8 # Plan for today -- .box-5.medium.sp-after[General questions] -- .box-2.medium.sp-after[IV questions] -- .box-6.medium[IV fun times] -- .box-3.medium[Synthetic data fun times] --- layout: false name: general-things class: center middle section-title section-title-5 animated fadeIn # General questions --- class: middle .box-5.medium[The final project instructions mention that<br>we need to preregister our questions.] .box-5.medium[Do we really need to do that?] --- class: middle .box-5.medium[Tell us more about exam 2] --- class: middle .box-5.medium[Minor schedule change!] --- layout: false name: iv class: center middle section-title section-title-2 animated fadeIn # IV questions --- layout: true class: middle --- .box-2.large[Can you review<br>endogeneity and exogeneity?] .center.small[[Slide from lecture](https://evalsp24.classes.andrewheiss.com/slides/11-slides.html#29)] --- .box-2.large[Can you review the<br>three IV conditions?] .center.small[[Slide from lecture](https://evalsp24.classes.andrewheiss.com/slides/11-slides.html#43)] --- .box-2[Are there certain disciplines that tend to use instrumental variables more than others, like how we learned that DAGs are big in public health and diff-in-diff and RDD are all the craze in econ?] --- .box-2.medium[Why are you making us do 2SLS<br>manually when `iv_robust()` exists?] --- .box-2[Given the strict criteria for instrumental variables,<br>they seem pretty impractical and uncommon<br>(especially compared to diff-in-diff and RDD).<br><br>Why do you include instrumental variables<br>as a part of this course?] .box-2[What's really the point of doing IV if finding instruments<br>is so difficult and easy to mess up?] .box-2.large[Why even bother?] --- .box-2.medium[Is there like a “bank” of good IVs?] .box-2.medium[Do you have a method that helps you think of instruments, or a popular process that people usually use to come up with ideas?] --- .box-2.medium[What does it mean to tell a good story about excludability and exogeneity?] ??? - https://braddelong.substack.com/p/podcast-hexapodia-is-e-key-insight-331 - Matthew Suandi, "Promoting to Opportunity: Evidence and Implications from the U.S. Submarine Service" - https://are.berkeley.edu/sites/are.berkeley.edu/files/job-candidates/paper/MatthewSuandi_JMP_Nov_21_Berkeley.pdf --- .center[ <figure> <img src="img/11-class/torpedo.png" alt="WWII torpedo" title="WWII torpedo" width="70%"> </figure> ] ??? Via <https://braddelong.substack.com/p/podcast-hexapodia-is-e-key-insight-331>: - In the early stages of the Pacific War, whether a US submarine-launched torpedo exploded was a matter of luck. - If a submarine captain had an enlisted man marked out for promotion, those promotions happened much more often if the submarine returned from its cruise having succeeded in sinking ships. - Those promoted because they happened to be on lucky submarines with torpedoes that exploded lived 2.4 years longer than their counterparts who happened to be on unlucky submarines and were not promoted. - Those promoted because they happened to be on lucky submarines with torpedoes that exploded are recorded as having a last known address in a zip code with housing prices higher by 7 percentiles than their counterparts who happened to be on unlucky submarines and were not promoted. - Early promotion to a job with more responsibility and scope—at least in the WWII-era USN—shapes your life to a remarkable degree by giving you scope to develop and exercise your talents. - If the WWII-era USN is typical, we waste huge amounts of human potential by not giving people workplace opportunities to show what they can learn to do. - Equality isn’t just about money: it is about scope for action, about developing and exercising talents, and about receiving external validation. - A good society would give people much more opportunity to discover how big a deal they are and can become, and remind them of this at every opportunity. --- .box-2[Why would we use instrumental variables when we can simply use DAGs to control for things instead?] .box-2[What is the advantage of using an IV versus trying to find a variable that is correlated with the excluded variable of interest? For example, trying to find a variable highly correlated with "ability"? This seems also difficult but less difficult than finding a true IV.] .box-2[Could we assume that things like “ability” are latent variables and then try to model them directly?] --- <img src="11-class_files/figure-html/iv-dag-example-1.png" width="100%" style="display: block; margin: auto;" /> --- .box-2.less-medium[In the lecture you mentioned that the instrumental variable should be weird (or make people say huh?). However, in *The Effect*, the author states that the instrument should be relevant. This is a bit mixed messaging. Which approach should we use?] .center[[Formal definitions of relevancy, excludability, and exogeneity](/slides/11-slides.html#43)] --- .box-2.less-medium[Why are things like weather, distance, or terrain bad instruments? How do they violate the exclusion restriction?] .center[[Lecture slides](/slides/11-slides.html#75)] ??? - Rainfall → income shocks → civil war - That only works if rainfall only causes civil war because of income shocks - Rainfall → economic activity → probability of civil war - Rainfall → voter turnout → party vote share - Rainfall → your mood → your friend's mood - Rainfall → your mood → sales - Rainfall → church attendance → drug arrests --- .box-2.medium[Fuzzy RDD requires an instrument,<br>but instruments seem impossible to find,<br>so can we ever really do fuzzy RDD?] --- layout: false name: iv class: center middle section-title section-title-6 animated fadeIn # IV fun times --- --- layout: false name: faqs class: center middle section-title section-title-1 animated fadeIn # Exam 2 --- layout: false name: synthetic-data class: center middle section-title section-title-3 animated fadeIn # Synthetic data<br>fun times! --- class: title title-3 # Basic process -- .box-inv-3.medium[1: Draw a DAG] -- .box-inv-3.medium[2: Create standalone exogenous columns] -- .box-inv-3.medium[3: Connect endogenous columns] -- .box-inv-3.medium[4: Polish columns] -- .box-3.large.sp-before-half[Iterate. Iterate so so much.]