Causal Effects
Home Publications Tools Data Links Imprint / Contact
Visitors since 2014-04-02:
whole website: 6438
current page: 974
EAM

Courses: Course information

en  Methods of Evaluation Research

Speakers: Prof. Dr. Rolf Steyer

Winter term 2015/2016, Course, Language: English, Topic: Methods of evaluation research

Topic: Analysis of conditional and average total causal treatment effects

  1. Why we need a theory of causal effects
  2. Concepts of probability theory
  3. Basic ideas of the theory of causal effects
  4. The core of the theory of causal effects
  5. Causality conditions (sufficient conditions for unbiasedness), randomization, and covariate selection
  6. First example: nonorthogonal analysis of variance
  7. Intercept function, effect functions, and average effects in the example of nonorthogonal analysis of variance
  8. Estimating intercept function, effect functions, and average effects via SPSS and its limitations
  9. Analyzing the data of nonorthogonal analysis of variance with SPSS ANOVA (Typ I, II, III sums of squares) and why these analyses yields wrong results
  10. The hypothesis of no treatment effects via SPSS using the R2-difference test
  11. Analysis of the data of nonorthogonal analysis of variance with EffectLiteR
  12. Second example: The Kirchmann study on the treatment effects on depression and its analysis with EffectLiteR
  13. Third example: The Klauer study on the training of inductive reasoning
  14. EffectLiteR analysis of the Klauer data with a continuous covariate
  15. Main hypotheses in EffectLiteR and the various conditional and average treatment effects
  16. EffectLiteR analysis of the Klauer data with a continuous covariate and a qualitative covariate


In order to view the videos, you need the VLC Player VLC media player which you can download here. The videos are hosted at the Digitale Bibliothek Thüringen Digitale Bibliothek Thüringen (dbt).Click the green link to watch the video or download the file.

 

Literature

Causal effects

  • Campbell, D. T. & Stanley, J. C. (1963). Experimental and Quasi-Experimental Designs for Research on Teaching. In N. L. Gage (Ed.), Handbook of research on teaching. Chicago: Rand McNally.
  • West, S. G., Biesanz, J. C. & Pitts, S. C. (2000), Causal inference and generalization in field settings. Experimental and quasi-experimental designs. In H. T. Reis and C. M. Judd (eds.), Handbook of research methods in social and personality psychology. Cambridge University Press.
  • Steyer, R. (2003). Wahrscheinlichkeit und Regression. Berlin: Springer. (Kapitel 15 - 17)
  • Steyer, R. (2004). Was wollen und was können wir durch empirische Kausalforschung erfahren? In E. Erdfelder & J. Funke (Hrsg.), Allgemeine Psychologie und deduktivistische Methodologie (pp.127-147). Göttingen: Vandenhoek und Ruprecht.
  • Steyer, R. (2005). Analyzing Individual and Average Causal Effects via Structural Equa­tion Models. Methodology-European Journal of Research Methods in the Behavio­ral and Social Sciences, 1, 39-54.
  • Steyer, R. & Partchev, I. (2006). Manual for EffectLite: A Program for the Uni- and Multivariate Analysis of Unconditional, Conditional and Average Mean Differences Between Groups.
  • Pohl, S., Steyer, R. & Kraus, K. (2008). Modelling method effects as individual causal effects. Journal of the Royal Statistical Society. Series A, 171, 41--63.
  • Steyer, R., Partchev, I., Kröhne, U., Nagengast, B., & Fiege, C. (in preparation). Probability and Causality.
  • Steyer. R. and Nagel, W. (2017). Probability and conditional expectation: Fundamentals for the empirical sciences. Chichester: Wiley.



Date Topic Video Material
2015-10-19 Why we need a theory of causal effects

  • Example Joe and Ann with self-selection
  • Random experiment
  • Set of possible outcomes of a random experiment
  • Event
  • Probability of an event
  • Conditional probability of an event
  • Random variable
  • Expectation of a discrete random variable
  • Conditional expectation of a discrete random variable
Video Slides
(updated 2015-10-26)

Blackboard sketches
2015-10-26 Basic Ideas of the theory of total causal effects

  • Kirchmann example
  • Individual total causal Effect
  • Average total causal Effect
Video Probability and Conditional Expectation
Materials
(updated 2015-10-27)

Blackboard sketches
2015-11-02 The core of the theory of total causal effects
  1. Covariate
  2. The random experiment (the empirical phenomenon) considered
  3. Examples in which one of the causality conditions for E(Y|X,Z) is satisfied
  4. Unbiasedness of E(Y|X,Z) and EX=x(Y|Z)
  5. Implications unbiasedness for the identification of conditional and average causal total effects.
Video Slides
(updated 2015-11-10)

2015-11-09
  1. Four causality conditions for E(Y|X,Z)
  2. The experimental design technique of conditional randomization
  3. Covariate selection based on the causality conditions
  4. The example of nonorthogonal analysis of variance: Conditional and average total treatment effects
Video Dataset

Blackboard sketch 01
Blackboard sketch 02
2015-11-16
  1. Intercept function and conditional-effect functions in the nonorthogonal ANOVA Example
  2. Parameterization of the intercept function and conditional-effect functions in this example
  3. Analysis of conditional effects in the nonorthogonal ANOVA Example with the Linear Regression program of SPSS
  4. Point estimation of the conditional effects based on this data analysis
  5. Limitations of the analysis conditional treatment effects via Linear Regression: No standard errors of conditional effects, no average treatment effects
Video SPSS-Output

Blackboard sketches
2015-11-23
  1. The distinction between fixed and stochastic regressors.
  2. Data analysis with (nonorthogonal) ANOVA (SPSS): Type I, II, III, and IV of decomposing the sum of squares. All of them do not test the hypothesis that the average treatment effect is zero.
  3. Hypotheses that are tested as the so-called main effects with Typ I, II, and III.
  4. Summarizing the basic concepts and equations in the analysis of conditional and average effects.
Video Slides
SPSS-Output

Blackboard sketches
2015-11-30
  1. R2-Difference test for the hypothesis "There are no treatment-effects"
  2. Point estimate for the average treatment effects in SPSS
  3. Analysis of the nonortho-data with EffectLiteR
  4. Interpretation of the first results of this EffectLiteR-Analysis: Average effects and conditional effects
  5. A first analysis of the Kirchmann-data set with EffectLiteR
Video Materials

Blackboard sketches
2015-12-07
  1. Conditional effects in the example of nonorthogonal Anova (continued)
  2. Conditional effects given a treatment condition
  3. Analysis of the Klauer data with a continuous covariate (pretest CFT) and an outcome variable (posttest CFT)
  4. Assuming linearity of the g-functions
  5. Interpretation of the main hypotheses in terms of the g-funktions and the gamma-coefficients
  6. Conditional effect given a pretest score
Video Slides
Dataset

Blackboard sketches
2015-12-14
  1. Checking linearity of the g-functions with EffectLiteR
  2. Testing linearity of the g-functions with SPSS (R2-difference test)
  3. (X=x)-conditional treatment effects
  4. When should we consider average effects and when (X=x)-conditional treatment effects?
  5. Basic idea and assumptions in the EffectLiteR analysis with qualitative and quantitative covariates
Video Materials

Blackboard sketches
2016-01-04
  1. EffectLiteR analysis of the Klauer data with a qualitative and a quantitative covariate
  2. Model equation and linearity assumption for the regression of the outcome variable on the quantitative covariate in each cell
  3. Meaning of the four main hypotheses in terms of (a) expected values or effects, (b) the g-functions, and (c) the coefficients of the g-functions
  4. Adjusted expected values
  5. Conditional effects given values of the qualitative covariate
  6. Conditional effects given values of the qualitative covariate and the treatment variable
  7. Conditional effects given values of the qualitative covariate and the quantitative covariate
  8. Conditional expected values of the outcome variable under treatment and under control given values of the qualitative covariate and the quantitative covariate
Video Dataset

Blackboard sketch 01
Blackboard sketch 02
2016-01-11
  1. EffectLiteR analysis of the Klauer data: one qualitative and one quantitative covariate (continued)
  2. Histograms of the dependent variable in the cells
  3. Regression of the dependent variable on the continuous covariate in each cell of the design
  4. Scattergram of the conditional effects and the continuous covariate
  5. Re-aggregation of the conditional effects in the context of the theory of causal effects
  6. EffectLiteR analysis of the Klauer data: one qualitative and two quantitative covariates
  7. Basic concepts and models of classical test theory
Video Slides 1
Slides 2

-Steyer, R., Mayer, A., Geiser, C., & Cole, D. (2015). A Theory of States and Traits—Revised. Annual Review of Clinical Psychology, 11, 71-98.

Blackboard sketches
2016-01-18
  1. EffectLiteR analysis of the Klauer data with a latent covariate and a latent outcome variable. Models of essentially tau-equivalent and tau-congeneric variables
  2. Testing the model with a goodness-of-fit test and the RMSEA
  3. Conditional effects given estimated values of the latent covariates
  4. EffectLiteR analysis of the Klauer data with two latent covariates and a latent outcome variable
  5. EffectLiteR analysis of the Klauer data with a latent covariate, a method factor, and a latent outcome variable
Video Blackboard sketches
2016-01-25
  1. Method factor as an additional latent covariate (continued)
  2. Method factor with a reference method and method factor with a common factor
  3. An EffectLiteR analysis with a qualitative and a latent covariate
  4. Under which circumstances should we use a model with a latent instead of a manifest covariate?
Video Blackboard sketch 01
Blackboard sketch 02
2016-02-01
  1. Combining the theory of causal Effects with EffectLiteR Analyses
  2. True-Outcome-Variables for total effects
  3. Atomic causal total effects
  4. Average causal total effects
  5. Conditional causal total effects
  6. Unbiasedness of the conditional expectations EX=x(Y|Z)
  7. Implications of Unbiasedness
  8. Two sufficient conditions for unbiasedness
  9. Testing the sufficient conditions for unbiasedness
Video Slides
SPSS-Output

Blackboard sketch 01
Blackboard sketch 02
2016-02-08
Video Blackboard sketches