Arbeitspapier
Sensitivity of propensity score methods to the specifications
Propensity score matching estimators have two advantages. One is that they overcome the curse of dimensionality of covariate matching, and the other is that they are nonparametric. However, the propensity score is usually unknown and needs to be estimated. If we estimate it nonparametrically, we are incurring the curse-of-dimensionality problem we are trying to avoid. If we estimate it parametrically, how sensitive the estimated treatment effects are to the specifications of the propensity score becomes an important question. In this paper, we study this issue. First, we use a Monte Carlo experimental method to investigate the sensitivity issue under the unconfoundedness assumption. We find that the estimates are not sensitive to the specifications. Next, we provide some theoretical justifications, using the insight from Rosenbaum and Rubin (1983) that any score finer than the propensity score is a balancing score. Then, we reconcile our finding with the finding in Smith and Todd (2005) that, if the unconfoundedness assumption fails, the matching results can be sensitive. However, failure of the unconfoundedness assumption will not necessarily result in sensitive estimates. Matching estimators can be speciously robust in the sense that the treatment effects are consistently overestimated or underestimated. Sensitivity checks applied in empirical studies are helpful in eliminating sensitive cases, but in general, it cannot help to solve the fundamental problem that the matching assumptions are inherently untestable. Last, our results suggest that including irrelevant variables in the propensity score will not bias the results, but overspecifying it (e.g., adding unnecessary nonlinear terms) probably will.
- Sprache
-
Englisch
- Erschienen in
-
Series: IZA Discussion Papers ; No. 1873
- Klassifikation
-
Wirtschaft
Single Equation Models; Single Variables: Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions
Semiparametric and Nonparametric Methods: General
Statistical Simulation Methods: General
Model Evaluation, Validation, and Selection
- Thema
-
sensitivity
propensity score
matching
causal model
Monte Carlo
- Ereignis
-
Geistige Schöpfung
- (wer)
-
Zhao, Zhong
- Ereignis
-
Veröffentlichung
- (wer)
-
Institute for the Study of Labor (IZA)
- (wo)
-
Bonn
- (wann)
-
2005
- Handle
- Letzte Aktualisierung
-
10.03.2025, 11:44 MEZ
Datenpartner
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Objekttyp
- Arbeitspapier
Beteiligte
- Zhao, Zhong
- Institute for the Study of Labor (IZA)
Entstanden
- 2005
Ähnliche Objekte (12)
Head to head comparison of the propensity score and the high-dimensional propensity score matching methods
Causal inference in collaboration networks using propensity score methods
Propensity score methods in observational studies : estimating the marginal odds ratio
Die Anwendung der Propensity-Score-Methode
Prognostic score-based model averaging approach for propensity score estimation
Adaptive experimental design using the propensity score
The Finite Sample Performance of Inference Methods for Propensity Score Matching and Weighting Estimators
Influence of initial misdiagnosis on mortality in patients with bacteraemia: propensity score matching and propensity score weighting analyses
The Propensity Score: A Means to An End
Empirical essays on job search behavior, active labor market policies, and propensity score balancing methods
Empirical essays on job search behavior, active labor market policies, and propensity score balancing methods
Comparison of methods for handling covariate missingness in propensity score estimation with a binary exposure
Head to head comparison of the propensity score and the high-dimensional propensity score matching methods
Causal inference in collaboration networks using propensity score methods
Propensity score methods in observational studies : estimating the marginal odds ratio
Die Anwendung der Propensity-Score-Methode
Prognostic score-based model averaging approach for propensity score estimation
Adaptive experimental design using the propensity score
The Finite Sample Performance of Inference Methods for Propensity Score Matching and Weighting Estimators
Influence of initial misdiagnosis on mortality in patients with bacteraemia: propensity score matching and propensity score weighting analyses
The Propensity Score: A Means to An End
Empirical essays on job search behavior, active labor market policies, and propensity score balancing methods
Empirical essays on job search behavior, active labor market policies, and propensity score balancing methods
Comparison of methods for handling covariate missingness in propensity score estimation with a binary exposure
Head to head comparison of the propensity score and the high-dimensional propensity score matching methods
Causal inference in collaboration networks using propensity score methods
Propensity score methods in observational studies : estimating the marginal odds ratio
Die Anwendung der Propensity-Score-Methode
Prognostic score-based model averaging approach for propensity score estimation
Adaptive experimental design using the propensity score
The Finite Sample Performance of Inference Methods for Propensity Score Matching and Weighting Estimators
Influence of initial misdiagnosis on mortality in patients with bacteraemia: propensity score matching and propensity score weighting analyses
The Propensity Score: A Means to An End
Empirical essays on job search behavior, active labor market policies, and propensity score balancing methods
Empirical essays on job search behavior, active labor market policies, and propensity score balancing methods