A General Framework for Comparing Predictions and Marginal Effects across Models

Sociological Methodology - Tập 49 Số 1 - Trang 152-189 - 2019
Trenton D. Mize1, Long Doan2, J. Scott Long3
1Purdue University, West Lafayette, IN USA
2University of Maryland, College Park, MD, USA
3Indiana University, Bloomington, IN USA

Tóm tắt

Many research questions involve comparing predictions or effects across multiple models. For example, it may be of interest whether an independent variable’s effect changes after adding variables to a model. Or, it could be important to compare a variable’s effect on different outcomes or across different types of models. When doing this, marginal effects are a useful method for quantifying effects because they are in the natural metric of the dependent variable and they avoid identification problems when comparing regression coefficients across logit and probit models. Despite advances that make it possible to compute marginal effects for almost any model, there is no general method for comparing these effects across models. In this article, the authors provide a general framework for comparing predictions and marginal effects across models using seemingly unrelated estimation to combine estimates from multiple models, which allows tests of the equality of predictions and effects across models. The authors illustrate their method to compare nested models, to compare effects on different dependent or independent variables, to compare results from different samples or groups within one sample, and to assess results from different types of models.

Từ khóa


Tài liệu tham khảo

Agresti Alan, 2013, Categorical Data Analysis, 3

10.1177/0049124199028002003

Amemiya Takeshi, 1981, Journal of Economic Literature, 19, 1483

10.1111/j.1468-0084.1987.mp49004006.x

Bishop Yvonne, 1975, Discrete Multivariate Analysis: Theory and Practice

10.2307/2532457

10.1177/0049124114544224

10.1146/annurev-soc-073117-041429

10.1017/CBO9780511811241

Canette Isabel. 2014. “Using gsem to Combine Estimation Results.” The Stata Blog. Retrieved May 16, 2019. http://blog.stata.com/2014/08/18/using-gsem-to-combine-estimation-results/.

10.2307/1910133

10.1086/230638

10.1111/1475-6773.12122

10.1007/978-1-4899-4541-9

10.1198/000313006X152649

Gould William, 1996, Stata Technical Bulletin Reports, 5, 15

Harris Kathleen M. 2009. “The National Longitudinal Study of Adolescent to Adult Health.”Chapel Hill: Carolina Population Center, University of North Carolina at Chapel Hill.

10.2307/1913827

10.1177/0081175012444861

10.2307/2669316

10.1093/biomet/73.1.13

Lindsey Charles. 2016. “Multiple Equation Models: Estimation and Marginal Effects Using gsem.” The Stata Blog. Retrieved May 17, 2019. https://blog.stata.com/2016/06/07/multiple-equation-models-estimation-and-marginal-effects-using-gsem/.

Long J. Scott, 1997, Regression Models for Categorical and Limited Dependent Variables

10.4135/9781446288146.n9

Long J. Scott, 2014, Regression Models for Categorical Dependent Variables Using Stata, 3

Long J. Scott, Mustillo Sarah A. Forthcoming. “Using Predictions and Marginal Effects to Compare Groups in Regression Models for Binary Outcomes.” Sociological Methods and Research.

10.1037/1082-989X.7.1.83

10.1080/0022250X.1975.9989847

10.1111/soc4.12331

10.1177/0003122418806282

10.1177/1536867X1301300304

10.1111/j.1745-9125.1998.tb01268.x

10.2307/1911359

10.3758/BRM.40.3.879

10.1037/a0022658

Smith Tom W., Davern Michael, Freese Jeremy, Morgan Stephen L. 2016. “General Social Surveys: 1972–2016.” Chicago: National Opinion Research Center, University of Chicago.

Weesie Jeroen, 1999, Stata Technical Bulletin, 9

10.2307/1912526

White Halbert, 1984, Asymptotic Theory for Econometricians

10.1177/0049124109335735

Wolfe Rory, 1998, Stata Technical Bulletin, 42, 24