When can I know that I'm in the presence of measurement errors? i.e., when can I know that I should use a measurement error model(error-in-variables model)?
Are there any statistical tests for checking that?
$\begingroup$
$\endgroup$
3
asked Mar 26, 2017 at 9:50
-
$\begingroup$ @denesp is it clearer now? $\endgroup$– An old man in the sea.Commented Mar 26, 2017 at 13:15
-
2$\begingroup$ Do you mean measurement error rather than error measurement? $\endgroup$– Richard HardyCommented Mar 26, 2017 at 13:40
-
$\begingroup$ @RichardHardy Thanks. I failed to see that. =D $\endgroup$– An old man in the sea.Commented Mar 26, 2017 at 15:43
Add a comment
|
3 Answers
$\begingroup$
$\endgroup$
1
Suppose we observe only $\tilde{x}$ and $\tilde{y}$ which are the true values measured with error: $$ \tilde{x} = x + u$$ $$ \tilde{y} = y + v.$$ We would like to estimate: $$ y = \beta x + \epsilon$$ but all we can really estimate is $$\tilde{y} = \hat{\beta} \tilde{x} + \zeta$$
However, if y is measured without error ($\tilde{y}=y$) we can use reverse regression to bound the measurement error in regressions. The regression is:
$$ y = \hat{\beta} \tilde{x} + \epsilon$$
You also run the reverse regression $$ \tilde{x} = \hat{\frac{1}{\beta}}y + \hat{\frac{1}{\beta}}\epsilon+ u$$ Define the reverse regression beta as $\hat{\beta}_r = \frac{1}{\hat{\frac{1}{\beta}}}$. It turns out that the results from the standard regression and from the reverse regression will bracket the true coeffcient, i.e. $plim\ \hat{\beta} \leq \beta \leq plim\ \hat{\beta}_r$.
This interval is small when the variance of $u$ and $\epsilon$ are small. If one of the two are zero then one of the inequalities hold exactly. Unfortunately, in practice this interval may be large and therefore this approach not very helpful.
-
$\begingroup$ BKay thanks for your answer. I have a doubt. Would we still have a bracket/interval for the coefficient, even if we we're not in the presence of substantial measurement errors? If so, then your approach cannot not tell me when I should consider the meas. errors to be so severe as to use an error-in-variables model... $\endgroup$ Commented Mar 27, 2017 at 18:02
$\begingroup$
$\endgroup$
1
With observational data, I would say measurement error always exists.
The real issue is "how severe" is the measurement error. Evidently in order to be able to assess the severity, "experimental-like" (or quasi-experimental) data should be available.
For an example, see this paper
Boyd, D., Lankford, H., Loeb, S., & Wyckoff, J. (2013). Measuring test measurement error: A general approach. Journal of Educational and Behavioral Statistics, 38(6), 629-663.
here downloadable freely from its initial NBER version.
They treat test-scores essentially as a proxy for "student achievement" (knowledge, skills and abilities), so we are not talking about errors in grading the tests. As the authors write
"Reliability coefficients based on the test-retest approach using parallel test forms is recognized in the psychometric literature as the gold standard for quantifying measurement error from all sources. Students take alternative, but parallel (i.e., interchangeable), tests on two or more occurrences sufficiently separated in time so as to allow for the “random variation within each individual in health, motivation, mental efficiency, concentration, forgetfulness, carelessness, subjectivity or impulsiveness in response and luck in random guessing” but sufficiently close in time that the knowledge, skills and abilities of individuals taking the tests are unchanged."
answered Mar 26, 2017 at 18:36
-
$\begingroup$ ALecos thanks for your answer. So, should I always use a error-in-variables model? If not, then how would we quantify that severity and at what level would we resort to measurement error models? Your answer seems to be a bit too specific. I was looking for something more general, statistically based. ;) $\endgroup$ Commented Mar 26, 2017 at 20:17
$\begingroup$
$\endgroup$
1
Testing for measurement error in linear regressions: Hausman (1978, Econometrica, www.jstor.org/stable/1913827)
Testing for measurement error in general nonlinear, nonparametric models: Wilhelm (2018, CeMMAP Working Paper, http://www.ucl.ac.uk/~uctpdwi/papers/cwp451818.pdf)
-
2$\begingroup$ These seem like helpful and relevant links. You could make your answer more useful by bringing the lessons from these papers into your answer. $\endgroup$– BKayCommented Aug 22, 2018 at 9:50