7
$\begingroup$

Is there a journal that publishes replications (failed and successful) of (published) experiments? And, if not, why not? And what about failed experiments (i.e. experiments with insignificant results)?

I think replications of experiments are very important, as experiments in economics depend on many different things and most of them we don't really understand. Having replicated an experiment helps to make sure that the results obtained are not by pure chance (or worse). And, more importantly, failed attempts to replicate a study shows that there was something wrong in one of the studies.

As this was not clear: I am talking about lab experiments, not field experiments.

$\endgroup$
  • $\begingroup$ These are two main questions but I think they are very similar, so just opened one question. If you disagree, just say so :-) $\endgroup$ – The Almighty Bob Jul 23 '15 at 11:58
3
$\begingroup$

I assume you're talking about field experiments and empirical work in general. (Not Vernon Smith's style lab experiments.)

AidGrade

The website aggregates results from multiple programs, including those that showed no significant relationships.

Also read Vivalt, “How Much Can We Generalize from Impact Evaluations?”

But also any academic journal publishing the empirics

Some researchers publish insignificant results of empirical work as a matter of refutation someone else's theory, usually along with significant results. Field experiments in economics allow for this, since you're trying to test as many hypotheses as possible when running a $1M-plus experiment.

For example:

You can see that these papers address many issues at once, including "failed" hypotheses. So, any journal that includes empirics also includes failed experiments.

$\endgroup$
  • $\begingroup$ Oh, sorry. I thought that was clear, I was talking about lab experiments, not field experiments. $\endgroup$ – The Almighty Bob Jul 23 '15 at 17:44
  • $\begingroup$ @TheAlmightyBob Then all what I can suggest is link.springer.com/journal/10683 , ideas.repec.org/s/eee/soceco.html , and similar journals ) $\endgroup$ – Anton Tarasenko Jul 23 '15 at 21:09
  • $\begingroup$ As far as I know, exp econ does not publish replications (or failed replications) and in soc econ I haven't found anything like that either. But thanks anyway! $\endgroup$ – The Almighty Bob Jul 24 '15 at 12:43
3
$\begingroup$

The Journal of Economic Science Association, a companion journal to Experimental Economics is one outlet devoted to publishing, among other article types, replication of experiments.

As said on the website of the Economic Science Association:

The Journal of the Economic Science Association is dedicated to advancing theoretical, empirical, methodological and policy-relevant knowledge using experimental economic methods. JESA promotes research pioneering and advancing laboratory and field methods to address important economic questions that are difficult to examine using naturally occurring data. JESA is open to all areas of inquiry in economics and at the intersection of economics and other disciplines including but not limited to psychology, political science, statistics, finance, marketing, and organizational behavior.

JESA will focus on publishing shorter papers (original articles, methodological pieces, surveys, comments on recently published experimental papers), and article types that are important yet under-represented in the experimental literature (i.e., replications, minor extensions, robustness checks, meta-analyses, and good experimental designs even if obtaining null results). JESA will periodically publish special issues with themes of particular interest for economics experiments, including articles solicited from leading scholars both within and outside of experimental economics.

JESA advances experimental economics by bringing together innovative research that meets professional standards of experimental method, but without editorial bias towards specific orientations. All papers will be reviewed through the standard, anonymous-referee procedure and all accepted manuscripts will be subject to the approval of both editors. Authors are expected to submit separate data and instruction appendices which will be attached to the journal's web page upon publication.

The journal is published under the auspices of the Economic Science Association, a professional organization devoted to using controlled experiments to learn about economic behavior. JESA is a companion journal to Experimental Economics which will publish longer original articles (excluding meta-analyses), together with longer surveys and methodologies.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.