Questions tagged [randomized-experiment]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
3 votes
1 answer
83 views

Interesting example of general equilibrium effects contradicting RCT results

One of the concerns that one can have regarding the use of RCTs for evaluating policies is that while when done in small scales, the RCTs may show the result in one direction, scaling the policies may ...
0 votes
1 answer
37 views

Can I draw a smaller sample from one treatment group?

in an RCT, I have 3 different treatment groups and one control group. The size of the control group is around 1000 while the size of other groups are just above 300. To test balance I used ANOVA and ...
1 vote
1 answer
20 views

Considering employment when estimating treatment effect on wage RCT

Suppose I run a RCT where the treatment is educating high school students. Outcome variable of interest $y$ is the wage the student will earn after graduating from high school. Suppose there is no non-...
1 vote
3 answers
55 views

Analysing data from a randomised experiment where independence fails

Suppose that I sell ice cream and want to know whether charging \$1 or \$2 raises more revenue. To do this, I conduct a randomised price experiment. Specifically, on every day, I flip a coin and use ...
0 votes
0 answers
14 views

Knitting empirical results in development economics together

Development Economics, to my knowledge, has become a mostly empirical field, with RCTs and other quasi-experimental techniques yielding a huge body of empirical knowledge about specific policies and ...
0 votes
0 answers
25 views

RCT power for optimal design

I have a question regarding Optimal Design software. Particularly, let's suppose I have an intervention that assigns police patrols to different street segments, and that these segments are randomized ...
3 votes
1 answer
112 views

Question about an ergodicity in economics paper

Disclaimer: I'm not well read in economics but am mathematically literate (PhD in Mech Eng) Recently I was sent a paper from Nature Physics, "The ergodicity problem in economics" by Ole ...
4 votes
3 answers
172 views

Randomisation and balance in experiments

Suppose we are interested in the effect of some 'treatment' on some outcome of interest. A common practice is to select a group of people and then randomly choose some fraction (often half) to receive ...
2 votes
0 answers
27 views

Adjusting categorical household income variable for interaction effects

For a research project (RCT) I am working on, I'm trying to identifying how different demographic groups differed in their performance on certain indices over time (like finance, health etc - measured ...
0 votes
0 answers
20 views

Minimum Sample Size For Clustered Data Randomized Experiment

I need help determining the minimum sample size for a randomized controlled experiment. The treatment (1 Factor, 3 Levels) will be administered to different households clustered within 5 routes. ...
0 votes
1 answer
31 views

How to interprete independence between treatment indicator and outcomes?

In Woodridge's textbook "Econometric Analysis of Cross Section and Panel Data", page 907, it says ...the treatment indicator $w$ is statistically independent of ($y_0$, $y_1$), as would occur when ...
7 votes
1 answer
100 views

Understanding this particular criticism of RCTs by Deaton and Cartwright

Deaton and Cartwright make several criticisms of randomized controlled trials (RCTs). My question is about this one in particular from a 2016 VoxEU piece: Well-conducted RCTs could provide unbiased ...
2 votes
1 answer
129 views

Can I treat pooled cross-section as panel data and do regression analysis?

I work with a large survey data that is pooled cross-section, i.e, people interviewed are randomly chosen in each time period. This is not panel data. But, I aggregate the individual cells according ...
1 vote
0 answers
173 views

Calculate power for multiple rounds of public goods experiment

I would like to calculate/simulate the a-priori necessary sample size for a repeated public goods experiment. $N$ Participants play $R$ rounds of a public goods game (linear, voluntary contribution ...
2 votes
1 answer
37 views

Software for field work: collecting survey data (multi-platform, on-line and off-line)

As part of an RCT, I am looking for Software to record digitally the answers some survey questionnaires. The questionnaire is somewhat long, ~100 questions divided into 10 blocks. We will collect 3 ...
5 votes
2 answers
963 views

Problems with Representative Sampling

I am curious: what exactly are the problems caused by using representative sampling rather than random sampling whenever creating a subsample of large dataset for nonexperimental analysis. Further, ...
12 votes
3 answers
336 views

Self-selection bias during the course of experiments

Suppose you are running a randomized experiment to assess the effect of $X$, say some training program for unemployed people, on $Y$, say the chance of finding a job in the coming year. Suppose also ...
3 votes
1 answer
1k views

How encouragement design works practically?

I'm trying to understand the encouragement design but I have some doubts. For example, if I want to introduce a voucher for teachers that can be used for professional development(the treatment) and I ...