Questions tagged [randomized-experiment]
The randomized-experiment tag has no usage guidance.
18
questions
1
vote
1
answer
20
views
Considering employment when estimating treatment effect on wage RCT
Suppose I run a RCT where the treatment is educating high school students. Outcome variable of interest $y$ is the wage the student will earn after graduating from high school. Suppose there is no non-...
- 115
1
vote
3
answers
55
views
Analysing data from a randomised experiment where independence fails
Suppose that I sell ice cream and want to know whether charging \$1 or \$2 raises more revenue. To do this, I conduct a randomised price experiment. Specifically, on every day, I flip a coin and use ...
- 856
0
votes
0
answers
14
views
Knitting empirical results in development economics together
Development Economics, to my knowledge, has become a mostly empirical field, with RCTs and other quasi-experimental techniques yielding a huge body of empirical knowledge about specific policies and ...
- 1,821
0
votes
0
answers
25
views
RCT power for optimal design
I have a question regarding Optimal Design software.
Particularly, let's suppose I have an intervention that assigns police patrols to different street segments, and that these segments are randomized ...
- 35
3
votes
1
answer
83
views
Interesting example of general equilibrium effects contradicting RCT results
One of the concerns that one can have regarding the use of RCTs for evaluating policies is that while when done in small scales, the RCTs may show the result in one direction, scaling the policies may ...
- 1,821
2
votes
0
answers
27
views
Adjusting categorical household income variable for interaction effects
For a research project (RCT) I am working on, I'm trying to identifying how different demographic groups differed in their performance on certain indices over time (like finance, health etc - measured ...
- 29
0
votes
0
answers
20
views
Minimum Sample Size For Clustered Data Randomized Experiment
I need help determining the minimum sample size for a randomized controlled experiment. The treatment (1 Factor, 3 Levels) will be administered to different households clustered within 5 routes. ...
- 1
0
votes
1
answer
31
views
How to interprete independence between treatment indicator and outcomes?
In Woodridge's textbook "Econometric Analysis of Cross Section and Panel Data", page 907, it says
...the treatment indicator $w$ is statistically independent of ($y_0$, $y_1$), as would occur when ...
- 382
3
votes
1
answer
112
views
Question about an ergodicity in economics paper
Disclaimer: I'm not well read in economics but am mathematically literate (PhD in Mech Eng)
Recently I was sent a paper from Nature Physics, "The ergodicity problem in economics" by Ole ...
- 131
7
votes
1
answer
100
views
Understanding this particular criticism of RCTs by Deaton and Cartwright
Deaton and Cartwright make several criticisms of randomized controlled trials (RCTs).
My question is about this one in particular from a 2016 VoxEU piece:
Well-conducted RCTs could provide unbiased ...
user23101
2
votes
1
answer
129
views
Can I treat pooled cross-section as panel data and do regression analysis?
I work with a large survey data that is pooled cross-section, i.e, people interviewed are randomly chosen in each time period. This is not panel data. But, I aggregate the individual cells according ...
- 21
0
votes
1
answer
37
views
Can I draw a smaller sample from one treatment group?
in an RCT, I have 3 different treatment groups and one control group. The size of the control group is around 1000 while the size of other groups are just above 300.
To test balance I used ANOVA and ...
- 1
4
votes
3
answers
172
views
Randomisation and balance in experiments
Suppose we are interested in the effect of some 'treatment' on some outcome of interest. A common practice is to select a group of people and then randomly choose some fraction (often half) to receive ...
user17900
1
vote
0
answers
173
views
Calculate power for multiple rounds of public goods experiment
I would like to calculate/simulate the a-priori necessary sample size for a repeated public goods experiment.
$N$ Participants play $R$ rounds of a public goods game (linear, voluntary contribution ...
- 111
2
votes
1
answer
37
views
Software for field work: collecting survey data (multi-platform, on-line and off-line)
As part of an RCT, I am looking for Software to record digitally the answers some survey questionnaires. The questionnaire is somewhat long, ~100 questions divided into 10 blocks.
We will collect 3 ...
- 141
5
votes
2
answers
963
views
Problems with Representative Sampling
I am curious: what exactly are the problems caused by using representative sampling rather than random sampling whenever creating a subsample of large dataset for nonexperimental analysis. Further, ...
- 2,911
3
votes
1
answer
1k
views
How encouragement design works practically?
I'm trying to understand the encouragement design but I have some doubts. For example, if I want to introduce a voucher for teachers that can be used for professional development(the treatment) and I ...
- 235
12
votes
3
answers
336
views
Self-selection bias during the course of experiments
Suppose you are running a randomized experiment to assess the effect of $X$, say some training program for unemployed people, on $Y$, say the chance of finding a job in the coming year. Suppose also ...
- 5,237