Skip to main content

Questions tagged [randomized-experiment]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
12 votes
3 answers
342 views

Self-selection bias during the course of experiments

Suppose you are running a randomized experiment to assess the effect of $X$, say some training program for unemployed people, on $Y$, say the chance of finding a job in the coming year. Suppose also ...
Martin Van der Linden's user avatar
7 votes
1 answer
102 views

Understanding this particular criticism of RCTs by Deaton and Cartwright

Deaton and Cartwright make several criticisms of randomized controlled trials (RCTs). My question is about this one in particular from a 2016 VoxEU piece: Well-conducted RCTs could provide unbiased ...
user avatar
5 votes
2 answers
982 views

Problems with Representative Sampling

I am curious: what exactly are the problems caused by using representative sampling rather than random sampling whenever creating a subsample of large dataset for nonexperimental analysis. Further, ...
123's user avatar
  • 2,911
4 votes
3 answers
208 views

Randomisation and balance in experiments

Suppose we are interested in the effect of some 'treatment' on some outcome of interest. A common practice is to select a group of people and then randomly choose some fraction (often half) to receive ...
user avatar
3 votes
1 answer
113 views

Question about an ergodicity in economics paper

Disclaimer: I'm not well read in economics but am mathematically literate (PhD in Mech Eng) Recently I was sent a paper from Nature Physics, "The ergodicity problem in economics" by Ole ...
DrBwts's user avatar
  • 131
3 votes
1 answer
1k views

How encouragement design works practically?

I'm trying to understand the encouragement design but I have some doubts. For example, if I want to introduce a voucher for teachers that can be used for professional development(the treatment) and I ...
Lex's user avatar
  • 235
2 votes
1 answer
106 views

Interesting example of general equilibrium effects contradicting RCT results

One of the concerns that one can have regarding the use of RCTs for evaluating policies is that while when done in small scales, the RCTs may show the result in one direction, scaling the policies may ...
Ishan Kashyap Hazarika's user avatar
2 votes
1 answer
140 views

Can I treat pooled cross-section as panel data and do regression analysis?

I work with a large survey data that is pooled cross-section, i.e, people interviewed are randomly chosen in each time period. This is not panel data. But, I aggregate the individual cells according ...
user23955's user avatar
2 votes
1 answer
38 views

Software for field work: collecting survey data (multi-platform, on-line and off-line)

As part of an RCT, I am looking for Software to record digitally the answers some survey questionnaires. The questionnaire is somewhat long, ~100 questions divided into 10 blocks. We will collect 3 ...
LucasMation's user avatar
2 votes
0 answers
33 views

Adjusting categorical household income variable for interaction effects

For a research project (RCT) I am working on, I'm trying to identifying how different demographic groups differed in their performance on certain indices over time (like finance, health etc - measured ...
Tara's user avatar
  • 29
1 vote
3 answers
55 views

Analysing data from a randomised experiment where independence fails

Suppose that I sell ice cream and want to know whether charging \$1 or \$2 raises more revenue. To do this, I conduct a randomised price experiment. Specifically, on every day, I flip a coin and use ...
afreelunch's user avatar
1 vote
1 answer
21 views

Considering employment when estimating treatment effect on wage RCT

Suppose I run a RCT where the treatment is educating high school students. Outcome variable of interest $y$ is the wage the student will earn after graduating from high school. Suppose there is no non-...
Hosea's user avatar
  • 115
1 vote
1 answer
27 views

Can you compare experimental data from students, investors, and professionals? Different N, different clusters

I have experimental data on students, retail investors, and professionals. The setup (experimental procedure is exactly identical). Each experiment consists of 5 rounds of decision-making. However, my ...
hunter_gatherer's user avatar
1 vote
0 answers
33 views

In RCT settings, are randomization inference p-values always greater than OLS p-values?

I was wondering if there's a proven/known relationship between RI p-values and OLS p-values in RCT settings, where treatment is completely random. Alwyn Young's paper1 shows many examples of OLS p-...
msc's user avatar
  • 11
1 vote
1 answer
48 views

Can I draw a smaller sample from one treatment group?

in an RCT, I have 3 different treatment groups and one control group. The size of the control group is around 1000 while the size of other groups are just above 300. To test balance I used ANOVA and ...
Aris's user avatar
  • 11
1 vote
0 answers
190 views

Calculate power for multiple rounds of public goods experiment

I would like to calculate/simulate the a-priori necessary sample size for a repeated public goods experiment. $N$ Participants play $R$ rounds of a public goods game (linear, voluntary contribution ...
Hendrik's user avatar
  • 111
0 votes
1 answer
32 views

How to interprete independence between treatment indicator and outcomes?

In Woodridge's textbook "Econometric Analysis of Cross Section and Panel Data", page 907, it says ...the treatment indicator $w$ is statistically independent of ($y_0$, $y_1$), as would occur when ...
Aqqqq's user avatar
  • 392
0 votes
0 answers
25 views

RCT power for optimal design

I have a question regarding Optimal Design software. Particularly, let's suppose I have an intervention that assigns police patrols to different street segments, and that these segments are randomized ...
Nacho's user avatar
  • 35
0 votes
0 answers
20 views

Minimum Sample Size For Clustered Data Randomized Experiment

I need help determining the minimum sample size for a randomized controlled experiment. The treatment (1 Factor, 3 Levels) will be administered to different households clustered within 5 routes. ...
iloveops's user avatar