Skip to main content

Questions tagged [randomized-experiment]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer

Can you compare experimental data from students, investors, and professionals? Different N, different clusters

I have experimental data on students, retail investors, and professionals. The setup (experimental procedure is exactly identical). Each experiment consists of 5 rounds of decision-making. However, my ...
hunter_gatherer's user avatar
1 vote
0 answers

In RCT settings, are randomization inference p-values always greater than OLS p-values?

I was wondering if there's a proven/known relationship between RI p-values and OLS p-values in RCT settings, where treatment is completely random. Alwyn Young's paper1 shows many examples of OLS p-...
msc's user avatar
  • 11
1 vote
1 answer

Considering employment when estimating treatment effect on wage RCT

Suppose I run a RCT where the treatment is educating high school students. Outcome variable of interest $y$ is the wage the student will earn after graduating from high school. Suppose there is no non-...
Hosea's user avatar
  • 115
1 vote
3 answers

Analysing data from a randomised experiment where independence fails

Suppose that I sell ice cream and want to know whether charging \$1 or \$2 raises more revenue. To do this, I conduct a randomised price experiment. Specifically, on every day, I flip a coin and use ...
afreelunch's user avatar
0 votes
0 answers

RCT power for optimal design

I have a question regarding Optimal Design software. Particularly, let's suppose I have an intervention that assigns police patrols to different street segments, and that these segments are randomized ...
Nacho's user avatar
  • 35
2 votes
1 answer

Interesting example of general equilibrium effects contradicting RCT results

One of the concerns that one can have regarding the use of RCTs for evaluating policies is that while when done in small scales, the RCTs may show the result in one direction, scaling the policies may ...
Ishan Kashyap Hazarika's user avatar
2 votes
0 answers

Adjusting categorical household income variable for interaction effects

For a research project (RCT) I am working on, I'm trying to identifying how different demographic groups differed in their performance on certain indices over time (like finance, health etc - measured ...
Tara's user avatar
  • 29
0 votes
0 answers

Minimum Sample Size For Clustered Data Randomized Experiment

I need help determining the minimum sample size for a randomized controlled experiment. The treatment (1 Factor, 3 Levels) will be administered to different households clustered within 5 routes. ...
iloveops's user avatar
0 votes
1 answer

How to interprete independence between treatment indicator and outcomes?

In Woodridge's textbook "Econometric Analysis of Cross Section and Panel Data", page 907, it says ...the treatment indicator $w$ is statistically independent of ($y_0$, $y_1$), as would occur when ...
Aqqqq's user avatar
  • 392
3 votes
1 answer

Question about an ergodicity in economics paper

Disclaimer: I'm not well read in economics but am mathematically literate (PhD in Mech Eng) Recently I was sent a paper from Nature Physics, "The ergodicity problem in economics" by Ole ...
DrBwts's user avatar
  • 131
7 votes
1 answer

Understanding this particular criticism of RCTs by Deaton and Cartwright

Deaton and Cartwright make several criticisms of randomized controlled trials (RCTs). My question is about this one in particular from a 2016 VoxEU piece: Well-conducted RCTs could provide unbiased ...
user avatar
2 votes
1 answer

Can I treat pooled cross-section as panel data and do regression analysis?

I work with a large survey data that is pooled cross-section, i.e, people interviewed are randomly chosen in each time period. This is not panel data. But, I aggregate the individual cells according ...
user23955's user avatar
1 vote
1 answer

Can I draw a smaller sample from one treatment group?

in an RCT, I have 3 different treatment groups and one control group. The size of the control group is around 1000 while the size of other groups are just above 300. To test balance I used ANOVA and ...
Aris's user avatar
  • 11
4 votes
3 answers

Randomisation and balance in experiments

Suppose we are interested in the effect of some 'treatment' on some outcome of interest. A common practice is to select a group of people and then randomly choose some fraction (often half) to receive ...
user avatar
1 vote
0 answers

Calculate power for multiple rounds of public goods experiment

I would like to calculate/simulate the a-priori necessary sample size for a repeated public goods experiment. $N$ Participants play $R$ rounds of a public goods game (linear, voluntary contribution ...
Hendrik's user avatar
  • 111
2 votes
1 answer

Software for field work: collecting survey data (multi-platform, on-line and off-line)

As part of an RCT, I am looking for Software to record digitally the answers some survey questionnaires. The questionnaire is somewhat long, ~100 questions divided into 10 blocks. We will collect 3 ...
LucasMation's user avatar
5 votes
2 answers

Problems with Representative Sampling

I am curious: what exactly are the problems caused by using representative sampling rather than random sampling whenever creating a subsample of large dataset for nonexperimental analysis. Further, ...
123's user avatar
  • 2,911
3 votes
1 answer

How encouragement design works practically?

I'm trying to understand the encouragement design but I have some doubts. For example, if I want to introduce a voucher for teachers that can be used for professional development(the treatment) and I ...
Lex's user avatar
  • 235
12 votes
3 answers

Self-selection bias during the course of experiments

Suppose you are running a randomized experiment to assess the effect of $X$, say some training program for unemployed people, on $Y$, say the chance of finding a job in the coming year. Suppose also ...
Martin Van der Linden's user avatar