What is the difference between ATE and ATT?

Question

I saw ATE and ATT in some discussions regarding DID settings recently. ATE is the Average Treatment Effect while ATT is Average Treatment Effects on Treated.

I am wondering the difference between these two terms and is there any example to clarify such a difference?

Answer 1

Treatment effects are causal effects of a binary treatment. Because the treatment is binary, individuals are either treated or they are not treated. For the sake of example assume that the treatment is participation in a money making course - the course is claimed to make you better at making money.

Obviously, the causal effect of such a course could very well be differ from person to person (this is referred to as treatment heterogeneity). Some people may learn a lot from the course and actually improve at making money while others will be bored by the content of the course and experience a zero effect. As usual when important quantitative measures vary across observational units a canonical summary statistic is the average. The Average Treatment Effect (ATE) is simply that: The average of the individual treatment effects of the population under consideration. And the Average Treatment Effect of the Treated (ATT) is simply the average of the individual treatment effects of those treated (hence not the entire population).

To make it formally more clear what the causal effect of treatment is, it is often assumed that for each individual $i$ there exists an amount of money $Y_i^0$ individual $i$ will make without taking the training course. And there also exists an amount of money $Y^1_i$ that individual $i$ will make if she takes course. The causal effect for individual $i$ of participation in the course is then defined as

$$\tau_i := Y_i^1- Y^0_i,$$

the difference in outcome with and without treatment.

For the sake of example consider the following table for 6 individuals:

It is clear from the table that individual $i=1,2,3$ are treated $D_i=1$ while $i=4,5,6$ are not treated. For those who are treated the observed amount of money made by the individual $Y_i$ is equal to $Y_i^1$. For those not treated the observed amount of money made $Y_i$ is equal to $Y_i^0$. In general this is written as

$$Y_i = D_i Y_i^1 + (1-D_i)Y_i^0.$$

An important part of the setup is therefore that while $Y_i^1$ and $Y_i^0$ are assumed to exist they are not assumed to be observed.

However, getting back to ATT and ATE. In the above example the ATE can be calculated as

$$ATE := \frac{1}{N} \sum_i \tau_i = \frac{1}{N} \sum_i (Y_i^1 - Y_i^0) = \frac{1+1+1+0+1-1}{6} = 0.5,$$

and the average treatment effect of those treated is calculated as

$$ATT := \frac{1}{N_1} \sum_i \tau_i = \frac{1}{N_1} \sum_i (Y_i^1 - Y_i^0) = \frac{1+1+1}{3} = 1.0,$$

where $N_1 = \sum_i D_i = 3$.

In this example ATE and ATT are numerically the same but as you can see they are averages of different sets of individual causal effects. As such they are not necessarily expected to be the same. Try to construct an example yourself where they are different simply by changing the group of treated individuals.

The average treatment effect is used when we are interested in the average treatment of the entire population, whereas the average treatment effect is used when we are only interested in the average treatment effect of those treated.

Answer 2

Let us explain this in a backdrop of simple model used by Burde and Linden (2013) who looked at an effect of building new village schools (as opposed to have children commuting) on students academic outcomes. They estimated the following model:

$$Y_{ijk} = β_0 + β_1T_k + e_{ijk}$$

Where $Y_{ijk}$ is an academic outcome of child $i$ in household $j$ in a village $k$.

Here the $T_k$ is a dummy that signifies whether the village got a school in the first year or not, that can take only two values 1 or 0 .

In this setting we will have 2 possible conditional outcomes

$$T_k = \begin{cases} Y_{ij1}| T_k = 1\implies Y_{ij1} = β_0 + β_{1}1 + e_{ijk} \\ Y_{ij0}| T_k = 0 \implies Y_{ij0} = β_0 + β_10 + e_{ijk} \end{cases}$$

Now finally we can turn our attention to explanation of ATE vs ATT.

Average Treatment Effect

In this setting the average treatment effect is simply:

$$\text{ATE}= E[Y_{ij1} - Y_{ij0}]$$

So it it is the difference between potential outcomes, in this case academic achievement between children who got access to village schools and children who did not get access to village schools.

Average Treatment Effect on Treated

Now when it comes to average treatment effect on treated this is defined as:

$$E[Y_{ij1} − Y_{ij0}|T_k = 1]$$

So in plain English and applied to the case above this is the difference in academic potential outcomes between children that got access to village schools, and children that did not get access to village schools conditionally on the fact that they both are assigned to village schools.

The outcome $Y_{ij0}|T_k = 1$ is essentially a counterfactual for $Y_{ij1}$ in a 'parallel universe' where exactly the same people who where assigned the treatment in this universe would not get the treatment. That is with ATE you are comparing children who got schools with other children who did not get schools, whereas in ATT you are comparing children who got schools, with the same children who got schools from a 'parallel universe' where they did not get schools.

Answer 3

In RCT, $ ATE = ATT = ATU$.

In observational study, $ATT\neq ATE$, since $$ ATE = E\{Y(1)-Y(0)\} = E_X\{E(Y|X,A=1)-E(Y|X,A=0)\}= E_X\{E(Y|X,A=1)\}- E_X\{ E(Y|X,A=0)\}\}, $$ $$ ATT = E\{Y(1)-Y(0)|A=1\} = E(Y|A=1) - E_X\{E(Y|X,A=0)\}. $$