Here's an example of why your question is difficult and depends on the framework.
Case 1: Take the classical OLS case $Y = \beta X + \epsilon$.
In this case, the $\epsilon$ can thought of as an error term which represents noise around the response. So, the mean of the response is $\beta X$ but on any particular response is not going to be exactly equal to that mean because of $\epsilon$ which represents the variation around that mean.
Case 2: Take a simple dynamic model in econometrics such as the ADL(1,0) so that $Y_t = \rho Y_{t-1} + \beta X_{t} + \epsilon_t$.
In this case, $\epsilon_t$ is not really noise because it's going to stay in $Y_{t}$ after that period is finished so it's actually part of the model. It's almost like an exogenous variable rather than noise so, to me, the best term in this case for $\epsilon$ would probably be innovation. It has what economists refer to as a "permanent" effect on the response.
So, my point is that each case can be different. This paper by Qin explains all of this in much more detail and more clearly.