I think in this case the typical economist's answer prevails: it depends. Taxes are distortive in so far as they prevent valuable economic activity from taking place.
Income taxes make working less attractive and therefore reduce the supply of labour. In an economy that is already labour constrained the distortion of income taxes can thus be significant. If, in contrast, land is a valuable but scarce resource land taxes will be distortive as well.
You're right that VAT is a consumption tax, and thrifty people won't mind such taxes typically. It is not true that non-thrifty people won't mind income taxes because if we tax away their income they have nothing to spend! Taxes on interest or capital on the other hand won't be a much of a direct problem for the non-thrifty consumers.
Taxes on investment are distortive because they prevent valuable investments from taking place. This is the main argument put forward for lowering the taxes for the super rich in the US. As their income comes from investment lowering their taxes will spur investment. In how far this actually happens and whether the money is actually invested in the US is a different matter.
As a final point: some taxes are actually improving things by preventing economic activity. Environmental taxes like a tax on CO2 should in principle curb CO2 emissions and in that way correct distortions rather than introduce them.