The dividends are additional income you generated by your hard work of picking a good investment. So, yes, you are essentially paying taxes on income from a second job, but at a lower rate. It may not be not “fair,” whatever that means, but it isn’t double taxation.