According to canon, you are correct. All the weight of the weapon is in the hilt, meaning that, by its very nature, the lightsaber is an awkward and unbalanced weapon, which is why it takes intense training and often help from the Force to master it.