Absolutely, talk to your landlord! My landlord will even reimburse me for upgrades which are permanent and improve the property, such as replacing a standard rental unit sink/faucet with a much nicer one, as long as I provide the labor and/or fix any of problem I create.