I know it probably isn't the safest (or stylish) way to keep your keys, but I have a carabiner that I hook on a belt loop and tuck the keys into my back pocket, while keeping my wallet and phone in the front. It works well for me, though I don't wear slacks that often.