I found a good way of not answering all mails is by reading them on my phone (Android + Gmail = great) even if I am at my computer already. Very often I simply call the sender then instead of typing a long response - most of the time even more things are sorted out this way than were mentioned in the initial mail.