5 minutes is a total dick move unless your physical safety is threatened. If someone's taken the time to meet you, regardless of who initiated, you can spare 20-30 minutes of conversation. Hell, half that time is usually taken up by waiting for the coffee or whatever to get made anyways.