They partly answered this in a DS9 episode where the patterns of 4 people required most of station memory and the holosweets memory to hold onto. The pattern buffer seems to be some sort of massive volitile storage system designed specifically to hold transporter patterns for short times.