Bay leaves do have a taste. It’s spicy, but not in a way that pepper is. For some reason though, it improves the flavor of dishes with lots of black pepper. It can be a bit bitter when in tomato based dishes, but not in a herb-like sense such as basil or oregano.