I guess it's more the lack on subtext for Dolarhyde that bugs me. The dragon speaking to him, his childhood, his mental anguish. All I'm getting out of the performance is the big "I am the great Red Dragon!" moments and then the creepy murmuring.
The Dolarhyde of the novel (and Fiennes' performance) is incredibly sad…