I completely agree with you that "fitness" and "progress" are different; my other comments here have probably been more clear on this. What I meant was, the way that evolution is routinely deployed in cultural arguments is based on this misunderstanding of evolution as progress.