I think Smokey is not Evil. He is just dissatisfied with the contract he signed.
Perhaps the Island is Power, and Jacob cannot give the Island to humanity until they have proved themselves able to choose Good on their own.
Thus, the tests, and "everything is progress" idea. Jacob is waiting for humanity to evolve…