Every FF game has side stuff and it never became a Fallout like game which shits on the story. I do not see many problems. Now to think that FF will skip on the story due to open world is not really justified. Tabata even said that it will not fully open world because locations are also bound to the actual story.