Sorry, there's a bit more to it then the emotions the voices give to the characters.
Even though the quality has increased much of the voice acting, dubs still tend to make me cringe here and there in ways of mistranslation, cultural reference and jokes.
Now I am fully aware that a lot of things, especially references to culture and jokes can't be litterally translated from any language to english without the risk losing it's meaning or clue but with dubs a lot of the studios aren't even trying to find another way to say it in a way which does make sense.
They simply make something up which makes no sense at all to the item, completely change the story or even worse, cut out the entire scene. (Yes, even that still happens).
In that regard, the quality of that has not been improving until recently.
It's only in the last couple of years that the bigger anime and game distributors (Madman, Funimation, Kaze, Viz, etc.) started to pay attention to things like that.
Distributors that have anime and games on the side but not as their primary focus (Universal, Disney, etc.) most of the time still do not.
And occasionally still the fact that even though the voice actors and acting itself are not bad at all.
It simply does not feel right with the character they are playing.
One recent example is Star ocean 4, where the voice acting is great and for example the actor playing Edge Marverick has done a splendid job with the acting, but the voice sounds too old for a 19 year old.
The voice simply doesn't fit the character played.
Although I do admit that this indeed is something personal.