I know this post is quite old, but I wanted to post a solution to your question in the event someone else comes across this thread. You can easily link from each varition on you view by simply rewriting the output of your link.
For example if you want the title field of your view to link to the correct varation on the product display, you could do the following.
Add field "Content: Path" to your view fields. You can exclude this field from display.
Add field "Product: Product ID" to your view fields. You can exclude this field from display.
Make sure both the "Content: Path" and "Product: Product ID" fields are above the title field.
Then edit the "Content: Title" field (Or the field you would like to link) and select the "Rewrite the output of this field" option.
You can then do something like the following.
This will then create a hyperlink to the product display with the correct variation from your view.
I hope somebody finds this helpful.