It's not.
No, it's not just both of you either. Speaking as a normal (I hope) heterosexual male, I don't find any of them attractive.
As a heterosexual male I do find some of Tiger's women to be attractive. Specifically,Rachel Uchitel;
with that being said, these are not the type of women that I would pursue a relationship with.
However, there a very few straight men that would be able to resist (especially Uchitel) a
number of these women;their personalities/character might be reprehensible but they are
physically attractive.