Complimenting colleagues on their good looks

Isn't it a challenge to tell your colleague in office, especially of the opposite sex, that s/he looks beautiful/handsome? Several factors come into play even before one could dare say such a thing. The camaraderie between the concerned people, how well they know each other, whether their personalities are conducive to receiving compliments in the right spirit, whether they themselves are inclined to compliment other people - all these matter a lot in whether one can take the liberty to compliment others.

I guess what holds most people back from complimenting each other is the fear of a rebuke or retort that might leave them in a sorry state as their co-workers watch. During regular office work, it is possible to identify people who have such a demeanour and keep safe distance from them. Otherwise, I believe, there is no harm in acknowledging that a lady looks pretty (even if she be married and/or you are not interested in her) or to a gentleman that he is looking handsome and graceful (even if you are not gay!).

I am sorry if this sounds too gender-biased, but I write as I think as a man. Maybe the ladies should comment on their views here; they are most welcome!