Monosexual. Which relates to being attracted only to people of a single gender. Lesbians, gay people and heterosexuals are often monosexual, but not always.

Synonyms:
monosexuality, monosexually, monosexualities