I had read a bit about it in a review of the manga, that there was a whole diatribe between him and one of the girls demanding that he choose to be female.
The show is weird, I'm not gonna go out of my way to finish this probably. Harem stuff is indeed to annoying to me personally. I can handle ecchi stuff sometimes depending on how it is done, but harems are weird fantasies that don't appeal to me personally. I don't even think I'd find a gay harem interesting, it'd probably be just weird....