i actually did the exact same thing as u in college(the one semester that I spent in college). There were guys I hung out w/who def wanted to fuck me but I psyched myself out thinking they didn't want me bc I'm trans. Believe it or not I wasn't always super confident sexually. Looking back I know I fucked up and could've hooked up. I should've tried and made a move. Lots of guys just won't make a move on u. They're so afraid of being seen as a creep/rapey.
What you should do all depends on what you want. But if you want to pursue relationships, keep in mind that good sex between two ppl changes their feelings for each other and brings them closer. Don't be afraid to try. Find out if he wants more sex than you're willing to give before you give up. Maybe you can please him. Or maybe you end up liking sex w/him so much you don't mind doing it for him even if you aren't super horny all the time. If it's what you want, just try for it.