Maybe you just need to let them know you're not interested, but it's perfectly okay to talk to them. People can have friends of the opposite gender even when they're straight and remain friends. It's not like having a gay friend will automatically make you susceptible to come-ons.
Just try talking a bit more. It's okay if you do end up hating them, though, because you'll have tried. ^^