Read the definition you linked to my man
irrational fear of, aversion to, or discrimination against homosexuality or homosexuals
Fear of, OR aversion to, OR discrimination against. Fear isn't necessary for something or someone to be homophobic.
That's how the word is used, that's what the word means. That's how words and definitions work.