I say if you need religion for morality, you probably weren't a good person in the first place.
I feel religion is holding us back. It's telling us what to think instead of how to think. I see it as a way to control and suppress. Some people use it as an excuse to belittle and hate others.
I wouldn't say there would be no fighting without it, but ditching religion would be a step in the right direction.