I'm not sure if it's a case of you and those seeing more than is there because you've ingested too much moldy rye bread or just a type of neo-"Tail Gunner Joe"-ism. There are no Witches nor Commies. Just a woman that wants to stay, but the societal morality of the time dictates that she shouldn't, so she hedges. You want to be offended, you go right ahead, but it doesn't mean you're right.
The guy that wrote the song did so for him & his wife to sing at parties and it was meant to sing the end as a duet, signifying agreement to stay, which she wanted to do all along.