First off, yes, clean yo' shit up.
Then figure out where they are coming in from and sprinkle the area(s) with powdered cinnamon. It's cheap, environmentally sound and safe if you have pets, and it burns the hell out of an ant's senses. I had an invasion from the neighbor's apartment after they busted water pipes doing something stupid and after blasting powder into the baseboards, the ants went away. It was also used at WS to curb all the ants that started getting into everything there.