outdoor growing / what bugs harm

I have black ants in my garden will they harm them? And if so how do I get reed of them.

Only if they're farming aphids.

I have a few ants crawling near my grow but I haven't noticed any problems yet. (They're not crawling on my plants, just around the pots that they're in).