ants in my plants

just what the title says, i got some black ants walking around my grow area, or had rather. i had some old dirt in there i brought in from an outside pot, i moved the dirt and put miracle grow in its place, no more ants

but im curious.....would ants cause damage to a plant....they didnt seem to do anything really