If you can see more female flowers than male ones you can try to remove them with tweezers or something. If you leave them they will pollenate the buds and they will be full of seeds. From my experience with hermies usually only 1 or 2 branches are effected you might be able to remove the male branches before the pollen spreads.