Learn to read the plants, if you do what you're suggesting it slows down the process if you put them back into veg after sexing. Most if not all seeds will show sex well before you'd ever have to up-pot from a 1gal pot. Never did get this process of putting them into flowering and then re-vegging again, makes no sense at all. And yes, any stress can hermie them if the genetics suck.
If you're impatient or can't learn to read your plants, cover up any node on a branch with anything (tape works), you'll see flowers (male or female) within a few days and you haven't f'd up the whole plant.