I find it a lot easier to do right when I harvest. It becomes quite a bit more time consuming after the fact. Some people like to leave them on because it helps in slowing down the drying process.
Much easier and less time consuming to cut them at harvest. They are still sticking out and you can trim right down to the bud. When they are withered and covering the buds, it's really a major pain to properly trim