I don't use it around black folks, but jokingly around my white friends in a sarcastic sense.
Personally it's just a word, can be hurtful in the way you say it. But if you slip and say it and your boys are really down with you, it shouldn't be a problem. I've straight up said N-gg-r in front of...