It is partially water soluble, otherwise it would just be course sand!
Next time you repot, just add it to your additional new soil! Or you can sprinkle it on the surface and "scratch" it in, a good half inch, or so. Try to keep it more around the "outer perimeter" of the soil.
