Very common mith. There is no asbestos in vermiculite. That was from an isolated incident at a particular mine a long time ago.
And on another note, mushrooms dont have pick up any chemicals like asbestos from the substrate. The mycellium DOES NOT act like the roots of the mushroom.