"Causes skin irritation. Causes serious eye irritation. May cause cancer. Causes damage to lungs through prolonged or repeated exposure."
Any finely-powdered mineral will cause cancer and lung damage. It has nothing to do with the type of clay, and everything to do with it being easily-inhaled rock dust.
As with the above advice, use pottery clay like Bentonite or Kaolin, and definitely use a particulate mask when pouring and if possible a fine water mist as well to limit dust. add water slowly while mixing, so things do not get too runny, ,and let the clay stand and saturate before use if you have the time. If it thickens too much with standing add some more water SPARINGLY!
The main ingredient in mortar clay is called Standard Portland Cement, which, according to Wikipedia, is caustic and can cause chemical burns.
Also, why are you so enamored with this particular type of clay? Why not use pottery clay?
I mean, if you want to ignore all of the warnings that everyone else has given, it's your right to do so, but it's probably not going to end well and you may lose sensation in your lower regions when the skin there burns off.