The key here is moderation. Anything done in excess could potentially kill you.
The key is in also in taking care of yourself. Knowing that pipe smoking has the potential for mouth, gum, tongue, or lip cancer, I ALWAYS as soon as possible, cleanse my mouth and gargle well with something like...