That can happen for a bit after you stop smoking.
Don't worry, it'll go away soon.
Try keeping a cigarette around, you know, in the car or in the house and such and just hold it or take dry puffs...