If something takes such a huge toll that you feel stifled, then it is certainly not worth holding on to. I suggest take some time off, connect with you, make a decision and then go for it.

then you should do it. but think twice before quitting

If you are not satisfied, then even i think you should quit. Don’t hold onto it.