At another turning point

Okay, this subject is a very difficult one for me to talk about and I have been torn about whether to "expose" it or not. But here goes:
Ever since I said I do, the difficulties in marriage have been thrown at me with light speed. I do not even know where to start. The honeymoon was horrible. That is when the verbal abuse started by name calling. We spent more time with his friend than we did on our "honeymoon" phase. One evening it was so bad that I left him sitting in the restaurant after ordering my food and that was the first time I had cried myself to sleep in a very long time. I was crushed. I do not want to portray that I have no fault in any difficulties because I feel I do; I know I am anal and I like to plan ahead (way ahead); I enjoy being talked to like a human (is that too bad?); I have issues with my weight and the way I look. I have a tendency to hold onto hurts sometimes. I do not feel like any of this constitutes abuse. Our communication was so very good before the wedding and it has gone to poop after.
You know the cycle; verbal, mental, emotional, physical. Well, the physical came after a couple more episodes of the emotional. I ended up getting physical back (my BIG mistake). No justification in my eyes and I have cried out for forgiveness from my Lord. I know most of you must be thinking that I should have left after this. But it is just not that easy and there was a point in my life that I would have given the same advice. Now, as I have made a commitment to this man in marriage, and I know God despises divorce, where do I turn?
Believe me, I have cried out to God plenty and in my despair, shared my feelings, good and bad with God. I have talked with a couple of God-fearing friends and I have gone as far as to go to my pastor. It is like a cycle, up and down, up and down. He claims to be sorry but I do not feel anything is heart-felt there because it continues to happen (no more physical). And let me add that the attitude is better.
I know the anger just boils under the surface all the time. I have read many faith-based books about marriage, anger, praying, etc. I have turned this over to God and I just need to know when is too much actually too much? I want to seek God's will in my life but I also want to be around people who actually build others up, not consistently tear down.
i know you are probably thinking, didn't you discuss all of this before you were married. The answer is YES. He had all the right answers, the godly attitude in a lot of areas. I didn't expect him to be the pastor type and we all have room to grow in faith and in the Lord. Am I just rambling on? I feel like I am. I need feed back and please refrain if it is not objective.