You aren't a pushover if you don't ban someone forever for insulting you. By not doing this, you aren't sending a message of everyone being pushovers, but that kind of mentality will inevitably make future actions more and more severe, just because you think you aren't going to send some type of message. He just got kicked, for something that he may not have even thought was legit, he was frustrated. Every time I kick somebody, if they immediately come back, I TP to them, and explain what they did wrong and how they can avoid making the same mistake. This avoids them feeling like they were screwed over, and they aren't prone to personal attacks. His actions were not acceptable, however a simple TP to him, and telling him straight up that that was his last warning, would have been the end of it. However, if he decided to keep it up, a ban would be understandable. I still don't understand why you lashed back at him. Also, calling your fellow admins "sadmins" just because they may disagree with your decision doesn't gain favor from anyone.
BBCode