What would you do in this situation?

Well its something he is just going to have to get over! It happens, what can you do? If he stops having with you over this, then he is a jerk.