<human>: Can you succinctly summarize the text in 1-3 sentences?

My SO and I went on a trip with another couple. My SO is really close to this couple and he respects the guy a lot. I have met these people a few times and I thought they were nice people. The four of us had lunch and then we started talking. Then they switched to Spanish, a language which I knew nothing about so I decided to check on my phone and stuff. I don't typically mind when they switch language since I do the same thing to other people too. All the sudden, the girl broke down and cried and her SO said something in spanish to comfort her. Then she left for the washroom. So I jokingly said to the husband "What did u do this time :)?" (since he and my boyfriend were so quiet and did not explain what the hell was going on). Then he told me "I didn't do anything, it's your SO that made fun of her because of her accent when she speaks English. Why are you jumping to conclusion?". I told him I was only joking  (which didn't work). I did apologize that my joke was not at the right timing and I didn't know what's going on. He cut me off while I said sorry and still repeated the "why I was jumping to conclusion".  My SO didn't say anything. After that my SO's friend didn't talk much to me. 

My SO and I did talk once we were alone. I told him that we made jokes at the wrong time. And then he went on and blamed me that I shouldn't have joked at that time. Then I said that it was unfair because I didn't know what was going on and no one wanted to explain anything AND that he was the one that said a bad joke to her. Also, I didn't tell him that before all this, that same guy said something kinda racist ( he was making a comment about this stranger on how dark he was and that I how my skin tone was lighter). No one else was there at that time and I did not take it as an offense and I just let it all slide.
<bot>: Your SO's friends are rude to you and your boyfriend doesn't like confrontations so he just lets things slide like this. My feelings are hurt so what should I do/think about this?